[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:07:20.590719 22480 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.244.62:35217
I20260709 13:07:20.592243 22480 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:07:20.593266 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:20.611088 22489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:20.611104 22487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:20.611122 22486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:20.612951 22480 server_base.cc:1061] running on GCE node
I20260709 13:07:21.854280 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:21.854658 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:21.854903 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602441854880 us; error 0 us; skew 500 ppm
I20260709 13:07:21.855937 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:21.862489 22480 webserver.cc:533] Webserver started at http://127.21.244.62:45741/ using document root <none> and password file <none>
I20260709 13:07:21.863466 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:21.863775 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:21.864270 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:21.871616 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/master-0-root/instance:
uuid: "c45d5bc09bbd488d8f44153ad4e5ce28"
format_stamp: "Formatted at 2026-07-09 13:07:21 on dist-test-slave-j314"
I20260709 13:07:21.880275 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:21.886142 22495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:21.887473 22480 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:21.887956 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/master-0-root
uuid: "c45d5bc09bbd488d8f44153ad4e5ce28"
format_stamp: "Formatted at 2026-07-09 13:07:21 on dist-test-slave-j314"
I20260709 13:07:21.888355 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:21.964157 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:21.966058 22480 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:07:21.966617 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:22.048794 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.62:35217
I20260709 13:07:22.049058 22546 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.62:35217 every 8 connection(s)
I20260709 13:07:22.057420 22547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:22.082571 22547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28: Bootstrap starting.
I20260709 13:07:22.089378 22547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:22.091531 22547 log.cc:826] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28: Log is configured to *not* fsync() on all Append() calls
I20260709 13:07:22.096804 22547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28: No bootstrap required, opened a new log
I20260709 13:07:22.123479 22547 raft_consensus.cc:359] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45d5bc09bbd488d8f44153ad4e5ce28" member_type: VOTER }
I20260709 13:07:22.124205 22547 raft_consensus.cc:385] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:22.124483 22547 raft_consensus.cc:740] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45d5bc09bbd488d8f44153ad4e5ce28, State: Initialized, Role: FOLLOWER
I20260709 13:07:22.125442 22547 consensus_queue.cc:260] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45d5bc09bbd488d8f44153ad4e5ce28" member_type: VOTER }
I20260709 13:07:22.126035 22547 raft_consensus.cc:399] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:22.126353 22547 raft_consensus.cc:493] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:22.126722 22547 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:22.131279 22547 raft_consensus.cc:515] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45d5bc09bbd488d8f44153ad4e5ce28" member_type: VOTER }
I20260709 13:07:22.132182 22547 leader_election.cc:304] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c45d5bc09bbd488d8f44153ad4e5ce28; no voters: 
I20260709 13:07:22.134117 22547 leader_election.cc:290] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:22.134455 22550 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:22.137413 22550 raft_consensus.cc:697] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [term 1 LEADER]: Becoming Leader. State: Replica: c45d5bc09bbd488d8f44153ad4e5ce28, State: Running, Role: LEADER
I20260709 13:07:22.138415 22550 consensus_queue.cc:237] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45d5bc09bbd488d8f44153ad4e5ce28" member_type: VOTER }
I20260709 13:07:22.139578 22547 sys_catalog.cc:565] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:22.149163 22551 sys_catalog.cc:455] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c45d5bc09bbd488d8f44153ad4e5ce28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45d5bc09bbd488d8f44153ad4e5ce28" member_type: VOTER } }
I20260709 13:07:22.149639 22552 sys_catalog.cc:455] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c45d5bc09bbd488d8f44153ad4e5ce28. Latest consensus state: current_term: 1 leader_uuid: "c45d5bc09bbd488d8f44153ad4e5ce28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45d5bc09bbd488d8f44153ad4e5ce28" member_type: VOTER } }
I20260709 13:07:22.150089 22551 sys_catalog.cc:458] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:22.150220 22552 sys_catalog.cc:458] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:22.153324 22559 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:22.167479 22559 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:22.169826 22480 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:22.184924 22559 catalog_manager.cc:1383] Generated new cluster ID: 410402e4794c4651b2d037c14efd9baf
I20260709 13:07:22.185279 22559 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:22.208767 22559 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:22.211040 22559 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:22.230898 22559 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28: Generated new TSK 0
I20260709 13:07:22.232262 22559 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:22.302701 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:22.313907 22569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:22.316413 22570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:22.319693 22572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:22.319754 22480 server_base.cc:1061] running on GCE node
I20260709 13:07:22.320859 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:22.321162 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:22.321367 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602442321348 us; error 0 us; skew 500 ppm
I20260709 13:07:22.322173 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:22.326467 22480 webserver.cc:533] Webserver started at http://127.21.244.1:42993/ using document root <none> and password file <none>
I20260709 13:07:22.327194 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:22.327438 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:22.327807 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:22.329312 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-0-root/instance:
uuid: "50a8b165161447cd9fa61f0ae414540e"
format_stamp: "Formatted at 2026-07-09 13:07:22 on dist-test-slave-j314"
I20260709 13:07:22.336540 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:07:22.342267 22577 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:22.343276 22480 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:22.343642 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-0-root
uuid: "50a8b165161447cd9fa61f0ae414540e"
format_stamp: "Formatted at 2026-07-09 13:07:22 on dist-test-slave-j314"
I20260709 13:07:22.344069 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:22.371410 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:22.373287 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:22.376236 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:22.382170 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:22.382510 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:22.382834 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:22.383064 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:22.482911 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.1:43965
I20260709 13:07:22.482970 22639 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.1:43965 every 8 connection(s)
I20260709 13:07:22.491967 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:22.502239 22644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:22.504215 22645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:22.509227 22647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:22.512315 22480 server_base.cc:1061] running on GCE node
I20260709 13:07:22.513243 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:22.513456 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:22.513690 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602442513651 us; error 0 us; skew 500 ppm
I20260709 13:07:22.514354 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:22.523626 22640 heartbeater.cc:344] Connected to a master server at 127.21.244.62:35217
I20260709 13:07:22.524191 22640 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:22.525076 22480 webserver.cc:533] Webserver started at http://127.21.244.2:39171/ using document root <none> and password file <none>
I20260709 13:07:22.525446 22640 heartbeater.cc:507] Master 127.21.244.62:35217 requested a full tablet report, sending...
I20260709 13:07:22.525699 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:22.526048 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:22.526371 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:22.527989 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-1-root/instance:
uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
format_stamp: "Formatted at 2026-07-09 13:07:22 on dist-test-slave-j314"
I20260709 13:07:22.529407 22512 ts_manager.cc:194] Registered new tserver with Master: 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965)
I20260709 13:07:22.532999 22512 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54984
I20260709 13:07:22.536499 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:07:22.542155 22652 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:22.543157 22480 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:07:22.543500 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-1-root
uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
format_stamp: "Formatted at 2026-07-09 13:07:22 on dist-test-slave-j314"
I20260709 13:07:22.543884 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:22.565430 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:22.566922 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:22.569883 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:22.573858 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:22.574159 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:22.574471 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:22.574633 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:22.678702 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.2:42731
I20260709 13:07:22.678821 22714 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.2:42731 every 8 connection(s)
I20260709 13:07:22.688735 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:22.700484 22718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:22.700560 22715 heartbeater.cc:344] Connected to a master server at 127.21.244.62:35217
I20260709 13:07:22.701143 22715 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:22.702153 22715 heartbeater.cc:507] Master 127.21.244.62:35217 requested a full tablet report, sending...
I20260709 13:07:22.704778 22512 ts_manager.cc:194] Registered new tserver with Master: c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:22.706580 22512 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54986
W20260709 13:07:22.711180 22719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:22.714663 22480 server_base.cc:1061] running on GCE node
W20260709 13:07:22.714876 22721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:22.715976 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:22.716259 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:22.716454 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602442716435 us; error 0 us; skew 500 ppm
I20260709 13:07:22.717011 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:22.720131 22480 webserver.cc:533] Webserver started at http://127.21.244.3:36069/ using document root <none> and password file <none>
I20260709 13:07:22.720659 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:22.720902 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:22.721309 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:22.722465 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-2-root/instance:
uuid: "64664346e1aa49639651be8bf7f41042"
format_stamp: "Formatted at 2026-07-09 13:07:22 on dist-test-slave-j314"
I20260709 13:07:22.727662 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.006s
I20260709 13:07:22.731529 22726 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:22.732519 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:22.732823 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-2-root
uuid: "64664346e1aa49639651be8bf7f41042"
format_stamp: "Formatted at 2026-07-09 13:07:22 on dist-test-slave-j314"
I20260709 13:07:22.733106 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602440417847-22480-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:22.761569 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:22.762861 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:22.764488 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:22.767051 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:22.767288 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:22.767540 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:22.767757 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:22.880666 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.3:45737
I20260709 13:07:22.880769 22788 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.3:45737 every 8 connection(s)
I20260709 13:07:22.899869 22789 heartbeater.cc:344] Connected to a master server at 127.21.244.62:35217
I20260709 13:07:22.900383 22789 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:22.901206 22789 heartbeater.cc:507] Master 127.21.244.62:35217 requested a full tablet report, sending...
I20260709 13:07:22.903462 22512 ts_manager.cc:194] Registered new tserver with Master: 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:22.903656 22480 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017494964s
I20260709 13:07:22.905296 22512 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54992
I20260709 13:07:22.969132 22512 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55002:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:22.974859 22512 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:23.113598 22754 tablet_service.cc:1511] Processing CreateTablet for tablet 0f09b1a0e6544cfca6de9aa046875de1 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:23.112099 22752 tablet_service.cc:1511] Processing CreateTablet for tablet c96684099bec48d995fa67f4f9c76835 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:23.119150 22680 tablet_service.cc:1511] Processing CreateTablet for tablet 0f09b1a0e6544cfca6de9aa046875de1 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:23.121178 22751 tablet_service.cc:1511] Processing CreateTablet for tablet 323675e5acbb43d68799e1aa1f68f174 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:23.131240 22754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f09b1a0e6544cfca6de9aa046875de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.124413 22678 tablet_service.cc:1511] Processing CreateTablet for tablet c96684099bec48d995fa67f4f9c76835 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:23.120312 22750 tablet_service.cc:1511] Processing CreateTablet for tablet 7992af2df2494951ae670d421a16cd65 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:23.131712 22679 tablet_service.cc:1511] Processing CreateTablet for tablet edcdca82b96c47aca8479f877c832ebd (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:23.133441 22749 tablet_service.cc:1511] Processing CreateTablet for tablet b0bbda324f8245a9846110e4076f80c8 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:23.134742 22753 tablet_service.cc:1511] Processing CreateTablet for tablet edcdca82b96c47aca8479f877c832ebd (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:23.141911 22605 tablet_service.cc:1511] Processing CreateTablet for tablet 0f09b1a0e6544cfca6de9aa046875de1 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:23.142621 22677 tablet_service.cc:1511] Processing CreateTablet for tablet 323675e5acbb43d68799e1aa1f68f174 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:23.144907 22680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f09b1a0e6544cfca6de9aa046875de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.145567 22676 tablet_service.cc:1511] Processing CreateTablet for tablet 7992af2df2494951ae670d421a16cd65 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:23.148111 22752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96684099bec48d995fa67f4f9c76835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.140942 22604 tablet_service.cc:1511] Processing CreateTablet for tablet edcdca82b96c47aca8479f877c832ebd (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:23.145699 22602 tablet_service.cc:1511] Processing CreateTablet for tablet 323675e5acbb43d68799e1aa1f68f174 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:23.151803 22601 tablet_service.cc:1511] Processing CreateTablet for tablet 7992af2df2494951ae670d421a16cd65 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:23.158114 22679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edcdca82b96c47aca8479f877c832ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.142117 22600 tablet_service.cc:1511] Processing CreateTablet for tablet b0bbda324f8245a9846110e4076f80c8 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:23.162307 22675 tablet_service.cc:1511] Processing CreateTablet for tablet b0bbda324f8245a9846110e4076f80c8 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:23.146522 22603 tablet_service.cc:1511] Processing CreateTablet for tablet c96684099bec48d995fa67f4f9c76835 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:23.163887 22676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7992af2df2494951ae670d421a16cd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.166005 22750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7992af2df2494951ae670d421a16cd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.156414 22599 tablet_service.cc:1511] Processing CreateTablet for tablet bd68cd7b76544ab8aa9f6114230a63d7 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:23.161108 22748 tablet_service.cc:1511] Processing CreateTablet for tablet bd68cd7b76544ab8aa9f6114230a63d7 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:23.156810 22674 tablet_service.cc:1511] Processing CreateTablet for tablet bd68cd7b76544ab8aa9f6114230a63d7 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:23.167094 22605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f09b1a0e6544cfca6de9aa046875de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.170641 22675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bbda324f8245a9846110e4076f80c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.175537 22599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd68cd7b76544ab8aa9f6114230a63d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.175413 22598 tablet_service.cc:1511] Processing CreateTablet for tablet ad6c8cd9fed74c8ba1ad48241fa5ae42 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:23.177389 22601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7992af2df2494951ae670d421a16cd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.177452 22748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd68cd7b76544ab8aa9f6114230a63d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.177388 22674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd68cd7b76544ab8aa9f6114230a63d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:23.181528 22560 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:23.184067 22603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96684099bec48d995fa67f4f9c76835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.192730 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96684099bec48d995fa67f4f9c76835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.190815 22749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bbda324f8245a9846110e4076f80c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.192260 22747 tablet_service.cc:1511] Processing CreateTablet for tablet ad6c8cd9fed74c8ba1ad48241fa5ae42 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:23.190977 22673 tablet_service.cc:1511] Processing CreateTablet for tablet ad6c8cd9fed74c8ba1ad48241fa5ae42 (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:23.200310 22604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edcdca82b96c47aca8479f877c832ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.198975 22597 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce2911fb8824d299b7141973177ddca (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:23.204396 22672 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce2911fb8824d299b7141973177ddca (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:23.214298 22677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323675e5acbb43d68799e1aa1f68f174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.213824 22600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bbda324f8245a9846110e4076f80c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.224786 22597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce2911fb8824d299b7141973177ddca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.228150 22598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6c8cd9fed74c8ba1ad48241fa5ae42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.232676 22746 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce2911fb8824d299b7141973177ddca (DEFAULT_TABLE table=test-workload [id=0d9d8cc401054355879286bc3eb3069c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:23.214963 22753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edcdca82b96c47aca8479f877c832ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.217304 22672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce2911fb8824d299b7141973177ddca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.239398 22746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce2911fb8824d299b7141973177ddca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.242065 22673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6c8cd9fed74c8ba1ad48241fa5ae42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.258665 22747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6c8cd9fed74c8ba1ad48241fa5ae42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.267132 22602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323675e5acbb43d68799e1aa1f68f174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.282963 22751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323675e5acbb43d68799e1aa1f68f174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.336211 22807 tablet_bootstrap.cc:492] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e: Bootstrap starting.
I20260709 13:07:23.446625 22807 tablet_bootstrap.cc:654] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.455906 22808 tablet_bootstrap.cc:492] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042: Bootstrap starting.
I20260709 13:07:23.487540 22809 tablet_bootstrap.cc:492] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d: Bootstrap starting.
I20260709 13:07:23.499229 22807 tablet_bootstrap.cc:492] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e: No bootstrap required, opened a new log
I20260709 13:07:23.501724 22807 ts_tablet_manager.cc:1403] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e: Time spent bootstrapping tablet: real 0.167s	user 0.017s	sys 0.006s
I20260709 13:07:23.508033 22807 raft_consensus.cc:359] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.508598 22808 tablet_bootstrap.cc:654] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.510195 22807 raft_consensus.cc:385] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.510633 22807 raft_consensus.cc:740] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.511842 22809 tablet_bootstrap.cc:654] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.511544 22807 consensus_queue.cc:260] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.519754 22808 tablet_bootstrap.cc:492] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042: No bootstrap required, opened a new log
I20260709 13:07:23.520402 22808 ts_tablet_manager.cc:1403] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042: Time spent bootstrapping tablet: real 0.146s	user 0.012s	sys 0.005s
I20260709 13:07:23.524508 22808 raft_consensus.cc:359] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.525393 22808 raft_consensus.cc:385] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.525770 22808 raft_consensus.cc:740] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.527747 22808 consensus_queue.cc:260] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.528518 22807 ts_tablet_manager.cc:1434] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e: Time spent starting tablet: real 0.025s	user 0.016s	sys 0.005s
I20260709 13:07:23.530336 22640 heartbeater.cc:499] Master 127.21.244.62:35217 was elected leader, sending a full tablet report...
I20260709 13:07:23.532276 22809 tablet_bootstrap.cc:492] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d: No bootstrap required, opened a new log
I20260709 13:07:23.532799 22809 ts_tablet_manager.cc:1403] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.011s
I20260709 13:07:23.532295 22807 tablet_bootstrap.cc:492] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e: Bootstrap starting.
I20260709 13:07:23.536355 22809 raft_consensus.cc:359] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.537163 22809 raft_consensus.cc:385] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.537523 22809 raft_consensus.cc:740] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.538321 22809 consensus_queue.cc:260] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.548956 22789 heartbeater.cc:499] Master 127.21.244.62:35217 was elected leader, sending a full tablet report...
I20260709 13:07:23.549608 22808 ts_tablet_manager.cc:1434] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.009s
I20260709 13:07:23.550686 22808 tablet_bootstrap.cc:492] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042: Bootstrap starting.
I20260709 13:07:23.558615 22808 tablet_bootstrap.cc:654] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.558715 22807 tablet_bootstrap.cc:654] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.565740 22715 heartbeater.cc:499] Master 127.21.244.62:35217 was elected leader, sending a full tablet report...
I20260709 13:07:23.566351 22809 ts_tablet_manager.cc:1434] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.022s
I20260709 13:07:23.568032 22809 tablet_bootstrap.cc:492] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d: Bootstrap starting.
I20260709 13:07:23.575933 22809 tablet_bootstrap.cc:654] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.589305 22809 tablet_bootstrap.cc:492] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d: No bootstrap required, opened a new log
I20260709 13:07:23.589913 22809 ts_tablet_manager.cc:1403] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.016s
I20260709 13:07:23.590873 22807 tablet_bootstrap.cc:492] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e: No bootstrap required, opened a new log
I20260709 13:07:23.591645 22807 ts_tablet_manager.cc:1403] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.001s
I20260709 13:07:23.593513 22809 raft_consensus.cc:359] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.594380 22809 raft_consensus.cc:385] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.594732 22809 raft_consensus.cc:740] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.595625 22809 consensus_queue.cc:260] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.596397 22807 raft_consensus.cc:359] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.597513 22807 raft_consensus.cc:385] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.597951 22807 raft_consensus.cc:740] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.598184 22809 ts_tablet_manager.cc:1434] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:23.599398 22809 tablet_bootstrap.cc:492] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d: Bootstrap starting.
I20260709 13:07:23.599103 22807 consensus_queue.cc:260] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.602380 22807 ts_tablet_manager.cc:1434] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:23.607884 22809 tablet_bootstrap.cc:654] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.607964 22808 tablet_bootstrap.cc:492] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042: No bootstrap required, opened a new log
I20260709 13:07:23.608595 22808 ts_tablet_manager.cc:1403] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042: Time spent bootstrapping tablet: real 0.058s	user 0.029s	sys 0.026s
I20260709 13:07:23.611711 22808 raft_consensus.cc:359] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.612581 22808 raft_consensus.cc:385] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.612908 22808 raft_consensus.cc:740] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.613662 22807 tablet_bootstrap.cc:492] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e: Bootstrap starting.
I20260709 13:07:23.613678 22808 consensus_queue.cc:260] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.616603 22808 ts_tablet_manager.cc:1434] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:07:23.617801 22808 tablet_bootstrap.cc:492] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042: Bootstrap starting.
I20260709 13:07:23.626157 22809 tablet_bootstrap.cc:492] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d: No bootstrap required, opened a new log
I20260709 13:07:23.626711 22809 ts_tablet_manager.cc:1403] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.004s
I20260709 13:07:23.631361 22808 tablet_bootstrap.cc:654] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.634754 22807 tablet_bootstrap.cc:654] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.634750 22809 raft_consensus.cc:359] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:23.635921 22809 raft_consensus.cc:385] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.636332 22809 raft_consensus.cc:740] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.637749 22808 tablet_bootstrap.cc:492] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042: No bootstrap required, opened a new log
I20260709 13:07:23.637312 22809 consensus_queue.cc:260] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
W20260709 13:07:23.639037 22790 tablet.cc:2406] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:23.638283 22808 ts_tablet_manager.cc:1403] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.001s
I20260709 13:07:23.642915 22809 ts_tablet_manager.cc:1434] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:07:23.644456 22809 tablet_bootstrap.cc:492] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d: Bootstrap starting.
I20260709 13:07:23.644687 22808 raft_consensus.cc:359] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.648782 22808 raft_consensus.cc:385] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.648859 22807 tablet_bootstrap.cc:492] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e: No bootstrap required, opened a new log
I20260709 13:07:23.649225 22808 raft_consensus.cc:740] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.650000 22807 ts_tablet_manager.cc:1403] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.004s
I20260709 13:07:23.650139 22808 consensus_queue.cc:260] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.652218 22809 tablet_bootstrap.cc:654] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.653088 22807 raft_consensus.cc:359] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.653859 22807 raft_consensus.cc:385] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.654167 22807 raft_consensus.cc:740] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.654990 22807 consensus_queue.cc:260] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.655840 22808 ts_tablet_manager.cc:1434] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:07:23.658278 22807 ts_tablet_manager.cc:1434] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:23.659615 22807 tablet_bootstrap.cc:492] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e: Bootstrap starting.
I20260709 13:07:23.669432 22808 tablet_bootstrap.cc:492] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042: Bootstrap starting.
I20260709 13:07:23.669626 22807 tablet_bootstrap.cc:654] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.677152 22809 tablet_bootstrap.cc:492] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d: No bootstrap required, opened a new log
I20260709 13:07:23.677811 22809 ts_tablet_manager.cc:1403] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.008s
I20260709 13:07:23.679584 22808 tablet_bootstrap.cc:654] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.681470 22807 tablet_bootstrap.cc:492] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e: No bootstrap required, opened a new log
I20260709 13:07:23.681107 22809 raft_consensus.cc:359] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.681864 22809 raft_consensus.cc:385] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.681970 22807 ts_tablet_manager.cc:1403] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:07:23.682224 22809 raft_consensus.cc:740] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.683054 22809 consensus_queue.cc:260] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.685313 22809 ts_tablet_manager.cc:1434] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:23.685105 22807 raft_consensus.cc:359] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.685855 22807 raft_consensus.cc:385] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.686167 22807 raft_consensus.cc:740] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.686443 22809 tablet_bootstrap.cc:492] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d: Bootstrap starting.
I20260709 13:07:23.686897 22807 consensus_queue.cc:260] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.689364 22807 ts_tablet_manager.cc:1434] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:23.690466 22807 tablet_bootstrap.cc:492] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e: Bootstrap starting.
I20260709 13:07:23.693629 22809 tablet_bootstrap.cc:654] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.697285 22815 raft_consensus.cc:493] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.697739 22807 tablet_bootstrap.cc:654] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.697851 22815 raft_consensus.cc:515] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.701370 22815 leader_election.cc:290] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:23.710764 22815 raft_consensus.cc:493] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.711301 22815 raft_consensus.cc:515] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.713486 22815 leader_election.cc:290] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:23.714819 22808 tablet_bootstrap.cc:492] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042: No bootstrap required, opened a new log
I20260709 13:07:23.715351 22808 ts_tablet_manager.cc:1403] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.013s
I20260709 13:07:23.718513 22808 raft_consensus.cc:359] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.719316 22808 raft_consensus.cc:385] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.719655 22808 raft_consensus.cc:740] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.720474 22808 consensus_queue.cc:260] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.731236 22808 ts_tablet_manager.cc:1434] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:07:23.739665 22808 tablet_bootstrap.cc:492] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042: Bootstrap starting.
I20260709 13:07:23.748090 22808 tablet_bootstrap.cc:654] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.748348 22807 tablet_bootstrap.cc:492] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e: No bootstrap required, opened a new log
I20260709 13:07:23.749023 22807 ts_tablet_manager.cc:1403] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.000s
I20260709 13:07:23.758560 22809 tablet_bootstrap.cc:492] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d: No bootstrap required, opened a new log
I20260709 13:07:23.759140 22809 ts_tablet_manager.cc:1403] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent bootstrapping tablet: real 0.073s	user 0.026s	sys 0.011s
I20260709 13:07:23.761330 22808 tablet_bootstrap.cc:492] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042: No bootstrap required, opened a new log
I20260709 13:07:23.761878 22808 ts_tablet_manager.cc:1403] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:07:23.762228 22807 raft_consensus.cc:359] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.762998 22807 raft_consensus.cc:385] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.763298 22807 raft_consensus.cc:740] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.764192 22807 consensus_queue.cc:260] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.764869 22808 raft_consensus.cc:359] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.765591 22808 raft_consensus.cc:385] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.765883 22808 raft_consensus.cc:740] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.766665 22808 consensus_queue.cc:260] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.769064 22807 ts_tablet_manager.cc:1434] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:07:23.769183 22808 ts_tablet_manager.cc:1434] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:07:23.770345 22808 tablet_bootstrap.cc:492] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042: Bootstrap starting.
I20260709 13:07:23.770345 22807 tablet_bootstrap.cc:492] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e: Bootstrap starting.
I20260709 13:07:23.775316 22809 raft_consensus.cc:359] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.776145 22809 raft_consensus.cc:385] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.776455 22809 raft_consensus.cc:740] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.777488 22807 tablet_bootstrap.cc:654] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.777240 22809 consensus_queue.cc:260] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.779605 22809 ts_tablet_manager.cc:1434] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:07:23.780649 22809 tablet_bootstrap.cc:492] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d: Bootstrap starting.
I20260709 13:07:23.785471 22814 raft_consensus.cc:493] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.786063 22814 raft_consensus.cc:515] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.789194 22814 leader_election.cc:290] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:23.797201 22808 tablet_bootstrap.cc:654] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.797477 22815 raft_consensus.cc:493] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.798048 22815 raft_consensus.cc:515] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.800381 22815 leader_election.cc:290] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:23.812901 22615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e" is_pre_election: true
I20260709 13:07:23.813625 22614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd68cd7b76544ab8aa9f6114230a63d7" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e" is_pre_election: true
I20260709 13:07:23.814201 22615 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 0.
I20260709 13:07:23.814428 22614 raft_consensus.cc:2468] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 0.
I20260709 13:07:23.815343 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e" is_pre_election: true
I20260709 13:07:23.816303 22613 raft_consensus.cc:2468] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 0.
I20260709 13:07:23.815711 22809 tablet_bootstrap.cc:654] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.819603 22763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd68cd7b76544ab8aa9f6114230a63d7" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
I20260709 13:07:23.820488 22763 raft_consensus.cc:2468] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 0.
I20260709 13:07:23.823756 22764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
I20260709 13:07:23.824699 22764 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 0.
I20260709 13:07:23.826129 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
I20260709 13:07:23.828982 22655 leader_election.cc:304] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:23.830011 22655 leader_election.cc:304] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:23.830881 22809 tablet_bootstrap.cc:492] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d: No bootstrap required, opened a new log
I20260709 13:07:23.831553 22809 ts_tablet_manager.cc:1403] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.000s
I20260709 13:07:23.831895 22815 raft_consensus.cc:2804] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:23.832276 22815 raft_consensus.cc:493] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.832631 22815 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:23.837052 22654 leader_election.cc:343] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:23.839514 22809 raft_consensus.cc:359] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.840556 22809 raft_consensus.cc:385] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.842145 22815 raft_consensus.cc:515] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.840910 22809 raft_consensus.cc:740] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.844883 22809 consensus_queue.cc:260] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.845614 22815 leader_election.cc:290] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:23.848874 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:23.849737 22762 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:23.850263 22807 tablet_bootstrap.cc:492] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e: No bootstrap required, opened a new log
I20260709 13:07:23.861647 22811 raft_consensus.cc:493] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.862679 22807 ts_tablet_manager.cc:1403] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e: Time spent bootstrapping tablet: real 0.092s	user 0.027s	sys 0.015s
I20260709 13:07:23.861877 22655 leader_election.cc:304] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 64664346e1aa49639651be8bf7f41042
I20260709 13:07:23.865242 22811 raft_consensus.cc:515] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.860867 22839 raft_consensus.cc:2804] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:23.867836 22815 raft_consensus.cc:2804] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:23.871440 22815 raft_consensus.cc:493] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.871114 22839 raft_consensus.cc:493] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.876957 22815 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:23.876410 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:23.877203 22811 leader_election.cc:290] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:23.881486 22613 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:23.878229 22839 raft_consensus.cc:3060] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:23.877082 22807 raft_consensus.cc:359] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:23.889361 22807 raft_consensus.cc:385] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.899211 22807 raft_consensus.cc:740] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.900332 22807 consensus_queue.cc:260] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:23.908293 22807 ts_tablet_manager.cc:1434] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.004s
I20260709 13:07:23.909754 22807 tablet_bootstrap.cc:492] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e: Bootstrap starting.
I20260709 13:07:23.912499 22814 raft_consensus.cc:493] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.915748 22814 raft_consensus.cc:515] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.916366 22808 tablet_bootstrap.cc:492] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042: No bootstrap required, opened a new log
I20260709 13:07:23.916927 22808 ts_tablet_manager.cc:1403] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042: Time spent bootstrapping tablet: real 0.147s	user 0.028s	sys 0.026s
I20260709 13:07:23.918254 22814 leader_election.cc:290] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:23.918859 22814 raft_consensus.cc:493] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.919334 22814 raft_consensus.cc:515] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.932360 22613 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 1.
I20260709 13:07:23.933751 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:23.934685 22655 leader_election.cc:304] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:23.934710 22690 raft_consensus.cc:2468] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 0.
I20260709 13:07:23.913187 22762 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 1.
I20260709 13:07:23.919940 22815 raft_consensus.cc:515] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.932190 22814 leader_election.cc:290] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:23.943809 22841 raft_consensus.cc:2804] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:23.931856 22808 raft_consensus.cc:359] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.929713 22839 raft_consensus.cc:515] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.946823 22808 raft_consensus.cc:385] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.949630 22809 ts_tablet_manager.cc:1434] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent starting tablet: real 0.118s	user 0.010s	sys 0.011s
I20260709 13:07:23.948186 22688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce2911fb8824d299b7141973177ddca" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:23.948221 22689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:23.950682 22808 raft_consensus.cc:740] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.950997 22730 leader_election.cc:304] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:23.953516 22688 raft_consensus.cc:2468] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 0.
I20260709 13:07:23.960727 22809 tablet_bootstrap.cc:492] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d: Bootstrap starting.
W20260709 13:07:23.960872 22730 leader_election.cc:343] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:23.962666 22730 leader_election.cc:304] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:23.962486 22841 raft_consensus.cc:697] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:23.961416 22814 raft_consensus.cc:2804] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:23.963331 22808 consensus_queue.cc:260] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.966136 22814 raft_consensus.cc:493] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.969281 22614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd68cd7b76544ab8aa9f6114230a63d7" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:23.971033 22614 raft_consensus.cc:3060] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:23.972172 22814 raft_consensus.cc:3060] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:23.975010 22615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e" is_pre_election: true
I20260709 13:07:23.972247 22815 leader_election.cc:290] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:23.972615 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:23.974804 22841 consensus_queue.cc:237] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:23.984230 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:23.984995 22612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e" is_pre_election: true
I20260709 13:07:23.985944 22839 leader_election.cc:290] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:23.988876 22764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd68cd7b76544ab8aa9f6114230a63d7" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:23.991008 22764 raft_consensus.cc:3060] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:23.986915 22844 raft_consensus.cc:2804] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:23.983989 22613 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:23.992812 22808 ts_tablet_manager.cc:1434] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042: Time spent starting tablet: real 0.076s	user 0.014s	sys 0.011s
I20260709 13:07:23.993726 22811 raft_consensus.cc:493] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.997905 22612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce2911fb8824d299b7141973177ddca" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e" is_pre_election: true
I20260709 13:07:23.998653 22612 raft_consensus.cc:2468] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 0.
W20260709 13:07:23.999763 22729 leader_election.cc:343] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.000223 22807 tablet_bootstrap.cc:654] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.999823 22811 raft_consensus.cc:515] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
W20260709 13:07:24.000878 22729 leader_election.cc:343] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:24.002260 22654 leader_election.cc:343] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.001277 22729 leader_election.cc:304] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64664346e1aa49639651be8bf7f41042; no voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:23.993830 22844 raft_consensus.cc:493] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.002807 22811 leader_election.cc:290] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:24.005584 22844 raft_consensus.cc:3060] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.009549 22808 tablet_bootstrap.cc:492] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042: Bootstrap starting.
I20260709 13:07:24.011785 22846 raft_consensus.cc:2749] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.037397 22614 raft_consensus.cc:2468] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 1.
I20260709 13:07:24.062757 22839 raft_consensus.cc:493] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.063948 22839 raft_consensus.cc:515] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:24.064707 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce2911fb8824d299b7141973177ddca" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
I20260709 13:07:24.065610 22763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbda324f8245a9846110e4076f80c8" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
I20260709 13:07:24.065824 22814 raft_consensus.cc:515] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.066197 22839 leader_election.cc:290] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:24.066267 22763 raft_consensus.cc:2468] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 0.
I20260709 13:07:24.068960 22579 leader_election.cc:304] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: 
I20260709 13:07:24.071133 22808 tablet_bootstrap.cc:654] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.070966 22763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
I20260709 13:07:24.071337 22807 tablet_bootstrap.cc:492] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e: No bootstrap required, opened a new log
I20260709 13:07:24.071557 22811 raft_consensus.cc:2804] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.068104 22655 leader_election.cc:304] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:24.072628 22807 ts_tablet_manager.cc:1403] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e: Time spent bootstrapping tablet: real 0.163s	user 0.018s	sys 0.009s
I20260709 13:07:24.072789 22811 raft_consensus.cc:493] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.073400 22811 raft_consensus.cc:3060] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.076334 22688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce2911fb8824d299b7141973177ddca" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:24.073201 22613 raft_consensus.cc:2468] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 1.
I20260709 13:07:24.074596 22839 raft_consensus.cc:2804] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.076982 22612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:24.078047 22839 raft_consensus.cc:697] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
W20260709 13:07:24.078819 22654 leader_election.cc:343] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.079208 22839 consensus_queue.cc:237] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.077471 22688 raft_consensus.cc:2468] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 0.
I20260709 13:07:24.078836 22689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:24.081012 22689 raft_consensus.cc:3060] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.078068 22614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e" is_pre_election: true
I20260709 13:07:24.076686 22814 leader_election.cc:290] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:24.062435 22844 raft_consensus.cc:515] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.086393 22688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbda324f8245a9846110e4076f80c8" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:24.087483 22581 leader_election.cc:304] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
W20260709 13:07:24.085278 22729 leader_election.cc:343] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.092506 22655 leader_election.cc:304] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 64664346e1aa49639651be8bf7f41042
I20260709 13:07:24.094026 22762 raft_consensus.cc:2393] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50a8b165161447cd9fa61f0ae414540e in current term 1: Already voted for candidate 64664346e1aa49639651be8bf7f41042 in this term.
I20260709 13:07:24.094655 22809 tablet_bootstrap.cc:654] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.085640 22614 raft_consensus.cc:2468] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 0.
I20260709 13:07:24.096246 22841 raft_consensus.cc:2804] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:07:24.097843 22581 leader_election.cc:343] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.097977 22850 raft_consensus.cc:2804] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.097095 22655 leader_election.cc:304] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 64664346e1aa49639651be8bf7f41042
I20260709 13:07:24.097018 22841 raft_consensus.cc:697] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:24.094713 22807 raft_consensus.cc:359] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.117497 22815 raft_consensus.cc:2804] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.118978 22815 raft_consensus.cc:493] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.119364 22815 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.108630 22807 raft_consensus.cc:385] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.122269 22841 consensus_queue.cc:237] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.117077 22850 raft_consensus.cc:493] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.121701 22807 raft_consensus.cc:740] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.125310 22764 raft_consensus.cc:2468] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 1.
I20260709 13:07:24.127485 22850 raft_consensus.cc:3060] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.130896 22689 raft_consensus.cc:2468] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 1.
I20260709 13:07:24.133064 22730 leader_election.cc:304] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 50a8b165161447cd9fa61f0ae414540e
I20260709 13:07:24.134768 22814 raft_consensus.cc:2804] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.130687 22807 consensus_queue.cc:260] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.135571 22814 raft_consensus.cc:697] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Becoming Leader. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:24.155562 22844 leader_election.cc:290] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:24.173149 22689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce2911fb8824d299b7141973177ddca" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:24.173858 22689 raft_consensus.cc:3060] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:24.209345 22560 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:24.160597 22815 raft_consensus.cc:515] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:24.206833 22614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce2911fb8824d299b7141973177ddca" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:24.168932 22814 consensus_queue.cc:237] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.217661 22856 raft_consensus.cc:493] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.202230 22811 raft_consensus.cc:515] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.222929 22809 tablet_bootstrap.cc:492] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d: No bootstrap required, opened a new log
I20260709 13:07:24.225783 22809 ts_tablet_manager.cc:1403] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent bootstrapping tablet: real 0.269s	user 0.029s	sys 0.009s
I20260709 13:07:24.220160 22850 raft_consensus.cc:515] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.231406 22807 ts_tablet_manager.cc:1434] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e: Time spent starting tablet: real 0.158s	user 0.012s	sys 0.002s
I20260709 13:07:24.233348 22614 raft_consensus.cc:2393] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 64664346e1aa49639651be8bf7f41042 in current term 1: Already voted for candidate 50a8b165161447cd9fa61f0ae414540e in this term.
I20260709 13:07:24.233752 22807 tablet_bootstrap.cc:492] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e: Bootstrap starting.
I20260709 13:07:24.235157 22688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce2911fb8824d299b7141973177ddca" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:24.233808 22809 raft_consensus.cc:359] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.232681 22808 tablet_bootstrap.cc:492] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042: No bootstrap required, opened a new log
I20260709 13:07:24.235885 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbda324f8245a9846110e4076f80c8" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:24.235954 22811 leader_election.cc:290] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 election: Requested vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:24.236639 22809 raft_consensus.cc:385] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.228027 22856 raft_consensus.cc:515] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.239261 22809 raft_consensus.cc:740] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.240321 22764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbda324f8245a9846110e4076f80c8" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:24.238437 22808 ts_tablet_manager.cc:1403] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042: Time spent bootstrapping tablet: real 0.232s	user 0.023s	sys 0.026s
I20260709 13:07:24.241099 22764 raft_consensus.cc:3060] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.241549 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:24.242986 22613 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.240412 22850 leader_election.cc:290] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 election: Requested vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:24.240573 22809 consensus_queue.cc:260] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.246021 22690 raft_consensus.cc:3060] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.245489 22815 leader_election.cc:290] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:24.249876 22763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce2911fb8824d299b7141973177ddca" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:24.253345 22761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:24.254441 22579 leader_election.cc:304] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e; no voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:24.256323 22850 raft_consensus.cc:2749] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:07:24.256800 22654 leader_election.cc:343] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.254578 22809 ts_tablet_manager.cc:1434] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:07:24.267863 22688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:24.268889 22689 raft_consensus.cc:2468] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 1.
W20260709 13:07:24.270954 22581 leader_election.cc:343] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.270772 22730 leader_election.cc:304] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:24.272023 22814 raft_consensus.cc:2804] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.272531 22814 raft_consensus.cc:697] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Becoming Leader. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:24.273378 22814 consensus_queue.cc:237] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.285523 22690 raft_consensus.cc:2468] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 1.
I20260709 13:07:24.290417 22809 tablet_bootstrap.cc:492] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d: Bootstrap starting.
I20260709 13:07:24.299268 22764 raft_consensus.cc:2468] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 1.
I20260709 13:07:24.301602 22856 leader_election.cc:290] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:24.302461 22613 raft_consensus.cc:2468] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 1.
I20260709 13:07:24.305909 22579 leader_election.cc:304] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: 
I20260709 13:07:24.306609 22655 leader_election.cc:304] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 64664346e1aa49639651be8bf7f41042
I20260709 13:07:24.308188 22841 raft_consensus.cc:2804] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.306663 22764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
I20260709 13:07:24.308708 22808 raft_consensus.cc:359] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.308801 22841 raft_consensus.cc:697] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:24.309340 22856 raft_consensus.cc:2804] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.320179 22808 raft_consensus.cc:385] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.320779 22808 raft_consensus.cc:740] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.321020 22856 raft_consensus.cc:697] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 1 LEADER]: Becoming Leader. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:24.321134 22841 consensus_queue.cc:237] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:24.321905 22808 consensus_queue.cc:260] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.324416 22808 ts_tablet_manager.cc:1434] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042: Time spent starting tablet: real 0.083s	user 0.021s	sys 0.015s
I20260709 13:07:24.323839 22510 catalog_manager.cc:5697] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.325680 22808 tablet_bootstrap.cc:492] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042: Bootstrap starting.
I20260709 13:07:24.322254 22856 consensus_queue.cc:237] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.337423 22807 tablet_bootstrap.cc:654] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.340941 22808 tablet_bootstrap.cc:654] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.342902 22511 catalog_manager.cc:5697] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64664346e1aa49639651be8bf7f41042 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "64664346e1aa49639651be8bf7f41042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.341071 22764 raft_consensus.cc:2468] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 0.
I20260709 13:07:24.346156 22579 leader_election.cc:304] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:24.346936 22850 raft_consensus.cc:2804] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.347333 22850 raft_consensus.cc:493] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.347672 22850 raft_consensus.cc:3060] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.348960 22807 tablet_bootstrap.cc:492] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e: No bootstrap required, opened a new log
I20260709 13:07:24.349423 22807 ts_tablet_manager.cc:1403] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.003s
I20260709 13:07:24.352058 22807 raft_consensus.cc:359] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.352761 22807 raft_consensus.cc:385] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.353075 22807 raft_consensus.cc:740] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.354730 22850 raft_consensus.cc:515] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.356238 22809 tablet_bootstrap.cc:654] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.358136 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
W20260709 13:07:24.359750 22581 leader_election.cc:343] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.359565 22807 consensus_queue.cc:260] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.362007 22764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:24.362496 22807 ts_tablet_manager.cc:1434] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:07:24.362602 22764 raft_consensus.cc:3060] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.363615 22807 tablet_bootstrap.cc:492] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e: Bootstrap starting.
I20260709 13:07:24.367797 22850 leader_election.cc:290] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 election: Requested vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:24.370477 22808 tablet_bootstrap.cc:492] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042: No bootstrap required, opened a new log
I20260709 13:07:24.370990 22808 ts_tablet_manager.cc:1403] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.024s
I20260709 13:07:24.373025 22764 raft_consensus.cc:2468] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 1.
I20260709 13:07:24.373658 22808 raft_consensus.cc:359] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:24.376677 22808 raft_consensus.cc:385] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.376581 22579 leader_election.cc:304] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:24.377074 22808 raft_consensus.cc:740] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.377537 22856 raft_consensus.cc:2804] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.378021 22856 raft_consensus.cc:697] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 1 LEADER]: Becoming Leader. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:24.377790 22808 consensus_queue.cc:260] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:24.378326 22807 tablet_bootstrap.cc:654] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.378854 22856 consensus_queue.cc:237] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.380219 22809 tablet_bootstrap.cc:492] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d: No bootstrap required, opened a new log
I20260709 13:07:24.381439 22809 ts_tablet_manager.cc:1403] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.005s
I20260709 13:07:24.383303 22809 raft_consensus.cc:359] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.383981 22809 raft_consensus.cc:385] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.384274 22809 raft_consensus.cc:740] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.384883 22809 consensus_queue.cc:260] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.386324 22809 ts_tablet_manager.cc:1434] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:07:24.387017 22809 tablet_bootstrap.cc:492] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d: Bootstrap starting.
I20260709 13:07:24.380088 22808 ts_tablet_manager.cc:1434] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:07:24.387274 22512 catalog_manager.cc:5697] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e reported cstate change: term changed from 0 to 1, leader changed from <none> to 50a8b165161447cd9fa61f0ae414540e (127.21.244.1). New cstate: current_term: 1 leader_uuid: "50a8b165161447cd9fa61f0ae414540e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.391165 22808 tablet_bootstrap.cc:492] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042: Bootstrap starting.
I20260709 13:07:24.392736 22809 tablet_bootstrap.cc:654] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.398382 22808 tablet_bootstrap.cc:654] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.430804 22807 tablet_bootstrap.cc:492] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e: No bootstrap required, opened a new log
I20260709 13:07:24.431499 22807 ts_tablet_manager.cc:1403] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.021s
I20260709 13:07:24.433190 22510 catalog_manager.cc:5697] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.434914 22807 raft_consensus.cc:359] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.437614 22807 raft_consensus.cc:385] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.437913 22807 raft_consensus.cc:740] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.437004 22510 catalog_manager.cc:5697] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.438597 22807 consensus_queue.cc:260] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.441373 22807 ts_tablet_manager.cc:1434] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:24.441978 22510 catalog_manager.cc:5697] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.446851 22809 tablet_bootstrap.cc:492] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d: No bootstrap required, opened a new log
I20260709 13:07:24.447314 22809 ts_tablet_manager.cc:1403] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent bootstrapping tablet: real 0.060s	user 0.020s	sys 0.020s
I20260709 13:07:24.448196 22808 tablet_bootstrap.cc:492] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042: No bootstrap required, opened a new log
I20260709 13:07:24.448707 22808 ts_tablet_manager.cc:1403] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.015s
I20260709 13:07:24.450057 22809 raft_consensus.cc:359] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.450764 22809 raft_consensus.cc:385] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.451033 22809 raft_consensus.cc:740] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.451486 22808 raft_consensus.cc:359] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.451710 22809 consensus_queue.cc:260] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.452250 22808 raft_consensus.cc:385] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.452628 22808 raft_consensus.cc:740] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.453354 22808 consensus_queue.cc:260] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.453819 22809 ts_tablet_manager.cc:1434] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:07:24.455569 22808 ts_tablet_manager.cc:1434] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:07:24.454907 22511 catalog_manager.cc:5697] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64664346e1aa49639651be8bf7f41042 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "64664346e1aa49639651be8bf7f41042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.458442 22512 catalog_manager.cc:5697] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e reported cstate change: term changed from 0 to 1, leader changed from <none> to 50a8b165161447cd9fa61f0ae414540e (127.21.244.1). New cstate: current_term: 1 leader_uuid: "50a8b165161447cd9fa61f0ae414540e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.500476 22814 raft_consensus.cc:493] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.501096 22814 raft_consensus.cc:515] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.503279 22814 leader_election.cc:290] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:24.504067 22614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e" is_pre_election: true
I20260709 13:07:24.504537 22856 raft_consensus.cc:493] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.504732 22614 raft_consensus.cc:2468] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 0.
I20260709 13:07:24.505025 22856 raft_consensus.cc:515] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.505554 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:24.505997 22729 leader_election.cc:304] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: 
I20260709 13:07:24.506232 22690 raft_consensus.cc:2468] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 0.
I20260709 13:07:24.506960 22814 raft_consensus.cc:2804] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.508435 22764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
I20260709 13:07:24.508626 22814 raft_consensus.cc:493] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.508906 22841 consensus_queue.cc:1048] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.510703 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:24.511509 22690 raft_consensus.cc:2393] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50a8b165161447cd9fa61f0ae414540e in current term 1: Already voted for candidate 64664346e1aa49639651be8bf7f41042 in this term.
I20260709 13:07:24.512290 22841 consensus_queue.cc:1048] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.512980 22581 leader_election.cc:304] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e; no voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:24.509163 22814 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.507269 22856 leader_election.cc:290] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:24.513933 22856 raft_consensus.cc:3060] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.521317 22856 raft_consensus.cc:2749] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.528697 22814 raft_consensus.cc:515] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.531944 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:24.532265 22814 leader_election.cc:290] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:24.532599 22613 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.540911 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:24.541764 22690 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.551522 22690 raft_consensus.cc:2468] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 1.
I20260709 13:07:24.553109 22730 leader_election.cc:304] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:24.553974 22814 raft_consensus.cc:2804] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.554514 22814 raft_consensus.cc:697] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Becoming Leader. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:24.554571 22613 raft_consensus.cc:2468] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 1.
I20260709 13:07:24.555490 22814 consensus_queue.cc:237] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.564841 22839 consensus_queue.cc:1048] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:24.565245 22841 consensus_queue.cc:1048] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.580636 22512 catalog_manager.cc:5697] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64664346e1aa49639651be8bf7f41042 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "64664346e1aa49639651be8bf7f41042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.596032 22841 consensus_queue.cc:1048] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.626546 22764 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.639243 22815 consensus_queue.cc:1048] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.652879 22690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
mode: GRACEFUL
new_leader_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:53254
I20260709 13:07:24.653499 22690 raft_consensus.cc:606] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Received request to transfer leadership to TS 50a8b165161447cd9fa61f0ae414540e
I20260709 13:07:24.658756 22814 raft_consensus.cc:493] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.659323 22814 raft_consensus.cc:515] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:24.660108 22690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
mode: GRACEFUL
new_leader_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:53254
I20260709 13:07:24.660852 22690 raft_consensus.cc:606] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Received request to transfer leadership to TS 50a8b165161447cd9fa61f0ae414540e
I20260709 13:07:24.661556 22814 leader_election.cc:290] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:24.662307 22614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e" is_pre_election: true
I20260709 13:07:24.663076 22614 raft_consensus.cc:2393] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 64664346e1aa49639651be8bf7f41042 in current term 1: Already voted for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in this term.
I20260709 13:07:24.664379 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:24.665493 22730 leader_election.cc:304] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64664346e1aa49639651be8bf7f41042; no voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:24.666232 22814 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.671895 22814 raft_consensus.cc:2749] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.682001 22764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174"
dest_uuid: "64664346e1aa49639651be8bf7f41042"
mode: GRACEFUL
new_leader_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:37898
I20260709 13:07:24.682624 22764 raft_consensus.cc:606] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Received request to transfer leadership to TS 50a8b165161447cd9fa61f0ae414540e
I20260709 13:07:24.702085 22614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0bbda324f8245a9846110e4076f80c8"
dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
mode: GRACEFUL
new_leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:43346
I20260709 13:07:24.702657 22614 raft_consensus.cc:606] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 1 LEADER]: Received request to transfer leadership to TS c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:24.711520 22764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42"
dest_uuid: "64664346e1aa49639651be8bf7f41042"
mode: GRACEFUL
new_leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:37898
I20260709 13:07:24.712211 22764 raft_consensus.cc:606] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Received request to transfer leadership to TS c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:24.736145 22856 consensus_queue.cc:1048] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.743346 22850 raft_consensus.cc:993] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e: : Instructing follower c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:24.743831 22850 raft_consensus.cc:1081] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 1 LEADER]: Signalling peer c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:24.747480 22689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0bbda324f8245a9846110e4076f80c8"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:53252
I20260709 13:07:24.748133 22689 raft_consensus.cc:493] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:24.748531 22689 raft_consensus.cc:3060] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.753283 22856 consensus_queue.cc:1048] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.756191 22844 consensus_queue.cc:1048] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.760362 22689 raft_consensus.cc:515] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.766499 22689 leader_election.cc:290] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 2 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:24.766754 22814 consensus_queue.cc:1048] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.767693 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbda324f8245a9846110e4076f80c8" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:24.767867 22815 raft_consensus.cc:493] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.771138 22815 raft_consensus.cc:515] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.773945 22815 leader_election.cc:290] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:24.775480 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbda324f8245a9846110e4076f80c8" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:24.776516 22613 raft_consensus.cc:3055] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:24.776926 22613 raft_consensus.cc:740] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:24.779264 22612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a8b165161447cd9fa61f0ae414540e" is_pre_election: true
I20260709 13:07:24.779704 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
I20260709 13:07:24.780809 22762 raft_consensus.cc:2393] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8e83288f36b4e50a8cea3aa7a1dac5d in current term 1: Already voted for candidate 50a8b165161447cd9fa61f0ae414540e in this term.
I20260709 13:07:24.782527 22654 leader_election.cc:304] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042
I20260709 13:07:24.783706 22815 raft_consensus.cc:3060] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.778084 22613 consensus_queue.cc:260] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.785308 22613 raft_consensus.cc:3060] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.790601 22815 raft_consensus.cc:2749] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.806663 22856 consensus_queue.cc:1048] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.814571 22613 raft_consensus.cc:2468] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 2.
I20260709 13:07:24.815853 22655 leader_election.cc:304] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 64664346e1aa49639651be8bf7f41042
I20260709 13:07:24.817232 22815 raft_consensus.cc:2804] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:24.818184 22815 raft_consensus.cc:697] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:24.819226 22815 consensus_queue.cc:237] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.831257 22511 catalog_manager.cc:5697] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 1 to 2, leader changed from 50a8b165161447cd9fa61f0ae414540e (127.21.244.1) to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 2 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.837777 22815 consensus_queue.cc:1048] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.846514 22892 raft_consensus.cc:993] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042: : Instructing follower c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:24.847676 22814 raft_consensus.cc:1081] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Signalling peer c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:24.849608 22689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:53236
I20260709 13:07:24.850198 22689 raft_consensus.cc:493] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:24.850566 22689 raft_consensus.cc:3060] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.857484 22689 raft_consensus.cc:515] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.858114 22892 consensus_queue.cc:1048] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:24.860468 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:24.861073 22613 raft_consensus.cc:3060] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.868409 22613 raft_consensus.cc:2468] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 2.
I20260709 13:07:24.870896 22655 leader_election.cc:304] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:24.872313 22815 raft_consensus.cc:2804] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:24.872792 22815 raft_consensus.cc:697] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:24.873569 22815 consensus_queue.cc:237] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.875160 22841 consensus_queue.cc:1048] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.881664 22856 consensus_queue.cc:1048] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:24.887303 22689 leader_election.cc:290] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 2 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:24.888767 22761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:24.890014 22761 raft_consensus.cc:3055] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:24.890364 22761 raft_consensus.cc:740] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:24.891098 22761 consensus_queue.cc:260] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:24.892117 22761 raft_consensus.cc:3060] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.900300 22761 raft_consensus.cc:2468] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 2.
I20260709 13:07:24.916946 22841 raft_consensus.cc:993] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d: : Instructing follower 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:24.917382 22841 raft_consensus.cc:1081] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Signalling peer 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:24.920105 22613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1"
dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:43334
I20260709 13:07:24.919647 22512 catalog_manager.cc:5697] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 1 to 2, leader changed from 64664346e1aa49639651be8bf7f41042 (127.21.244.3) to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 2 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.920789 22613 raft_consensus.cc:493] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:24.921321 22613 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:24.927346 22729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:43965, user_credentials={real_user=slave}} blocked reactor thread for 100826us
I20260709 13:07:24.929945 22612 raft_consensus.cc:1240] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Rejecting Update request from peer 64664346e1aa49639651be8bf7f41042 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:24.931135 22613 raft_consensus.cc:515] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:24.932405 22614 raft_consensus.cc:1240] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Rejecting Update request from peer c8e83288f36b4e50a8cea3aa7a1dac5d for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:24.936619 22841 consensus_queue.cc:1059] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.937368 22613 leader_election.cc:290] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 2 election: Requested vote from peers 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:24.937480 22841 raft_consensus.cc:3055] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:24.937901 22841 raft_consensus.cc:740] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:24.938720 22841 consensus_queue.cc:260] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:24.939337 22689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:24.939529 22764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:24.940080 22841 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.940130 22764 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.947795 22764 raft_consensus.cc:2468] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 2.
I20260709 13:07:24.949826 22579 leader_election.cc:304] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: 
I20260709 13:07:24.950188 22893 consensus_queue.cc:1048] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.950687 22850 raft_consensus.cc:2804] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:24.951159 22850 raft_consensus.cc:697] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Becoming Leader. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:24.952129 22850 consensus_queue.cc:237] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:24.962702 22510 catalog_manager.cc:5697] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e reported cstate change: term changed from 1 to 2, leader changed from c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2) to 50a8b165161447cd9fa61f0ae414540e (127.21.244.1). New cstate: current_term: 2 leader_uuid: "50a8b165161447cd9fa61f0ae414540e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.963805 22689 raft_consensus.cc:2468] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 2.
I20260709 13:07:24.978327 22894 consensus_queue.cc:1048] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.991878 22893 raft_consensus.cc:993] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042: : Instructing follower 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:24.992353 22894 raft_consensus.cc:1081] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Signalling peer 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:24.994019 22613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174"
dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:43336
I20260709 13:07:24.994611 22613 raft_consensus.cc:493] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:24.994974 22613 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.000213 22613 raft_consensus.cc:515] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:25.002277 22613 leader_election.cc:290] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 2 election: Requested vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:25.003320 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:25.003954 22690 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.004446 22764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:25.005016 22764 raft_consensus.cc:3055] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.005329 22764 raft_consensus.cc:740] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:25.006146 22764 consensus_queue.cc:260] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:25.007403 22764 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.011283 22690 raft_consensus.cc:2468] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 2.
I20260709 13:07:25.012538 22581 leader_election.cc:304] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:25.013478 22850 raft_consensus.cc:2804] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.014009 22850 raft_consensus.cc:697] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Becoming Leader. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:25.014232 22764 raft_consensus.cc:2468] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 2.
I20260709 13:07:25.014928 22850 consensus_queue.cc:237] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:25.022675 22511 catalog_manager.cc:5697] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e reported cstate change: term changed from 1 to 2, leader changed from 64664346e1aa49639651be8bf7f41042 (127.21.244.3) to 50a8b165161447cd9fa61f0ae414540e (127.21.244.1). New cstate: current_term: 2 leader_uuid: "50a8b165161447cd9fa61f0ae414540e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.035399 22815 raft_consensus.cc:993] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d: : Instructing follower 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:25.035939 22841 raft_consensus.cc:1081] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Signalling peer 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:25.037659 22613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd"
dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:43334
I20260709 13:07:25.038244 22613 raft_consensus.cc:493] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.038556 22613 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.044773 22613 raft_consensus.cc:515] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:25.047125 22613 leader_election.cc:290] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 2 election: Requested vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:25.047466 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:25.048171 22690 raft_consensus.cc:3055] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.048202 22764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:25.048671 22690 raft_consensus.cc:740] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:25.048893 22764 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.049612 22690 consensus_queue.cc:260] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:25.050999 22690 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.053735 22764 raft_consensus.cc:2468] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 2.
I20260709 13:07:25.054937 22579 leader_election.cc:304] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: 
I20260709 13:07:25.055809 22850 raft_consensus.cc:2804] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.056285 22850 raft_consensus.cc:697] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Becoming Leader. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:25.057119 22850 consensus_queue.cc:237] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:25.058355 22690 raft_consensus.cc:2468] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 2.
I20260709 13:07:25.064869 22511 catalog_manager.cc:5697] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e reported cstate change: term changed from 1 to 2, leader changed from c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2) to 50a8b165161447cd9fa61f0ae414540e (127.21.244.1). New cstate: current_term: 2 leader_uuid: "50a8b165161447cd9fa61f0ae414540e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.204782 22613 raft_consensus.cc:1275] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.206116 22815 consensus_queue.cc:1048] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.220954 22764 raft_consensus.cc:3060] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.231542 22764 raft_consensus.cc:1275] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.232816 22841 consensus_queue.cc:1048] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.319231 22764 raft_consensus.cc:1275] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.320672 22841 consensus_queue.cc:1048] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.329013 22613 raft_consensus.cc:1275] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.335042 22841 consensus_queue.cc:1048] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.382833 22762 raft_consensus.cc:1275] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.384429 22850 consensus_queue.cc:1048] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.394361 22690 raft_consensus.cc:1275] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.396754 22856 consensus_queue.cc:1048] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:25.449375 22690 raft_consensus.cc:1275] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.450742 22856 consensus_queue.cc:1048] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.459447 22762 raft_consensus.cc:1275] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.461338 22811 consensus_queue.cc:1048] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.610584 22690 raft_consensus.cc:1275] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.612304 22903 consensus_queue.cc:1048] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.615499 22762 raft_consensus.cc:1275] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.617100 22850 consensus_queue.cc:1048] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:27.825762 22480 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:07:27.826596 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:27.851855 22613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174"
dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
mode: GRACEFUL
new_leader_uuid: "64664346e1aa49639651be8bf7f41042"
 from {username='slave'} at 127.0.0.1:50624
I20260709 13:07:27.852452 22613 raft_consensus.cc:606] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Received request to transfer leadership to TS 64664346e1aa49639651be8bf7f41042
I20260709 13:07:27.865518 22690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7992af2df2494951ae670d421a16cd65"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
mode: GRACEFUL
new_leader_uuid: "64664346e1aa49639651be8bf7f41042"
 from {username='slave'} at 127.0.0.1:60810
I20260709 13:07:27.866184 22690 raft_consensus.cc:606] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Received request to transfer leadership to TS 64664346e1aa49639651be8bf7f41042
I20260709 13:07:27.867456 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:27.868039 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:27.876876 22850 raft_consensus.cc:993] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e: : Instructing follower 64664346e1aa49639651be8bf7f41042 to start an election
I20260709 13:07:27.877424 22904 raft_consensus.cc:1081] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Signalling peer 64664346e1aa49639651be8bf7f41042 to start an election
I20260709 13:07:27.879271 22762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174"
dest_uuid: "64664346e1aa49639651be8bf7f41042"
 from {username='slave'} at 127.0.0.1:37896
I20260709 13:07:27.879860 22762 raft_consensus.cc:493] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.880182 22762 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.885520 22762 raft_consensus.cc:515] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:27.888185 22762 leader_election.cc:290] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 3 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:27.888434 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:27.888796 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:27.889087 22613 raft_consensus.cc:3055] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:27.889353 22690 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.889444 22613 raft_consensus.cc:740] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:27.890331 22613 consensus_queue.cc:260] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:27.891562 22613 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:27.896534 22690 raft_consensus.cc:2468] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 3.
I20260709 13:07:27.898003 22730 leader_election.cc:304] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:27.898252 22613 raft_consensus.cc:2468] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 3.
I20260709 13:07:27.898824 22891 raft_consensus.cc:2804] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:27.900228 22891 raft_consensus.cc:697] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 3 LEADER]: Becoming Leader. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:27.901005 22891 consensus_queue.cc:237] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:27.912956 22512 catalog_manager.cc:5697] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 reported cstate change: term changed from 2 to 3, leader changed from 50a8b165161447cd9fa61f0ae414540e (127.21.244.1) to 64664346e1aa49639651be8bf7f41042 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "64664346e1aa49639651be8bf7f41042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.252480 22841 raft_consensus.cc:993] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d: : Instructing follower 64664346e1aa49639651be8bf7f41042 to start an election
I20260709 13:07:28.252943 22914 raft_consensus.cc:1081] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Signalling peer 64664346e1aa49639651be8bf7f41042 to start an election
I20260709 13:07:28.254731 22762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7992af2df2494951ae670d421a16cd65"
dest_uuid: "64664346e1aa49639651be8bf7f41042"
 from {username='slave'} at 127.0.0.1:37884
I20260709 13:07:28.255322 22762 raft_consensus.cc:493] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:28.255689 22762 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.260849 22762 raft_consensus.cc:515] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:28.262916 22762 leader_election.cc:290] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 2 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:28.263710 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:28.264374 22613 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.264922 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:28.265478 22690 raft_consensus.cc:3055] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:28.265797 22690 raft_consensus.cc:740] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:28.266577 22690 consensus_queue.cc:260] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:28.267591 22690 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.271126 22613 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 2.
I20260709 13:07:28.272502 22729 leader_election.cc:304] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: 
I20260709 13:07:28.273308 22891 raft_consensus.cc:2804] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:28.273432 22690 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 2.
I20260709 13:07:28.274009 22891 raft_consensus.cc:697] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 2 LEADER]: Becoming Leader. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:28.275028 22891 consensus_queue.cc:237] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:28.283706 22512 catalog_manager.cc:5697] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 reported cstate change: term changed from 1 to 2, leader changed from c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2) to 64664346e1aa49639651be8bf7f41042 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "64664346e1aa49639651be8bf7f41042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.364063 22613 raft_consensus.cc:1275] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Refusing update from remote peer 64664346e1aa49639651be8bf7f41042: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:28.365509 22891 consensus_queue.cc:1048] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:28.376435 22689 raft_consensus.cc:1275] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Refusing update from remote peer 64664346e1aa49639651be8bf7f41042: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:28.379575 22891 consensus_queue.cc:1048] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:28.454020 22785 debug-util.cc:398] Leaking SignalData structure 0x7b080016d060 after lost signal to thread 22483
W20260709 13:07:28.454965 22785 debug-util.cc:398] Leaking SignalData structure 0x7b080016d740 after lost signal to thread 22546
W20260709 13:07:28.456703 22785 debug-util.cc:398] Leaking SignalData structure 0x7b08001ac0a0 after lost signal to thread 22788
I20260709 13:07:28.706183 22613 raft_consensus.cc:1275] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Refusing update from remote peer 64664346e1aa49639651be8bf7f41042: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.707639 22891 consensus_queue.cc:1048] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.719038 22689 raft_consensus.cc:1275] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Refusing update from remote peer 64664346e1aa49639651be8bf7f41042: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.725410 22922 consensus_queue.cc:1048] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:28.868953 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:28.880417 22613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1"
dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
mode: GRACEFUL
new_leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:43346
I20260709 13:07:28.881076 22613 raft_consensus.cc:606] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Received request to transfer leadership to TS c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:28.887687 22613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd"
dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
mode: GRACEFUL
new_leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:43346
I20260709 13:07:28.888329 22613 raft_consensus.cc:606] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Received request to transfer leadership to TS c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:28.896492 22613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835"
dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
mode: GRACEFUL
new_leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:43346
I20260709 13:07:28.897323 22613 raft_consensus.cc:606] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 1 LEADER]: Received request to transfer leadership to TS c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:28.904706 22762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174"
dest_uuid: "64664346e1aa49639651be8bf7f41042"
mode: GRACEFUL
new_leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:37898
I20260709 13:07:28.905303 22762 raft_consensus.cc:606] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 3 LEADER]: Received request to transfer leadership to TS c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:28.911943 22762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7992af2df2494951ae670d421a16cd65"
dest_uuid: "64664346e1aa49639651be8bf7f41042"
mode: GRACEFUL
new_leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:37898
I20260709 13:07:28.912550 22762 raft_consensus.cc:606] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 2 LEADER]: Received request to transfer leadership to TS c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:28.981021 22925 raft_consensus.cc:993] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e: : Instructing follower c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:28.981549 22904 raft_consensus.cc:1081] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 1 LEADER]: Signalling peer c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:28.983352 22689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:53252
I20260709 13:07:28.983904 22689 raft_consensus.cc:493] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:28.984234 22689 raft_consensus.cc:3060] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.990051 22689 raft_consensus.cc:515] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:28.992015 22689 leader_election.cc:290] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 2 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:28.993193 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:28.993139 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96684099bec48d995fa67f4f9c76835" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:28.993964 22762 raft_consensus.cc:3060] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.994061 22613 raft_consensus.cc:3055] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:28.994481 22613 raft_consensus.cc:740] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:28.995277 22613 consensus_queue.cc:260] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:28.996596 22613 raft_consensus.cc:3060] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.999167 22762 raft_consensus.cc:2468] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 2.
I20260709 13:07:29.000617 22654 leader_election.cc:304] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:29.001344 22914 raft_consensus.cc:2804] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.002480 22914 raft_consensus.cc:697] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:29.003449 22613 raft_consensus.cc:2468] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 2.
I20260709 13:07:29.003346 22914 consensus_queue.cc:237] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:29.012859 22512 catalog_manager.cc:5697] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 1 to 2, leader changed from 50a8b165161447cd9fa61f0ae414540e (127.21.244.1) to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 2 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.090713 22925 raft_consensus.cc:993] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e: : Instructing follower c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:29.091233 22904 raft_consensus.cc:1081] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Signalling peer c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:29.093326 22689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:53252
I20260709 13:07:29.094025 22689 raft_consensus.cc:493] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.094394 22689 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.099373 22689 raft_consensus.cc:515] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:29.101351 22689 leader_election.cc:290] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 3 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:29.102308 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:29.102577 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:29.102929 22613 raft_consensus.cc:3055] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:29.103300 22762 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.103297 22613 raft_consensus.cc:740] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:29.104312 22613 consensus_queue.cc:260] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:29.105552 22613 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.108883 22762 raft_consensus.cc:2468] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 3.
I20260709 13:07:29.110451 22654 leader_election.cc:304] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:29.111462 22914 raft_consensus.cc:2804] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:29.112030 22914 raft_consensus.cc:697] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:29.112950 22914 consensus_queue.cc:237] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:29.113406 22613 raft_consensus.cc:2468] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 3.
I20260709 13:07:29.121603 22512 catalog_manager.cc:5697] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 2 to 3, leader changed from 50a8b165161447cd9fa61f0ae414540e (127.21.244.1) to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 3 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.129035 22922 raft_consensus.cc:993] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042: : Instructing follower c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:29.129536 22922 raft_consensus.cc:1081] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 2 LEADER]: Signalling peer c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:29.131523 22689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7992af2df2494951ae670d421a16cd65"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:53236
I20260709 13:07:29.132138 22689 raft_consensus.cc:493] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.132521 22689 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.139300 22689 raft_consensus.cc:515] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:29.141549 22689 leader_election.cc:290] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 3 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:29.142647 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:29.143153 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:29.143343 22613 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.144001 22762 raft_consensus.cc:3055] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:29.144510 22762 raft_consensus.cc:740] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:29.145254 22762 consensus_queue.cc:260] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:29.146658 22762 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.150656 22613 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 3.
I20260709 13:07:29.151516 22762 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 3.
I20260709 13:07:29.152043 22655 leader_election.cc:304] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:29.153059 22914 raft_consensus.cc:2804] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:29.153621 22914 raft_consensus.cc:697] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:29.154397 22914 consensus_queue.cc:237] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:29.162446 22509 catalog_manager.cc:5697] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 2 to 3, leader changed from 64664346e1aa49639651be8bf7f41042 (127.21.244.3) to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 3 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.420147 22925 raft_consensus.cc:993] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e: : Instructing follower c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:29.420785 22904 raft_consensus.cc:1081] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Signalling peer c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:29.422348 22689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:53252
I20260709 13:07:29.422945 22689 raft_consensus.cc:493] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.423276 22689 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.430558 22689 raft_consensus.cc:515] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:29.432525 22689 leader_election.cc:290] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 3 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:29.434206 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:29.434464 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:29.434799 22613 raft_consensus.cc:3055] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:29.435168 22613 raft_consensus.cc:740] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:29.435223 22762 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.435976 22613 consensus_queue.cc:260] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:29.437357 22613 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.435539 22923 raft_consensus.cc:993] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042: : Instructing follower c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:29.438540 22923 raft_consensus.cc:1081] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 3 LEADER]: Signalling peer c8e83288f36b4e50a8cea3aa7a1dac5d to start an election
I20260709 13:07:29.440694 22690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
 from {username='slave'} at 127.0.0.1:53236
I20260709 13:07:29.441284 22690 raft_consensus.cc:493] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.441664 22690 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.444271 22613 raft_consensus.cc:2468] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 3.
I20260709 13:07:29.444271 22762 raft_consensus.cc:2468] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 3.
I20260709 13:07:29.445572 22655 leader_election.cc:304] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:29.446364 22914 raft_consensus.cc:2804] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:29.446856 22914 raft_consensus.cc:697] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:29.447654 22914 consensus_queue.cc:237] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:29.452167 22690 raft_consensus.cc:515] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:29.454879 22690 leader_election.cc:290] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 4 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:29.455010 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:29.455992 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323675e5acbb43d68799e1aa1f68f174" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:29.456445 22613 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.456622 22762 raft_consensus.cc:3055] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:29.457136 22762 raft_consensus.cc:740] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:29.456398 22509 catalog_manager.cc:5697] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 2 to 3, leader changed from 50a8b165161447cd9fa61f0ae414540e (127.21.244.1) to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 3 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.458024 22762 consensus_queue.cc:260] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:29.459173 22762 raft_consensus.cc:3060] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.463864 22613 raft_consensus.cc:2468] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 4.
I20260709 13:07:29.465413 22762 raft_consensus.cc:2468] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 4.
I20260709 13:07:29.465246 22655 leader_election.cc:304] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:29.467209 22914 raft_consensus.cc:2804] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:29.467759 22914 raft_consensus.cc:697] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:29.468506 22914 consensus_queue.cc:237] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:29.471858 22613 raft_consensus.cc:1275] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:29.473500 22914 consensus_queue.cc:1048] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:29.476960 22509 catalog_manager.cc:5697] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 3 to 4, leader changed from 64664346e1aa49639651be8bf7f41042 (127.21.244.3) to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 4 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.485532 22762 raft_consensus.cc:1275] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:29.487217 22926 consensus_queue.cc:1048] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:29.557754 22613 raft_consensus.cc:1275] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:29.559504 22914 consensus_queue.cc:1048] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:29.560837 22762 raft_consensus.cc:1275] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:29.562204 22914 consensus_queue.cc:1048] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:29.573710 22764 raft_consensus.cc:1275] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:29.579346 22613 raft_consensus.cc:1275] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:29.588969 22941 consensus_queue.cc:1048] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:29.587553 22914 consensus_queue.cc:1048] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:07:29.846035 22762 raft_consensus.cc:1275] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:29.847540 22914 consensus_queue.cc:1048] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:29.860805 22613 raft_consensus.cc:1275] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:29.862375 22926 consensus_queue.cc:1048] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:29.944195 22762 raft_consensus.cc:1275] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:29.945406 22926 consensus_queue.cc:1048] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:29.954237 22613 raft_consensus.cc:1275] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:29.956003 22914 consensus_queue.cc:1048] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:31.930248 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:31.939217 22690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
mode: GRACEFUL
new_leader_uuid: "64664346e1aa49639651be8bf7f41042"
 from {username='slave'} at 127.0.0.1:60810
I20260709 13:07:31.939911 22690 raft_consensus.cc:606] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Received request to transfer leadership to TS 64664346e1aa49639651be8bf7f41042
I20260709 13:07:31.942935 22690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7992af2df2494951ae670d421a16cd65"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
mode: GRACEFUL
new_leader_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:60810
I20260709 13:07:31.943377 22690 raft_consensus.cc:606] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Received request to transfer leadership to TS 50a8b165161447cd9fa61f0ae414540e
I20260709 13:07:31.946074 22690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
mode: GRACEFUL
new_leader_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:60810
I20260709 13:07:31.946712 22690 raft_consensus.cc:606] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 LEADER]: Received request to transfer leadership to TS 50a8b165161447cd9fa61f0ae414540e
I20260709 13:07:31.949762 22690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd68cd7b76544ab8aa9f6114230a63d7"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
mode: GRACEFUL
new_leader_uuid: "64664346e1aa49639651be8bf7f41042"
 from {username='slave'} at 127.0.0.1:60810
I20260709 13:07:31.950215 22690 raft_consensus.cc:606] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Received request to transfer leadership to TS 64664346e1aa49639651be8bf7f41042
I20260709 13:07:31.952824 22690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd"
dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
mode: GRACEFUL
new_leader_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:60810
I20260709 13:07:31.953372 22690 raft_consensus.cc:606] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Received request to transfer leadership to TS 50a8b165161447cd9fa61f0ae414540e
I20260709 13:07:31.954633 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:31.955123 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:32.033865 22914 raft_consensus.cc:993] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d: : Instructing follower 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:32.034286 22914 raft_consensus.cc:1081] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Signalling peer 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:32.036087 22614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd"
dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:43334
I20260709 13:07:32.036649 22614 raft_consensus.cc:493] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.037029 22614 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.042738 22614 raft_consensus.cc:515] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:32.044803 22614 leader_election.cc:290] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 4 election: Requested vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:32.046161 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:32.046041 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:32.046918 22762 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.046968 22690 raft_consensus.cc:3055] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.047410 22690 raft_consensus.cc:740] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:32.048435 22690 consensus_queue.cc:260] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:32.049819 22690 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.054041 22762 raft_consensus.cc:2468] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 4.
I20260709 13:07:32.055449 22579 leader_election.cc:304] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: 
I20260709 13:07:32.056465 22690 raft_consensus.cc:2468] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 4.
I20260709 13:07:32.057125 22951 raft_consensus.cc:2804] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:32.058362 22951 raft_consensus.cc:697] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 4 LEADER]: Becoming Leader. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:32.059155 22951 consensus_queue.cc:237] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:32.067061 22510 catalog_manager.cc:5697] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e reported cstate change: term changed from 3 to 4, leader changed from c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2) to 50a8b165161447cd9fa61f0ae414540e (127.21.244.1). New cstate: current_term: 4 leader_uuid: "50a8b165161447cd9fa61f0ae414540e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.263425 22950 raft_consensus.cc:993] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d: : Instructing follower 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:32.263927 22914 raft_consensus.cc:1081] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Signalling peer 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:32.265710 22614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7992af2df2494951ae670d421a16cd65"
dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:43334
I20260709 13:07:32.266248 22614 raft_consensus.cc:493] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.266610 22614 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.271615 22614 raft_consensus.cc:515] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:32.273554 22614 leader_election.cc:290] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 4 election: Requested vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:32.274614 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:32.274626 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:32.275249 22690 raft_consensus.cc:3055] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.275347 22762 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.275540 22690 raft_consensus.cc:740] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:32.276384 22690 consensus_queue.cc:260] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:32.277289 22690 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.280081 22762 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 4.
I20260709 13:07:32.281242 22579 leader_election.cc:304] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: 
I20260709 13:07:32.281708 22690 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 4.
I20260709 13:07:32.282015 22951 raft_consensus.cc:2804] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:32.282560 22951 raft_consensus.cc:697] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 4 LEADER]: Becoming Leader. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:32.283509 22951 consensus_queue.cc:237] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:32.290403 22510 catalog_manager.cc:5697] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e reported cstate change: term changed from 3 to 4, leader changed from c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2) to 50a8b165161447cd9fa61f0ae414540e (127.21.244.1). New cstate: current_term: 4 leader_uuid: "50a8b165161447cd9fa61f0ae414540e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.323019 22950 raft_consensus.cc:993] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d: : Instructing follower 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:32.323556 22914 raft_consensus.cc:1081] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 LEADER]: Signalling peer 50a8b165161447cd9fa61f0ae414540e to start an election
I20260709 13:07:32.325223 22614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42"
dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
 from {username='slave'} at 127.0.0.1:43334
I20260709 13:07:32.325637 22614 raft_consensus.cc:493] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.325896 22614 raft_consensus.cc:3060] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.330461 22614 raft_consensus.cc:515] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:32.332054 22614 leader_election.cc:290] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 3 election: Requested vote from peers c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:32.332942 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:32.333078 22762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "50a8b165161447cd9fa61f0ae414540e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:32.333496 22762 raft_consensus.cc:3060] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.333490 22690 raft_consensus.cc:3055] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.334002 22690 raft_consensus.cc:740] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:32.334728 22690 consensus_queue.cc:260] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:32.335841 22690 raft_consensus.cc:3060] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.339658 22762 raft_consensus.cc:2468] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 3.
I20260709 13:07:32.340772 22579 leader_election.cc:304] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: 
I20260709 13:07:32.341594 22951 raft_consensus.cc:2804] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.341801 22690 raft_consensus.cc:2468] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a8b165161447cd9fa61f0ae414540e in term 3.
I20260709 13:07:32.342072 22951 raft_consensus.cc:697] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 3 LEADER]: Becoming Leader. State: Replica: 50a8b165161447cd9fa61f0ae414540e, State: Running, Role: LEADER
I20260709 13:07:32.343628 22951 consensus_queue.cc:237] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:32.351188 22510 catalog_manager.cc:5697] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e reported cstate change: term changed from 2 to 3, leader changed from c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2) to 50a8b165161447cd9fa61f0ae414540e (127.21.244.1). New cstate: current_term: 3 leader_uuid: "50a8b165161447cd9fa61f0ae414540e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.457178 22950 raft_consensus.cc:993] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d: : Instructing follower 64664346e1aa49639651be8bf7f41042 to start an election
I20260709 13:07:32.458091 22950 raft_consensus.cc:1081] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Signalling peer 64664346e1aa49639651be8bf7f41042 to start an election
I20260709 13:07:32.860848 22689 raft_consensus.cc:1275] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.862332 22690 raft_consensus.cc:1275] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:32.867177 22951 consensus_queue.cc:1048] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:32.923786 22581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:42731, user_credentials={real_user=slave}} blocked reactor thread for 60243.6us
I20260709 13:07:32.925900 22961 consensus_queue.cc:1048] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:32.994998 22688 raft_consensus.cc:1275] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:32.997556 22764 raft_consensus.cc:1275] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:32.999607 22961 consensus_queue.cc:1048] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.000699 22761 raft_consensus.cc:1275] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.001617 22961 consensus_queue.cc:1048] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.004606 22961 consensus_queue.cc:1048] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.013594 22763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd68cd7b76544ab8aa9f6114230a63d7"
dest_uuid: "64664346e1aa49639651be8bf7f41042"
 from {username='slave'} at 127.0.0.1:37884
I20260709 13:07:33.014580 22763 raft_consensus.cc:493] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.015210 22763 raft_consensus.cc:3060] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.025318 22914 raft_consensus.cc:993] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d: : Instructing follower 64664346e1aa49639651be8bf7f41042 to start an election
I20260709 13:07:33.025872 22914 raft_consensus.cc:1081] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Signalling peer 64664346e1aa49639651be8bf7f41042 to start an election
I20260709 13:07:33.028110 22759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1"
dest_uuid: "64664346e1aa49639651be8bf7f41042"
 from {username='slave'} at 127.0.0.1:37884
I20260709 13:07:33.028698 22759 raft_consensus.cc:493] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.029054 22759 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.032166 22763 raft_consensus.cc:515] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:33.033442 22762 raft_consensus.cc:1275] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Refusing update from remote peer 50a8b165161447cd9fa61f0ae414540e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:33.035475 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd68cd7b76544ab8aa9f6114230a63d7" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:33.036089 22613 raft_consensus.cc:3060] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.043318 22951 consensus_queue.cc:1048] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:33.046557 22613 raft_consensus.cc:2468] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 2.
I20260709 13:07:33.048601 22729 leader_election.cc:304] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: 
I20260709 13:07:33.050235 22763 leader_election.cc:290] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 2 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:33.051381 22688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd68cd7b76544ab8aa9f6114230a63d7" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:33.052011 22923 raft_consensus.cc:2804] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:33.059159 22923 raft_consensus.cc:697] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 2 LEADER]: Becoming Leader. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:33.060339 22923 consensus_queue.cc:237] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:33.051602 22759 raft_consensus.cc:515] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:33.065596 22688 raft_consensus.cc:3055] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:33.066807 22688 raft_consensus.cc:740] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:33.067701 22688 consensus_queue.cc:260] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:33.068977 22688 raft_consensus.cc:3060] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.091339 22613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "50a8b165161447cd9fa61f0ae414540e"
I20260709 13:07:33.092123 22613 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.091989 22690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f09b1a0e6544cfca6de9aa046875de1" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:33.093122 22690 raft_consensus.cc:3055] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:33.093698 22690 raft_consensus.cc:740] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:33.095281 22690 consensus_queue.cc:260] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:33.096964 22690 raft_consensus.cc:3060] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:33.099671 22613 raft_consensus.cc:2468] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 4.
I20260709 13:07:33.101315 22729 leader_election.cc:304] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042; no voters: 
I20260709 13:07:33.102522 22966 raft_consensus.cc:2804] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:33.103101 22966 raft_consensus.cc:697] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 4 LEADER]: Becoming Leader. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:33.104257 22966 consensus_queue.cc:237] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } }
I20260709 13:07:33.110819 22690 raft_consensus.cc:2468] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 4.
I20260709 13:07:33.124066 22688 raft_consensus.cc:2468] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 2.
I20260709 13:07:33.126329 22759 leader_election.cc:290] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 4 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:33.129876 22760 raft_consensus.cc:1240] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 2 LEADER]: Rejecting Update request from peer c8e83288f36b4e50a8cea3aa7a1dac5d for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:33.151335 22512 catalog_manager.cc:5697] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 reported cstate change: term changed from 1 to 2, leader changed from c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2) to 64664346e1aa49639651be8bf7f41042 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "64664346e1aa49639651be8bf7f41042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.152500 22512 catalog_manager.cc:5697] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 reported cstate change: term changed from 3 to 4, leader changed from c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2) to 64664346e1aa49639651be8bf7f41042 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "64664346e1aa49639651be8bf7f41042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.409427 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:33.416486 22480 tablet_server.cc:179] TabletServer@127.21.244.1:0 shutting down...
I20260709 13:07:33.442732 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:33.443583 22480 tablet_replica.cc:333] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e: stopping tablet replica
I20260709 13:07:33.444380 22480 raft_consensus.cc:2243] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.445262 22480 raft_consensus.cc:2272] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 50a8b165161447cd9fa61f0ae414540e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.448248 22480 tablet_replica.cc:333] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e: stopping tablet replica
I20260709 13:07:33.448988 22480 raft_consensus.cc:2243] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.449587 22480 raft_consensus.cc:2272] T c96684099bec48d995fa67f4f9c76835 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.451390 22480 tablet_replica.cc:333] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e: stopping tablet replica
I20260709 13:07:33.452031 22480 raft_consensus.cc:2243] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.452497 22480 raft_consensus.cc:2272] T bd68cd7b76544ab8aa9f6114230a63d7 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.454288 22480 tablet_replica.cc:333] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e: stopping tablet replica
I20260709 13:07:33.454917 22480 raft_consensus.cc:2243] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.455896 22480 raft_consensus.cc:2272] T 7992af2df2494951ae670d421a16cd65 P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.457882 22480 tablet_replica.cc:333] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e: stopping tablet replica
I20260709 13:07:33.458460 22480 raft_consensus.cc:2243] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.458909 22480 raft_consensus.cc:2272] T 6ce2911fb8824d299b7141973177ddca P 50a8b165161447cd9fa61f0ae414540e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.460958 22480 tablet_replica.cc:333] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e: stopping tablet replica
I20260709 13:07:33.461488 22480 raft_consensus.cc:2243] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.461916 22480 raft_consensus.cc:2272] T 0f09b1a0e6544cfca6de9aa046875de1 P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.463654 22480 tablet_replica.cc:333] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e: stopping tablet replica
I20260709 13:07:33.464231 22480 raft_consensus.cc:2243] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.464956 22480 raft_consensus.cc:2272] T edcdca82b96c47aca8479f877c832ebd P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.466996 22480 tablet_replica.cc:333] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e: stopping tablet replica
I20260709 13:07:33.467512 22480 raft_consensus.cc:2243] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.467978 22480 raft_consensus.cc:2272] T 323675e5acbb43d68799e1aa1f68f174 P 50a8b165161447cd9fa61f0ae414540e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:33.468227 22636 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5060 after lost signal to thread 22483
W20260709 13:07:33.468988 22636 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5740 after lost signal to thread 22546
W20260709 13:07:33.469807 22636 debug-util.cc:398] Leaking SignalData structure 0x7b08001b7ce0 after lost signal to thread 22639
I20260709 13:07:33.470008 22480 tablet_replica.cc:333] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e: stopping tablet replica
W20260709 13:07:33.470559 22636 debug-util.cc:398] Leaking SignalData structure 0x7b0800196d20 after lost signal to thread 22714
I20260709 13:07:33.470535 22480 raft_consensus.cc:2243] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.471176 22480 raft_consensus.cc:2272] T b0bbda324f8245a9846110e4076f80c8 P 50a8b165161447cd9fa61f0ae414540e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:33.471376 22636 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef2c0 after lost signal to thread 22788
W20260709 13:07:33.475785 22655 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:07:33.482848 22655 consensus_peers.cc:597] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d -> Peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Couldn't send request to peer 50a8b165161447cd9fa61f0ae414540e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:33.506726 22688 raft_consensus.cc:1275] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Refusing update from remote peer 64664346e1aa49639651be8bf7f41042: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:33.508291 22923 consensus_queue.cc:1048] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:33.630069 22729 consensus_peers.cc:597] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 -> Peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Couldn't send request to peer 50a8b165161447cd9fa61f0ae414540e. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:33.630522 22729 consensus_peers.cc:597] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 -> Peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Couldn't send request to peer 50a8b165161447cd9fa61f0ae414540e. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:33.633234 22729 consensus_peers.cc:597] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 -> Peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Couldn't send request to peer 50a8b165161447cd9fa61f0ae414540e. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:33.678656 22688 raft_consensus.cc:1275] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Refusing update from remote peer 64664346e1aa49639651be8bf7f41042: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:33.680441 22966 consensus_queue.cc:1048] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:33.811126 22655 consensus_peers.cc:597] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d -> Peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Couldn't send request to peer 50a8b165161447cd9fa61f0ae414540e. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:34.004386 22655 consensus_peers.cc:597] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d -> Peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Couldn't send request to peer 50a8b165161447cd9fa61f0ae414540e. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:34.581838 22992 raft_consensus.cc:493] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50a8b165161447cd9fa61f0ae414540e)
I20260709 13:07:34.582425 22992 raft_consensus.cc:515] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:34.584769 22992 leader_election.cc:290] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:34.585947 22760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
W20260709 13:07:34.588490 22655 leader_election.cc:336] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111)
I20260709 13:07:34.588860 22655 leader_election.cc:304] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042
I20260709 13:07:34.589483 22992 raft_consensus.cc:2749] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:34.601751 22966 raft_consensus.cc:493] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50a8b165161447cd9fa61f0ae414540e)
I20260709 13:07:34.602447 22966 raft_consensus.cc:515] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:34.604990 22966 leader_election.cc:290] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:34.606329 22688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:34.607194 22966 raft_consensus.cc:493] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50a8b165161447cd9fa61f0ae414540e)
I20260709 13:07:34.607698 22966 raft_consensus.cc:515] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
W20260709 13:07:34.609421 22729 leader_election.cc:336] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111)
I20260709 13:07:34.609907 22729 leader_election.cc:304] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64664346e1aa49639651be8bf7f41042; no voters: 50a8b165161447cd9fa61f0ae414540e, c8e83288f36b4e50a8cea3aa7a1dac5d
I20260709 13:07:34.609930 22966 leader_election.cc:290] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:34.611043 22966 raft_consensus.cc:2749] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:34.611548 22480 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22636)
I20260709 13:07:34.613168 22688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:34.613941 22688 raft_consensus.cc:2468] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 4.
I20260709 13:07:34.615940 22730 leader_election.cc:304] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:34.616750 22993 raft_consensus.cc:2804] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:34.617103 22993 raft_consensus.cc:493] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50a8b165161447cd9fa61f0ae414540e)
I20260709 13:07:34.617467 22993 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:34.617465 22729 leader_election.cc:336] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111)
I20260709 13:07:34.623193 22993 raft_consensus.cc:515] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:34.625043 22993 leader_election.cc:290] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:34.626291 22688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcdca82b96c47aca8479f877c832ebd" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:34.626978 22688 raft_consensus.cc:3060] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.629329 22992 raft_consensus.cc:493] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50a8b165161447cd9fa61f0ae414540e)
W20260709 13:07:34.629426 22729 leader_election.cc:336] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111)
I20260709 13:07:34.629959 22992 raft_consensus.cc:515] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:34.633291 22760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
I20260709 13:07:34.633987 22688 raft_consensus.cc:2468] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 5.
I20260709 13:07:34.635005 22992 leader_election.cc:290] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:34.635563 22730 leader_election.cc:304] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 50a8b165161447cd9fa61f0ae414540e
I20260709 13:07:34.636528 22993 raft_consensus.cc:2804] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:34.637003 22993 raft_consensus.cc:697] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 5 LEADER]: Becoming Leader. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:34.637501 22992 raft_consensus.cc:493] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50a8b165161447cd9fa61f0ae414540e)
W20260709 13:07:34.637262 22655 leader_election.cc:336] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111)
I20260709 13:07:34.638149 22655 leader_election.cc:304] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 50a8b165161447cd9fa61f0ae414540e, 64664346e1aa49639651be8bf7f41042
I20260709 13:07:34.638063 22993 consensus_queue.cc:237] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:34.638108 22992 raft_consensus.cc:515] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:34.639212 22991 raft_consensus.cc:2749] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:34.640820 22992 leader_election.cc:290] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:34.641536 22966 raft_consensus.cc:493] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 50a8b165161447cd9fa61f0ae414540e)
I20260709 13:07:34.642258 22966 raft_consensus.cc:515] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:34.644019 22760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042" is_pre_election: true
I20260709 13:07:34.644393 22966 leader_election.cc:290] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:34.644869 22760 raft_consensus.cc:2468] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 3.
I20260709 13:07:34.646818 22654 leader_election.cc:304] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 
I20260709 13:07:34.648168 22991 raft_consensus.cc:2804] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:34.648663 22991 raft_consensus.cc:493] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 50a8b165161447cd9fa61f0ae414540e)
I20260709 13:07:34.649119 22991 raft_consensus.cc:3060] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:34.656479 22729 leader_election.cc:336] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111)
W20260709 13:07:34.659276 22655 leader_election.cc:336] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111)
I20260709 13:07:34.661175 22688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" is_pre_election: true
I20260709 13:07:34.662186 22688 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 4.
I20260709 13:07:34.664916 22991 raft_consensus.cc:515] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:34.670199 22760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c8cd9fed74c8ba1ad48241fa5ae42" candidate_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "64664346e1aa49639651be8bf7f41042"
I20260709 13:07:34.672367 22730 leader_election.cc:304] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 50a8b165161447cd9fa61f0ae414540e
I20260709 13:07:34.673254 22966 raft_consensus.cc:2804] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:34.673708 22966 raft_consensus.cc:493] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 50a8b165161447cd9fa61f0ae414540e)
I20260709 13:07:34.674086 22966 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:34.674342 22760 raft_consensus.cc:3060] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.682839 22966 raft_consensus.cc:515] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
W20260709 13:07:34.684899 22655 leader_election.cc:336] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111)
I20260709 13:07:34.685238 22966 leader_election.cc:290] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731)
I20260709 13:07:34.685897 22991 leader_election.cc:290] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 4 election: Requested vote from peers 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965), 64664346e1aa49639651be8bf7f41042 (127.21.244.3:45737)
I20260709 13:07:34.687453 22688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7992af2df2494951ae670d421a16cd65" candidate_uuid: "64664346e1aa49639651be8bf7f41042" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d"
I20260709 13:07:34.688305 22688 raft_consensus.cc:3060] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:34.690481 22729 leader_election.cc:336] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111)
I20260709 13:07:34.692699 22760 raft_consensus.cc:2468] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e83288f36b4e50a8cea3aa7a1dac5d in term 4.
I20260709 13:07:34.694154 22654 leader_election.cc:304] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 50a8b165161447cd9fa61f0ae414540e
I20260709 13:07:34.695358 22991 raft_consensus.cc:2804] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:34.696586 22991 raft_consensus.cc:697] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 LEADER]: Becoming Leader. State: Replica: c8e83288f36b4e50a8cea3aa7a1dac5d, State: Running, Role: LEADER
I20260709 13:07:34.696038 22512 catalog_manager.cc:5697] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 reported cstate change: term changed from 4 to 5, leader changed from 50a8b165161447cd9fa61f0ae414540e (127.21.244.1) to 64664346e1aa49639651be8bf7f41042 (127.21.244.3). New cstate: current_term: 5 leader_uuid: "64664346e1aa49639651be8bf7f41042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:34.697542 22991 consensus_queue.cc:237] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:34.698972 22688 raft_consensus.cc:2468] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64664346e1aa49639651be8bf7f41042 in term 5.
I20260709 13:07:34.700546 22730 leader_election.cc:304] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64664346e1aa49639651be8bf7f41042, c8e83288f36b4e50a8cea3aa7a1dac5d; no voters: 50a8b165161447cd9fa61f0ae414540e
I20260709 13:07:34.701407 22993 raft_consensus.cc:2804] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:34.701879 22993 raft_consensus.cc:697] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 5 LEADER]: Becoming Leader. State: Replica: 64664346e1aa49639651be8bf7f41042, State: Running, Role: LEADER
I20260709 13:07:34.702662 22993 consensus_queue.cc:237] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } }
I20260709 13:07:34.714869 22510 catalog_manager.cc:5697] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d reported cstate change: term changed from 3 to 4, leader changed from 50a8b165161447cd9fa61f0ae414540e (127.21.244.1) to c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2). New cstate: current_term: 4 leader_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.727264 22510 catalog_manager.cc:5697] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 reported cstate change: term changed from 4 to 5, leader changed from 50a8b165161447cd9fa61f0ae414540e (127.21.244.1) to 64664346e1aa49639651be8bf7f41042 (127.21.244.3). New cstate: current_term: 5 leader_uuid: "64664346e1aa49639651be8bf7f41042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a8b165161447cd9fa61f0ae414540e" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:35.101528 22729 consensus_peers.cc:597] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 -> Peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Couldn't send request to peer 50a8b165161447cd9fa61f0ae414540e. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.114467 22688 raft_consensus.cc:1275] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 5 FOLLOWER]: Refusing update from remote peer 64664346e1aa49639651be8bf7f41042: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:35.115856 22993 consensus_queue.cc:1048] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:35.135171 22729 consensus_peers.cc:597] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 -> Peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Couldn't send request to peer 50a8b165161447cd9fa61f0ae414540e. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:35.232694 22655 consensus_peers.cc:597] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d -> Peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Couldn't send request to peer 50a8b165161447cd9fa61f0ae414540e. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.235870 22760 raft_consensus.cc:1275] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Refusing update from remote peer c8e83288f36b4e50a8cea3aa7a1dac5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:35.237485 22991 consensus_queue.cc:1048] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64664346e1aa49639651be8bf7f41042" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:35.246481 22688 raft_consensus.cc:1275] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 5 FOLLOWER]: Refusing update from remote peer 64664346e1aa49639651be8bf7f41042: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:35.248070 22966 consensus_queue.cc:1048] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e83288f36b4e50a8cea3aa7a1dac5d" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:35.612068 22480 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22636)
W20260709 13:07:35.967810 22655 consensus_peers.cc:597] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d -> Peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Couldn't send request to peer 50a8b165161447cd9fa61f0ae414540e. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:36.014791 22480 tablet_server.cc:196] TabletServer@127.21.244.1:0 shutdown complete.
W20260709 13:07:36.015654 22729 consensus_peers.cc:597] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 -> Peer 50a8b165161447cd9fa61f0ae414540e (127.21.244.1:43965): Couldn't send request to peer 50a8b165161447cd9fa61f0ae414540e. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:43965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:36.033572 22480 tablet_server.cc:179] TabletServer@127.21.244.2:0 shutting down...
I20260709 13:07:36.058122 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:36.058806 22480 tablet_replica.cc:333] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d: stopping tablet replica
I20260709 13:07:36.059682 22480 raft_consensus.cc:2243] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.060866 22480 raft_consensus.cc:2272] T 323675e5acbb43d68799e1aa1f68f174 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.063107 22480 tablet_replica.cc:333] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d: stopping tablet replica
I20260709 13:07:36.063669 22480 raft_consensus.cc:2243] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.064538 22480 raft_consensus.cc:2272] T b0bbda324f8245a9846110e4076f80c8 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.066377 22480 tablet_replica.cc:333] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d: stopping tablet replica
I20260709 13:07:36.066903 22480 raft_consensus.cc:2243] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.067341 22480 raft_consensus.cc:2272] T 0f09b1a0e6544cfca6de9aa046875de1 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.069088 22480 tablet_replica.cc:333] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d: stopping tablet replica
I20260709 13:07:36.069788 22480 raft_consensus.cc:2243] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.070245 22480 raft_consensus.cc:2272] T edcdca82b96c47aca8479f877c832ebd P c8e83288f36b4e50a8cea3aa7a1dac5d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.073024 22480 tablet_replica.cc:333] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d: stopping tablet replica
I20260709 13:07:36.073587 22480 raft_consensus.cc:2243] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.074369 22480 raft_consensus.cc:2272] T c96684099bec48d995fa67f4f9c76835 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.076320 22480 tablet_replica.cc:333] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d: stopping tablet replica
I20260709 13:07:36.076841 22480 raft_consensus.cc:2243] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.077625 22480 raft_consensus.cc:2272] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.079993 22480 tablet_replica.cc:333] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d: stopping tablet replica
I20260709 13:07:36.080516 22480 raft_consensus.cc:2243] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.081090 22480 raft_consensus.cc:2272] T bd68cd7b76544ab8aa9f6114230a63d7 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.082734 22480 tablet_replica.cc:333] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d: stopping tablet replica
I20260709 13:07:36.083212 22480 raft_consensus.cc:2243] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.083614 22480 raft_consensus.cc:2272] T 7992af2df2494951ae670d421a16cd65 P c8e83288f36b4e50a8cea3aa7a1dac5d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.085884 22480 tablet_replica.cc:333] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d: stopping tablet replica
I20260709 13:07:36.086369 22480 raft_consensus.cc:2243] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.086826 22480 raft_consensus.cc:2272] T 6ce2911fb8824d299b7141973177ddca P c8e83288f36b4e50a8cea3aa7a1dac5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.115581 22480 tablet_server.cc:196] TabletServer@127.21.244.2:0 shutdown complete.
W20260709 13:07:36.137836 22730 consensus_peers.cc:597] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 -> Peer c8e83288f36b4e50a8cea3aa7a1dac5d (127.21.244.2:42731): Couldn't send request to peer c8e83288f36b4e50a8cea3aa7a1dac5d. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:42731: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.138895 22480 tablet_server.cc:179] TabletServer@127.21.244.3:0 shutting down...
I20260709 13:07:36.165637 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:36.166481 22480 tablet_replica.cc:333] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042: stopping tablet replica
I20260709 13:07:36.167505 22480 raft_consensus.cc:2243] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.168635 22480 raft_consensus.cc:2272] T edcdca82b96c47aca8479f877c832ebd P 64664346e1aa49639651be8bf7f41042 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.170411 22480 tablet_replica.cc:333] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042: stopping tablet replica
I20260709 13:07:36.170902 22480 raft_consensus.cc:2243] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.171645 22480 raft_consensus.cc:2272] T 0f09b1a0e6544cfca6de9aa046875de1 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.173429 22480 tablet_replica.cc:333] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042: stopping tablet replica
I20260709 13:07:36.173919 22480 raft_consensus.cc:2243] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.174312 22480 raft_consensus.cc:2272] T 323675e5acbb43d68799e1aa1f68f174 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.175995 22480 tablet_replica.cc:333] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042: stopping tablet replica
I20260709 13:07:36.176542 22480 raft_consensus.cc:2243] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.177022 22480 raft_consensus.cc:2272] T b0bbda324f8245a9846110e4076f80c8 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.178753 22480 tablet_replica.cc:333] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042: stopping tablet replica
I20260709 13:07:36.179303 22480 raft_consensus.cc:2243] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.179852 22480 raft_consensus.cc:2272] T c96684099bec48d995fa67f4f9c76835 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.181890 22480 tablet_replica.cc:333] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042: stopping tablet replica
I20260709 13:07:36.182435 22480 raft_consensus.cc:2243] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.182898 22480 raft_consensus.cc:2272] T ad6c8cd9fed74c8ba1ad48241fa5ae42 P 64664346e1aa49639651be8bf7f41042 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.185024 22480 tablet_replica.cc:333] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042: stopping tablet replica
I20260709 13:07:36.185567 22480 raft_consensus.cc:2243] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.186452 22480 raft_consensus.cc:2272] T bd68cd7b76544ab8aa9f6114230a63d7 P 64664346e1aa49639651be8bf7f41042 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.188414 22480 tablet_replica.cc:333] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042: stopping tablet replica
I20260709 13:07:36.188910 22480 raft_consensus.cc:2243] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.189646 22480 raft_consensus.cc:2272] T 6ce2911fb8824d299b7141973177ddca P 64664346e1aa49639651be8bf7f41042 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.191282 22480 tablet_replica.cc:333] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042: stopping tablet replica
I20260709 13:07:36.191802 22480 raft_consensus.cc:2243] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.192559 22480 raft_consensus.cc:2272] T 7992af2df2494951ae670d421a16cd65 P 64664346e1aa49639651be8bf7f41042 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.240520 22480 tablet_server.cc:196] TabletServer@127.21.244.3:0 shutdown complete.
I20260709 13:07:36.259172 22480 master.cc:562] Master@127.21.244.62:35217 shutting down...
I20260709 13:07:36.332453 22567 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:07:36.390872 22480 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.391525 22480 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.391942 22480 tablet_replica.cc:333] T 00000000000000000000000000000000 P c45d5bc09bbd488d8f44153ad4e5ce28: stopping tablet replica
I20260709 13:07:36.412398 22480 master.cc:584] Master@127.21.244.62:35217 shutdown complete.
50a8b165161447cd9fa61f0ae414540e  4
64664346e1aa49639651be8bf7f41042  1
c8e83288f36b4e50a8cea3aa7a1dac5d  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (15868 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:07:36.456692 22480 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.244.62:45155
I20260709 13:07:36.457818 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.464339 23014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.464401 23013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.464542 23016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.465687 22480 server_base.cc:1061] running on GCE node
I20260709 13:07:36.466639 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.466820 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.467024 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602456466990 us; error 0 us; skew 500 ppm
I20260709 13:07:36.467557 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.470147 22480 webserver.cc:533] Webserver started at http://127.21.244.62:34711/ using document root <none> and password file <none>
I20260709 13:07:36.470670 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.470865 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.471158 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.472425 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/master-0-root/instance:
uuid: "18ffb356e6194a3e804c520385d49884"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-j314"
I20260709 13:07:36.476914 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:07:36.480563 23021 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.481544 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:07:36.481849 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/master-0-root
uuid: "18ffb356e6194a3e804c520385d49884"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-j314"
I20260709 13:07:36.482137 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:36.503949 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:36.505177 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:36.546006 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.62:45155
I20260709 13:07:36.546116 23072 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.62:45155 every 8 connection(s)
I20260709 13:07:36.550417 23073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.559978 23073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884: Bootstrap starting.
I20260709 13:07:36.564738 23073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.569010 23073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884: No bootstrap required, opened a new log
I20260709 13:07:36.571190 23073 raft_consensus.cc:359] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18ffb356e6194a3e804c520385d49884" member_type: VOTER }
I20260709 13:07:36.571578 23073 raft_consensus.cc:385] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.571818 23073 raft_consensus.cc:740] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18ffb356e6194a3e804c520385d49884, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.572423 23073 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18ffb356e6194a3e804c520385d49884" member_type: VOTER }
I20260709 13:07:36.572847 23073 raft_consensus.cc:399] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:36.573036 23073 raft_consensus.cc:493] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:36.573254 23073 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.577217 23073 raft_consensus.cc:515] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18ffb356e6194a3e804c520385d49884" member_type: VOTER }
I20260709 13:07:36.577723 23073 leader_election.cc:304] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18ffb356e6194a3e804c520385d49884; no voters: 
I20260709 13:07:36.579013 23073 leader_election.cc:290] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:36.579465 23076 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:36.580977 23076 raft_consensus.cc:697] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [term 1 LEADER]: Becoming Leader. State: Replica: 18ffb356e6194a3e804c520385d49884, State: Running, Role: LEADER
I20260709 13:07:36.581640 23076 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18ffb356e6194a3e804c520385d49884" member_type: VOTER }
I20260709 13:07:36.582056 23073 sys_catalog.cc:565] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:36.585325 23078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18ffb356e6194a3e804c520385d49884. Latest consensus state: current_term: 1 leader_uuid: "18ffb356e6194a3e804c520385d49884" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18ffb356e6194a3e804c520385d49884" member_type: VOTER } }
I20260709 13:07:36.585902 23078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:36.586796 23077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18ffb356e6194a3e804c520385d49884" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18ffb356e6194a3e804c520385d49884" member_type: VOTER } }
I20260709 13:07:36.587604 23077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:36.590343 23082 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:36.599072 23082 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:36.600689 22480 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:36.608382 23082 catalog_manager.cc:1383] Generated new cluster ID: d849cec3e7b4479b88aaf78184251570
I20260709 13:07:36.608697 23082 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:36.626572 23082 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:36.627934 23082 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:36.643890 23082 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884: Generated new TSK 0
I20260709 13:07:36.644614 23082 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:36.667881 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.674347 23094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.676038 23095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.678282 23097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.678632 22480 server_base.cc:1061] running on GCE node
I20260709 13:07:36.679663 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.679972 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.680137 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602456680121 us; error 0 us; skew 500 ppm
I20260709 13:07:36.680610 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.683317 22480 webserver.cc:533] Webserver started at http://127.21.244.1:43657/ using document root <none> and password file <none>
I20260709 13:07:36.684015 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.684226 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.684576 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.685716 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-0-root/instance:
uuid: "5f59e800427c4b22816a6a161c3b1786"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-j314"
I20260709 13:07:36.690503 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:07:36.694068 23102 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.694986 22480 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:07:36.695392 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-0-root
uuid: "5f59e800427c4b22816a6a161c3b1786"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-j314"
I20260709 13:07:36.695711 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:36.710389 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:36.711818 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:36.713433 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:36.715847 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:36.716074 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.716341 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:36.716549 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.761112 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.1:36285
I20260709 13:07:36.761220 23164 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.1:36285 every 8 connection(s)
I20260709 13:07:36.766180 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.773901 23169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.776099 23170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.777329 23172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.779838 22480 server_base.cc:1061] running on GCE node
I20260709 13:07:36.780841 23165 heartbeater.cc:344] Connected to a master server at 127.21.244.62:45155
I20260709 13:07:36.781212 23165 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:36.781237 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.781646 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.781847 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602456781810 us; error 0 us; skew 500 ppm
I20260709 13:07:36.782166 23165 heartbeater.cc:507] Master 127.21.244.62:45155 requested a full tablet report, sending...
I20260709 13:07:36.782572 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.785034 23038 ts_manager.cc:194] Registered new tserver with Master: 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285)
I20260709 13:07:36.785924 22480 webserver.cc:533] Webserver started at http://127.21.244.2:33737/ using document root <none> and password file <none>
I20260709 13:07:36.786732 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.787019 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.787381 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.787935 23038 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58400
I20260709 13:07:36.788959 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-1-root/instance:
uuid: "31a4b72b8eaf4c9e973424c330559fa0"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-j314"
I20260709 13:07:36.794760 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:07:36.798753 23177 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.799712 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:36.800130 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-1-root
uuid: "31a4b72b8eaf4c9e973424c330559fa0"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-j314"
I20260709 13:07:36.800558 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:36.833333 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:36.834542 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:36.836115 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:36.838469 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:36.838719 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.838974 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:36.839159 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.884503 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.2:41269
I20260709 13:07:36.884620 23239 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.2:41269 every 8 connection(s)
I20260709 13:07:36.889453 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.896176 23243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.897076 23244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.900029 22480 server_base.cc:1061] running on GCE node
W20260709 13:07:36.901000 23246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.902159 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.902456 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.902592 23240 heartbeater.cc:344] Connected to a master server at 127.21.244.62:45155
I20260709 13:07:36.902767 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602456902742 us; error 0 us; skew 500 ppm
I20260709 13:07:36.903045 23240 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:36.903520 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.903841 23240 heartbeater.cc:507] Master 127.21.244.62:45155 requested a full tablet report, sending...
I20260709 13:07:36.906224 23038 ts_manager.cc:194] Registered new tserver with Master: 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:36.906450 22480 webserver.cc:533] Webserver started at http://127.21.244.3:46883/ using document root <none> and password file <none>
I20260709 13:07:36.907078 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.907326 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.907619 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.907824 23038 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58402
I20260709 13:07:36.909101 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-2-root/instance:
uuid: "078a3c9112864046b3984a52779f6f9b"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-j314"
I20260709 13:07:36.914528 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:07:36.918534 23251 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.919593 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:36.920014 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-2-root
uuid: "078a3c9112864046b3984a52779f6f9b"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-j314"
I20260709 13:07:36.920354 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602440417847-22480-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:36.956904 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:36.958206 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:36.959895 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:36.962387 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:36.962657 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.962937 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:36.963140 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.006719 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.3:35253
I20260709 13:07:37.006826 23313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.3:35253 every 8 connection(s)
I20260709 13:07:37.022138 23314 heartbeater.cc:344] Connected to a master server at 127.21.244.62:45155
I20260709 13:07:37.022572 23314 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:37.023353 23314 heartbeater.cc:507] Master 127.21.244.62:45155 requested a full tablet report, sending...
I20260709 13:07:37.025595 23038 ts_manager.cc:194] Registered new tserver with Master: 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:37.025820 22480 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01578588s
I20260709 13:07:37.027093 23038 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59118
I20260709 13:07:37.053416 23038 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59120:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:37.056376 23038 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:37.276109 23277 tablet_service.cc:1511] Processing CreateTablet for tablet 23635aee6a1f486db9ba691690cd2ba5 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:37.277626 23277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23635aee6a1f486db9ba691690cd2ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.291282 23279 tablet_service.cc:1511] Processing CreateTablet for tablet f385e3d41c104ba3aabd56504f6958de (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:37.293304 23279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f385e3d41c104ba3aabd56504f6958de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.301024 23327 tablet_bootstrap.cc:492] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b: Bootstrap starting.
I20260709 13:07:37.308494 23327 tablet_bootstrap.cc:654] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.314954 23327 tablet_bootstrap.cc:492] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b: No bootstrap required, opened a new log
I20260709 13:07:37.315528 23327 ts_tablet_manager.cc:1403] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.005s
I20260709 13:07:37.315429 23204 tablet_service.cc:1511] Processing CreateTablet for tablet e52466db7a544dee8a3c31dae4b517ae (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:37.316154 23203 tablet_service.cc:1511] Processing CreateTablet for tablet 23635aee6a1f486db9ba691690cd2ba5 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:37.316888 23204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52466db7a544dee8a3c31dae4b517ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.317601 23203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23635aee6a1f486db9ba691690cd2ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.318437 23327 raft_consensus.cc:359] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.319159 23327 raft_consensus.cc:385] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.319466 23327 raft_consensus.cc:740] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.320309 23327 consensus_queue.cc:260] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.320716 23279 tablet_service.cc:1511] Processing CreateTablet for tablet 6e20a9cb65e740b0885d8b9e3020bede (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:37.322207 23279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e20a9cb65e740b0885d8b9e3020bede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.326071 23314 heartbeater.cc:499] Master 127.21.244.62:45155 was elected leader, sending a full tablet report...
I20260709 13:07:37.326942 23327 ts_tablet_manager.cc:1434] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.007s
I20260709 13:07:37.328164 23327 tablet_bootstrap.cc:492] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b: Bootstrap starting.
I20260709 13:07:37.332980 23278 tablet_service.cc:1511] Processing CreateTablet for tablet e52466db7a544dee8a3c31dae4b517ae (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:37.334550 23278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52466db7a544dee8a3c31dae4b517ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.335091 23327 tablet_bootstrap.cc:654] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.339156 23202 tablet_service.cc:1511] Processing CreateTablet for tablet 6e20a9cb65e740b0885d8b9e3020bede (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:37.340667 23202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e20a9cb65e740b0885d8b9e3020bede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.347218 23205 tablet_service.cc:1511] Processing CreateTablet for tablet f385e3d41c104ba3aabd56504f6958de (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:37.348662 23205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f385e3d41c104ba3aabd56504f6958de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.348801 23277 tablet_service.cc:1511] Processing CreateTablet for tablet 2a4c344327dc4fc79aa5aa041d0c8c12 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:37.350032 23327 tablet_bootstrap.cc:492] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b: No bootstrap required, opened a new log
I20260709 13:07:37.350853 23327 ts_tablet_manager.cc:1403] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:07:37.351907 23331 tablet_bootstrap.cc:492] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0: Bootstrap starting.
I20260709 13:07:37.354470 23201 tablet_service.cc:1511] Processing CreateTablet for tablet 2a4c344327dc4fc79aa5aa041d0c8c12 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:37.354367 23327 raft_consensus.cc:359] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.350171 23277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a4c344327dc4fc79aa5aa041d0c8c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.360785 23331 tablet_bootstrap.cc:654] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.364049 23201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a4c344327dc4fc79aa5aa041d0c8c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.367901 23327 raft_consensus.cc:385] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.368569 23327 raft_consensus.cc:740] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.369660 23327 consensus_queue.cc:260] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.370016 23203 tablet_service.cc:1511] Processing CreateTablet for tablet bb2ac038116d454db4f799a0877a8a25 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:37.371520 23203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2ac038116d454db4f799a0877a8a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.372306 23327 ts_tablet_manager.cc:1434] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.006s
I20260709 13:07:37.373433 23327 tablet_bootstrap.cc:492] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b: Bootstrap starting.
I20260709 13:07:37.378717 23276 tablet_service.cc:1511] Processing CreateTablet for tablet bb2ac038116d454db4f799a0877a8a25 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:37.380254 23276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2ac038116d454db4f799a0877a8a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.388209 23327 tablet_bootstrap.cc:654] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.406685 23203 tablet_service.cc:1511] Processing CreateTablet for tablet 13c437c666384559a1ab704f7a2183e1 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:37.407893 23279 tablet_service.cc:1511] Processing CreateTablet for tablet 13c437c666384559a1ab704f7a2183e1 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:37.412272 23279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c437c666384559a1ab704f7a2183e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.413532 23204 tablet_service.cc:1511] Processing CreateTablet for tablet b47e5aee4b5f4092b9855df93de808fd (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:37.414911 23204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b47e5aee4b5f4092b9855df93de808fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.422690 23203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c437c666384559a1ab704f7a2183e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.427084 23277 tablet_service.cc:1511] Processing CreateTablet for tablet b47e5aee4b5f4092b9855df93de808fd (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:37.428619 23277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b47e5aee4b5f4092b9855df93de808fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.446604 23200 tablet_service.cc:1511] Processing CreateTablet for tablet 891e2e9c7c2b4a4099d4e97d0d981f91 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:37.448025 23200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891e2e9c7c2b4a4099d4e97d0d981f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.458050 23130 tablet_service.cc:1511] Processing CreateTablet for tablet f385e3d41c104ba3aabd56504f6958de (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:37.459467 23130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f385e3d41c104ba3aabd56504f6958de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.459928 23129 tablet_service.cc:1511] Processing CreateTablet for tablet e52466db7a544dee8a3c31dae4b517ae (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:37.461269 23129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52466db7a544dee8a3c31dae4b517ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.464923 23128 tablet_service.cc:1511] Processing CreateTablet for tablet 23635aee6a1f486db9ba691690cd2ba5 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:37.466324 23128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23635aee6a1f486db9ba691690cd2ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.469017 23127 tablet_service.cc:1511] Processing CreateTablet for tablet 6e20a9cb65e740b0885d8b9e3020bede (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:37.470408 23127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e20a9cb65e740b0885d8b9e3020bede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.472822 23126 tablet_service.cc:1511] Processing CreateTablet for tablet 2a4c344327dc4fc79aa5aa041d0c8c12 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:37.474167 23126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a4c344327dc4fc79aa5aa041d0c8c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.476862 23125 tablet_service.cc:1511] Processing CreateTablet for tablet bb2ac038116d454db4f799a0877a8a25 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:37.478209 23125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2ac038116d454db4f799a0877a8a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.480952 23124 tablet_service.cc:1511] Processing CreateTablet for tablet 13c437c666384559a1ab704f7a2183e1 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:37.482252 23124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c437c666384559a1ab704f7a2183e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.484817 23279 tablet_service.cc:1511] Processing CreateTablet for tablet 891e2e9c7c2b4a4099d4e97d0d981f91 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:37.485160 23123 tablet_service.cc:1511] Processing CreateTablet for tablet b47e5aee4b5f4092b9855df93de808fd (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:37.486177 23279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891e2e9c7c2b4a4099d4e97d0d981f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.486379 23123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b47e5aee4b5f4092b9855df93de808fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.489364 23122 tablet_service.cc:1511] Processing CreateTablet for tablet 891e2e9c7c2b4a4099d4e97d0d981f91 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:37.489916 23121 tablet_service.cc:1511] Processing CreateTablet for tablet 666fc116f63446f7b1a67dab4eef8a01 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:37.490952 23122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891e2e9c7c2b4a4099d4e97d0d981f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.491684 23121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666fc116f63446f7b1a67dab4eef8a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.503852 23327 tablet_bootstrap.cc:492] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b: No bootstrap required, opened a new log
I20260709 13:07:37.504413 23327 ts_tablet_manager.cc:1403] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b: Time spent bootstrapping tablet: real 0.131s	user 0.034s	sys 0.050s
I20260709 13:07:37.504571 23331 tablet_bootstrap.cc:492] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0: No bootstrap required, opened a new log
I20260709 13:07:37.505223 23331 ts_tablet_manager.cc:1403] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent bootstrapping tablet: real 0.154s	user 0.012s	sys 0.046s
I20260709 13:07:37.506054 23278 tablet_service.cc:1511] Processing CreateTablet for tablet 666fc116f63446f7b1a67dab4eef8a01 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:37.507397 23278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666fc116f63446f7b1a67dab4eef8a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.507992 23327 raft_consensus.cc:359] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.508836 23327 raft_consensus.cc:385] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.509168 23327 raft_consensus.cc:740] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.511392 23331 raft_consensus.cc:359] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.517424 23331 raft_consensus.cc:385] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.517865 23331 raft_consensus.cc:740] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.518222 23327 consensus_queue.cc:260] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.519282 23331 consensus_queue.cc:260] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.523488 23327 ts_tablet_manager.cc:1434] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.005s
I20260709 13:07:37.524693 23327 tablet_bootstrap.cc:492] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b: Bootstrap starting.
I20260709 13:07:37.526413 23335 tablet_bootstrap.cc:492] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786: Bootstrap starting.
I20260709 13:07:37.527825 23240 heartbeater.cc:499] Master 127.21.244.62:45155 was elected leader, sending a full tablet report...
I20260709 13:07:37.531057 23327 tablet_bootstrap.cc:654] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.531026 23329 raft_consensus.cc:493] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.531625 23329 raft_consensus.cc:515] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.528889 23331 ts_tablet_manager.cc:1434] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:07:37.534982 23331 tablet_bootstrap.cc:492] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0: Bootstrap starting.
I20260709 13:07:37.542840 23327 tablet_bootstrap.cc:492] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b: No bootstrap required, opened a new log
I20260709 13:07:37.543462 23327 ts_tablet_manager.cc:1403] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:07:37.547472 23329 leader_election.cc:290] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:37.554628 23335 tablet_bootstrap.cc:654] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.550420 23205 tablet_service.cc:1511] Processing CreateTablet for tablet 666fc116f63446f7b1a67dab4eef8a01 (DEFAULT_TABLE table=test-workload [id=c0f18accb7bf4234bd658449baff55b1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:37.573462 23331 tablet_bootstrap.cc:654] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.576565 23205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666fc116f63446f7b1a67dab4eef8a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.580238 23329 raft_consensus.cc:493] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.580839 23329 raft_consensus.cc:515] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.581599 23327 raft_consensus.cc:359] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.585543 23329 leader_election.cc:290] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285)
I20260709 13:07:37.582340 23327 raft_consensus.cc:385] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.586938 23327 raft_consensus.cc:740] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.588050 23327 consensus_queue.cc:260] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.590890 23327 ts_tablet_manager.cc:1434] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:07:37.592403 23327 tablet_bootstrap.cc:492] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b: Bootstrap starting.
I20260709 13:07:37.595921 23335 tablet_bootstrap.cc:492] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786: No bootstrap required, opened a new log
I20260709 13:07:37.596519 23335 ts_tablet_manager.cc:1403] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.008s
I20260709 13:07:37.601558 23335 raft_consensus.cc:359] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.603065 23335 raft_consensus.cc:385] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.603498 23335 raft_consensus.cc:740] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.604640 23335 consensus_queue.cc:260] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
W20260709 13:07:37.605549 23086 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:37.607532 23327 tablet_bootstrap.cc:654] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.619594 23327 tablet_bootstrap.cc:492] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b: No bootstrap required, opened a new log
I20260709 13:07:37.621973 23327 ts_tablet_manager.cc:1403] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.006s
I20260709 13:07:37.623662 23335 ts_tablet_manager.cc:1434] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.004s
I20260709 13:07:37.624679 23165 heartbeater.cc:499] Master 127.21.244.62:45155 was elected leader, sending a full tablet report...
I20260709 13:07:37.627136 23327 raft_consensus.cc:359] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.629520 23335 tablet_bootstrap.cc:492] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786: Bootstrap starting.
I20260709 13:07:37.630764 23327 raft_consensus.cc:385] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.631625 23327 raft_consensus.cc:740] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.633419 23327 consensus_queue.cc:260] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.639237 23327 ts_tablet_manager.cc:1434] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:07:37.639045 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23635aee6a1f486db9ba691690cd2ba5" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
I20260709 13:07:37.641204 23335 tablet_bootstrap.cc:654] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.640511 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385e3d41c104ba3aabd56504f6958de" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
W20260709 13:07:37.642616 23255 leader_election.cc:343] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:37.643467 23255 leader_election.cc:343] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.644368 23327 tablet_bootstrap.cc:492] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b: Bootstrap starting.
I20260709 13:07:37.647823 23331 tablet_bootstrap.cc:492] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0: No bootstrap required, opened a new log
I20260709 13:07:37.648502 23331 ts_tablet_manager.cc:1403] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0: Time spent bootstrapping tablet: real 0.114s	user 0.022s	sys 0.017s
I20260709 13:07:37.651911 23331 raft_consensus.cc:359] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.659101 23327 tablet_bootstrap.cc:654] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.655817 23214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385e3d41c104ba3aabd56504f6958de" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:37.655437 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23635aee6a1f486db9ba691690cd2ba5" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:37.659359 23331 raft_consensus.cc:385] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.659813 23331 raft_consensus.cc:740] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.659958 23215 raft_consensus.cc:2468] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 0.
W20260709 13:07:37.660944 23255 leader_election.cc:343] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.660815 23331 consensus_queue.cc:260] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.661602 23335 tablet_bootstrap.cc:492] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786: No bootstrap required, opened a new log
I20260709 13:07:37.661432 23255 leader_election.cc:304] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b; no voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:37.662055 23335 ts_tablet_manager.cc:1403] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.012s
I20260709 13:07:37.662662 23255 leader_election.cc:304] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:37.663131 23331 ts_tablet_manager.cc:1434] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.001s
I20260709 13:07:37.663868 23329 raft_consensus.cc:2749] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.664278 23331 tablet_bootstrap.cc:492] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0: Bootstrap starting.
I20260709 13:07:37.664568 23329 raft_consensus.cc:2804] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.664937 23329 raft_consensus.cc:493] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.665266 23329 raft_consensus.cc:3060] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.665210 23335 raft_consensus.cc:359] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.666116 23335 raft_consensus.cc:385] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.666424 23335 raft_consensus.cc:740] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.667428 23335 consensus_queue.cc:260] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.671888 23331 tablet_bootstrap.cc:654] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.673559 23329 raft_consensus.cc:515] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.678920 23331 tablet_bootstrap.cc:492] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0: No bootstrap required, opened a new log
I20260709 13:07:37.679481 23331 ts_tablet_manager.cc:1403] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 13:07:37.679857 23329 leader_election.cc:290] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:37.677879 23335 ts_tablet_manager.cc:1434] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:07:37.681244 23335 tablet_bootstrap.cc:492] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786: Bootstrap starting.
I20260709 13:07:37.682638 23331 raft_consensus.cc:359] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.683465 23331 raft_consensus.cc:385] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.683866 23331 raft_consensus.cc:740] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.685271 23327 tablet_bootstrap.cc:492] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b: No bootstrap required, opened a new log
I20260709 13:07:37.684911 23331 consensus_queue.cc:260] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.685755 23327 ts_tablet_manager.cc:1403] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.000s
I20260709 13:07:37.687806 23331 ts_tablet_manager.cc:1434] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:07:37.689137 23331 tablet_bootstrap.cc:492] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0: Bootstrap starting.
I20260709 13:07:37.688921 23327 raft_consensus.cc:359] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.689729 23327 raft_consensus.cc:385] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.690055 23327 raft_consensus.cc:740] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.690582 23335 tablet_bootstrap.cc:654] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.692497 23327 consensus_queue.cc:260] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.694299 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23635aee6a1f486db9ba691690cd2ba5" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
W20260709 13:07:37.695900 23255 leader_election.cc:343] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.696431 23331 tablet_bootstrap.cc:654] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.697085 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23635aee6a1f486db9ba691690cd2ba5" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:37.697685 23215 raft_consensus.cc:3060] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.702137 23327 ts_tablet_manager.cc:1434] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.005s
I20260709 13:07:37.711010 23327 tablet_bootstrap.cc:492] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b: Bootstrap starting.
I20260709 13:07:37.712358 23215 raft_consensus.cc:2468] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 1.
I20260709 13:07:37.713724 23255 leader_election.cc:304] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:37.715024 23345 raft_consensus.cc:2804] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.715534 23345 raft_consensus.cc:697] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Becoming Leader. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:37.716431 23345 consensus_queue.cc:237] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.717489 23327 tablet_bootstrap.cc:654] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.724161 23331 tablet_bootstrap.cc:492] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0: No bootstrap required, opened a new log
I20260709 13:07:37.723898 23335 tablet_bootstrap.cc:492] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786: No bootstrap required, opened a new log
I20260709 13:07:37.724390 23329 raft_consensus.cc:493] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.724821 23335 ts_tablet_manager.cc:1403] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.032s
I20260709 13:07:37.725472 23327 tablet_bootstrap.cc:492] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b: No bootstrap required, opened a new log
I20260709 13:07:37.724943 23329 raft_consensus.cc:515] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.726188 23327 ts_tablet_manager.cc:1403] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:07:37.727499 23329 leader_election.cc:290] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:37.728511 23335 raft_consensus.cc:359] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.729014 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
I20260709 13:07:37.729359 23335 raft_consensus.cc:385] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.729444 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:37.729828 23335 raft_consensus.cc:740] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.729817 23331 ts_tablet_manager.cc:1403] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.011s
W20260709 13:07:37.730520 23255 leader_election.cc:343] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:37.732275 23255 leader_election.cc:343] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.732749 23255 leader_election.cc:304] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b; no voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:37.729451 23327 raft_consensus.cc:359] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.733536 23329 raft_consensus.cc:2749] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.733878 23327 raft_consensus.cc:385] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.730917 23335 consensus_queue.cc:260] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.734230 23327 raft_consensus.cc:740] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.734460 23331 raft_consensus.cc:359] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.735332 23331 raft_consensus.cc:385] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.735042 23327 consensus_queue.cc:260] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.735704 23331 raft_consensus.cc:740] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.736367 23336 raft_consensus.cc:493] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.736665 23331 consensus_queue.cc:260] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.736886 23336 raft_consensus.cc:515] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.737613 23327 ts_tablet_manager.cc:1434] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:07:37.738652 23327 tablet_bootstrap.cc:492] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b: Bootstrap starting.
I20260709 13:07:37.745843 23327 tablet_bootstrap.cc:654] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.738683 23037 catalog_manager.cc:5697] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 078a3c9112864046b3984a52779f6f9b (127.21.244.3). New cstate: current_term: 1 leader_uuid: "078a3c9112864046b3984a52779f6f9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.754172 23336 leader_election.cc:290] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:37.761426 23329 raft_consensus.cc:493] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.762233 23329 raft_consensus.cc:515] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.764699 23329 leader_election.cc:290] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:37.766180 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
W20260709 13:07:37.768087 23255 leader_election.cc:343] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.768111 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:37.768976 23215 raft_consensus.cc:2468] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 0.
I20260709 13:07:37.770138 23335 ts_tablet_manager.cc:1434] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:07:37.770725 23255 leader_election.cc:304] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:37.772277 23329 raft_consensus.cc:2804] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.772807 23329 raft_consensus.cc:493] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.773239 23329 raft_consensus.cc:3060] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.777818 23335 tablet_bootstrap.cc:492] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786: Bootstrap starting.
I20260709 13:07:37.780061 23331 ts_tablet_manager.cc:1434] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent starting tablet: real 0.048s	user 0.017s	sys 0.026s
I20260709 13:07:37.786453 23331 tablet_bootstrap.cc:492] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0: Bootstrap starting.
I20260709 13:07:37.793668 23331 tablet_bootstrap.cc:654] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.795104 23352 raft_consensus.cc:493] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.795847 23352 raft_consensus.cc:515] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.797165 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b" is_pre_election: true
I20260709 13:07:37.798804 23352 leader_election.cc:290] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:37.800258 23335 tablet_bootstrap.cc:654] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.805930 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b" is_pre_election: true
I20260709 13:07:37.806905 23289 raft_consensus.cc:2468] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 0.
W20260709 13:07:37.808990 23180 leader_election.cc:343] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.815236 23327 tablet_bootstrap.cc:492] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b: No bootstrap required, opened a new log
I20260709 13:07:37.815718 23327 ts_tablet_manager.cc:1403] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b: Time spent bootstrapping tablet: real 0.077s	user 0.027s	sys 0.043s
I20260709 13:07:37.811301 23180 leader_election.cc:304] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 
I20260709 13:07:37.818446 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
I20260709 13:07:37.819674 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
I20260709 13:07:37.821117 23327 raft_consensus.cc:359] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.821609 23327 raft_consensus.cc:385] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:37.821334 23181 leader_election.cc:343] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.821900 23327 raft_consensus.cc:740] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.822173 23181 leader_election.cc:304] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0; no voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:37.822517 23327 consensus_queue.cc:260] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
W20260709 13:07:37.823841 23181 leader_election.cc:343] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.824254 23327 ts_tablet_manager.cc:1434] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:37.825129 23327 tablet_bootstrap.cc:492] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b: Bootstrap starting.
I20260709 13:07:37.825035 23336 raft_consensus.cc:2804] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.825784 23336 raft_consensus.cc:493] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.826280 23336 raft_consensus.cc:3060] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.831141 23327 tablet_bootstrap.cc:654] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.819427 23329 raft_consensus.cc:515] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.839461 23352 raft_consensus.cc:2749] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.840853 23342 raft_consensus.cc:493] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.841508 23342 raft_consensus.cc:515] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.842432 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
W20260709 13:07:37.844511 23255 leader_election.cc:343] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.847455 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:37.848245 23215 raft_consensus.cc:3060] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.853091 23342 leader_election.cc:290] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:37.856990 23215 raft_consensus.cc:2468] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 1.
I20260709 13:07:37.858254 23255 leader_election.cc:304] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:37.859272 23345 raft_consensus.cc:2804] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.838568 23336 raft_consensus.cc:515] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.865280 23329 leader_election.cc:290] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:37.866761 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
W20260709 13:07:37.868942 23181 leader_election.cc:343] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.872547 23342 raft_consensus.cc:493] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.873126 23342 raft_consensus.cc:515] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.874300 23336 leader_election.cc:290] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:37.874523 23329 raft_consensus.cc:493] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.875605 23342 leader_election.cc:290] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:37.875139 23329 raft_consensus.cc:515] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.876850 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:37.877468 23289 raft_consensus.cc:3060] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.877635 23335 tablet_bootstrap.cc:492] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786: No bootstrap required, opened a new log
I20260709 13:07:37.878167 23335 ts_tablet_manager.cc:1403] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.024s
I20260709 13:07:37.879050 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
I20260709 13:07:37.881117 23214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666fc116f63446f7b1a67dab4eef8a01" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
W20260709 13:07:37.881290 23255 leader_election.cc:343] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.881549 23335 raft_consensus.cc:359] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.882412 23335 raft_consensus.cc:385] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.882799 23335 raft_consensus.cc:740] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.883177 23345 raft_consensus.cc:697] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Becoming Leader. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
W20260709 13:07:37.884155 23106 leader_election.cc:343] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.884869 23345 consensus_queue.cc:237] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.888033 23331 tablet_bootstrap.cc:492] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0: No bootstrap required, opened a new log
I20260709 13:07:37.888628 23331 ts_tablet_manager.cc:1403] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0: Time spent bootstrapping tablet: real 0.102s	user 0.021s	sys 0.026s
I20260709 13:07:37.890050 23289 raft_consensus.cc:2468] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 1.
I20260709 13:07:37.890286 23214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:37.891574 23180 leader_election.cc:304] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:37.891932 23331 raft_consensus.cc:359] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
W20260709 13:07:37.892601 23255 leader_election.cc:343] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.893057 23336 raft_consensus.cc:2804] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.893353 23255 leader_election.cc:304] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b; no voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:37.892715 23331 raft_consensus.cc:385] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.895008 23331 raft_consensus.cc:740] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.895138 23364 raft_consensus.cc:2749] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.895972 23331 consensus_queue.cc:260] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.883692 23335 consensus_queue.cc:260] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.884928 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891e2e9c7c2b4a4099d4e97d0d981f91" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:37.897581 23329 leader_election.cc:290] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
W20260709 13:07:37.899067 23106 leader_election.cc:343] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.899995 23336 raft_consensus.cc:697] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 LEADER]: Becoming Leader. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:37.906394 23336 consensus_queue.cc:237] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.911170 23335 ts_tablet_manager.cc:1434] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.005s
I20260709 13:07:37.915532 23327 tablet_bootstrap.cc:492] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b: No bootstrap required, opened a new log
I20260709 13:07:37.916081 23327 ts_tablet_manager.cc:1403] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b: Time spent bootstrapping tablet: real 0.091s	user 0.028s	sys 0.033s
I20260709 13:07:37.917668 23364 raft_consensus.cc:493] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.917964 23329 raft_consensus.cc:493] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.918850 23364 raft_consensus.cc:515] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.920115 23329 raft_consensus.cc:515] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.920817 23331 ts_tablet_manager.cc:1434] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0: Time spent starting tablet: real 0.032s	user 0.019s	sys 0.005s
I20260709 13:07:37.920420 23327 raft_consensus.cc:359] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.921288 23327 raft_consensus.cc:385] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.921569 23327 raft_consensus.cc:740] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.921712 23364 leader_election.cc:290] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:37.922052 23329 leader_election.cc:290] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:37.922209 23331 tablet_bootstrap.cc:492] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0: Bootstrap starting.
I20260709 13:07:37.922454 23327 consensus_queue.cc:260] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.923955 23335 tablet_bootstrap.cc:492] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786: Bootstrap starting.
I20260709 13:07:37.924549 23327 ts_tablet_manager.cc:1434] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:07:37.925630 23214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:37.925722 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
I20260709 13:07:37.926539 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
I20260709 13:07:37.927767 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:37.928092 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666fc116f63446f7b1a67dab4eef8a01" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b" is_pre_election: true
I20260709 13:07:37.930068 23331 tablet_bootstrap.cc:654] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:37.931550 23255 leader_election.cc:343] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:37.932336 23255 leader_election.cc:343] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:37.932525 23105 leader_election.cc:343] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.932700 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891e2e9c7c2b4a4099d4e97d0d981f91" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b" is_pre_election: true
I20260709 13:07:37.932994 23105 leader_election.cc:304] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f59e800427c4b22816a6a161c3b1786; no voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0
I20260709 13:07:37.933362 23289 raft_consensus.cc:2468] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 0.
I20260709 13:07:37.934195 23342 raft_consensus.cc:2749] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.935681 23105 leader_election.cc:304] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 31a4b72b8eaf4c9e973424c330559fa0
I20260709 13:07:37.937033 23335 tablet_bootstrap.cc:654] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:37.936920 23255 leader_election.cc:343] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.937517 23255 leader_election.cc:304] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b; no voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:37.938282 23329 raft_consensus.cc:2749] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.938853 23342 raft_consensus.cc:2804] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.939218 23342 raft_consensus.cc:493] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.939568 23342 raft_consensus.cc:3060] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.940408 23327 tablet_bootstrap.cc:492] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b: Bootstrap starting.
W20260709 13:07:37.939796 23255 leader_election.cc:343] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.945586 23255 leader_election.cc:304] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b; no voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:37.946420 23329 raft_consensus.cc:2749] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.945729 23037 catalog_manager.cc:5697] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 078a3c9112864046b3984a52779f6f9b (127.21.244.3). New cstate: current_term: 1 leader_uuid: "078a3c9112864046b3984a52779f6f9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.949486 23342 raft_consensus.cc:515] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.950305 23327 tablet_bootstrap.cc:654] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.953433 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891e2e9c7c2b4a4099d4e97d0d981f91" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:37.953966 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891e2e9c7c2b4a4099d4e97d0d981f91" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:37.954523 23289 raft_consensus.cc:3060] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:37.955384 23106 leader_election.cc:343] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.961557 23289 raft_consensus.cc:2468] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 1.
I20260709 13:07:37.966120 23105 leader_election.cc:304] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 31a4b72b8eaf4c9e973424c330559fa0
I20260709 13:07:37.966517 23037 catalog_manager.cc:5697] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.968047 23336 raft_consensus.cc:493] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.968575 23336 raft_consensus.cc:515] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.970758 23336 leader_election.cc:290] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:37.971604 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385e3d41c104ba3aabd56504f6958de" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
I20260709 13:07:37.971932 23342 leader_election.cc:290] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:37.972548 23139 raft_consensus.cc:2468] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 0.
I20260709 13:07:37.974428 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385e3d41c104ba3aabd56504f6958de" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b" is_pre_election: true
I20260709 13:07:37.975157 23289 raft_consensus.cc:2468] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 0.
I20260709 13:07:37.974963 23181 leader_election.cc:304] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:37.976783 23336 raft_consensus.cc:2804] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.977146 23336 raft_consensus.cc:493] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.977481 23336 raft_consensus.cc:3060] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.980201 23331 tablet_bootstrap.cc:492] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0: No bootstrap required, opened a new log
I20260709 13:07:37.980801 23331 ts_tablet_manager.cc:1403] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.006s
I20260709 13:07:37.983915 23327 tablet_bootstrap.cc:492] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b: No bootstrap required, opened a new log
I20260709 13:07:37.983659 23331 raft_consensus.cc:359] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.984356 23327 ts_tablet_manager.cc:1403] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.006s
I20260709 13:07:37.984869 23336 raft_consensus.cc:515] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.984418 23331 raft_consensus.cc:385] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.986641 23331 raft_consensus.cc:740] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.987113 23336 leader_election.cc:290] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:37.973043 23342 raft_consensus.cc:2804] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.987843 23342 raft_consensus.cc:697] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:37.987573 23331 consensus_queue.cc:260] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.988865 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385e3d41c104ba3aabd56504f6958de" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:37.989025 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385e3d41c104ba3aabd56504f6958de" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:37.988690 23342 consensus_queue.cc:237] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.989470 23139 raft_consensus.cc:3060] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.989602 23288 raft_consensus.cc:3060] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.989835 23335 tablet_bootstrap.cc:492] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786: No bootstrap required, opened a new log
I20260709 13:07:37.990517 23335 ts_tablet_manager.cc:1403] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.022s
I20260709 13:07:37.993583 23335 raft_consensus.cc:359] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:37.994244 23335 raft_consensus.cc:385] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.994554 23335 raft_consensus.cc:740] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.996729 23331 ts_tablet_manager.cc:1434] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:07:37.997767 23331 tablet_bootstrap.cc:492] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0: Bootstrap starting.
I20260709 13:07:38.000234 23288 raft_consensus.cc:2468] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 1.
I20260709 13:07:38.004396 23331 tablet_bootstrap.cc:654] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.995254 23335 consensus_queue.cc:260] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.005775 23180 leader_election.cc:304] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 
I20260709 13:07:38.006747 23336 raft_consensus.cc:2804] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.007252 23336 raft_consensus.cc:697] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 LEADER]: Becoming Leader. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:38.008113 23336 consensus_queue.cc:237] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.013020 23036 catalog_manager.cc:5697] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.017247 23139 raft_consensus.cc:2468] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 1.
I20260709 13:07:38.019336 23327 raft_consensus.cc:359] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.020630 23327 raft_consensus.cc:385] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.021246 23327 raft_consensus.cc:740] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.022225 23327 consensus_queue.cc:260] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.021551 23331 tablet_bootstrap.cc:492] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0: No bootstrap required, opened a new log
I20260709 13:07:38.023444 23331 ts_tablet_manager.cc:1403] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.005s
I20260709 13:07:38.024494 23327 ts_tablet_manager.cc:1434] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:07:38.026391 23331 raft_consensus.cc:359] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.027129 23331 raft_consensus.cc:385] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.027446 23331 raft_consensus.cc:740] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.028199 23331 consensus_queue.cc:260] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.031497 23335 ts_tablet_manager.cc:1434] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786: Time spent starting tablet: real 0.041s	user 0.013s	sys 0.000s
I20260709 13:07:38.032598 23335 tablet_bootstrap.cc:492] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786: Bootstrap starting.
I20260709 13:07:38.037978 23037 catalog_manager.cc:5697] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.039188 23335 tablet_bootstrap.cc:654] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.040056 23331 ts_tablet_manager.cc:1434] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:07:38.041191 23331 tablet_bootstrap.cc:492] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0: Bootstrap starting.
I20260709 13:07:38.047477 23335 tablet_bootstrap.cc:492] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786: No bootstrap required, opened a new log
I20260709 13:07:38.047993 23335 ts_tablet_manager.cc:1403] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.005s
I20260709 13:07:38.048156 23331 tablet_bootstrap.cc:654] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.051054 23335 raft_consensus.cc:359] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.051628 23335 raft_consensus.cc:385] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.051951 23335 raft_consensus.cc:740] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.053017 23331 tablet_bootstrap.cc:492] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0: No bootstrap required, opened a new log
I20260709 13:07:38.052796 23335 consensus_queue.cc:260] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.053467 23331 ts_tablet_manager.cc:1403] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:07:38.054867 23335 ts_tablet_manager.cc:1434] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:38.055886 23335 tablet_bootstrap.cc:492] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786: Bootstrap starting.
I20260709 13:07:38.058967 23331 raft_consensus.cc:359] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.059752 23331 raft_consensus.cc:385] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.060047 23331 raft_consensus.cc:740] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.060737 23331 consensus_queue.cc:260] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.062156 23335 tablet_bootstrap.cc:654] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.062781 23331 ts_tablet_manager.cc:1434] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:07:38.063126 23329 raft_consensus.cc:493] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.063620 23329 raft_consensus.cc:515] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.065680 23329 leader_election.cc:290] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:38.066315 23331 tablet_bootstrap.cc:492] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0: Bootstrap starting.
I20260709 13:07:38.066759 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
I20260709 13:07:38.067198 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:38.067376 23139 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 0.
I20260709 13:07:38.067819 23215 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 0.
I20260709 13:07:38.068420 23255 leader_election.cc:304] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.069237 23329 raft_consensus.cc:2804] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.069590 23329 raft_consensus.cc:493] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.069947 23329 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.075065 23329 raft_consensus.cc:515] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.077340 23335 tablet_bootstrap.cc:492] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786: No bootstrap required, opened a new log
I20260709 13:07:38.077790 23331 tablet_bootstrap.cc:654] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.077848 23335 ts_tablet_manager.cc:1403] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:07:38.077968 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:38.078596 23139 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.080899 23335 raft_consensus.cc:359] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.081578 23335 raft_consensus.cc:385] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.081883 23335 raft_consensus.cc:740] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.081821 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:38.082757 23215 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.082861 23335 consensus_queue.cc:260] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.085731 23335 ts_tablet_manager.cc:1434] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:38.086807 23335 tablet_bootstrap.cc:492] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786: Bootstrap starting.
I20260709 13:07:38.088706 23331 tablet_bootstrap.cc:492] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0: No bootstrap required, opened a new log
I20260709 13:07:38.088964 23139 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 1.
I20260709 13:07:38.089180 23331 ts_tablet_manager.cc:1403] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.009s
I20260709 13:07:38.090327 23255 leader_election.cc:304] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.090636 23329 leader_election.cc:290] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:38.091261 23329 raft_consensus.cc:2804] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.092833 23329 raft_consensus.cc:697] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Becoming Leader. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:38.092300 23331 raft_consensus.cc:359] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.093380 23331 raft_consensus.cc:385] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.093668 23331 raft_consensus.cc:740] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.094116 23329 consensus_queue.cc:237] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.094455 23331 consensus_queue.cc:260] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.096526 23331 ts_tablet_manager.cc:1434] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:38.094731 23215 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 1.
I20260709 13:07:38.097398 23331 tablet_bootstrap.cc:492] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0: Bootstrap starting.
I20260709 13:07:38.098242 23335 tablet_bootstrap.cc:654] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.104923 23331 tablet_bootstrap.cc:654] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.114023 23335 tablet_bootstrap.cc:492] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786: No bootstrap required, opened a new log
I20260709 13:07:38.114409 23331 tablet_bootstrap.cc:492] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0: No bootstrap required, opened a new log
I20260709 13:07:38.114490 23335 ts_tablet_manager.cc:1403] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.005s
I20260709 13:07:38.114909 23331 ts_tablet_manager.cc:1403] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.002s
I20260709 13:07:38.117519 23331 raft_consensus.cc:359] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.117347 23335 raft_consensus.cc:359] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.118214 23331 raft_consensus.cc:385] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.118371 23335 raft_consensus.cc:385] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.118535 23331 raft_consensus.cc:740] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.118669 23335 raft_consensus.cc:740] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.119267 23335 consensus_queue.cc:260] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.119230 23331 consensus_queue.cc:260] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.121460 23335 ts_tablet_manager.cc:1434] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:38.122364 23331 ts_tablet_manager.cc:1434] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:38.122891 23335 tablet_bootstrap.cc:492] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786: Bootstrap starting.
I20260709 13:07:38.124617 23036 catalog_manager.cc:5697] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 078a3c9112864046b3984a52779f6f9b (127.21.244.3). New cstate: current_term: 1 leader_uuid: "078a3c9112864046b3984a52779f6f9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:38.129298 23335 tablet_bootstrap.cc:654] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.137317 23335 tablet_bootstrap.cc:492] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786: No bootstrap required, opened a new log
I20260709 13:07:38.137810 23335 ts_tablet_manager.cc:1403] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786: Time spent bootstrapping tablet: real 0.015s	user 0.001s	sys 0.011s
I20260709 13:07:38.139882 23335 raft_consensus.cc:359] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.140336 23335 raft_consensus.cc:385] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.140580 23335 raft_consensus.cc:740] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.141181 23335 consensus_queue.cc:260] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.142803 23335 ts_tablet_manager.cc:1434] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:38.143935 23335 tablet_bootstrap.cc:492] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786: Bootstrap starting.
I20260709 13:07:38.148348 23335 tablet_bootstrap.cc:654] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.153331 23335 tablet_bootstrap.cc:492] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786: No bootstrap required, opened a new log
I20260709 13:07:38.153807 23335 ts_tablet_manager.cc:1403] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:38.156045 23335 raft_consensus.cc:359] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.156507 23335 raft_consensus.cc:385] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.156798 23335 raft_consensus.cc:740] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.157387 23335 consensus_queue.cc:260] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.159024 23335 ts_tablet_manager.cc:1434] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:38.159651 23373 raft_consensus.cc:493] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.160158 23373 raft_consensus.cc:515] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.162653 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:38.163198 23215 raft_consensus.cc:2468] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 0.
I20260709 13:07:38.163566 23373 leader_election.cc:290] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.163080 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b" is_pre_election: true
I20260709 13:07:38.164198 23106 leader_election.cc:304] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.164275 23288 raft_consensus.cc:2468] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 0.
I20260709 13:07:38.165088 23373 raft_consensus.cc:2804] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.165661 23373 raft_consensus.cc:493] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.166047 23373 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.171132 23373 raft_consensus.cc:515] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.172751 23373 leader_election.cc:290] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.173575 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:38.173753 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:38.174106 23215 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.174446 23288 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.176877 23139 raft_consensus.cc:3060] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.179497 23288 raft_consensus.cc:2468] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 1.
I20260709 13:07:38.180701 23105 leader_election.cc:304] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.181563 23373 raft_consensus.cc:2804] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.182405 23215 raft_consensus.cc:2468] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 1.
I20260709 13:07:38.182500 23373 raft_consensus.cc:697] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:38.184365 23329 consensus_queue.cc:1048] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.184353 23373 consensus_queue.cc:237] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.185622 23364 consensus_queue.cc:1048] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.208061 23037 catalog_manager.cc:5697] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.224877 23373 raft_consensus.cc:493] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.225374 23373 raft_consensus.cc:515] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.227583 23373 leader_election.cc:290] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.228757 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:38.228757 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b" is_pre_election: true
I20260709 13:07:38.230171 23288 raft_consensus.cc:2393] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f59e800427c4b22816a6a161c3b1786 in current term 1: Already voted for candidate 31a4b72b8eaf4c9e973424c330559fa0 in this term.
I20260709 13:07:38.231240 23105 leader_election.cc:304] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f59e800427c4b22816a6a161c3b1786; no voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0
I20260709 13:07:38.231957 23373 raft_consensus.cc:3060] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.237468 23373 raft_consensus.cc:2749] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.265360 23139 raft_consensus.cc:3060] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.271891 23345 consensus_queue.cc:1048] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:38.286311 23310 debug-util.cc:398] Leaking SignalData structure 0x7b080018cca0 after lost signal to thread 22483
W20260709 13:07:38.287925 23310 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca920 after lost signal to thread 23072
I20260709 13:07:38.290261 23392 consensus_queue.cc:1048] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.328402 23392 raft_consensus.cc:493] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.328862 23373 raft_consensus.cc:493] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.328958 23392 raft_consensus.cc:515] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.329581 23373 raft_consensus.cc:515] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.331369 23392 leader_election.cc:290] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:38.332513 23342 raft_consensus.cc:493] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.332993 23342 raft_consensus.cc:515] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.333313 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b" is_pre_election: true
I20260709 13:07:38.333804 23214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:38.334085 23288 raft_consensus.cc:2468] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 0.
I20260709 13:07:38.334443 23214 raft_consensus.cc:2468] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 0.
I20260709 13:07:38.335091 23342 leader_election.cc:290] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.336170 23105 leader_election.cc:304] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.337268 23371 raft_consensus.cc:2804] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.332993 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666fc116f63446f7b1a67dab4eef8a01" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
I20260709 13:07:38.337729 23371 raft_consensus.cc:493] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.338312 23139 raft_consensus.cc:2468] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 0.
I20260709 13:07:38.338685 23371 raft_consensus.cc:3060] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.339681 23336 consensus_queue.cc:1048] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.340585 23255 leader_election.cc:304] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.339865 23214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:38.341671 23214 raft_consensus.cc:2468] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 0.
I20260709 13:07:38.342582 23392 raft_consensus.cc:2804] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.342900 23106 leader_election.cc:304] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.343075 23392 raft_consensus.cc:493] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.343545 23392 raft_consensus.cc:3060] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.343793 23342 raft_consensus.cc:2804] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.344162 23342 raft_consensus.cc:493] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.344275 23373 leader_election.cc:290] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.344175 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b" is_pre_election: true
I20260709 13:07:38.346139 23288 raft_consensus.cc:2468] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 0.
I20260709 13:07:38.344568 23342 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.353082 23392 raft_consensus.cc:515] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.357333 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666fc116f63446f7b1a67dab4eef8a01" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:38.358156 23140 raft_consensus.cc:3060] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.360129 23371 raft_consensus.cc:515] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.363327 23214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:38.363976 23214 raft_consensus.cc:3060] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.370324 23140 raft_consensus.cc:2468] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 1.
I20260709 13:07:38.374603 23214 raft_consensus.cc:2468] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 1.
I20260709 13:07:38.375450 23255 leader_election.cc:304] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.375962 23106 leader_election.cc:304] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.376967 23373 raft_consensus.cc:2804] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.377302 23364 raft_consensus.cc:2804] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.377548 23373 raft_consensus.cc:697] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:38.377926 23364 raft_consensus.cc:697] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Becoming Leader. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:38.378567 23373 consensus_queue.cc:237] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.379087 23364 consensus_queue.cc:237] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.355535 23342 raft_consensus.cc:515] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.336275 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666fc116f63446f7b1a67dab4eef8a01" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0" is_pre_election: true
I20260709 13:07:38.372906 23213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666fc116f63446f7b1a67dab4eef8a01" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:38.384819 23213 raft_consensus.cc:3060] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.386008 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:38.386696 23288 raft_consensus.cc:3060] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.394483 23288 raft_consensus.cc:2468] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 1.
I20260709 13:07:38.396180 23371 leader_election.cc:290] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.373772 23392 leader_election.cc:290] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 1 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:38.398486 23213 raft_consensus.cc:2468] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 1.
I20260709 13:07:38.399483 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:38.405861 23215 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.400416 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:38.407703 23035 catalog_manager.cc:5697] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 078a3c9112864046b3984a52779f6f9b (127.21.244.3). New cstate: current_term: 1 leader_uuid: "078a3c9112864046b3984a52779f6f9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:38.408571 23289 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.416989 23215 raft_consensus.cc:2468] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 1.
I20260709 13:07:38.401547 23342 leader_election.cc:290] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.418555 23106 leader_election.cc:304] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.419600 23342 raft_consensus.cc:2804] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.420197 23342 raft_consensus.cc:697] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:38.423382 23342 consensus_queue.cc:237] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.425860 23365 consensus_queue.cc:1048] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:07:38.426525 23289 raft_consensus.cc:2468] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 1.
I20260709 13:07:38.430666 23036 catalog_manager.cc:5697] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.432072 23365 raft_consensus.cc:493] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.434532 23365 raft_consensus.cc:515] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.437402 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891e2e9c7c2b4a4099d4e97d0d981f91" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f59e800427c4b22816a6a161c3b1786" is_pre_election: true
I20260709 13:07:38.439599 23365 leader_election.cc:290] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.440786 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891e2e9c7c2b4a4099d4e97d0d981f91" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "078a3c9112864046b3984a52779f6f9b" is_pre_election: true
I20260709 13:07:38.441679 23288 raft_consensus.cc:2393] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31a4b72b8eaf4c9e973424c330559fa0 in current term 1: Already voted for candidate 5f59e800427c4b22816a6a161c3b1786 in this term.
I20260709 13:07:38.443688 23180 leader_election.cc:304] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0; no voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:38.445000 23365 raft_consensus.cc:3060] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.456669 23365 raft_consensus.cc:2749] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.460224 23036 catalog_manager.cc:5697] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.492436 23365 consensus_queue.cc:1048] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.504536 23365 consensus_queue.cc:1048] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.539084 23342 consensus_queue.cc:1048] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.557392 23373 consensus_queue.cc:1048] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.567538 23213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f385e3d41c104ba3aabd56504f6958de"
dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
mode: GRACEFUL
new_leader_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55188
I20260709 13:07:38.568190 23213 raft_consensus.cc:606] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 LEADER]: Received request to transfer leadership to TS 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:38.588194 23289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae"
dest_uuid: "078a3c9112864046b3984a52779f6f9b"
mode: GRACEFUL
new_leader_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:33558
I20260709 13:07:38.588868 23289 raft_consensus.cc:606] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Received request to transfer leadership to TS 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:38.595927 23289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23635aee6a1f486db9ba691690cd2ba5"
dest_uuid: "078a3c9112864046b3984a52779f6f9b"
mode: GRACEFUL
new_leader_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:33558
I20260709 13:07:38.596570 23289 raft_consensus.cc:606] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Received request to transfer leadership to TS 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:38.605181 23215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12"
dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
mode: GRACEFUL
new_leader_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55188
I20260709 13:07:38.605815 23215 raft_consensus.cc:606] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 LEADER]: Received request to transfer leadership to TS 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:38.612350 23289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25"
dest_uuid: "078a3c9112864046b3984a52779f6f9b"
mode: GRACEFUL
new_leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:33558
I20260709 13:07:38.613022 23289 raft_consensus.cc:606] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Received request to transfer leadership to TS 31a4b72b8eaf4c9e973424c330559fa0
I20260709 13:07:38.629813 23139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
mode: GRACEFUL
new_leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:55324
I20260709 13:07:38.630523 23139 raft_consensus.cc:606] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Received request to transfer leadership to TS 31a4b72b8eaf4c9e973424c330559fa0
I20260709 13:07:38.637195 23139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
mode: GRACEFUL
new_leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:55324
I20260709 13:07:38.637846 23139 raft_consensus.cc:606] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Received request to transfer leadership to TS 31a4b72b8eaf4c9e973424c330559fa0
I20260709 13:07:38.643823 23139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "891e2e9c7c2b4a4099d4e97d0d981f91"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
mode: GRACEFUL
new_leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:55324
I20260709 13:07:38.644496 23139 raft_consensus.cc:606] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Received request to transfer leadership to TS 31a4b72b8eaf4c9e973424c330559fa0
I20260709 13:07:38.662204 23364 consensus_queue.cc:1048] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.670116 23392 raft_consensus.cc:993] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b: : Instructing follower 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:38.670640 23392 raft_consensus.cc:1081] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Signalling peer 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:38.673141 23140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55300
I20260709 13:07:38.677982 23140 raft_consensus.cc:493] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.678530 23140 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.678282 23329 consensus_queue.cc:1048] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.689507 23140 raft_consensus.cc:515] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.695483 23140 leader_election.cc:290] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 2 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.697307 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:38.697431 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:38.698136 23289 raft_consensus.cc:3055] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.698316 23215 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.698580 23289 raft_consensus.cc:740] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:38.699595 23289 consensus_queue.cc:260] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.700834 23289 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.706717 23215 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 2.
I20260709 13:07:38.708105 23106 leader_election.cc:304] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.709065 23373 raft_consensus.cc:2804] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.709571 23373 raft_consensus.cc:697] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:38.710434 23289 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 2.
I20260709 13:07:38.710471 23373 consensus_queue.cc:237] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.719094 23038 catalog_manager.cc:5697] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 1 to 2, leader changed from 078a3c9112864046b3984a52779f6f9b (127.21.244.3) to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.725245 23329 raft_consensus.cc:993] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b: : Instructing follower 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:38.725790 23364 raft_consensus.cc:1081] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Signalling peer 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:38.727820 23140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23635aee6a1f486db9ba691690cd2ba5"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55300
I20260709 13:07:38.728459 23140 raft_consensus.cc:493] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.728935 23140 raft_consensus.cc:3060] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.735594 23373 consensus_queue.cc:1048] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.736101 23140 raft_consensus.cc:515] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.738945 23215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23635aee6a1f486db9ba691690cd2ba5" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:38.739108 23140 leader_election.cc:290] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 2 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.739650 23215 raft_consensus.cc:3060] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.739898 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23635aee6a1f486db9ba691690cd2ba5" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:38.740554 23288 raft_consensus.cc:3055] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.740914 23288 raft_consensus.cc:740] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:38.742069 23288 consensus_queue.cc:260] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.743585 23288 raft_consensus.cc:3060] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.745043 23215 raft_consensus.cc:2468] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 2.
I20260709 13:07:38.746443 23106 leader_election.cc:304] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.747612 23373 raft_consensus.cc:2804] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.748555 23373 raft_consensus.cc:697] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:38.749919 23373 consensus_queue.cc:237] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.753518 23288 raft_consensus.cc:2468] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 2.
I20260709 13:07:38.760571 23038 catalog_manager.cc:5697] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 1 to 2, leader changed from 078a3c9112864046b3984a52779f6f9b (127.21.244.3) to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.767980 23342 consensus_queue.cc:1048] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.781246 23342 raft_consensus.cc:993] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786: : Instructing follower 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:38.781756 23342 raft_consensus.cc:1081] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Signalling peer 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:38.783833 23215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd"
dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:55172
I20260709 13:07:38.784494 23215 raft_consensus.cc:493] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.784911 23215 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.791510 23215 raft_consensus.cc:515] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.794983 23215 leader_election.cc:290] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 2 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.795397 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:38.796109 23140 raft_consensus.cc:3055] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.796365 23140 raft_consensus.cc:740] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:38.796309 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:38.797150 23288 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.797400 23140 consensus_queue.cc:260] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.798422 23140 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.808606 23288 raft_consensus.cc:2468] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 2.
I20260709 13:07:38.810393 23180 leader_election.cc:304] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 
I20260709 13:07:38.811582 23401 raft_consensus.cc:2804] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.812173 23401 raft_consensus.cc:697] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Becoming Leader. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:38.813156 23401 consensus_queue.cc:237] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.814607 23364 consensus_queue.cc:1048] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.817028 23140 raft_consensus.cc:2468] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 2.
I20260709 13:07:38.823964 23037 catalog_manager.cc:5697] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 reported cstate change: term changed from 1 to 2, leader changed from 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1) to 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.830413 23371 consensus_queue.cc:1048] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.832015 23371 consensus_queue.cc:1048] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.842687 23329 consensus_queue.cc:1048] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.863883 23345 raft_consensus.cc:993] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b: : Instructing follower 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:38.864506 23345 raft_consensus.cc:1081] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Signalling peer 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:38.867295 23371 raft_consensus.cc:993] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786: : Instructing follower 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:38.867844 23371 raft_consensus.cc:1081] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Signalling peer 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:38.875036 23394 consensus_queue.cc:1048] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.879159 23214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1"
dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:55172
I20260709 13:07:38.879873 23214 raft_consensus.cc:493] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.880304 23214 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.886076 23213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25"
dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:55156
I20260709 13:07:38.886754 23213 raft_consensus.cc:493] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.887151 23213 raft_consensus.cc:3060] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.893041 23214 raft_consensus.cc:515] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.896219 23394 consensus_queue.cc:1048] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.896593 23214 leader_election.cc:290] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 2 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.897729 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:38.899667 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:38.900285 23213 raft_consensus.cc:515] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.900296 23139 raft_consensus.cc:3055] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.901208 23139 raft_consensus.cc:740] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:38.902136 23139 consensus_queue.cc:260] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.903324 23139 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.904541 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:38.905131 23140 raft_consensus.cc:3060] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.919288 23140 raft_consensus.cc:2468] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 2.
I20260709 13:07:38.921077 23181 leader_election.cc:304] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.922422 23401 raft_consensus.cc:2804] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.923080 23401 raft_consensus.cc:697] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Becoming Leader. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:38.924530 23401 consensus_queue.cc:237] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.927893 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:38.928597 23289 raft_consensus.cc:3055] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.928997 23289 raft_consensus.cc:740] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:38.930006 23289 consensus_queue.cc:260] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.931298 23289 raft_consensus.cc:3060] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.936844 23139 raft_consensus.cc:2468] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 2.
I20260709 13:07:38.938577 23181 leader_election.cc:304] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786; no voters: 078a3c9112864046b3984a52779f6f9b
I20260709 13:07:38.940274 23401 raft_consensus.cc:2804] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.940943 23401 raft_consensus.cc:697] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Becoming Leader. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:38.941032 23213 leader_election.cc:290] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 2 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.942090 23401 consensus_queue.cc:237] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.945539 23289 raft_consensus.cc:2468] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 2.
I20260709 13:07:38.951855 23365 raft_consensus.cc:993] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0: : Instructing follower 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:38.952797 23336 raft_consensus.cc:1081] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 LEADER]: Signalling peer 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:38.954615 23140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f385e3d41c104ba3aabd56504f6958de"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55314
I20260709 13:07:38.955262 23140 raft_consensus.cc:493] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.955662 23140 raft_consensus.cc:3060] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.963162 23140 raft_consensus.cc:515] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.966144 23140 leader_election.cc:290] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 2 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:38.965332 23038 catalog_manager.cc:5697] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 reported cstate change: term changed from 1 to 2, leader changed from 078a3c9112864046b3984a52779f6f9b (127.21.244.3) to 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.967262 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385e3d41c104ba3aabd56504f6958de" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:38.967826 23214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385e3d41c104ba3aabd56504f6958de" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:38.967983 23289 raft_consensus.cc:3060] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.968550 23214 raft_consensus.cc:3055] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.968957 23214 raft_consensus.cc:740] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:38.968329 23038 catalog_manager.cc:5697] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 reported cstate change: term changed from 1 to 2, leader changed from 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1) to 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.969869 23214 consensus_queue.cc:260] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.971297 23214 raft_consensus.cc:3060] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.976212 23289 raft_consensus.cc:2468] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 2.
I20260709 13:07:38.977878 23105 leader_election.cc:304] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:38.978792 23394 raft_consensus.cc:2804] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.979292 23394 raft_consensus.cc:697] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:38.979562 23214 raft_consensus.cc:2468] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 2.
I20260709 13:07:38.980249 23394 consensus_queue.cc:237] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:38.988830 23038 catalog_manager.cc:5697] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 1 to 2, leader changed from 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2) to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.023526 23365 raft_consensus.cc:993] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0: : Instructing follower 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:39.024163 23419 raft_consensus.cc:1081] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 LEADER]: Signalling peer 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:39.025938 23140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55314
I20260709 13:07:39.026234 23342 raft_consensus.cc:993] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786: : Instructing follower 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:39.026599 23140 raft_consensus.cc:493] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.026757 23394 raft_consensus.cc:1081] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Signalling peer 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:39.027062 23140 raft_consensus.cc:3060] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.028384 23214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "891e2e9c7c2b4a4099d4e97d0d981f91"
dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:55172
I20260709 13:07:39.028874 23214 raft_consensus.cc:493] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.029184 23214 raft_consensus.cc:3060] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.034394 23214 raft_consensus.cc:515] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:39.034574 23140 raft_consensus.cc:515] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:39.036360 23214 leader_election.cc:290] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 2 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:39.037189 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891e2e9c7c2b4a4099d4e97d0d981f91" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:39.037490 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891e2e9c7c2b4a4099d4e97d0d981f91" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:39.037804 23139 raft_consensus.cc:3055] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:39.038007 23289 raft_consensus.cc:3060] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.038166 23139 raft_consensus.cc:740] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:39.038997 23139 consensus_queue.cc:260] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:39.039417 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:39.040076 23287 raft_consensus.cc:3060] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.040405 23139 raft_consensus.cc:3060] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.045533 23289 raft_consensus.cc:2468] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 2.
I20260709 13:07:39.047058 23180 leader_election.cc:304] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 
I20260709 13:07:39.048024 23419 raft_consensus.cc:2804] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:39.049144 23214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:39.049544 23419 raft_consensus.cc:697] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Becoming Leader. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:39.049758 23214 raft_consensus.cc:3055] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:39.048712 23287 raft_consensus.cc:2468] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 2.
I20260709 13:07:39.050177 23214 raft_consensus.cc:740] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:39.050590 23419 consensus_queue.cc:237] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:39.051067 23214 consensus_queue.cc:260] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:39.051373 23105 leader_election.cc:304] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:39.048810 23140 leader_election.cc:290] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 2 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:39.052304 23214 raft_consensus.cc:3060] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.054612 23394 raft_consensus.cc:2804] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:39.055303 23394 raft_consensus.cc:697] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:39.047693 23139 raft_consensus.cc:2468] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 2.
I20260709 13:07:39.056281 23394 consensus_queue.cc:237] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:39.059659 23038 catalog_manager.cc:5697] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 reported cstate change: term changed from 1 to 2, leader changed from 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1) to 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.060469 23214 raft_consensus.cc:2468] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 2.
I20260709 13:07:39.066942 23037 catalog_manager.cc:5697] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 1 to 2, leader changed from 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2) to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.117457 23287 raft_consensus.cc:1275] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.119083 23394 consensus_queue.cc:1048] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.129289 23214 raft_consensus.cc:1275] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.130913 23373 consensus_queue.cc:1048] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.229913 23287 raft_consensus.cc:1275] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.231402 23394 consensus_queue.cc:1048] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:39.235013 23289 raft_consensus.cc:1275] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.236977 23419 consensus_queue.cc:1048] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.243868 23214 raft_consensus.cc:1275] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.251801 23139 raft_consensus.cc:1275] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.253221 23394 consensus_queue.cc:1048] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:39.254104 23336 consensus_queue.cc:1048] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.307312 23139 raft_consensus.cc:1275] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.308792 23336 consensus_queue.cc:1048] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.320559 23287 raft_consensus.cc:1275] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.322445 23419 consensus_queue.cc:1048] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.424926 23214 raft_consensus.cc:1275] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.426587 23394 consensus_queue.cc:1048] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.435022 23287 raft_consensus.cc:1275] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.436894 23373 consensus_queue.cc:1048] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.479954 23289 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.488538 23139 raft_consensus.cc:1275] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.488766 23289 raft_consensus.cc:1275] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.490520 23365 consensus_queue.cc:1048] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:39.491456 23419 consensus_queue.cc:1048] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.529469 23214 raft_consensus.cc:1275] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.531064 23394 consensus_queue.cc:1048] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.541838 23289 raft_consensus.cc:1275] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.543433 23342 consensus_queue.cc:1048] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:39.563387 23289 raft_consensus.cc:1275] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.564944 23419 consensus_queue.cc:1048] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.575822 23139 raft_consensus.cc:1275] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.577252 23419 consensus_queue.cc:1048] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:41.689293 22480 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:07:41.690227 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:41.716848 23139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
mode: GRACEFUL
new_leader_uuid: "078a3c9112864046b3984a52779f6f9b"
 from {username='slave'} at 127.0.0.1:55326
I20260709 13:07:41.717864 23139 raft_consensus.cc:606] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Received request to transfer leadership to TS 078a3c9112864046b3984a52779f6f9b
I20260709 13:07:41.721290 23139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
mode: GRACEFUL
new_leader_uuid: "078a3c9112864046b3984a52779f6f9b"
 from {username='slave'} at 127.0.0.1:55326
I20260709 13:07:41.721800 23139 raft_consensus.cc:606] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Received request to transfer leadership to TS 078a3c9112864046b3984a52779f6f9b
I20260709 13:07:41.722949 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:41.723448 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:41.911398 23433 raft_consensus.cc:993] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786: : Instructing follower 078a3c9112864046b3984a52779f6f9b to start an election
I20260709 13:07:41.911918 23433 raft_consensus.cc:1081] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Signalling peer 078a3c9112864046b3984a52779f6f9b to start an election
I20260709 13:07:41.913808 23287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede"
dest_uuid: "078a3c9112864046b3984a52779f6f9b"
 from {username='slave'} at 127.0.0.1:33554
I20260709 13:07:41.914285 23287 raft_consensus.cc:493] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:41.914572 23287 raft_consensus.cc:3060] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:41.920589 23287 raft_consensus.cc:515] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:41.923558 23371 raft_consensus.cc:993] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786: : Instructing follower 078a3c9112864046b3984a52779f6f9b to start an election
I20260709 13:07:41.923501 23287 leader_election.cc:290] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 2 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:41.924758 23433 raft_consensus.cc:1081] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Signalling peer 078a3c9112864046b3984a52779f6f9b to start an election
I20260709 13:07:41.924821 23213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:41.925757 23213 raft_consensus.cc:3060] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:41.924821 23139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:41.926762 23287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae"
dest_uuid: "078a3c9112864046b3984a52779f6f9b"
 from {username='slave'} at 127.0.0.1:33554
I20260709 13:07:41.926775 23139 raft_consensus.cc:3055] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:41.927302 23287 raft_consensus.cc:493] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:41.927265 23139 raft_consensus.cc:740] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:41.927831 23287 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:41.928382 23139 consensus_queue.cc:260] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:41.929756 23139 raft_consensus.cc:3060] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:41.933108 23287 raft_consensus.cc:515] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:41.934100 23213 raft_consensus.cc:2468] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 2.
I20260709 13:07:41.935010 23287 leader_election.cc:290] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 3 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:41.935787 23255 leader_election.cc:304] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 
I20260709 13:07:41.936218 23213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:41.936084 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:41.936851 23430 raft_consensus.cc:2804] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:41.937012 23140 raft_consensus.cc:3055] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:41.937493 23140 raft_consensus.cc:740] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:41.938513 23430 raft_consensus.cc:697] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 2 LEADER]: Becoming Leader. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:41.938431 23140 consensus_queue.cc:260] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:41.939957 23140 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:41.939627 23430 consensus_queue.cc:237] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:41.940567 23139 raft_consensus.cc:2468] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 2.
I20260709 13:07:41.936952 23213 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:41.947202 23140 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 3.
I20260709 13:07:41.950026 23255 leader_election.cc:304] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:41.950866 23213 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 3.
I20260709 13:07:41.950978 23430 raft_consensus.cc:2804] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:41.951658 23430 raft_consensus.cc:697] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 3 LEADER]: Becoming Leader. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:41.951797 23035 catalog_manager.cc:5697] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b reported cstate change: term changed from 1 to 2, leader changed from 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1) to 078a3c9112864046b3984a52779f6f9b (127.21.244.3). New cstate: current_term: 2 leader_uuid: "078a3c9112864046b3984a52779f6f9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.952574 23430 consensus_queue.cc:237] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:41.971550 23035 catalog_manager.cc:5697] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b reported cstate change: term changed from 2 to 3, leader changed from 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1) to 078a3c9112864046b3984a52779f6f9b (127.21.244.3). New cstate: current_term: 3 leader_uuid: "078a3c9112864046b3984a52779f6f9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.401947 23140 raft_consensus.cc:1275] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Refusing update from remote peer 078a3c9112864046b3984a52779f6f9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:42.403249 23430 consensus_queue.cc:1048] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:42.414749 23213 raft_consensus.cc:1275] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Refusing update from remote peer 078a3c9112864046b3984a52779f6f9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:42.416649 23430 consensus_queue.cc:1048] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:42.436371 23213 raft_consensus.cc:1275] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Refusing update from remote peer 078a3c9112864046b3984a52779f6f9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.437757 23435 consensus_queue.cc:1048] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.448791 23140 raft_consensus.cc:1275] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Refusing update from remote peer 078a3c9112864046b3984a52779f6f9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.450945 23435 consensus_queue.cc:1048] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:42.724411 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:42.738833 23287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae"
dest_uuid: "078a3c9112864046b3984a52779f6f9b"
mode: GRACEFUL
new_leader_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:33558
I20260709 13:07:42.739459 23287 raft_consensus.cc:606] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 3 LEADER]: Received request to transfer leadership to TS 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:42.747898 23287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede"
dest_uuid: "078a3c9112864046b3984a52779f6f9b"
mode: GRACEFUL
new_leader_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:33558
I20260709 13:07:42.748529 23287 raft_consensus.cc:606] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 2 LEADER]: Received request to transfer leadership to TS 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:42.756481 23213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25"
dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
mode: GRACEFUL
new_leader_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55188
I20260709 13:07:42.757010 23213 raft_consensus.cc:606] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Received request to transfer leadership to TS 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:42.762459 23213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1"
dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
mode: GRACEFUL
new_leader_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55188
I20260709 13:07:42.763072 23213 raft_consensus.cc:606] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Received request to transfer leadership to TS 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:42.768492 23213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd"
dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
mode: GRACEFUL
new_leader_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55188
I20260709 13:07:42.769100 23213 raft_consensus.cc:606] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Received request to transfer leadership to TS 5f59e800427c4b22816a6a161c3b1786
I20260709 13:07:42.868636 23419 raft_consensus.cc:993] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0: : Instructing follower 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:42.869134 23419 raft_consensus.cc:1081] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Signalling peer 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:42.870997 23140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55314
I20260709 13:07:42.871773 23140 raft_consensus.cc:493] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.872200 23140 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.877875 23140 raft_consensus.cc:515] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:42.881057 23140 leader_election.cc:290] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 3 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:42.881317 23213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:42.881712 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:42.882042 23213 raft_consensus.cc:3055] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:42.882302 23287 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.882664 23213 raft_consensus.cc:740] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:42.883569 23213 consensus_queue.cc:260] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:42.884865 23213 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.890075 23287 raft_consensus.cc:2468] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 3.
I20260709 13:07:42.891633 23105 leader_election.cc:304] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:42.891887 23213 raft_consensus.cc:2468] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 3.
I20260709 13:07:42.892498 23433 raft_consensus.cc:2804] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:42.893545 23433 raft_consensus.cc:697] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:42.894341 23433 consensus_queue.cc:237] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:42.901033 23035 catalog_manager.cc:5697] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 2 to 3, leader changed from 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2) to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.022197 23430 raft_consensus.cc:993] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b: : Instructing follower 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:43.022859 23448 raft_consensus.cc:1081] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 2 LEADER]: Signalling peer 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:43.024609 23140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55300
I20260709 13:07:43.025166 23140 raft_consensus.cc:493] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.025661 23140 raft_consensus.cc:3060] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.032068 23140 raft_consensus.cc:515] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.033814 23430 raft_consensus.cc:993] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b: : Instructing follower 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:43.034322 23140 leader_election.cc:290] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 3 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:43.034977 23213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:43.035012 23430 raft_consensus.cc:1081] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 3 LEADER]: Signalling peer 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:43.035399 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e20a9cb65e740b0885d8b9e3020bede" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:43.035667 23213 raft_consensus.cc:3060] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.036099 23287 raft_consensus.cc:3055] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:43.036536 23287 raft_consensus.cc:740] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:43.037547 23140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55300
I20260709 13:07:43.037424 23287 consensus_queue.cc:260] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.038170 23140 raft_consensus.cc:493] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.038591 23140 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.038618 23287 raft_consensus.cc:3060] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.043274 23213 raft_consensus.cc:2468] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 3.
I20260709 13:07:43.044253 23287 raft_consensus.cc:2468] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 3.
I20260709 13:07:43.044881 23106 leader_election.cc:304] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:43.045758 23433 raft_consensus.cc:2804] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:43.045836 23140 raft_consensus.cc:515] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.046442 23433 raft_consensus.cc:697] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:43.047302 23433 consensus_queue.cc:237] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.048027 23140 leader_election.cc:290] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 4 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:43.048784 23213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:43.049331 23213 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.049301 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:43.049959 23287 raft_consensus.cc:3055] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:43.050298 23287 raft_consensus.cc:740] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:43.051106 23287 consensus_queue.cc:260] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.052388 23287 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.055584 23035 catalog_manager.cc:5697] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 2 to 3, leader changed from 078a3c9112864046b3984a52779f6f9b (127.21.244.3) to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.056859 23213 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 4.
I20260709 13:07:43.058099 23106 leader_election.cc:304] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31a4b72b8eaf4c9e973424c330559fa0, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:43.058961 23433 raft_consensus.cc:2804] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:43.059520 23433 raft_consensus.cc:697] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 4 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:43.059538 23287 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 4.
I20260709 13:07:43.060637 23433 consensus_queue.cc:237] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.069530 23035 catalog_manager.cc:5697] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 3 to 4, leader changed from 078a3c9112864046b3984a52779f6f9b (127.21.244.3) to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 4 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.138664 23451 raft_consensus.cc:993] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0: : Instructing follower 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:43.139189 23419 raft_consensus.cc:1081] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Signalling peer 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:43.140942 23140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55314
I20260709 13:07:43.141420 23140 raft_consensus.cc:493] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.141669 23140 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.146878 23140 raft_consensus.cc:515] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.149096 23140 leader_election.cc:290] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 3 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:43.149969 23213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:43.150357 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:43.150658 23213 raft_consensus.cc:3055] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:43.151029 23213 raft_consensus.cc:740] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:43.151032 23287 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.152143 23213 consensus_queue.cc:260] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.153591 23213 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.159379 23287 raft_consensus.cc:2468] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 3.
I20260709 13:07:43.160789 23105 leader_election.cc:304] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:43.161468 23213 raft_consensus.cc:2468] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 3.
I20260709 13:07:43.161834 23433 raft_consensus.cc:2804] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:43.162480 23433 raft_consensus.cc:697] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:43.163332 23433 consensus_queue.cc:237] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.170279 23035 catalog_manager.cc:5697] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 2 to 3, leader changed from 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2) to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.312227 23451 raft_consensus.cc:993] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0: : Instructing follower 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:43.312695 23419 raft_consensus.cc:1081] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Signalling peer 5f59e800427c4b22816a6a161c3b1786 to start an election
I20260709 13:07:43.314163 23140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
 from {username='slave'} at 127.0.0.1:55314
I20260709 13:07:43.314600 23140 raft_consensus.cc:493] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.314853 23140 raft_consensus.cc:3060] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.319142 23140 raft_consensus.cc:515] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.320608 23140 leader_election.cc:290] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 3 election: Requested vote from peers 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:43.321580 23213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:43.321722 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb2ac038116d454db4f799a0877a8a25" candidate_uuid: "5f59e800427c4b22816a6a161c3b1786" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:43.322121 23213 raft_consensus.cc:3055] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:43.322454 23287 raft_consensus.cc:3060] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.322459 23213 raft_consensus.cc:740] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:43.323834 23213 consensus_queue.cc:260] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.324988 23213 raft_consensus.cc:3060] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.327960 23287 raft_consensus.cc:2468] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 3.
I20260709 13:07:43.329150 23105 leader_election.cc:304] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 5f59e800427c4b22816a6a161c3b1786; no voters: 
I20260709 13:07:43.330083 23433 raft_consensus.cc:2804] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:43.330619 23433 raft_consensus.cc:697] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Becoming Leader. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:43.330574 23213 raft_consensus.cc:2468] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f59e800427c4b22816a6a161c3b1786 in term 3.
I20260709 13:07:43.331880 23433 consensus_queue.cc:237] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:43.340126 23035 catalog_manager.cc:5697] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 reported cstate change: term changed from 2 to 3, leader changed from 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2) to 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "5f59e800427c4b22816a6a161c3b1786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.416710 23287 raft_consensus.cc:1275] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.418035 23433 consensus_queue.cc:1048] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.431023 23213 raft_consensus.cc:1275] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.433313 23461 consensus_queue.cc:1048] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:43.442637 23213 raft_consensus.cc:1275] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.444089 23461 consensus_queue.cc:1048] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.453851 23287 raft_consensus.cc:1275] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.455236 23433 consensus_queue.cc:1048] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.491281 23287 raft_consensus.cc:1275] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 4 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:43.492672 23433 consensus_queue.cc:1048] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:43.502403 23213 raft_consensus.cc:1275] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:43.504484 23461 consensus_queue.cc:1048] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:07:43.665272 23214 raft_consensus.cc:1275] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.667124 23433 consensus_queue.cc:1048] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.677578 23287 raft_consensus.cc:1275] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.679778 23461 consensus_queue.cc:1048] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.862774 23213 raft_consensus.cc:1275] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.864109 23433 consensus_queue.cc:1048] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.875012 23287 raft_consensus.cc:1275] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Refusing update from remote peer 5f59e800427c4b22816a6a161c3b1786: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.876919 23461 consensus_queue.cc:1048] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:45.776597 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:45.783947 23140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
mode: GRACEFUL
new_leader_uuid: "078a3c9112864046b3984a52779f6f9b"
 from {username='slave'} at 127.0.0.1:55326
I20260709 13:07:45.784420 23140 raft_consensus.cc:606] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Received request to transfer leadership to TS 078a3c9112864046b3984a52779f6f9b
I20260709 13:07:45.787331 23140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
mode: GRACEFUL
new_leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:55326
I20260709 13:07:45.787891 23140 raft_consensus.cc:606] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Received request to transfer leadership to TS 31a4b72b8eaf4c9e973424c330559fa0
I20260709 13:07:45.790618 23140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
mode: GRACEFUL
new_leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:55326
I20260709 13:07:45.791198 23140 raft_consensus.cc:606] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Received request to transfer leadership to TS 31a4b72b8eaf4c9e973424c330559fa0
I20260709 13:07:45.793896 23140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae"
dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
mode: GRACEFUL
new_leader_uuid: "078a3c9112864046b3984a52779f6f9b"
 from {username='slave'} at 127.0.0.1:55326
I20260709 13:07:45.794392 23140 raft_consensus.cc:606] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 4 LEADER]: Received request to transfer leadership to TS 078a3c9112864046b3984a52779f6f9b
I20260709 13:07:45.795615 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:45.796140 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:45.855832 23461 raft_consensus.cc:993] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786: : Instructing follower 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:45.856474 23433 raft_consensus.cc:1081] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Signalling peer 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:45.858043 23213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd"
dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:55172
I20260709 13:07:45.858489 23213 raft_consensus.cc:493] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.858857 23213 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.864979 23213 raft_consensus.cc:515] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:45.867324 23213 leader_election.cc:290] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 4 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:45.867818 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:45.868052 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47e5aee4b5f4092b9855df93de808fd" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:45.868535 23140 raft_consensus.cc:3055] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:45.868643 23287 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.868856 23140 raft_consensus.cc:740] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:45.869590 23140 consensus_queue.cc:260] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:45.870437 23140 raft_consensus.cc:3060] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.873260 23287 raft_consensus.cc:2468] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 4.
I20260709 13:07:45.874614 23180 leader_election.cc:304] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 
I20260709 13:07:45.875036 23140 raft_consensus.cc:2468] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 4.
I20260709 13:07:45.875466 23474 raft_consensus.cc:2804] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:45.876564 23474 raft_consensus.cc:697] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 LEADER]: Becoming Leader. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:45.877274 23474 consensus_queue.cc:237] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:45.884294 23038 catalog_manager.cc:5697] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 reported cstate change: term changed from 3 to 4, leader changed from 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1) to 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2). New cstate: current_term: 4 leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.915124 23461 raft_consensus.cc:993] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786: : Instructing follower 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:45.915822 23433 raft_consensus.cc:1081] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Signalling peer 31a4b72b8eaf4c9e973424c330559fa0 to start an election
I20260709 13:07:45.917707 23213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12"
dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
 from {username='slave'} at 127.0.0.1:55172
I20260709 13:07:45.918207 23213 raft_consensus.cc:493] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.918581 23213 raft_consensus.cc:3060] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.922996 23213 raft_consensus.cc:515] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:45.924518 23213 leader_election.cc:290] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 3 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 078a3c9112864046b3984a52779f6f9b (127.21.244.3:35253)
I20260709 13:07:45.925642 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "078a3c9112864046b3984a52779f6f9b"
I20260709 13:07:45.925686 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a4c344327dc4fc79aa5aa041d0c8c12" candidate_uuid: "31a4b72b8eaf4c9e973424c330559fa0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:45.926322 23287 raft_consensus.cc:3060] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.926465 23140 raft_consensus.cc:3055] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:45.926908 23140 raft_consensus.cc:740] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:45.927649 23140 consensus_queue.cc:260] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:45.928877 23140 raft_consensus.cc:3060] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.931529 23287 raft_consensus.cc:2468] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 3.
I20260709 13:07:45.932658 23180 leader_election.cc:304] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 
I20260709 13:07:45.933559 23474 raft_consensus.cc:2804] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:45.933993 23474 raft_consensus.cc:697] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 LEADER]: Becoming Leader. State: Replica: 31a4b72b8eaf4c9e973424c330559fa0, State: Running, Role: LEADER
I20260709 13:07:45.934316 23140 raft_consensus.cc:2468] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31a4b72b8eaf4c9e973424c330559fa0 in term 3.
I20260709 13:07:45.934779 23474 consensus_queue.cc:237] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:45.941772 23038 catalog_manager.cc:5697] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 reported cstate change: term changed from 2 to 3, leader changed from 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1) to 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2). New cstate: current_term: 3 leader_uuid: "31a4b72b8eaf4c9e973424c330559fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.089128 23461 raft_consensus.cc:993] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786: : Instructing follower 078a3c9112864046b3984a52779f6f9b to start an election
I20260709 13:07:46.089630 23433 raft_consensus.cc:1081] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 4 LEADER]: Signalling peer 078a3c9112864046b3984a52779f6f9b to start an election
I20260709 13:07:46.091332 23287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae"
dest_uuid: "078a3c9112864046b3984a52779f6f9b"
 from {username='slave'} at 127.0.0.1:33554
I20260709 13:07:46.091853 23287 raft_consensus.cc:493] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.092160 23287 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:46.096838 23287 raft_consensus.cc:515] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:46.098440 23287 leader_election.cc:290] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 5 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:46.099455 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:46.100111 23140 raft_consensus.cc:3055] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:46.100468 23140 raft_consensus.cc:740] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:46.099862 23213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52466db7a544dee8a3c31dae4b517ae" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:46.101243 23213 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:46.101341 23140 consensus_queue.cc:260] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:46.103137 23140 raft_consensus.cc:3060] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:46.109818 23213 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 5.
I20260709 13:07:46.110769 23140 raft_consensus.cc:2468] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 5.
I20260709 13:07:46.111284 23255 leader_election.cc:304] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 
I20260709 13:07:46.112277 23469 raft_consensus.cc:2804] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:46.113554 23469 raft_consensus.cc:697] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 5 LEADER]: Becoming Leader. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:46.114395 23469 consensus_queue.cc:237] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:46.121424 23038 catalog_manager.cc:5697] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b reported cstate change: term changed from 4 to 5, leader changed from 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1) to 078a3c9112864046b3984a52779f6f9b (127.21.244.3). New cstate: current_term: 5 leader_uuid: "078a3c9112864046b3984a52779f6f9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.223717 23461 raft_consensus.cc:993] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786: : Instructing follower 078a3c9112864046b3984a52779f6f9b to start an election
I20260709 13:07:46.224267 23433 raft_consensus.cc:1081] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Signalling peer 078a3c9112864046b3984a52779f6f9b to start an election
I20260709 13:07:46.226039 23287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1"
dest_uuid: "078a3c9112864046b3984a52779f6f9b"
 from {username='slave'} at 127.0.0.1:33554
I20260709 13:07:46.226569 23287 raft_consensus.cc:493] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.226881 23287 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:46.232218 23287 raft_consensus.cc:515] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:46.234562 23287 leader_election.cc:290] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 4 election: Requested vote from peers 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285), 31a4b72b8eaf4c9e973424c330559fa0 (127.21.244.2:41269)
I20260709 13:07:46.235531 23140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f59e800427c4b22816a6a161c3b1786"
I20260709 13:07:46.235697 23213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c437c666384559a1ab704f7a2183e1" candidate_uuid: "078a3c9112864046b3984a52779f6f9b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "31a4b72b8eaf4c9e973424c330559fa0"
I20260709 13:07:46.236241 23140 raft_consensus.cc:3055] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:46.236306 23213 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:46.236678 23140 raft_consensus.cc:740] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f59e800427c4b22816a6a161c3b1786, State: Running, Role: LEADER
I20260709 13:07:46.237366 23140 consensus_queue.cc:260] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:46.238289 23140 raft_consensus.cc:3060] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:46.241235 23213 raft_consensus.cc:2468] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 4.
I20260709 13:07:46.242882 23255 leader_election.cc:304] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 078a3c9112864046b3984a52779f6f9b, 31a4b72b8eaf4c9e973424c330559fa0; no voters: 
I20260709 13:07:46.243599 23140 raft_consensus.cc:2468] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 078a3c9112864046b3984a52779f6f9b in term 4.
I20260709 13:07:46.243621 23469 raft_consensus.cc:2804] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:46.244635 23469 raft_consensus.cc:697] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 4 LEADER]: Becoming Leader. State: Replica: 078a3c9112864046b3984a52779f6f9b, State: Running, Role: LEADER
I20260709 13:07:46.245556 23469 consensus_queue.cc:237] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } }
I20260709 13:07:46.253037 23038 catalog_manager.cc:5697] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b reported cstate change: term changed from 3 to 4, leader changed from 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1) to 078a3c9112864046b3984a52779f6f9b (127.21.244.3). New cstate: current_term: 4 leader_uuid: "078a3c9112864046b3984a52779f6f9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.346134 23140 raft_consensus.cc:1275] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 4 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:46.347577 23474 consensus_queue.cc:1048] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:46.359436 23287 raft_consensus.cc:1275] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 4 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:46.360805 23474 consensus_queue.cc:1048] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:46.496018 23140 raft_consensus.cc:1275] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 5 FOLLOWER]: Refusing update from remote peer 078a3c9112864046b3984a52779f6f9b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:46.497344 23469 consensus_queue.cc:1048] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:46.506935 23213 raft_consensus.cc:1275] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 5 FOLLOWER]: Refusing update from remote peer 078a3c9112864046b3984a52779f6f9b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:46.508953 23469 consensus_queue.cc:1048] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:46.512753 23287 raft_consensus.cc:1275] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:46.514417 23474 consensus_queue.cc:1048] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "078a3c9112864046b3984a52779f6f9b" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:46.528177 23140 raft_consensus.cc:1275] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Refusing update from remote peer 31a4b72b8eaf4c9e973424c330559fa0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:46.529758 23495 consensus_queue.cc:1048] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:46.626544 23140 raft_consensus.cc:1275] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 4 FOLLOWER]: Refusing update from remote peer 078a3c9112864046b3984a52779f6f9b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:46.628044 23469 consensus_queue.cc:1048] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f59e800427c4b22816a6a161c3b1786" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:46.639436 23213 raft_consensus.cc:1275] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 FOLLOWER]: Refusing update from remote peer 078a3c9112864046b3984a52779f6f9b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:46.642181 23469 consensus_queue.cc:1048] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31a4b72b8eaf4c9e973424c330559fa0" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:46.797034 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:46.803246 22480 tablet_server.cc:179] TabletServer@127.21.244.1:0 shutting down...
I20260709 13:07:46.828131 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:46.828964 22480 tablet_replica.cc:333] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786: stopping tablet replica
I20260709 13:07:46.829595 22480 raft_consensus.cc:2243] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.830057 22480 raft_consensus.cc:2272] T b47e5aee4b5f4092b9855df93de808fd P 5f59e800427c4b22816a6a161c3b1786 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.832705 22480 tablet_replica.cc:333] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786: stopping tablet replica
I20260709 13:07:46.833240 22480 raft_consensus.cc:2243] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.833983 22480 raft_consensus.cc:2272] T 23635aee6a1f486db9ba691690cd2ba5 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.835856 22480 tablet_replica.cc:333] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786: stopping tablet replica
I20260709 13:07:46.836414 22480 raft_consensus.cc:2243] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.837137 22480 raft_consensus.cc:2272] T bb2ac038116d454db4f799a0877a8a25 P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.838912 22480 tablet_replica.cc:333] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786: stopping tablet replica
I20260709 13:07:46.839423 22480 raft_consensus.cc:2243] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.839890 22480 raft_consensus.cc:2272] T e52466db7a544dee8a3c31dae4b517ae P 5f59e800427c4b22816a6a161c3b1786 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.842769 22480 tablet_replica.cc:333] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786: stopping tablet replica
I20260709 13:07:46.843293 22480 raft_consensus.cc:2243] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.844069 22480 raft_consensus.cc:2272] T 6e20a9cb65e740b0885d8b9e3020bede P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.845661 22480 tablet_replica.cc:333] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786: stopping tablet replica
I20260709 13:07:46.846179 22480 raft_consensus.cc:2243] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.846890 22480 raft_consensus.cc:2272] T f385e3d41c104ba3aabd56504f6958de P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.848541 22480 tablet_replica.cc:333] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786: stopping tablet replica
I20260709 13:07:46.849043 22480 raft_consensus.cc:2243] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.849443 22480 raft_consensus.cc:2272] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 5f59e800427c4b22816a6a161c3b1786 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.851390 22480 tablet_replica.cc:333] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786: stopping tablet replica
I20260709 13:07:46.852154 22480 raft_consensus.cc:2243] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.852696 22480 raft_consensus.cc:2272] T 666fc116f63446f7b1a67dab4eef8a01 P 5f59e800427c4b22816a6a161c3b1786 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.854420 22480 tablet_replica.cc:333] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786: stopping tablet replica
I20260709 13:07:46.854890 22480 raft_consensus.cc:2243] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.855295 22480 raft_consensus.cc:2272] T 13c437c666384559a1ab704f7a2183e1 P 5f59e800427c4b22816a6a161c3b1786 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.857527 22480 tablet_replica.cc:333] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786: stopping tablet replica
I20260709 13:07:46.858007 22480 raft_consensus.cc:2243] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.858421 22480 raft_consensus.cc:2272] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 5f59e800427c4b22816a6a161c3b1786 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.881274 22480 tablet_server.cc:196] TabletServer@127.21.244.1:0 shutdown complete.
I20260709 13:07:46.902058 22480 tablet_server.cc:179] TabletServer@127.21.244.2:0 shutting down...
I20260709 13:07:46.928383 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:46.929199 22480 tablet_replica.cc:333] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0: stopping tablet replica
I20260709 13:07:46.929929 22480 raft_consensus.cc:2243] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.931010 22480 raft_consensus.cc:2272] T b47e5aee4b5f4092b9855df93de808fd P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.933207 22480 tablet_replica.cc:333] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0: stopping tablet replica
I20260709 13:07:46.933706 22480 raft_consensus.cc:2243] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.934518 22480 raft_consensus.cc:2272] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.936306 22480 tablet_replica.cc:333] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0: stopping tablet replica
I20260709 13:07:46.936817 22480 raft_consensus.cc:2243] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.937196 22480 raft_consensus.cc:2272] T 13c437c666384559a1ab704f7a2183e1 P 31a4b72b8eaf4c9e973424c330559fa0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.939471 22480 tablet_replica.cc:333] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0: stopping tablet replica
I20260709 13:07:46.940029 22480 raft_consensus.cc:2243] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.940416 22480 raft_consensus.cc:2272] T 6e20a9cb65e740b0885d8b9e3020bede P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.941939 22480 tablet_replica.cc:333] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0: stopping tablet replica
I20260709 13:07:46.942378 22480 raft_consensus.cc:2243] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.942749 22480 raft_consensus.cc:2272] T f385e3d41c104ba3aabd56504f6958de P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.944375 22480 tablet_replica.cc:333] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0: stopping tablet replica
I20260709 13:07:46.944819 22480 raft_consensus.cc:2243] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.945202 22480 raft_consensus.cc:2272] T 666fc116f63446f7b1a67dab4eef8a01 P 31a4b72b8eaf4c9e973424c330559fa0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.946705 22480 tablet_replica.cc:333] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0: stopping tablet replica
I20260709 13:07:46.947147 22480 raft_consensus.cc:2243] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.947937 22480 raft_consensus.cc:2272] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.949796 22480 tablet_replica.cc:333] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0: stopping tablet replica
I20260709 13:07:46.950222 22480 raft_consensus.cc:2243] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.950577 22480 raft_consensus.cc:2272] T bb2ac038116d454db4f799a0877a8a25 P 31a4b72b8eaf4c9e973424c330559fa0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.952133 22480 tablet_replica.cc:333] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0: stopping tablet replica
I20260709 13:07:46.952536 22480 raft_consensus.cc:2243] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.952988 22480 raft_consensus.cc:2272] T e52466db7a544dee8a3c31dae4b517ae P 31a4b72b8eaf4c9e973424c330559fa0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.955158 22480 tablet_replica.cc:333] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0: stopping tablet replica
I20260709 13:07:46.955646 22480 raft_consensus.cc:2243] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.956158 22480 raft_consensus.cc:2272] T 23635aee6a1f486db9ba691690cd2ba5 P 31a4b72b8eaf4c9e973424c330559fa0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.985826 22480 tablet_server.cc:196] TabletServer@127.21.244.2:0 shutdown complete.
W20260709 13:07:46.989732 23255 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.244.1:36285: connect: Connection refused (error 111) [suppressed 47 similar messages]
W20260709 13:07:46.993866 23255 consensus_peers.cc:597] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b -> Peer 5f59e800427c4b22816a6a161c3b1786 (127.21.244.1:36285): Couldn't send request to peer 5f59e800427c4b22816a6a161c3b1786. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:36285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:47.007164 22480 tablet_server.cc:179] TabletServer@127.21.244.3:0 shutting down...
I20260709 13:07:47.030620 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:47.031280 22480 tablet_replica.cc:333] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b: stopping tablet replica
I20260709 13:07:47.032037 22480 raft_consensus.cc:2243] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.032648 22480 raft_consensus.cc:2272] T 891e2e9c7c2b4a4099d4e97d0d981f91 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.034409 22480 tablet_replica.cc:333] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b: stopping tablet replica
I20260709 13:07:47.034956 22480 raft_consensus.cc:2243] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:47.035718 22480 raft_consensus.cc:2272] T 13c437c666384559a1ab704f7a2183e1 P 078a3c9112864046b3984a52779f6f9b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.038026 22480 tablet_replica.cc:333] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b: stopping tablet replica
I20260709 13:07:47.038576 22480 raft_consensus.cc:2243] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.038971 22480 raft_consensus.cc:2272] T b47e5aee4b5f4092b9855df93de808fd P 078a3c9112864046b3984a52779f6f9b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.041298 22480 tablet_replica.cc:333] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b: stopping tablet replica
I20260709 13:07:47.041913 22480 raft_consensus.cc:2243] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:07:47.042620 22480 raft_consensus.cc:2272] T e52466db7a544dee8a3c31dae4b517ae P 078a3c9112864046b3984a52779f6f9b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.044708 22480 tablet_replica.cc:333] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b: stopping tablet replica
I20260709 13:07:47.045153 22480 raft_consensus.cc:2243] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.045531 22480 raft_consensus.cc:2272] T bb2ac038116d454db4f799a0877a8a25 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.047049 22480 tablet_replica.cc:333] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b: stopping tablet replica
I20260709 13:07:47.047498 22480 raft_consensus.cc:2243] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:47.048266 22480 raft_consensus.cc:2272] T 666fc116f63446f7b1a67dab4eef8a01 P 078a3c9112864046b3984a52779f6f9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.049885 22480 tablet_replica.cc:333] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b: stopping tablet replica
I20260709 13:07:47.050349 22480 raft_consensus.cc:2243] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.050698 22480 raft_consensus.cc:2272] T 2a4c344327dc4fc79aa5aa041d0c8c12 P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.052614 22480 tablet_replica.cc:333] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b: stopping tablet replica
I20260709 13:07:47.053056 22480 raft_consensus.cc:2243] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.053434 22480 raft_consensus.cc:2272] T f385e3d41c104ba3aabd56504f6958de P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.055095 22480 tablet_replica.cc:333] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b: stopping tablet replica
I20260709 13:07:47.055503 22480 raft_consensus.cc:2243] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.055917 22480 raft_consensus.cc:2272] T 6e20a9cb65e740b0885d8b9e3020bede P 078a3c9112864046b3984a52779f6f9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.057363 22480 tablet_replica.cc:333] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b: stopping tablet replica
I20260709 13:07:47.057751 22480 raft_consensus.cc:2243] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.058084 22480 raft_consensus.cc:2272] T 23635aee6a1f486db9ba691690cd2ba5 P 078a3c9112864046b3984a52779f6f9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.115056 22480 tablet_server.cc:196] TabletServer@127.21.244.3:0 shutdown complete.
I20260709 13:07:47.137086 22480 master.cc:562] Master@127.21.244.62:45155 shutting down...
I20260709 13:07:47.159642 22480 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:47.160295 22480 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.160656 22480 tablet_replica.cc:333] T 00000000000000000000000000000000 P 18ffb356e6194a3e804c520385d49884: stopping tablet replica
I20260709 13:07:47.181480 22480 master.cc:584] Master@127.21.244.62:45155 shutdown complete.
078a3c9112864046b3984a52779f6f9b  1
31a4b72b8eaf4c9e973424c330559fa0  4
5f59e800427c4b22816a6a161c3b1786  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10768 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:07:47.225327 22480 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.244.62:36967
I20260709 13:07:47.226461 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:47.233186 23502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.233774 23503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.234458 23505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:47.237018 22480 server_base.cc:1061] running on GCE node
I20260709 13:07:47.238008 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:47.238242 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:47.238577 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602467238535 us; error 0 us; skew 500 ppm
I20260709 13:07:47.239114 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:47.242143 22480 webserver.cc:533] Webserver started at http://127.21.244.62:33293/ using document root <none> and password file <none>
I20260709 13:07:47.242775 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:47.243026 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:47.243332 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:47.244815 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/master-0-root/instance:
uuid: "446420ed83784f0ea35de949dc9242f4"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-j314"
I20260709 13:07:47.250118 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:47.254251 23510 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.255362 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:47.255650 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/master-0-root
uuid: "446420ed83784f0ea35de949dc9242f4"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-j314"
I20260709 13:07:47.255996 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:47.269891 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:47.271347 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:47.315268 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.62:36967
I20260709 13:07:47.315408 23561 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.62:36967 every 8 connection(s)
I20260709 13:07:47.319636 23562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.330649 23562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Bootstrap starting.
I20260709 13:07:47.335706 23562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.340942 23562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: No bootstrap required, opened a new log
I20260709 13:07:47.343248 23562 raft_consensus.cc:359] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446420ed83784f0ea35de949dc9242f4" member_type: VOTER }
I20260709 13:07:47.343698 23562 raft_consensus.cc:385] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.343959 23562 raft_consensus.cc:740] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 446420ed83784f0ea35de949dc9242f4, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.344630 23562 consensus_queue.cc:260] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446420ed83784f0ea35de949dc9242f4" member_type: VOTER }
I20260709 13:07:47.345094 23562 raft_consensus.cc:399] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:47.345306 23562 raft_consensus.cc:493] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:47.345541 23562 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.350342 23562 raft_consensus.cc:515] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446420ed83784f0ea35de949dc9242f4" member_type: VOTER }
I20260709 13:07:47.350946 23562 leader_election.cc:304] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 446420ed83784f0ea35de949dc9242f4; no voters: 
I20260709 13:07:47.352210 23562 leader_election.cc:290] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:47.352605 23565 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.354030 23565 raft_consensus.cc:697] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [term 1 LEADER]: Becoming Leader. State: Replica: 446420ed83784f0ea35de949dc9242f4, State: Running, Role: LEADER
I20260709 13:07:47.354735 23565 consensus_queue.cc:237] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446420ed83784f0ea35de949dc9242f4" member_type: VOTER }
I20260709 13:07:47.355531 23562 sys_catalog.cc:565] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:47.359954 23567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 446420ed83784f0ea35de949dc9242f4. Latest consensus state: current_term: 1 leader_uuid: "446420ed83784f0ea35de949dc9242f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446420ed83784f0ea35de949dc9242f4" member_type: VOTER } }
I20260709 13:07:47.360396 23566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "446420ed83784f0ea35de949dc9242f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446420ed83784f0ea35de949dc9242f4" member_type: VOTER } }
I20260709 13:07:47.360822 23567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:47.361112 23566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:47.364665 23571 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:47.369746 23571 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:47.374948 22480 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:47.379024 23571 catalog_manager.cc:1383] Generated new cluster ID: b42779db872f4e13944c43fcabeb7e3a
I20260709 13:07:47.379340 23571 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:47.393853 23571 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:47.395221 23571 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:47.409262 23571 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Generated new TSK 0
I20260709 13:07:47.409921 23571 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:47.442974 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:47.450356 23584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.450909 23583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:47.452422 22480 server_base.cc:1061] running on GCE node
W20260709 13:07:47.452250 23586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:47.453810 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:47.454017 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:47.454252 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602467454235 us; error 0 us; skew 500 ppm
I20260709 13:07:47.454802 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:47.457574 22480 webserver.cc:533] Webserver started at http://127.21.244.1:34219/ using document root <none> and password file <none>
I20260709 13:07:47.458120 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:47.458328 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:47.458622 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:47.459969 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/instance:
uuid: "9ab488f10c434878a749f261e99a8065"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-j314"
I20260709 13:07:47.464454 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:07:47.468312 23591 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.469113 22480 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:07:47.469501 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root
uuid: "9ab488f10c434878a749f261e99a8065"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-j314"
I20260709 13:07:47.469815 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:47.503684 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:47.505179 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:47.507032 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:47.509589 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:47.509845 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.510128 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:47.510355 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.556314 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.1:37537
I20260709 13:07:47.556500 23653 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.1:37537 every 8 connection(s)
I20260709 13:07:47.561465 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:47.569437 23659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.570387 23658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.571384 23661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:47.573400 22480 server_base.cc:1061] running on GCE node
I20260709 13:07:47.574558 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:47.574771 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:47.575011 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602467574991 us; error 0 us; skew 500 ppm
I20260709 13:07:47.575398 23654 heartbeater.cc:344] Connected to a master server at 127.21.244.62:36967
I20260709 13:07:47.575851 23654 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:47.575824 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:47.576997 23654 heartbeater.cc:507] Master 127.21.244.62:36967 requested a full tablet report, sending...
I20260709 13:07:47.578926 22480 webserver.cc:533] Webserver started at http://127.21.244.2:45901/ using document root <none> and password file <none>
I20260709 13:07:47.580008 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:47.579954 23527 ts_manager.cc:194] Registered new tserver with Master: 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:07:47.580330 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:47.580653 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:47.581899 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/instance:
uuid: "c885217113574e7489e6c3afb6950f76"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-j314"
I20260709 13:07:47.582006 23527 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52048
I20260709 13:07:47.587230 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:07:47.591117 23666 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.592337 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:47.592694 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root
uuid: "c885217113574e7489e6c3afb6950f76"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-j314"
I20260709 13:07:47.593043 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:47.626717 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:47.628022 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:47.629567 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:47.631954 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:47.632179 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.632429 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:47.632607 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.677832 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.2:44167
I20260709 13:07:47.677995 23728 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.2:44167 every 8 connection(s)
I20260709 13:07:47.683261 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:47.690606 23732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.691177 23733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.694482 23735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:47.696643 23729 heartbeater.cc:344] Connected to a master server at 127.21.244.62:36967
I20260709 13:07:47.696822 22480 server_base.cc:1061] running on GCE node
I20260709 13:07:47.697206 23729 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:47.697980 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:47.698295 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:47.698278 23729 heartbeater.cc:507] Master 127.21.244.62:36967 requested a full tablet report, sending...
I20260709 13:07:47.698714 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602467698688 us; error 0 us; skew 500 ppm
I20260709 13:07:47.699579 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:47.701285 23527 ts_manager.cc:194] Registered new tserver with Master: c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:47.702898 22480 webserver.cc:533] Webserver started at http://127.21.244.3:33707/ using document root <none> and password file <none>
I20260709 13:07:47.703286 23527 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52058
I20260709 13:07:47.703564 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:47.703855 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:47.704172 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:47.705713 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/instance:
uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-j314"
I20260709 13:07:47.710597 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:47.714663 23740 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.715593 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:47.715981 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root
uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-j314"
I20260709 13:07:47.716320 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:47.737531 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:47.738824 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:47.740468 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:47.742859 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:47.743127 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.743382 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:47.743561 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.788115 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.3:45959
I20260709 13:07:47.788226 23802 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.3:45959 every 8 connection(s)
I20260709 13:07:47.802726 23803 heartbeater.cc:344] Connected to a master server at 127.21.244.62:36967
I20260709 13:07:47.803112 23803 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:47.803905 23803 heartbeater.cc:507] Master 127.21.244.62:36967 requested a full tablet report, sending...
I20260709 13:07:47.806084 23527 ts_manager.cc:194] Registered new tserver with Master: 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:47.806237 22480 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014866741s
I20260709 13:07:47.807934 23527 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52072
I20260709 13:07:47.836213 23527 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52086:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:47.842541 23527 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:48.050525 23768 tablet_service.cc:1511] Processing CreateTablet for tablet 88d337bff4764c8591ac46843de3fa91 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:48.052538 23768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d337bff4764c8591ac46843de3fa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.057367 23767 tablet_service.cc:1511] Processing CreateTablet for tablet 161b847a6eca457eb80fb6cb57531127 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:48.059446 23767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161b847a6eca457eb80fb6cb57531127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.063162 23763 tablet_service.cc:1511] Processing CreateTablet for tablet a17c243311054979a1c285f2ef18d20e (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:48.063524 23764 tablet_service.cc:1511] Processing CreateTablet for tablet aff661e739d84f06b43002ae9d8ae607 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:48.066102 23765 tablet_service.cc:1511] Processing CreateTablet for tablet 71fc75ce25404089ad5bf00f9dd40cbd (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:48.071810 23762 tablet_service.cc:1511] Processing CreateTablet for tablet 2906fc04ac3a43e5a91763bfbd1ff990 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:48.068663 23766 tablet_service.cc:1511] Processing CreateTablet for tablet 334c9018414947cabb4405ef47b8018e (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:48.075937 23761 tablet_service.cc:1511] Processing CreateTablet for tablet 44b7b7e4ddb143138d48247cb9feb2d4 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:48.077934 23761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b7b7e4ddb143138d48247cb9feb2d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.080395 23763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17c243311054979a1c285f2ef18d20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.084210 23762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2906fc04ac3a43e5a91763bfbd1ff990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.088254 23766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334c9018414947cabb4405ef47b8018e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.089614 23760 tablet_service.cc:1511] Processing CreateTablet for tablet d52390cad487467d9b1b0b951d9300b7 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:48.091179 23760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52390cad487467d9b1b0b951d9300b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.092227 23764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff661e739d84f06b43002ae9d8ae607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.093677 23765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fc75ce25404089ad5bf00f9dd40cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.107982 23759 tablet_service.cc:1511] Processing CreateTablet for tablet e8c18a99e9414e39bff9dea9564bd61b (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:48.109583 23759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c18a99e9414e39bff9dea9564bd61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.154584 23694 tablet_service.cc:1511] Processing CreateTablet for tablet 88d337bff4764c8591ac46843de3fa91 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:48.156131 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d337bff4764c8591ac46843de3fa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.155287 23693 tablet_service.cc:1511] Processing CreateTablet for tablet 161b847a6eca457eb80fb6cb57531127 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:48.157256 23693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161b847a6eca457eb80fb6cb57531127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.157156 23692 tablet_service.cc:1511] Processing CreateTablet for tablet 334c9018414947cabb4405ef47b8018e (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:48.158563 23692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334c9018414947cabb4405ef47b8018e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.155287 23619 tablet_service.cc:1511] Processing CreateTablet for tablet 88d337bff4764c8591ac46843de3fa91 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:48.160804 23619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d337bff4764c8591ac46843de3fa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.160642 23686 tablet_service.cc:1511] Processing CreateTablet for tablet d52390cad487467d9b1b0b951d9300b7 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:48.161191 23691 tablet_service.cc:1511] Processing CreateTablet for tablet 71fc75ce25404089ad5bf00f9dd40cbd (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:48.162066 23686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52390cad487467d9b1b0b951d9300b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.163673 23690 tablet_service.cc:1511] Processing CreateTablet for tablet aff661e739d84f06b43002ae9d8ae607 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:48.165239 23690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff661e739d84f06b43002ae9d8ae607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.169081 23689 tablet_service.cc:1511] Processing CreateTablet for tablet a17c243311054979a1c285f2ef18d20e (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:48.171718 23688 tablet_service.cc:1511] Processing CreateTablet for tablet 2906fc04ac3a43e5a91763bfbd1ff990 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:48.171841 23685 tablet_service.cc:1511] Processing CreateTablet for tablet e8c18a99e9414e39bff9dea9564bd61b (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:48.174365 23687 tablet_service.cc:1511] Processing CreateTablet for tablet 44b7b7e4ddb143138d48247cb9feb2d4 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:48.178930 23691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fc75ce25404089ad5bf00f9dd40cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.179492 23759 tablet_service.cc:1511] Processing CreateTablet for tablet 7479a1f927d94d5e873a594847f4ee10 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:48.180840 23759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7479a1f927d94d5e873a594847f4ee10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.183159 23689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17c243311054979a1c285f2ef18d20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.188017 23760 tablet_service.cc:1511] Processing CreateTablet for tablet eb27ed2f4a5b46d5a40126f9893f0c3c (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:48.189606 23760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb27ed2f4a5b46d5a40126f9893f0c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.197773 23818 tablet_bootstrap.cc:492] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:48.204164 23685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c18a99e9414e39bff9dea9564bd61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.207713 23688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2906fc04ac3a43e5a91763bfbd1ff990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.212208 23687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b7b7e4ddb143138d48247cb9feb2d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.216342 23618 tablet_service.cc:1511] Processing CreateTablet for tablet 161b847a6eca457eb80fb6cb57531127 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:48.217916 23618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161b847a6eca457eb80fb6cb57531127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.218407 23617 tablet_service.cc:1511] Processing CreateTablet for tablet 334c9018414947cabb4405ef47b8018e (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:48.220992 23616 tablet_service.cc:1511] Processing CreateTablet for tablet 71fc75ce25404089ad5bf00f9dd40cbd (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:48.223753 23615 tablet_service.cc:1511] Processing CreateTablet for tablet aff661e739d84f06b43002ae9d8ae607 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:48.227041 23614 tablet_service.cc:1511] Processing CreateTablet for tablet a17c243311054979a1c285f2ef18d20e (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:48.230296 23613 tablet_service.cc:1511] Processing CreateTablet for tablet 2906fc04ac3a43e5a91763bfbd1ff990 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:48.233945 23612 tablet_service.cc:1511] Processing CreateTablet for tablet 44b7b7e4ddb143138d48247cb9feb2d4 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:48.236678 23611 tablet_service.cc:1511] Processing CreateTablet for tablet d52390cad487467d9b1b0b951d9300b7 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:48.239506 23610 tablet_service.cc:1511] Processing CreateTablet for tablet e8c18a99e9414e39bff9dea9564bd61b (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:48.231438 23617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334c9018414947cabb4405ef47b8018e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.242959 23613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2906fc04ac3a43e5a91763bfbd1ff990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.246685 23762 tablet_service.cc:1511] Processing CreateTablet for tablet 2d951ceae2c04062b838b8fec5fbcc9f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:48.248142 23612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b7b7e4ddb143138d48247cb9feb2d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.252167 23614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17c243311054979a1c285f2ef18d20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.254706 23616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fc75ce25404089ad5bf00f9dd40cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.256239 23611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52390cad487467d9b1b0b951d9300b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.260138 23615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff661e739d84f06b43002ae9d8ae607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.268241 23610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c18a99e9414e39bff9dea9564bd61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.283629 23692 tablet_service.cc:1511] Processing CreateTablet for tablet 38286c47d38c4f9084acbb510661dcfa (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:48.284232 23762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d951ceae2c04062b838b8fec5fbcc9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.285204 23692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38286c47d38c4f9084acbb510661dcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.289884 23818 tablet_bootstrap.cc:654] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.294307 23686 tablet_service.cc:1511] Processing CreateTablet for tablet 7479a1f927d94d5e873a594847f4ee10 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:48.296249 23686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7479a1f927d94d5e873a594847f4ee10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.300197 23693 tablet_service.cc:1511] Processing CreateTablet for tablet eb27ed2f4a5b46d5a40126f9893f0c3c (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:48.311164 23765 tablet_service.cc:1511] Processing CreateTablet for tablet 1614a6a9a62040cab19c65c57018c05e (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:48.311826 23763 tablet_service.cc:1511] Processing CreateTablet for tablet aa38658745b04f268c400fe20554d483 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:48.312829 23765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1614a6a9a62040cab19c65c57018c05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.313689 23763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa38658745b04f268c400fe20554d483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.320219 23764 tablet_service.cc:1511] Processing CreateTablet for tablet 38286c47d38c4f9084acbb510661dcfa (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:48.321591 23764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38286c47d38c4f9084acbb510661dcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.321341 23691 tablet_service.cc:1511] Processing CreateTablet for tablet 2d951ceae2c04062b838b8fec5fbcc9f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:48.315165 23761 tablet_service.cc:1511] Processing CreateTablet for tablet 737154dff44a498f96f906fc83416830 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:48.326325 23693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb27ed2f4a5b46d5a40126f9893f0c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.336259 23767 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf8733dc7d947f08af2274d90145039 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:48.337170 23619 tablet_service.cc:1511] Processing CreateTablet for tablet eb27ed2f4a5b46d5a40126f9893f0c3c (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:48.337862 23767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf8733dc7d947f08af2274d90145039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.338739 23619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb27ed2f4a5b46d5a40126f9893f0c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.351457 23618 tablet_service.cc:1511] Processing CreateTablet for tablet 2d951ceae2c04062b838b8fec5fbcc9f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:48.357307 23819 tablet_bootstrap.cc:492] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:48.360569 23768 tablet_service.cc:1511] Processing CreateTablet for tablet b55528b161184b85a266eb8c58844016 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:48.361948 23768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55528b161184b85a266eb8c58844016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.365250 23759 tablet_service.cc:1511] Processing CreateTablet for tablet 6baa103a3f5c4452b91dd335e0c94373 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:48.326996 23613 tablet_service.cc:1511] Processing CreateTablet for tablet 7479a1f927d94d5e873a594847f4ee10 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:48.370983 23694 tablet_service.cc:1511] Processing CreateTablet for tablet aa38658745b04f268c400fe20554d483 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:48.372237 23820 tablet_bootstrap.cc:492] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:48.380882 23691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d951ceae2c04062b838b8fec5fbcc9f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:48.393344 23575 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:48.396081 23689 tablet_service.cc:1511] Processing CreateTablet for tablet 1614a6a9a62040cab19c65c57018c05e (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:48.365269 23761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737154dff44a498f96f906fc83416830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.400918 23687 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf8733dc7d947f08af2274d90145039 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:48.404107 23759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6baa103a3f5c4452b91dd335e0c94373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.409935 23613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7479a1f927d94d5e873a594847f4ee10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.414345 23690 tablet_service.cc:1511] Processing CreateTablet for tablet 737154dff44a498f96f906fc83416830 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:48.415398 23618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d951ceae2c04062b838b8fec5fbcc9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.403646 23760 tablet_service.cc:1511] Processing CreateTablet for tablet c455a888f1c64ea3a1c2ae56502f7432 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:48.422744 23760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c455a888f1c64ea3a1c2ae56502f7432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.417574 23764 tablet_service.cc:1511] Processing CreateTablet for tablet 4a97c483343c425ea75f1f6632924819 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:48.436342 23819 tablet_bootstrap.cc:654] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.436375 23818 tablet_bootstrap.cc:492] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:48.444445 23818 ts_tablet_manager.cc:1403] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.257s	user 0.019s	sys 0.005s
I20260709 13:07:48.449002 23818 raft_consensus.cc:359] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:48.447500 23614 tablet_service.cc:1511] Processing CreateTablet for tablet 38286c47d38c4f9084acbb510661dcfa (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:48.484925 23614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38286c47d38c4f9084acbb510661dcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.452430 23615 tablet_service.cc:1511] Processing CreateTablet for tablet aa38658745b04f268c400fe20554d483 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:48.456280 23766 tablet_service.cc:1511] Processing CreateTablet for tablet 2de1999cb30f49b981475a62d0d0feb9 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:48.455521 23768 tablet_service.cc:1511] Processing CreateTablet for tablet f0854ca8274d49df9583c253583ec3d7 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:48.483310 23611 tablet_service.cc:1511] Processing CreateTablet for tablet b55528b161184b85a266eb8c58844016 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:48.470844 23610 tablet_service.cc:1511] Processing CreateTablet for tablet 1614a6a9a62040cab19c65c57018c05e (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:48.460286 23689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1614a6a9a62040cab19c65c57018c05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.489097 23611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55528b161184b85a266eb8c58844016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.489130 23687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf8733dc7d947f08af2274d90145039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.462023 23685 tablet_service.cc:1511] Processing CreateTablet for tablet b55528b161184b85a266eb8c58844016 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:48.490854 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa38658745b04f268c400fe20554d483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.492308 23690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737154dff44a498f96f906fc83416830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.492904 23685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55528b161184b85a266eb8c58844016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.495077 23610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1614a6a9a62040cab19c65c57018c05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.462703 23612 tablet_service.cc:1511] Processing CreateTablet for tablet 737154dff44a498f96f906fc83416830 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:48.465329 23688 tablet_service.cc:1511] Processing CreateTablet for tablet 6baa103a3f5c4452b91dd335e0c94373 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:48.466115 23820 tablet_bootstrap.cc:654] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.466691 23764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a97c483343c425ea75f1f6632924819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.501188 23768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0854ca8274d49df9583c253583ec3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.468178 23692 tablet_service.cc:1511] Processing CreateTablet for tablet c455a888f1c64ea3a1c2ae56502f7432 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:48.501230 23763 tablet_service.cc:1511] Processing CreateTablet for tablet dbdbb7d679eb4d0d935669cb839c12c0 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:48.502347 23692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c455a888f1c64ea3a1c2ae56502f7432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.502847 23763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdbb7d679eb4d0d935669cb839c12c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.504393 23766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de1999cb30f49b981475a62d0d0feb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.500352 23612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737154dff44a498f96f906fc83416830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.512419 23688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6baa103a3f5c4452b91dd335e0c94373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.472252 23616 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf8733dc7d947f08af2274d90145039 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:48.483916 23818 raft_consensus.cc:385] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.516646 23818 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.453974 23762 tablet_service.cc:1511] Processing CreateTablet for tablet b7656d11fa2f4f27beac8e46f9f20be9 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:48.519295 23616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf8733dc7d947f08af2274d90145039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.532339 23615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa38658745b04f268c400fe20554d483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.538252 23686 tablet_service.cc:1511] Processing CreateTablet for tablet f0854ca8274d49df9583c253583ec3d7 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:48.515275 23691 tablet_service.cc:1511] Processing CreateTablet for tablet 4a97c483343c425ea75f1f6632924819 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:48.538887 23617 tablet_service.cc:1511] Processing CreateTablet for tablet c455a888f1c64ea3a1c2ae56502f7432 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:48.551473 23762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7656d11fa2f4f27beac8e46f9f20be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.572758 23617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c455a888f1c64ea3a1c2ae56502f7432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.570284 23686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0854ca8274d49df9583c253583ec3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.551679 23818 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:48.555286 23618 tablet_service.cc:1511] Processing CreateTablet for tablet 6baa103a3f5c4452b91dd335e0c94373 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:48.587895 23654 heartbeater.cc:499] Master 127.21.244.62:36967 was elected leader, sending a full tablet report...
I20260709 13:07:48.596141 23691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a97c483343c425ea75f1f6632924819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.578037 23613 tablet_service.cc:1511] Processing CreateTablet for tablet b7656d11fa2f4f27beac8e46f9f20be9 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:48.614151 23819 tablet_bootstrap.cc:492] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:48.613929 23765 tablet_service.cc:1511] Processing CreateTablet for tablet f5cd55b231da4c27b7547a2714bb43d9 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:48.614782 23819 ts_tablet_manager.cc:1403] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.258s	user 0.021s	sys 0.000s
I20260709 13:07:48.615291 23765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cd55b231da4c27b7547a2714bb43d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.620482 23694 tablet_service.cc:1511] Processing CreateTablet for tablet b7656d11fa2f4f27beac8e46f9f20be9 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:48.622860 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7656d11fa2f4f27beac8e46f9f20be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.625721 23687 tablet_service.cc:1511] Processing CreateTablet for tablet 2de1999cb30f49b981475a62d0d0feb9 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:48.626803 23618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6baa103a3f5c4452b91dd335e0c94373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.627310 23687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de1999cb30f49b981475a62d0d0feb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.595824 23767 tablet_service.cc:1511] Processing CreateTablet for tablet 2033291a683e4f2b8c99fb6fa6d479f8 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:48.630870 23613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7656d11fa2f4f27beac8e46f9f20be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.636920 23619 tablet_service.cc:1511] Processing CreateTablet for tablet 4a97c483343c425ea75f1f6632924819 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:48.637809 23803 heartbeater.cc:499] Master 127.21.244.62:36967 was elected leader, sending a full tablet report...
I20260709 13:07:48.637612 23689 tablet_service.cc:1511] Processing CreateTablet for tablet f5cd55b231da4c27b7547a2714bb43d9 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:48.638118 23820 tablet_bootstrap.cc:492] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:48.644364 23767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2033291a683e4f2b8c99fb6fa6d479f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.644734 23818 ts_tablet_manager.cc:1434] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.200s	user 0.007s	sys 0.003s
I20260709 13:07:48.617887 23819 raft_consensus.cc:359] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:48.654851 23820 ts_tablet_manager.cc:1403] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.283s	user 0.015s	sys 0.022s
I20260709 13:07:48.657897 23759 tablet_service.cc:1511] Processing CreateTablet for tablet bc5bb39aaf4940fb9d34ec725193ca2c (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:48.670598 23759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5bb39aaf4940fb9d34ec725193ca2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.672477 23818 tablet_bootstrap.cc:492] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:48.673070 23619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a97c483343c425ea75f1f6632924819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.659336 23820 raft_consensus.cc:359] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:07:48.675992 23820 raft_consensus.cc:385] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.676517 23820 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.677739 23820 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:07:48.664636 23768 tablet_service.cc:1511] Processing CreateTablet for tablet d67625249f734ae3b71d554b7a2ba33b (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:48.681002 23768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d67625249f734ae3b71d554b7a2ba33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.685207 23693 tablet_service.cc:1511] Processing CreateTablet for tablet dbdbb7d679eb4d0d935669cb839c12c0 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:48.687439 23766 tablet_service.cc:1511] Processing CreateTablet for tablet 1000e2c5e53d429ba2126c263f2e8a6d (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:48.688899 23766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1000e2c5e53d429ba2126c263f2e8a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.663364 23764 tablet_service.cc:1511] Processing CreateTablet for tablet a325d91f6c384021a7930b39886904d2 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:48.693109 23764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a325d91f6c384021a7930b39886904d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.697064 23691 tablet_service.cc:1511] Processing CreateTablet for tablet 2033291a683e4f2b8c99fb6fa6d479f8 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:48.702035 23763 tablet_service.cc:1511] Processing CreateTablet for tablet 0fcdc335ab6748159bae3d8308e238ae (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:48.703392 23763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fcdc335ab6748159bae3d8308e238ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.666489 23760 tablet_service.cc:1511] Processing CreateTablet for tablet e1f8fde8107545d5a59c6b12b0822584 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:48.669071 23610 tablet_service.cc:1511] Processing CreateTablet for tablet f0854ca8274d49df9583c253583ec3d7 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:48.704589 23610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0854ca8274d49df9583c253583ec3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.706175 23729 heartbeater.cc:499] Master 127.21.244.62:36967 was elected leader, sending a full tablet report...
I20260709 13:07:48.714535 23818 tablet_bootstrap.cc:654] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.655956 23819 raft_consensus.cc:385] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.716961 23614 tablet_service.cc:1511] Processing CreateTablet for tablet 2de1999cb30f49b981475a62d0d0feb9 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:48.717466 23819 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.718465 23614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de1999cb30f49b981475a62d0d0feb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.718508 23819 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:48.720563 23615 tablet_service.cc:1511] Processing CreateTablet for tablet dbdbb7d679eb4d0d935669cb839c12c0 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:48.724757 23612 tablet_service.cc:1511] Processing CreateTablet for tablet f5cd55b231da4c27b7547a2714bb43d9 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:48.727377 23762 tablet_service.cc:1511] Processing CreateTablet for tablet e65f1370869c4d4eb4d8f7be8a50f45f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:48.729008 23760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f8fde8107545d5a59c6b12b0822584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.729625 23765 tablet_service.cc:1511] Processing CreateTablet for tablet b8b889a8b97443f781c7eef38dba2f96 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:48.773234 23765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b889a8b97443f781c7eef38dba2f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.775677 23761 tablet_service.cc:1511] Processing CreateTablet for tablet 3eff2185a07540f08c005b02304d15ad (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:48.777063 23761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eff2185a07540f08c005b02304d15ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.784816 23615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdbb7d679eb4d0d935669cb839c12c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.785547 23612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cd55b231da4c27b7547a2714bb43d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.786543 23762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65f1370869c4d4eb4d8f7be8a50f45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.788834 23691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2033291a683e4f2b8c99fb6fa6d479f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.789412 23759 tablet_service.cc:1511] Processing CreateTablet for tablet d5fa82982f53411c84a07a2fb3918888 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:48.790859 23759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5fa82982f53411c84a07a2fb3918888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.790685 23692 tablet_service.cc:1511] Processing CreateTablet for tablet bc5bb39aaf4940fb9d34ec725193ca2c (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:48.792586 23689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cd55b231da4c27b7547a2714bb43d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.799939 23820 ts_tablet_manager.cc:1434] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.143s	user 0.015s	sys 0.007s
I20260709 13:07:48.801559 23820 tablet_bootstrap.cc:492] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:48.803369 23693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdbb7d679eb4d0d935669cb839c12c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.806036 23692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5bb39aaf4940fb9d34ec725193ca2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.821947 23688 tablet_service.cc:1511] Processing CreateTablet for tablet d67625249f734ae3b71d554b7a2ba33b (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:48.822912 23690 tablet_service.cc:1511] Processing CreateTablet for tablet a325d91f6c384021a7930b39886904d2 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:48.848289 23690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a325d91f6c384021a7930b39886904d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.825292 23685 tablet_service.cc:1511] Processing CreateTablet for tablet e1f8fde8107545d5a59c6b12b0822584 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:48.851408 23685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f8fde8107545d5a59c6b12b0822584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.856312 23688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d67625249f734ae3b71d554b7a2ba33b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:48.832647 23511 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 43889.9us
W20260709 13:07:48.840113 23512 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44479.8us
I20260709 13:07:48.803360 23616 tablet_service.cc:1511] Processing CreateTablet for tablet 2033291a683e4f2b8c99fb6fa6d479f8 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:48.826501 23613 tablet_service.cc:1511] Processing CreateTablet for tablet bc5bb39aaf4940fb9d34ec725193ca2c (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:48.878984 23616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2033291a683e4f2b8c99fb6fa6d479f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.880900 23818 tablet_bootstrap.cc:492] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:48.881512 23818 ts_tablet_manager.cc:1403] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.209s	user 0.011s	sys 0.013s
I20260709 13:07:48.891494 23765 tablet_service.cc:1511] Processing CreateTablet for tablet 819369bff57548ee8188f19ea4e8f622 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:48.893018 23765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819369bff57548ee8188f19ea4e8f622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.885475 23767 tablet_service.cc:1511] Processing CreateTablet for tablet ee650b0b99c4413293e36b0fa9631151 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:48.901372 23762 tablet_service.cc:1511] Processing CreateTablet for tablet f7ba611dbb174024a86916a09b17660c (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:48.910447 23693 tablet_service.cc:1511] Processing CreateTablet for tablet 1000e2c5e53d429ba2126c263f2e8a6d (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:48.912206 23693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1000e2c5e53d429ba2126c263f2e8a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.914618 23766 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab3e50aa3864da9beb30247f660a030 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:48.918274 23694 tablet_service.cc:1511] Processing CreateTablet for tablet 0fcdc335ab6748159bae3d8308e238ae (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:48.923061 23767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee650b0b99c4413293e36b0fa9631151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.934474 23824 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.936540 23819 ts_tablet_manager.cc:1434] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.321s	user 0.021s	sys 0.007s
I20260709 13:07:48.936954 23613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5bb39aaf4940fb9d34ec725193ca2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.937898 23819 tablet_bootstrap.cc:492] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:48.935247 23824 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:48.939953 23826 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.928279 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fcdc335ab6748159bae3d8308e238ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.950511 23826 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:48.954329 23825 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.954944 23825 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:07:48.948936 23766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab3e50aa3864da9beb30247f660a030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.955539 23820 tablet_bootstrap.cc:654] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.969818 23824 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:48.972831 23825 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:48.992128 23762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ba611dbb174024a86916a09b17660c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.996306 23818 raft_consensus.cc:359] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:48.993204 23826 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:49.022285 23692 tablet_service.cc:1511] Processing CreateTablet for tablet b8b889a8b97443f781c7eef38dba2f96 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:49.005654 23818 raft_consensus.cc:385] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.057785 23763 tablet_service.cc:1511] Processing CreateTablet for tablet 55436fc3614f4f558828ea5de361e5f0 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:49.060317 23763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55436fc3614f4f558828ea5de361e5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.064021 23618 tablet_service.cc:1511] Processing CreateTablet for tablet d67625249f734ae3b71d554b7a2ba33b (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:49.065918 23618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d67625249f734ae3b71d554b7a2ba33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.076208 23614 tablet_service.cc:1511] Processing CreateTablet for tablet a325d91f6c384021a7930b39886904d2 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:49.078126 23614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a325d91f6c384021a7930b39886904d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.081656 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:49.081493 23611 tablet_service.cc:1511] Processing CreateTablet for tablet e1f8fde8107545d5a59c6b12b0822584 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:49.083496 23611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f8fde8107545d5a59c6b12b0822584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.034642 23818 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.105005 23818 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.012143 23686 tablet_service.cc:1511] Processing CreateTablet for tablet e65f1370869c4d4eb4d8f7be8a50f45f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:49.109088 23692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b889a8b97443f781c7eef38dba2f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.114540 23818 ts_tablet_manager.cc:1434] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.233s	user 0.010s	sys 0.001s
I20260709 13:07:49.115206 23610 tablet_service.cc:1511] Processing CreateTablet for tablet 1000e2c5e53d429ba2126c263f2e8a6d (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:49.121889 23610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1000e2c5e53d429ba2126c263f2e8a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.123618 23764 tablet_service.cc:1511] Processing CreateTablet for tablet da6c8d6f775147c1807ebd5917f806a8 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:49.125023 23764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6c8d6f775147c1807ebd5917f806a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.133167 23818 tablet_bootstrap.cc:492] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:49.132823 23687 tablet_service.cc:1511] Processing CreateTablet for tablet ee650b0b99c4413293e36b0fa9631151 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:49.132823 23691 tablet_service.cc:1511] Processing CreateTablet for tablet d5fa82982f53411c84a07a2fb3918888 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:49.136339 23615 tablet_service.cc:1511] Processing CreateTablet for tablet e65f1370869c4d4eb4d8f7be8a50f45f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:49.143888 23615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65f1370869c4d4eb4d8f7be8a50f45f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:49.143970 23743 leader_election.cc:343] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.167253 23686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65f1370869c4d4eb4d8f7be8a50f45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.167781 23768 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9e0e43fe5147ef802644460230dc6f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:49.169787 23768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9e0e43fe5147ef802644460230dc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.170883 23689 tablet_service.cc:1511] Processing CreateTablet for tablet 3eff2185a07540f08c005b02304d15ad (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:49.172516 23617 tablet_service.cc:1511] Processing CreateTablet for tablet b8b889a8b97443f781c7eef38dba2f96 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:49.177495 23759 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0f95eab8184aa59b6fcef0d9f32b0f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:49.190129 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:49.190909 23819 tablet_bootstrap.cc:654] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:49.198391 23667 leader_election.cc:343] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.201732 23759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0f95eab8184aa59b6fcef0d9f32b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.204339 23617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b889a8b97443f781c7eef38dba2f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.212370 23612 tablet_service.cc:1511] Processing CreateTablet for tablet 3eff2185a07540f08c005b02304d15ad (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:49.213774 23612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eff2185a07540f08c005b02304d15ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.221345 23763 tablet_service.cc:1511] Processing CreateTablet for tablet ec11dcde267d48f4b479e4ffb468a0bc (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:49.222703 23687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee650b0b99c4413293e36b0fa9631151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.222801 23763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec11dcde267d48f4b479e4ffb468a0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.226418 23692 tablet_service.cc:1511] Processing CreateTablet for tablet f7ba611dbb174024a86916a09b17660c (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:49.227929 23693 tablet_service.cc:1511] Processing CreateTablet for tablet 819369bff57548ee8188f19ea4e8f622 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:49.234308 23685 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab3e50aa3864da9beb30247f660a030 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:49.227929 23619 tablet_service.cc:1511] Processing CreateTablet for tablet 0fcdc335ab6748159bae3d8308e238ae (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:49.238730 23818 tablet_bootstrap.cc:654] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.238581 23690 tablet_service.cc:1511] Processing CreateTablet for tablet 55436fc3614f4f558828ea5de361e5f0 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:49.253880 23691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5fa82982f53411c84a07a2fb3918888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.264767 23692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ba611dbb174024a86916a09b17660c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.265793 23761 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3b7e5b938d488e915e4b83c40e6e1d (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:49.270251 23619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fcdc335ab6748159bae3d8308e238ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.274971 23685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab3e50aa3864da9beb30247f660a030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.276410 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:49.276952 23690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55436fc3614f4f558828ea5de361e5f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:49.278261 23592 leader_election.cc:343] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.283715 23693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819369bff57548ee8188f19ea4e8f622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.284781 23689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eff2185a07540f08c005b02304d15ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.280478 23761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3b7e5b938d488e915e4b83c40e6e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.319674 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:49.320290 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:49.321161 23768 tablet_service.cc:1511] Processing CreateTablet for tablet 80466d92afe9453b9cd96ab9f7f593dc (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:49.323439 23615 tablet_service.cc:1511] Processing CreateTablet for tablet ee650b0b99c4413293e36b0fa9631151 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:49.324846 23615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee650b0b99c4413293e36b0fa9631151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.325173 23610 tablet_service.cc:1511] Processing CreateTablet for tablet 819369bff57548ee8188f19ea4e8f622 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:07:49.330807 23742 leader_election.cc:343] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.311302 23766 tablet_service.cc:1511] Processing CreateTablet for tablet 8f80c880e2784395811b9b9ab65aaf82 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:49.331347 23742 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:49.340808 23824 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.340582 23616 tablet_service.cc:1511] Processing CreateTablet for tablet d5fa82982f53411c84a07a2fb3918888 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:07:49.334545 23669 leader_election.cc:343] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.341845 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:49.342828 23826 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.343807 23819 tablet_bootstrap.cc:492] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:49.344324 23819 ts_tablet_manager.cc:1403] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.407s	user 0.003s	sys 0.033s
I20260709 13:07:49.344156 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:49.347011 23593 leader_election.cc:343] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.347479 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:49.347338 23819 raft_consensus.cc:359] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.348254 23819 raft_consensus.cc:385] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.348579 23819 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.348678 23825 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.349375 23819 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.350684 23688 tablet_service.cc:1511] Processing CreateTablet for tablet da6c8d6f775147c1807ebd5917f806a8 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:49.351511 23819 ts_tablet_manager.cc:1434] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:07:49.330011 23765 tablet_service.cc:1511] Processing CreateTablet for tablet 3473b09c073142659e12a365e9aed3f3 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:49.385111 23759 tablet_service.cc:1511] Processing CreateTablet for tablet 8126e5c9a36b4a6e859566d2a92590e6 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:49.385771 23819 tablet_bootstrap.cc:492] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:49.389461 23691 tablet_service.cc:1511] Processing CreateTablet for tablet ec11dcde267d48f4b479e4ffb468a0bc (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:49.391072 23610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819369bff57548ee8188f19ea4e8f622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.370743 23686 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0f95eab8184aa59b6fcef0d9f32b0f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:49.369216 23820 tablet_bootstrap.cc:492] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
W20260709 13:07:49.396050 23575 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:49.393882 23820 ts_tablet_manager.cc:1403] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.593s	user 0.031s	sys 0.050s
I20260709 13:07:49.398433 23612 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab3e50aa3864da9beb30247f660a030 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:49.363808 23688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6c8d6f775147c1807ebd5917f806a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.398674 23611 tablet_service.cc:1511] Processing CreateTablet for tablet f7ba611dbb174024a86916a09b17660c (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:49.356076 23768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80466d92afe9453b9cd96ab9f7f593dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.362687 23690 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9e0e43fe5147ef802644460230dc6f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:49.383416 23613 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 28) took 1023 ms. Trace:
I20260709 13:07:49.388908 23618 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 29) took 1027 ms. Trace:
I20260709 13:07:49.401978 23612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab3e50aa3864da9beb30247f660a030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.404021 23618 rpcz_store.cc:276] 0709 13:07:48.361974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.949890 (+587916us) service_pool.cc:224] Handling call
0709 13:07:49.065256 (+115366us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.065402 (+   146us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.255751 (+190349us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.358440 (+102689us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.388755 (+ 30315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.403913 23613 rpcz_store.cc:276] 0709 13:07:48.360094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.825484 (+465390us) service_pool.cc:224] Handling call
0709 13:07:48.911618 (+ 86134us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b46340831 00007f2b4631dac3 00007f2b462cc400 00007f2b3f751af4 00007f2b3f751a82 00007f2b3f7519b1
0709 13:07:48.921399 (+  9781us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:48.926956 (+  5557us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.209544 (+282588us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.332406 (+122862us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.383352 (+ 50946us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3949824}
I20260709 13:07:49.408070 23616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5fa82982f53411c84a07a2fb3918888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.408911 23826 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.409410 23826 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.412056 23686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0f95eab8184aa59b6fcef0d9f32b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.245790 23762 tablet_service.cc:1511] Processing CreateTablet for tablet de67ca6156e842db9c8994e493d241ca (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:49.413012 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:49.414274 23690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9e0e43fe5147ef802644460230dc6f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:49.414633 23667 leader_election.cc:343] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.416584 23613 tablet_service.cc:1511] Processing CreateTablet for tablet 55436fc3614f4f558828ea5de361e5f0 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:49.411500 23826 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:49.418857 23691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec11dcde267d48f4b479e4ffb468a0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.419505 23824 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.402746 23766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f80c880e2784395811b9b9ab65aaf82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.420022 23824 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.421581 23613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55436fc3614f4f558828ea5de361e5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.424127 23765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3473b09c073142659e12a365e9aed3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.424679 23767 tablet_service.cc:1511] Processing CreateTablet for tablet 36da9377816744739720cb01b6191368 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:49.425001 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:49.426100 23767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36da9377816744739720cb01b6191368. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:49.426679 23743 leader_election.cc:343] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.427788 23618 tablet_service.cc:1511] Processing CreateTablet for tablet da6c8d6f775147c1807ebd5917f806a8 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:49.429232 23618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6c8d6f775147c1807ebd5917f806a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.429998 23759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8126e5c9a36b4a6e859566d2a92590e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.431711 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:49.434861 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:49.436097 23762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de67ca6156e842db9c8994e493d241ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.436669 23611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ba611dbb174024a86916a09b17660c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.436735 23685 tablet_service.cc:1511] Processing CreateTablet for tablet de67ca6156e842db9c8994e493d241ca (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:49.438073 23685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de67ca6156e842db9c8994e493d241ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.399669 23820 raft_consensus.cc:359] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.440507 23820 raft_consensus.cc:385] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.418219 23819 tablet_bootstrap.cc:654] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.422127 23824 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:49.421695 23692 tablet_service.cc:1511] Processing CreateTablet for tablet 3473b09c073142659e12a365e9aed3f3 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:49.440828 23820 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.417886 23614 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 30) took 1013 ms. Trace:
I20260709 13:07:49.442418 23614 rpcz_store.cc:276] 0709 13:07:48.404702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.964350 (+559648us) service_pool.cc:224] Handling call
0709 13:07:49.077466 (+113116us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.077603 (+   137us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.318926 (+241323us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.417330 (+ 98404us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.417819 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:49.443149 23742 leader_election.cc:343] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.443614 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:49.411356 23694 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3b7e5b938d488e915e4b83c40e6e1d (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:49.444859 23824 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.446599 23820 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.445338 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3b7e5b938d488e915e4b83c40e6e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.450736 23614 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9e0e43fe5147ef802644460230dc6f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:49.454686 23820 ts_tablet_manager.cc:1434] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.002s
W20260709 13:07:49.455238 23669 leader_election.cc:343] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.464015 23669 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:49.464862 23826 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.477770 23693 tablet_service.cc:1511] Processing CreateTablet for tablet 8f80c880e2784395811b9b9ab65aaf82 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:49.479197 23693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f80c880e2784395811b9b9ab65aaf82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.481278 23689 tablet_service.cc:1511] Processing CreateTablet for tablet 80466d92afe9453b9cd96ab9f7f593dc (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:49.482659 23689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80466d92afe9453b9cd96ab9f7f593dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.483387 23617 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0f95eab8184aa59b6fcef0d9f32b0f (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:49.485270 23692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3473b09c073142659e12a365e9aed3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.493943 23764 tablet_service.cc:1511] Processing CreateTablet for tablet a0d6af36909c4398a1ec8496f1dde507 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:49.496207 23764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d6af36909c4398a1ec8496f1dde507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.496759 23617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0f95eab8184aa59b6fcef0d9f32b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.498200 23766 tablet_service.cc:1511] Processing CreateTablet for tablet 5499c62f40a046f2a8efb671c77f08b3 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:49.508076 23619 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 33) took 1045 ms. Trace:
I20260709 13:07:49.508617 23619 rpcz_store.cc:276] 0709 13:07:48.462518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.114975 (+652457us) service_pool.cc:224] Handling call
0709 13:07:49.269578 (+154603us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.269728 (+   150us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.412391 (+142663us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.479038 (+ 66647us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.508007 (+ 28969us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.509779 23691 tablet_service.cc:1511] Processing CreateTablet for tablet 8126e5c9a36b4a6e859566d2a92590e6 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:49.511080 23691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8126e5c9a36b4a6e859566d2a92590e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.511184 23820 tablet_bootstrap.cc:492] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:49.499606 23766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5499c62f40a046f2a8efb671c77f08b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.512915 23614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9e0e43fe5147ef802644460230dc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.524267 23690 tablet_service.cc:1511] Processing CreateTablet for tablet 36da9377816744739720cb01b6191368 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:49.525641 23818 tablet_bootstrap.cc:492] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:49.525683 23690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36da9377816744739720cb01b6191368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.526294 23818 ts_tablet_manager.cc:1403] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.393s	user 0.002s	sys 0.014s
I20260709 13:07:49.526780 23761 tablet_service.cc:1511] Processing CreateTablet for tablet 01ec1d400f174350acc92722149e02d4 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:49.529444 23818 raft_consensus.cc:359] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.530156 23818 raft_consensus.cc:385] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.530478 23818 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.533895 23819 tablet_bootstrap.cc:492] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:49.534413 23819 ts_tablet_manager.cc:1403] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.149s	user 0.006s	sys 0.011s
I20260709 13:07:49.537508 23819 raft_consensus.cc:359] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.538363 23819 raft_consensus.cc:385] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.538714 23819 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.539636 23819 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.545503 23690 tablet_service.cc:1511] Processing CreateTablet for tablet a0d6af36909c4398a1ec8496f1dde507 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:49.547030 23690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d6af36909c4398a1ec8496f1dde507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.546744 23687 tablet_service.cc:1511] Processing CreateTablet for tablet 5499c62f40a046f2a8efb671c77f08b3 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:49.511647 23619 tablet_service.cc:1511] Processing CreateTablet for tablet ec11dcde267d48f4b479e4ffb468a0bc (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:49.549487 23687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5499c62f40a046f2a8efb671c77f08b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.551322 23819 ts_tablet_manager.cc:1434] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:07:49.552134 23761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ec1d400f174350acc92722149e02d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.531236 23818 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.567790 23760 tablet_service.cc:1511] Processing CreateTablet for tablet ce71536613184c6d869077ae232876cc (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:49.569197 23760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce71536613184c6d869077ae232876cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.583173 23763 tablet_service.cc:1511] Processing CreateTablet for tablet 37a8de42d0d8417f9ad5486f22fdbf73 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:49.585501 23763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a8de42d0d8417f9ad5486f22fdbf73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.596894 23688 tablet_service.cc:1511] Processing CreateTablet for tablet ce71536613184c6d869077ae232876cc (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:49.601704 23688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce71536613184c6d869077ae232876cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.603876 23690 tablet_service.cc:1511] Processing CreateTablet for tablet 37a8de42d0d8417f9ad5486f22fdbf73 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:49.608685 23690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a8de42d0d8417f9ad5486f22fdbf73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.615283 23819 tablet_bootstrap.cc:492] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:49.622016 23819 tablet_bootstrap.cc:654] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.624042 23619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec11dcde267d48f4b479e4ffb468a0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.628664 23615 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 38) took 1033 ms. Trace:
I20260709 13:07:49.629050 23611 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 40) took 1021 ms. Trace:
I20260709 13:07:49.629498 23612 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 41) took 1018 ms. Trace:
I20260709 13:07:49.629099 23615 rpcz_store.cc:276] 0709 13:07:48.594867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.322468 (+727601us) service_pool.cc:224] Handling call
0709 13:07:49.324357 (+  1889us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.324445 (+    88us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.439794 (+115349us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.628089 (+188295us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.628596 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51606}
I20260709 13:07:49.629591 23611 rpcz_store.cc:276] 0709 13:07:48.607323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.394390 (+787067us) service_pool.cc:224] Handling call
0709 13:07:49.402798 (+  8408us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.402902 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.517483 (+114581us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.628561 (+111078us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.628989 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40721}
I20260709 13:07:49.630033 23612 rpcz_store.cc:276] 0709 13:07:48.611336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.397476 (+786140us) service_pool.cc:224] Handling call
0709 13:07:49.399315 (+  1839us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.399410 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.507125 (+107715us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.629026 (+121901us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.629438 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31369}
I20260709 13:07:49.631978 23612 tablet_service.cc:1511] Processing CreateTablet for tablet 3473b09c073142659e12a365e9aed3f3 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:49.633276 23612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3473b09c073142659e12a365e9aed3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.631598 23615 tablet_service.cc:1511] Processing CreateTablet for tablet de67ca6156e842db9c8994e493d241ca (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:49.633654 23617 tablet_service.cc:1511] Processing CreateTablet for tablet 8f80c880e2784395811b9b9ab65aaf82 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:49.634524 23615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de67ca6156e842db9c8994e493d241ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.635334 23610 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 39) took 1029 ms. Trace:
I20260709 13:07:49.635978 23616 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 37) took 1051 ms. Trace:
I20260709 13:07:49.635771 23610 rpcz_store.cc:276] 0709 13:07:48.606098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.324168 (+718070us) service_pool.cc:224] Handling call
0709 13:07:49.326015 (+  1847us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.382312 (+ 56297us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.465329 (+ 83017us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.628616 (+163287us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.635277 (+  6661us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35705}
I20260709 13:07:49.636500 23616 rpcz_store.cc:276] 0709 13:07:48.586513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.247669 (+661156us) service_pool.cc:224] Handling call
0709 13:07:49.399831 (+152162us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.400000 (+   169us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.471010 (+ 71010us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.628015 (+157005us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.635921 (+  7906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.637833 23610 tablet_service.cc:1511] Processing CreateTablet for tablet 80466d92afe9453b9cd96ab9f7f593dc (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:49.638355 23616 tablet_service.cc:1511] Processing CreateTablet for tablet 8126e5c9a36b4a6e859566d2a92590e6 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:49.639099 23610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80466d92afe9453b9cd96ab9f7f593dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.648105 23617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f80c880e2784395811b9b9ab65aaf82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.648550 23824 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.653455 23824 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.654084 23612 tablet_service.cc:1511] Processing CreateTablet for tablet 36da9377816744739720cb01b6191368 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:49.655434 23612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36da9377816744739720cb01b6191368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.657068 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:49.658640 23743 leader_election.cc:343] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.660892 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:49.662545 23742 leader_election.cc:343] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.663154 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:49.664903 23824 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:49.650472 23614 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 44) took 1013 ms. Trace:
I20260709 13:07:49.648597 23611 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3b7e5b938d488e915e4b83c40e6e1d (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:49.649374 23618 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 43) took 1030 ms. Trace:
I20260709 13:07:49.666507 23614 rpcz_store.cc:276] 0709 13:07:48.637384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.449705 (+812321us) service_pool.cc:224] Handling call
0709 13:07:49.474545 (+ 24840us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.511435 (+ 36890us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.603163 (+ 91728us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.649927 (+ 46764us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.650403 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23208,"spinlock_wait_cycles":17792}
I20260709 13:07:49.668226 23824 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.666551 23818 ts_tablet_manager.cc:1434] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.140s	user 0.009s	sys 0.000s
I20260709 13:07:49.669238 23618 rpcz_store.cc:276] 0709 13:07:48.619205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.422096 (+802891us) service_pool.cc:224] Handling call
0709 13:07:49.428760 (+  6664us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.428865 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.610214 (+181349us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.648848 (+ 38634us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.649309 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31632}
I20260709 13:07:49.680737 23686 tablet_service.cc:1511] Processing CreateTablet for tablet 01ec1d400f174350acc92722149e02d4 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:49.681277 23613 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 42) took 1066 ms. Trace:
I20260709 13:07:49.689608 23616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8126e5c9a36b4a6e859566d2a92590e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.701360 23686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ec1d400f174350acc92722149e02d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.694952 23613 rpcz_store.cc:276] 0709 13:07:48.615316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.408564 (+793248us) service_pool.cc:224] Handling call
0709 13:07:49.418208 (+  9644us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.418302 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.626772 (+208470us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.668746 (+ 41974us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.680847 (+ 12101us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e81a2 00007f2b47129bb9 00007f2b4625ad88 00007f2b46321973 00007f2b4631d70f 00007f2b4631decd 00007f2b462cc400 00007f2b3f751af4 00007f2b3f751a82
0709 13:07:49.681208 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3162496}
I20260709 13:07:49.702023 23618 tablet_service.cc:1511] Processing CreateTablet for tablet 5499c62f40a046f2a8efb671c77f08b3 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:49.696609 23818 tablet_bootstrap.cc:492] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:49.704015 23613 tablet_service.cc:1511] Processing CreateTablet for tablet 01ec1d400f174350acc92722149e02d4 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:49.712107 23820 tablet_bootstrap.cc:700] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Time spent opening tablet: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:07:49.712839 23820 tablet_bootstrap.cc:654] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.716881 23613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ec1d400f174350acc92722149e02d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.720359 23611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3b7e5b938d488e915e4b83c40e6e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.722972 23618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5499c62f40a046f2a8efb671c77f08b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.729852 23818 tablet_bootstrap.cc:654] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.732117 23614 tablet_service.cc:1511] Processing CreateTablet for tablet a0d6af36909c4398a1ec8496f1dde507 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:49.733611 23614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d6af36909c4398a1ec8496f1dde507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.736696 23612 tablet_service.cc:1511] Processing CreateTablet for tablet ce71536613184c6d869077ae232876cc (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:49.746049 23612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce71536613184c6d869077ae232876cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.749424 23615 tablet_service.cc:1511] Processing CreateTablet for tablet 37a8de42d0d8417f9ad5486f22fdbf73 (DEFAULT_TABLE table=test-workload [id=f97dd27cebde439b932c69ce5e91597a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:49.750788 23615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a8de42d0d8417f9ad5486f22fdbf73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.758785 23820 tablet_bootstrap.cc:492] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:49.759596 23820 ts_tablet_manager.cc:1403] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.249s	user 0.004s	sys 0.012s
I20260709 13:07:49.764391 23820 raft_consensus.cc:359] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.765568 23820 raft_consensus.cc:385] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.766037 23820 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.767246 23820 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.773216 23819 tablet_bootstrap.cc:492] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:49.773734 23819 ts_tablet_manager.cc:1403] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.209s	user 0.016s	sys 0.035s
I20260709 13:07:49.774540 23820 ts_tablet_manager.cc:1434] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:07:49.779353 23819 raft_consensus.cc:359] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.780148 23819 raft_consensus.cc:385] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.780471 23819 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.776669 23619 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52038 (request call id 46) took 1084 ms. Trace:
I20260709 13:07:49.781363 23819 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.782307 23619 rpcz_store.cc:276] 0709 13:07:48.691998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.510717 (+818719us) service_pool.cc:224] Handling call
0709 13:07:49.559236 (+ 48519us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:49.564035 (+  4799us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:49.729183 (+165148us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:49.769564 (+ 40381us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:49.776112 (+  6548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.793141 23819 ts_tablet_manager.cc:1434] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:07:49.783376 23820 tablet_bootstrap.cc:492] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:49.795258 23819 tablet_bootstrap.cc:492] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:49.801780 23819 tablet_bootstrap.cc:654] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.807854 23820 tablet_bootstrap.cc:654] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.809293 23818 tablet_bootstrap.cc:492] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:49.809861 23818 ts_tablet_manager.cc:1403] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.114s	user 0.022s	sys 0.018s
I20260709 13:07:49.817294 23818 raft_consensus.cc:359] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.819228 23818 raft_consensus.cc:385] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.819578 23819 tablet_bootstrap.cc:492] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:49.819634 23818 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.820344 23819 ts_tablet_manager.cc:1403] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 13:07:49.820747 23820 tablet_bootstrap.cc:492] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:49.821383 23820 ts_tablet_manager.cc:1403] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.002s
I20260709 13:07:49.820938 23818 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.823772 23818 ts_tablet_manager.cc:1434] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:49.825076 23818 tablet_bootstrap.cc:492] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:49.825946 23820 raft_consensus.cc:359] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.826817 23820 raft_consensus.cc:385] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.827196 23820 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.826984 23819 raft_consensus.cc:359] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:07:49.827881 23819 raft_consensus.cc:385] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.828282 23819 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.828168 23820 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.829355 23819 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:07:49.830814 23820 ts_tablet_manager.cc:1434] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:49.832409 23820 tablet_bootstrap.cc:492] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:49.832952 23818 tablet_bootstrap.cc:654] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.837405 23819 ts_tablet_manager.cc:1434] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.005s
I20260709 13:07:49.838821 23819 tablet_bootstrap.cc:492] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:49.839882 23820 tablet_bootstrap.cc:654] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.847483 23819 tablet_bootstrap.cc:654] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.866801 23820 tablet_bootstrap.cc:492] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:49.867524 23820 ts_tablet_manager.cc:1403] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.008s
I20260709 13:07:49.871541 23820 raft_consensus.cc:359] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.873039 23820 raft_consensus.cc:385] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.873459 23820 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.874498 23819 tablet_bootstrap.cc:492] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:49.875010 23819 ts_tablet_manager.cc:1403] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.010s
I20260709 13:07:49.874332 23820 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.875217 23818 tablet_bootstrap.cc:492] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:49.875859 23818 ts_tablet_manager.cc:1403] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.051s	user 0.026s	sys 0.021s
I20260709 13:07:49.877141 23820 ts_tablet_manager.cc:1434] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:07:49.878733 23820 tablet_bootstrap.cc:492] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:49.878443 23819 raft_consensus.cc:359] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.879379 23818 raft_consensus.cc:359] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.880400 23818 raft_consensus.cc:385] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.880810 23818 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.879321 23819 raft_consensus.cc:385] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.882462 23819 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.881940 23818 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.883298 23819 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.885596 23818 ts_tablet_manager.cc:1434] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:07:49.886385 23819 ts_tablet_manager.cc:1434] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:07:49.887683 23819 tablet_bootstrap.cc:492] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:49.887575 23818 tablet_bootstrap.cc:492] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:49.890497 23820 tablet_bootstrap.cc:654] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.893285 23825 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.893831 23825 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.895059 23819 tablet_bootstrap.cc:654] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.898150 23818 tablet_bootstrap.cc:654] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.902887 23820 tablet_bootstrap.cc:492] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:49.903674 23820 ts_tablet_manager.cc:1403] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 13:07:49.907760 23819 tablet_bootstrap.cc:492] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:49.908365 23819 ts_tablet_manager.cc:1403] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.015s
I20260709 13:07:49.908915 23820 raft_consensus.cc:359] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.910221 23820 raft_consensus.cc:385] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.910840 23820 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.912254 23819 raft_consensus.cc:359] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.913060 23819 raft_consensus.cc:385] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.913372 23819 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.914251 23819 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.917502 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:49.917781 23819 ts_tablet_manager.cc:1434] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:07:49.918306 23778 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:49.920275 23592 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:49.921027 23819 tablet_bootstrap.cc:492] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:49.921128 23820 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.922757 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:49.925376 23593 leader_election.cc:343] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.928879 23818 tablet_bootstrap.cc:492] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:49.929642 23818 ts_tablet_manager.cc:1403] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.015s
I20260709 13:07:49.930007 23819 tablet_bootstrap.cc:654] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.930689 23825 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:49.931376 23825 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.931706 23825 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.932067 23825 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.933881 23818 raft_consensus.cc:359] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.934957 23818 raft_consensus.cc:385] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.935385 23818 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.936609 23818 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.940323 23818 ts_tablet_manager.cc:1434] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260709 13:07:49.941777 23818 tablet_bootstrap.cc:492] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:49.947089 23819 tablet_bootstrap.cc:492] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:49.947598 23819 ts_tablet_manager.cc:1403] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.007s
I20260709 13:07:49.950246 23819 raft_consensus.cc:359] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.951056 23819 raft_consensus.cc:385] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.951339 23819 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.951785 23825 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.952055 23819 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.953792 23818 tablet_bootstrap.cc:654] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.954298 23819 ts_tablet_manager.cc:1434] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:49.954979 23825 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:49.955387 23819 tablet_bootstrap.cc:492] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:49.957034 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:49.958580 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:49.959203 23778 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:49.959125 23593 leader_election.cc:343] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.963656 23819 tablet_bootstrap.cc:654] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.967130 23778 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:49.969014 23592 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:07:49.970450 23857 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.971010 23857 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:49.972741 23857 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.976902 23819 tablet_bootstrap.cc:492] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:49.977408 23819 ts_tablet_manager.cc:1403] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.016s
I20260709 13:07:49.977324 23820 ts_tablet_manager.cc:1434] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.073s	user 0.013s	sys 0.025s
I20260709 13:07:49.977708 23818 tablet_bootstrap.cc:492] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:49.978394 23818 ts_tablet_manager.cc:1403] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.005s
I20260709 13:07:49.979274 23820 tablet_bootstrap.cc:492] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:49.980410 23819 raft_consensus.cc:359] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.981122 23819 raft_consensus.cc:385] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.981421 23819 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.981235 23818 raft_consensus.cc:359] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.982014 23818 raft_consensus.cc:385] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.982316 23818 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.982281 23819 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.983240 23818 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:49.988399 23820 tablet_bootstrap.cc:654] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.991499 23819 ts_tablet_manager.cc:1434] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:07:49.994295 23818 ts_tablet_manager.cc:1434] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:07:49.999755 23826 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.000368 23826 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:07:50.002364 23826 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:07:50.004679 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.004038 23526 catalog_manager.cc:5697] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.004782 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.005708 23629 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
W20260709 13:07:50.006127 23667 leader_election.cc:343] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.007511 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:50.008308 23826 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.008773 23826 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.008373 23819 tablet_bootstrap.cc:492] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:50.009104 23826 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.010397 23818 tablet_bootstrap.cc:492] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:50.011572 23820 tablet_bootstrap.cc:492] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:50.012151 23820 ts_tablet_manager.cc:1403] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.014s
I20260709 13:07:50.015197 23820 raft_consensus.cc:359] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.016001 23819 tablet_bootstrap.cc:654] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.016003 23820 raft_consensus.cc:385] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.016734 23820 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.016729 23826 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:07:50.018039 23820 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.019863 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:50.020697 23820 ts_tablet_manager.cc:1434] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
W20260709 13:07:50.021389 23667 leader_election.cc:343] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.021814 23820 tablet_bootstrap.cc:492] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:50.023579 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:50.024226 23629 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.027943 23818 tablet_bootstrap.cc:654] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.028863 23819 tablet_bootstrap.cc:492] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:50.029460 23819 ts_tablet_manager.cc:1403] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 13:07:50.029775 23820 tablet_bootstrap.cc:654] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.032896 23819 raft_consensus.cc:359] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.033962 23819 raft_consensus.cc:385] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.034353 23819 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.035701 23819 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.039566 23826 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:07:50.041162 23826 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.041632 23818 tablet_bootstrap.cc:492] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:50.041736 23826 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.046591 23819 ts_tablet_manager.cc:1434] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:07:50.048379 23819 tablet_bootstrap.cc:492] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:50.035542 23629 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:50.042413 23818 ts_tablet_manager.cc:1403] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.007s
I20260709 13:07:50.051414 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:50.055403 23819 tablet_bootstrap.cc:654] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.058260 23870 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.058454 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.058914 23870 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.059280 23866 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:07:50.059991 23669 leader_election.cc:343] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.061578 23870 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.062387 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.063182 23778 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:50.063988 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.064829 23777 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 1: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:07:50.065095 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:50.065765 23826 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.066390 23826 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.066861 23826 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.067310 23826 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.062341 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.069638 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:50.071381 23870 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.055186 23818 raft_consensus.cc:359] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.072700 23818 raft_consensus.cc:385] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.073094 23818 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.080974 23820 tablet_bootstrap.cc:492] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:50.081131 23866 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:50.081682 23820 ts_tablet_manager.cc:1403] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.060s	user 0.030s	sys 0.022s
I20260709 13:07:50.082125 23866 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:07:50.082994 23870 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.084379 23818 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.087144 23818 ts_tablet_manager.cc:1434] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:07:50.087662 23819 tablet_bootstrap.cc:492] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:50.088171 23819 ts_tablet_manager.cc:1403] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.023s
I20260709 13:07:50.084926 23820 raft_consensus.cc:359] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.088814 23820 raft_consensus.cc:385] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.088392 23818 tablet_bootstrap.cc:492] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:50.089195 23820 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.090839 23820 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.091003 23819 raft_consensus.cc:359] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.091943 23819 raft_consensus.cc:385] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.092293 23819 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.093179 23819 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.093721 23820 ts_tablet_manager.cc:1434] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 13:07:50.094859 23820 tablet_bootstrap.cc:492] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:50.095672 23819 ts_tablet_manager.cc:1434] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:07:50.096117 23818 tablet_bootstrap.cc:654] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.096688 23819 tablet_bootstrap.cc:492] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:50.102581 23820 tablet_bootstrap.cc:654] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.104414 23819 tablet_bootstrap.cc:654] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.107115 23818 tablet_bootstrap.cc:492] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:50.107656 23818 ts_tablet_manager.cc:1403] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.003s
I20260709 13:07:50.110775 23818 raft_consensus.cc:359] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.111670 23818 raft_consensus.cc:385] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.112011 23818 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.112883 23818 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.113819 23826 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.115463 23818 ts_tablet_manager.cc:1434] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:50.116772 23818 tablet_bootstrap.cc:492] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:50.118629 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:07:50.120380 23669 leader_election.cc:343] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.122227 23826 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.123605 23820 tablet_bootstrap.cc:492] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:50.124158 23820 ts_tablet_manager.cc:1403] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.002s
I20260709 13:07:50.124334 23845 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.124876 23845 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.127043 23820 raft_consensus.cc:359] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.127840 23820 raft_consensus.cc:385] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.128151 23820 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.128813 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:50.128887 23820 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.129585 23704 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:50.130157 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:50.131191 23820 ts_tablet_manager.cc:1434] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:50.131430 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:50.131989 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.132544 23824 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.132972 23824 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.132898 23629 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:50.133513 23824 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.131048 23777 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.134521 23818 tablet_bootstrap.cc:654] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.136006 23845 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:50.138051 23857 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.139022 23857 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.143914 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:50.144888 23704 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:50.145928 23820 tablet_bootstrap.cc:492] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:50.146409 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:50.147421 23858 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.147887 23858 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.148257 23858 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.149013 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.149791 23778 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:50.151366 23857 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.152478 23820 tablet_bootstrap.cc:654] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.156682 23858 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.159212 23858 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.159538 23857 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.160179 23857 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.160820 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:50.161582 23778 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.165620 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:50.166471 23704 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.167155 23857 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.169082 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.158313 23824 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.174552 23776 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:50.176993 23777 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:50.177178 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:50.179368 23857 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.179816 23857 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.180204 23857 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.180266 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:50.182067 23702 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.172174 23826 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.185277 23525 catalog_manager.cc:5697] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.187466 23845 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.187997 23845 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.186352 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:50.190179 23845 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:50.190641 23866 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.188184 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:50.185343 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:50.192548 23866 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:50.193370 23866 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.193826 23870 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.194298 23870 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.191541 23826 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.177191 23824 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:50.197283 23870 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.197180 23778 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:50.197553 23826 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.198125 23629 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.198241 23703 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:50.201434 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.202739 23776 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:50.203882 23592 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:50.204074 23667 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:50.204838 23858 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.205333 23858 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:50.205902 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.206578 23777 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:50.206899 23629 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:50.206197 23858 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.198025 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:50.202030 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.199307 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.200906 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:50.213092 23742 leader_election.cc:343] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.213373 23819 tablet_bootstrap.cc:492] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:50.213227 23627 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:50.213864 23819 ts_tablet_manager.cc:1403] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.117s	user 0.036s	sys 0.030s
I20260709 13:07:50.216606 23819 raft_consensus.cc:359] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.217290 23819 raft_consensus.cc:385] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.217566 23819 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.218204 23819 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.220244 23819 ts_tablet_manager.cc:1434] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:07:50.208868 23826 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.221410 23819 tablet_bootstrap.cc:492] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:50.222205 23825 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.222692 23825 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.224416 23820 tablet_bootstrap.cc:492] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:50.224833 23825 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.224990 23820 ts_tablet_manager.cc:1403] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.011s
I20260709 13:07:50.220728 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:50.221985 23826 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.220322 23667 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:50.226820 23826 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:50.230559 23743 leader_election.cc:343] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.230903 23824 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.231089 23743 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:50.231530 23824 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:50.235697 23845 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.233788 23824 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.234740 23870 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.236807 23870 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.237182 23870 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.239123 23826 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.239627 23818 tablet_bootstrap.cc:492] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:50.240165 23818 ts_tablet_manager.cc:1403] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.013s
I20260709 13:07:50.233680 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:50.245023 23704 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:50.252174 23819 tablet_bootstrap.cc:654] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.253981 23820 raft_consensus.cc:359] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.258843 23820 raft_consensus.cc:385] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.259251 23820 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.249159 23701 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:50.249539 23857 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.266919 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:50.268311 23825 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.268986 23825 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.269532 23825 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.269544 23626 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 1: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:07:50.250850 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.271991 23866 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.274048 23777 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:50.273360 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:50.273721 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:50.276804 23818 raft_consensus.cc:359] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:07:50.286160 23820 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.286670 23818 raft_consensus.cc:385] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.249544 23702 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:50.287213 23818 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.285467 23872 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.272161 23857 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.288919 23872 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.289057 23818 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:07:50.277330 23866 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.291345 23872 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.292156 23818 ts_tablet_manager.cc:1434] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:07:50.292299 23866 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.293618 23818 tablet_bootstrap.cc:492] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:50.294205 23701 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:50.294775 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.287808 23776 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.295480 23778 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:50.297045 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.299386 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:50.300707 23866 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.302348 23866 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.302738 23866 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:50.307595 23667 leader_election.cc:343] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.308683 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.331334 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:50.332350 23628 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 1: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:07:50.333680 23818 tablet_bootstrap.cc:654] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.338398 23826 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.342222 23527 catalog_manager.cc:5697] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.343225 23866 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.344769 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:50.346221 23667 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:50.346812 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:50.346735 23825 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.347288 23826 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.312827 23858 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.348145 23858 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.349073 23626 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:50.350131 23858 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.351748 23870 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.352869 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:50.353648 23701 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:50.353626 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.315419 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.354331 23778 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:50.356204 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:50.356978 23777 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.358253 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:50.358728 23626 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.360425 23824 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.361905 23824 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:07:50.362251 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:07:50.362622 23776 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:50.363636 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:07:50.364049 23824 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:50.359226 23870 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.365795 23858 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.366329 23858 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:50.366839 23885 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.367616 23885 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.368197 23885 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.314934 23526 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.308748 23525 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.367190 23858 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:50.369148 23669 leader_election.cc:343] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.369590 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:50.370723 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:50.370100 23820 ts_tablet_manager.cc:1434] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.145s	user 0.012s	sys 0.037s
I20260709 13:07:50.374612 23820 tablet_bootstrap.cc:492] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:50.380964 23777 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:50.381836 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:50.383332 23776 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.384061 23667 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:50.376684 23866 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.384871 23866 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.385427 23866 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:50.383285 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.386652 23627 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:50.386551 23866 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.387909 23626 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:50.392403 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:50.394013 23819 tablet_bootstrap.cc:492] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:50.375851 23870 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.393477 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:50.397328 23701 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.397651 23885 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.401038 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:50.402405 23702 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:50.402261 23824 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.401515 23819 ts_tablet_manager.cc:1403] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.180s	user 0.015s	sys 0.006s
I20260709 13:07:50.407697 23819 raft_consensus.cc:359] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.408680 23819 raft_consensus.cc:385] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.409082 23819 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.410132 23819 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.416846 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:50.418262 23777 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.422638 23820 tablet_bootstrap.cc:654] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.426219 23701 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:50.428392 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:50.429324 23776 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:50.430099 23857 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.442718 23819 ts_tablet_manager.cc:1434] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.006s
I20260709 13:07:50.424201 23825 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.444144 23819 tablet_bootstrap.cc:492] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:50.445796 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:50.446872 23870 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.447343 23870 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:07:50.442150 23575 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:50.448195 23870 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.451249 23818 tablet_bootstrap.cc:492] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:50.451741 23818 ts_tablet_manager.cc:1403] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.158s	user 0.024s	sys 0.004s
I20260709 13:07:50.448570 23777 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:50.436592 23885 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.456070 23818 raft_consensus.cc:359] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.457196 23818 raft_consensus.cc:385] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.457620 23818 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.460117 23818 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.465616 23818 ts_tablet_manager.cc:1434] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:07:50.467163 23818 tablet_bootstrap.cc:492] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:50.468101 23526 catalog_manager.cc:5697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.459467 23857 raft_consensus.cc:697] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:50.462816 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:50.473888 23857 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.478178 23885 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.479089 23776 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:50.481818 23824 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.488456 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:50.489362 23885 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.491483 23885 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.496673 23527 catalog_manager.cc:5697] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.498811 23527 catalog_manager.cc:5697] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.499931 23818 tablet_bootstrap.cc:654] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.503784 23885 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.504357 23885 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.506702 23819 tablet_bootstrap.cc:654] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.512826 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:50.512952 23870 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.521096 23885 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.520255 23866 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:50.522419 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.534029 23527 catalog_manager.cc:5697] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.528743 23777 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:50.547796 23592 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:50.551419 23857 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.535194 23866 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.583320 23882 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.590334 23882 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.591645 23866 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.605904 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.606130 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:50.607638 23743 leader_election.cc:343] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.630060 23857 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.635016 23820 tablet_bootstrap.cc:492] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:50.636044 23820 ts_tablet_manager.cc:1403] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.262s	user 0.017s	sys 0.004s
W20260709 13:07:50.638854 23742 leader_election.cc:343] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.639647 23742 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:50.640951 23845 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.654397 23819 tablet_bootstrap.cc:492] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:50.649601 23882 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:50.667953 23857 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.655668 23820 raft_consensus.cc:359] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.668792 23820 raft_consensus.cc:385] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.660538 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.668653 23857 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.669504 23820 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.670267 23628 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:50.670419 23820 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.672356 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:50.666725 23819 ts_tablet_manager.cc:1403] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.223s	user 0.004s	sys 0.020s
I20260709 13:07:50.660351 23870 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:07:50.673460 23826 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.676415 23826 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.677011 23826 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.679207 23819 raft_consensus.cc:359] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.682516 23819 raft_consensus.cc:385] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.665472 23818 tablet_bootstrap.cc:492] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:50.683099 23819 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.685207 23819 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.683657 23818 ts_tablet_manager.cc:1403] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.217s	user 0.008s	sys 0.010s
I20260709 13:07:50.686337 23845 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:50.666615 23866 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.690786 23819 ts_tablet_manager.cc:1434] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:07:50.692008 23819 tablet_bootstrap.cc:492] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:50.696492 23820 ts_tablet_manager.cc:1434] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.006s
I20260709 13:07:50.705186 23820 tablet_bootstrap.cc:492] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:50.736276 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.742875 23866 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.755472 23818 raft_consensus.cc:359] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.756677 23818 raft_consensus.cc:385] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.757094 23818 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.747327 23866 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.758173 23818 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:50.757673 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63520.6us
I20260709 13:07:50.757364 23872 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:07:50.783270 23866 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.783867 23866 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.784332 23866 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.784626 23885 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.786755 23890 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.788885 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:50.796221 23820 tablet_bootstrap.cc:654] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.797053 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.799371 23777 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:50.800868 23866 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:07:50.835707 23667 leader_election.cc:343] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.804114 23818 ts_tablet_manager.cc:1434] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.118s	user 0.011s	sys 0.021s
I20260709 13:07:50.841411 23818 tablet_bootstrap.cc:492] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:50.838919 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:50.846397 23857 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.852603 23819 tablet_bootstrap.cc:654] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.853277 23907 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.857204 23907 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.858186 23907 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.885684 23825 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.886626 23818 tablet_bootstrap.cc:654] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.892935 23826 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.899087 23702 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:50.900556 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.904697 23820 tablet_bootstrap.cc:492] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:50.906486 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:50.910265 23902 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.911263 23902 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:50.923230 23667 leader_election.cc:343] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.924733 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.924925 23872 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.905236 23826 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:50.936753 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:50.930174 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.938694 23819 tablet_bootstrap.cc:492] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:50.939872 23628 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:50.942878 23845 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:50.944780 23669 leader_election.cc:343] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.945403 23669 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:07:50.945676 23592 leader_election.cc:343] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.946204 23592 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:50.948417 23872 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.949476 23872 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.949950 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:50.950764 23629 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:50.944805 23667 leader_election.cc:343] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.951144 23820 ts_tablet_manager.cc:1403] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.251s	user 0.020s	sys 0.029s
I20260709 13:07:50.956387 23819 ts_tablet_manager.cc:1403] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.265s	user 0.018s	sys 0.027s
I20260709 13:07:50.963125 23818 tablet_bootstrap.cc:492] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:50.963922 23818 ts_tablet_manager.cc:1403] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.123s	user 0.020s	sys 0.003s
I20260709 13:07:50.968297 23819 raft_consensus.cc:359] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.969261 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:50.972972 23820 raft_consensus.cc:359] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.968643 23826 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.969689 23819 raft_consensus.cc:385] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.968719 23902 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:50.974229 23820 raft_consensus.cc:385] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.975915 23820 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.975719 23819 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
W20260709 13:07:50.971829 23743 leader_election.cc:343] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.987679 23890 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.990649 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:50.991626 23702 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:50.993202 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:50.994323 23882 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.986526 23819 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.994921 23882 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.995494 23882 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.994340 23820 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:50.997763 23819 ts_tablet_manager.cc:1434] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 13:07:50.998986 23820 ts_tablet_manager.cc:1434] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 13:07:50.999183 23819 tablet_bootstrap.cc:492] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:51.001729 23820 tablet_bootstrap.cc:492] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:51.007215 23885 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.028079 23818 raft_consensus.cc:359] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.034662 23818 raft_consensus.cc:385] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.034407 23882 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.035205 23818 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.037047 23818 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.038546 23907 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.040500 23818 ts_tablet_manager.cc:1434] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.001s
I20260709 13:07:51.041666 23907 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.041965 23818 tablet_bootstrap.cc:492] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:51.055866 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:51.056849 23778 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.082664 23819 tablet_bootstrap.cc:654] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.083669 23882 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:51.086656 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:51.086743 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:07:51.089342 23743 leader_election.cc:343] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.091061 23704 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.093415 23629 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:51.095786 23858 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.097479 23872 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.100432 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:51.101145 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:51.102439 23628 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.102656 23826 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.112900 23858 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:07:51.157761 23704 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:51.161844 23820 tablet_bootstrap.cc:654] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.170614 23819 tablet_bootstrap.cc:492] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:51.171155 23819 ts_tablet_manager.cc:1403] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.172s	user 0.003s	sys 0.015s
I20260709 13:07:51.175714 23778 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:51.178795 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:51.179709 23818 tablet_bootstrap.cc:654] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.178968 23819 raft_consensus.cc:359] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.156435 23826 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:51.181015 23819 raft_consensus.cc:385] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.181233 23907 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.181363 23819 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.181836 23907 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:51.182580 23819 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.182824 23907 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.182824 23826 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.185875 23819 ts_tablet_manager.cc:1434] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:07:51.186959 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:51.189073 23882 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.190476 23882 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:51.192167 23882 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.195441 23628 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:51.198812 23872 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.199525 23872 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.201485 23819 tablet_bootstrap.cc:492] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:51.203066 23872 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.203753 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:51.206045 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:51.210505 23818 tablet_bootstrap.cc:492] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:51.213392 23820 tablet_bootstrap.cc:492] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:51.222193 23818 ts_tablet_manager.cc:1403] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.001s
I20260709 13:07:51.222193 23820 ts_tablet_manager.cc:1403] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.222s	user 0.011s	sys 0.007s
I20260709 13:07:51.224279 23872 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.227322 23819 tablet_bootstrap.cc:654] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:51.227234 23667 leader_election.cc:343] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.227191 23872 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.231798 23820 raft_consensus.cc:359] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.232556 23820 raft_consensus.cc:385] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.232805 23820 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.233434 23820 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.234769 23820 ts_tablet_manager.cc:1434] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 13:07:51.235653 23820 tablet_bootstrap.cc:492] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
W20260709 13:07:51.235931 23669 leader_election.cc:343] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.237653 23669 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:51.238116 23818 raft_consensus.cc:359] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.238843 23818 raft_consensus.cc:385] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.239043 23818 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.240453 23818 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.242573 23818 ts_tablet_manager.cc:1434] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:07:51.243669 23818 tablet_bootstrap.cc:492] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:51.245101 23902 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.245568 23902 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.248544 23826 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.248871 23902 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:51.249815 23872 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.250005 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:51.250788 23628 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:51.249675 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:51.251304 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:51.252063 23629 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:51.252602 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:51.253378 23667 leader_election.cc:343] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.254151 23669 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:51.254547 23524 catalog_manager.cc:5697] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.255643 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:51.256947 23820 tablet_bootstrap.cc:654] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.257032 23818 tablet_bootstrap.cc:654] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.258193 23826 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.259387 23902 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.259663 23826 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.260134 23826 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.270280 23902 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.272275 23818 tablet_bootstrap.cc:492] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:51.272732 23818 ts_tablet_manager.cc:1403] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.007s
I20260709 13:07:51.270418 23819 tablet_bootstrap.cc:492] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:51.273670 23819 ts_tablet_manager.cc:1403] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.004s
I20260709 13:07:51.279924 23819 raft_consensus.cc:359] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.281169 23819 raft_consensus.cc:385] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.281572 23819 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.282686 23819 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.276880 23818 raft_consensus.cc:359] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.289672 23819 ts_tablet_manager.cc:1434] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:07:51.289817 23818 raft_consensus.cc:385] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.290323 23818 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.286875 23826 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.291446 23818 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.292498 23820 tablet_bootstrap.cc:492] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:51.293085 23820 ts_tablet_manager.cc:1403] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.058s	user 0.029s	sys 0.010s
I20260709 13:07:51.290942 23819 tablet_bootstrap.cc:492] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:51.294116 23818 ts_tablet_manager.cc:1434] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:07:51.294044 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:51.294932 23629 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.295640 23818 tablet_bootstrap.cc:492] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:51.301411 23819 tablet_bootstrap.cc:654] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.303491 23629 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:51.304914 23669 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:51.305982 23872 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.306507 23818 tablet_bootstrap.cc:654] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.306516 23872 raft_consensus.cc:697] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:51.307480 23820 raft_consensus.cc:359] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.308125 23872 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.308720 23820 raft_consensus.cc:385] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.309424 23820 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.310256 23820 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.313875 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:51.314577 23777 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.322247 23820 ts_tablet_manager.cc:1434] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:07:51.322875 23777 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:51.324321 23826 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.325006 23858 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.325631 23858 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.329517 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:51.330307 23702 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:51.331843 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:51.332414 23819 tablet_bootstrap.cc:492] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:51.332741 23857 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.332912 23819 ts_tablet_manager.cc:1403] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 13:07:51.333122 23857 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.333482 23857 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.348129 23858 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.348351 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:51.349025 23777 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:51.336390 23819 raft_consensus.cc:359] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.360455 23818 tablet_bootstrap.cc:492] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:51.360105 23857 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.360961 23818 ts_tablet_manager.cc:1403] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.009s
I20260709 13:07:51.361053 23819 raft_consensus.cc:385] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.361409 23819 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.362188 23819 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.363127 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:51.363680 23702 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.364585 23819 ts_tablet_manager.cc:1434] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:07:51.365694 23819 tablet_bootstrap.cc:492] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:51.365576 23818 raft_consensus.cc:359] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.366498 23818 raft_consensus.cc:385] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.366837 23818 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.367573 23818 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.371892 23820 tablet_bootstrap.cc:492] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:51.372143 23819 tablet_bootstrap.cc:654] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.372959 23527 catalog_manager.cc:5697] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.376528 23702 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:51.377106 23818 ts_tablet_manager.cc:1434] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:07:51.378625 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:51.380196 23858 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.384159 23858 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:51.384500 23820 tablet_bootstrap.cc:654] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.385885 23902 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.385572 23858 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.386394 23902 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.380677 23857 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.382262 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:51.388715 23902 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:51.388914 23777 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.389348 23819 tablet_bootstrap.cc:492] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:51.389827 23819 ts_tablet_manager.cc:1403] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.007s
I20260709 13:07:51.391615 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:51.392355 23702 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:51.392845 23819 raft_consensus.cc:359] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.393563 23819 raft_consensus.cc:385] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.393891 23819 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.394843 23819 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.395301 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:51.397234 23819 ts_tablet_manager.cc:1434] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:51.398361 23819 tablet_bootstrap.cc:492] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:51.393779 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:07:51.400259 23743 leader_election.cc:343] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.401760 23818 tablet_bootstrap.cc:492] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:51.404515 23902 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.404735 23819 tablet_bootstrap.cc:654] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.405133 23902 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.405561 23902 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.408037 23777 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:51.420946 23818 tablet_bootstrap.cc:654] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.425747 23527 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.426687 23819 tablet_bootstrap.cc:492] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:51.427125 23819 ts_tablet_manager.cc:1403] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 13:07:51.424624 23820 tablet_bootstrap.cc:492] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:51.427779 23820 ts_tablet_manager.cc:1403] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.010s
I20260709 13:07:51.427646 23527 catalog_manager.cc:5697] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.429755 23819 raft_consensus.cc:359] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.424351 23902 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.430398 23819 raft_consensus.cc:385] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.430706 23819 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.431319 23819 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.433079 23819 ts_tablet_manager.cc:1434] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:51.433073 23820 raft_consensus.cc:359] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.433939 23820 raft_consensus.cc:385] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.434192 23819 tablet_bootstrap.cc:492] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:51.434242 23820 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.435401 23820 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.438835 23820 ts_tablet_manager.cc:1434] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:07:51.440618 23819 tablet_bootstrap.cc:654] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.441190 23820 tablet_bootstrap.cc:492] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:51.442387 23818 tablet_bootstrap.cc:492] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:51.442845 23818 ts_tablet_manager.cc:1403] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.006s
I20260709 13:07:51.447461 23820 tablet_bootstrap.cc:654] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.453665 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:07:51.457101 23743 leader_election.cc:343] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.457082 23818 raft_consensus.cc:359] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.459002 23882 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.459080 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:51.458220 23524 catalog_manager.cc:5697] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.459690 23702 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.459530 23882 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.461689 23882 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:51.463387 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:51.464900 23742 leader_election.cc:343] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.466531 23702 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:51.466845 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:51.467749 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:51.458549 23818 raft_consensus.cc:385] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.469355 23818 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.468679 23902 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:07:51.468655 23743 leader_election.cc:343] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.470755 23818 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.472103 23882 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.471653 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:51.474653 23818 ts_tablet_manager.cc:1434] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:07:51.475260 23902 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.473454 23882 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:51.477447 23818 tablet_bootstrap.cc:492] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:51.477955 23882 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.497934 23858 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.500427 23858 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.505515 23858 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.508579 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:51.508973 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:51.509742 23819 tablet_bootstrap.cc:492] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:51.510246 23819 ts_tablet_manager.cc:1403] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.076s	user 0.028s	sys 0.035s
W20260709 13:07:51.510406 23592 leader_election.cc:343] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:51.512679 23593 leader_election.cc:343] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.513236 23820 tablet_bootstrap.cc:492] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:51.513712 23820 ts_tablet_manager.cc:1403] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.024s
I20260709 13:07:51.513625 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:51.513872 23819 raft_consensus.cc:359] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.514501 23858 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.514621 23819 raft_consensus.cc:385] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.514990 23819 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
W20260709 13:07:51.516065 23575 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:51.517063 23819 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.519678 23819 ts_tablet_manager.cc:1434] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:07:51.520779 23819 tablet_bootstrap.cc:492] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:51.521657 23818 tablet_bootstrap.cc:654] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.524821 23820 raft_consensus.cc:359] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.525583 23820 raft_consensus.cc:385] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.525880 23820 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.526593 23820 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.528896 23820 ts_tablet_manager.cc:1434] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:07:51.529621 23819 tablet_bootstrap.cc:654] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.530450 23527 catalog_manager.cc:5697] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.536603 23818 tablet_bootstrap.cc:492] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:51.537140 23820 tablet_bootstrap.cc:492] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:51.537191 23818 ts_tablet_manager.cc:1403] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.006s
I20260709 13:07:51.544195 23818 raft_consensus.cc:359] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.544891 23818 raft_consensus.cc:385] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.545164 23818 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.545805 23818 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.548189 23818 ts_tablet_manager.cc:1434] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:51.549024 23818 tablet_bootstrap.cc:492] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:51.555444 23858 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.556833 23820 tablet_bootstrap.cc:654] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.554610 23818 tablet_bootstrap.cc:654] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.557521 23858 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.568608 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:51.569474 23702 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:51.570667 23858 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.570911 23818 tablet_bootstrap.cc:492] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:51.570824 23872 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.571535 23818 ts_tablet_manager.cc:1403] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:07:51.571925 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:51.572623 23777 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:51.573825 23820 tablet_bootstrap.cc:492] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:51.574005 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:51.574321 23820 ts_tablet_manager.cc:1403] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:07:51.575390 23858 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.571547 23872 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.575995 23858 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.574559 23818 raft_consensus.cc:359] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.576524 23858 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.578629 23820 raft_consensus.cc:359] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.579368 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:51.579643 23820 raft_consensus.cc:385] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.580217 23820 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.582442 23820 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.583454 23819 tablet_bootstrap.cc:492] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:51.576568 23818 raft_consensus.cc:385] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.583951 23819 ts_tablet_manager.cc:1403] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.063s	user 0.029s	sys 0.021s
I20260709 13:07:51.583913 23818 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.584771 23820 ts_tablet_manager.cc:1434] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:07:51.584934 23818 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.586115 23820 tablet_bootstrap.cc:492] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:51.586635 23818 ts_tablet_manager.cc:1434] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:07:51.586747 23819 raft_consensus.cc:359] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.588018 23819 raft_consensus.cc:385] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.588356 23819 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.587200 23858 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.588567 23818 tablet_bootstrap.cc:492] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:51.589323 23819 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.591449 23819 ts_tablet_manager.cc:1434] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:07:51.593231 23858 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.593505 23820 tablet_bootstrap.cc:654] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.595319 23819 tablet_bootstrap.cc:492] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:51.595559 23818 tablet_bootstrap.cc:654] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.597469 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:51.598119 23776 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:51.580987 23669 leader_election.cc:343] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.601810 23907 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.602013 23819 tablet_bootstrap.cc:654] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.602331 23907 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.611018 23907 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.618387 23818 tablet_bootstrap.cc:492] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:51.618387 23820 tablet_bootstrap.cc:492] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:51.619035 23818 ts_tablet_manager.cc:1403] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.031s	user 0.028s	sys 0.000s
I20260709 13:07:51.619045 23820 ts_tablet_manager.cc:1403] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.009s
I20260709 13:07:51.621937 23818 raft_consensus.cc:359] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.622670 23818 raft_consensus.cc:385] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.622980 23818 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.621964 23820 raft_consensus.cc:359] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.623329 23776 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:51.623608 23820 raft_consensus.cc:385] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.636400 23820 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.636552 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:51.637149 23702 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.637210 23820 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.639335 23820 ts_tablet_manager.cc:1434] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.002s
I20260709 13:07:51.623705 23818 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.624948 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:51.625363 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:51.640640 23667 leader_election.cc:343] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.630825 23872 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.632575 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:51.641167 23818 ts_tablet_manager.cc:1434] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.002s
I20260709 13:07:51.637022 23907 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.642234 23818 tablet_bootstrap.cc:492] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
W20260709 13:07:51.643554 23667 leader_election.cc:343] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.644032 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:51.644568 23820 tablet_bootstrap.cc:492] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:51.644901 23858 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.645601 23907 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.645397 23858 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.645704 23702 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:51.624550 23819 tablet_bootstrap.cc:492] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:51.646862 23819 ts_tablet_manager.cc:1403] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.008s
I20260709 13:07:51.647517 23858 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.648669 23818 tablet_bootstrap.cc:654] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.649559 23819 raft_consensus.cc:359] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.650311 23819 raft_consensus.cc:385] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.650595 23819 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.651077 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:51.651320 23819 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.654171 23819 ts_tablet_manager.cc:1434] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:51.655205 23820 tablet_bootstrap.cc:654] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.655704 23819 tablet_bootstrap.cc:492] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:51.657514 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:51.658557 23858 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.659224 23858 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:51.660266 23858 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.665645 23819 tablet_bootstrap.cc:654] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.667331 23907 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:51.667855 23669 leader_election.cc:343] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.668308 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:51.669552 23907 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.677997 23820 tablet_bootstrap.cc:492] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:51.678582 23820 ts_tablet_manager.cc:1403] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.009s
I20260709 13:07:51.681383 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:51.682524 23702 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:07:51.684401 23820 raft_consensus.cc:359] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.687080 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:51.687474 23820 raft_consensus.cc:385] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.688261 23820 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.688694 23857 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.689441 23820 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.694948 23820 ts_tablet_manager.cc:1434] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:07:51.696770 23820 tablet_bootstrap.cc:492] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:51.698912 23825 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.699551 23825 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.702373 23825 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.708721 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:51.709510 23857 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.709721 23777 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:51.716828 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:51.717775 23857 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.718971 23857 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.714160 23825 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.719638 23872 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.729389 23825 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.731526 23826 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.732721 23825 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.713515 23820 tablet_bootstrap.cc:654] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.724664 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:51.734050 23702 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:51.735024 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:51.736178 23872 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.737315 23857 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.737000 23872 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.740450 23872 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.735440 23826 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:07:51.741169 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:51.743223 23667 leader_election.cc:343] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.752048 23882 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.762926 23820 tablet_bootstrap.cc:492] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:51.762082 23857 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.774500 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:51.778849 23628 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:51.777360 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:51.780179 23702 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:07:51.782397 23858 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.782964 23858 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.784919 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:51.785851 23776 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.778750 23820 ts_tablet_manager.cc:1403] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.003s
I20260709 13:07:51.789129 23858 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.789660 23857 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:51.791078 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:51.792992 23592 leader_election.cc:343] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.793409 23628 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.796916 23776 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:51.799540 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:51.800606 23857 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.801134 23857 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:51.790378 23820 raft_consensus.cc:359] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.802078 23857 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.803110 23820 raft_consensus.cc:385] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.803483 23820 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.804219 23820 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.805742 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:51.807144 23820 ts_tablet_manager.cc:1434] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:07:51.818046 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:51.820822 23701 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.821344 23819 tablet_bootstrap.cc:492] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:51.821849 23819 ts_tablet_manager.cc:1403] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.166s	user 0.028s	sys 0.026s
I20260709 13:07:51.828141 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:51.818084 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:51.834515 23820 tablet_bootstrap.cc:492] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:51.838757 23526 catalog_manager.cc:5697] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.840826 23818 tablet_bootstrap.cc:492] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:51.841553 23818 ts_tablet_manager.cc:1403] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.200s	user 0.051s	sys 0.052s
I20260709 13:07:51.845527 23701 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:51.852270 23968 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.852746 23968 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.853096 23968 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.853680 23882 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.854365 23819 raft_consensus.cc:359] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.855136 23819 raft_consensus.cc:385] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.855424 23819 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.856247 23819 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.858156 23818 raft_consensus.cc:359] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.858848 23818 raft_consensus.cc:385] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.859117 23818 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.852164 23858 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.859980 23818 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:51.871886 23593 leader_election.cc:343] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.872191 23902 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.873023 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:51.873523 23902 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:51.912940 23818 ts_tablet_manager.cc:1434] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
W20260709 13:07:52.065362 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 193516us
I20260709 13:07:52.066001 23818 tablet_bootstrap.cc:492] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:52.077507 23819 ts_tablet_manager.cc:1434] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.255s	user 0.009s	sys 0.000s
I20260709 13:07:51.913092 23882 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.917188 23960 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.013051 23858 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.083906 23872 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.080901 23826 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.073293 23825 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:07:52.076893 23902 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:52.090703 23820 tablet_bootstrap.cc:654] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.082021 23845 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.075664 23968 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.082949 23882 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.090939 23858 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.143254 23882 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:52.122742 23966 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.092883 23826 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.093457 23872 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.097723 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.116986 23902 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:07:52.156931 23819 tablet_bootstrap.cc:492] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:52.096877 23845 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:52.172808 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 63840.5us
I20260709 13:07:52.173496 23858 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.150956 23966 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.189268 23974 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:52.189884 23971 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:07:52.189810 23974 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.204020 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.191833 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:52.201824 23974 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.196679 23968 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.213853 23819 tablet_bootstrap.cc:654] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.214123 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:52.217563 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:52.218200 23743 leader_election.cc:343] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.221396 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:52.222144 23667 leader_election.cc:343] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.225076 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:52.223237 23667 leader_election.cc:343] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.207343 23826 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.206715 23627 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:52.209190 23777 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:52.250128 23592 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:52.235495 23872 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.251500 23858 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.253809 23845 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:52.254652 23858 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.255236 23858 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:52.242022 23743 leader_election.cc:343] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:52.256595 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 275495us
I20260709 13:07:52.257545 23820 tablet_bootstrap.cc:492] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:52.259781 23820 ts_tablet_manager.cc:1403] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.444s	user 0.013s	sys 0.032s
I20260709 13:07:52.263226 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:52.269860 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:52.267915 23857 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:07:52.285802 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.287130 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.273002 23778 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:52.284898 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:52.290153 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:52.290846 23703 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:52.291281 23907 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.293538 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:52.294234 23701 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:52.294871 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:52.281915 23625 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.291790 23845 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.296763 23979 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.298424 23845 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.312068 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.312740 23621 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:52.314399 23820 raft_consensus.cc:359] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.315105 23820 raft_consensus.cc:385] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.315397 23820 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.316042 23966 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.311414 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:52.309612 23845 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.321544 23820 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.324314 23818 tablet_bootstrap.cc:654] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.309188 23979 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.331975 23820 ts_tablet_manager.cc:1434] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:07:52.340004 23857 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.348984 23625 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:52.351843 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:52.353248 23667 leader_election.cc:343] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.354911 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:52.355595 23704 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
W20260709 13:07:52.360795 23669 leader_election.cc:343] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.329874 23979 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.382315 23819 tablet_bootstrap.cc:492] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:52.382905 23819 ts_tablet_manager.cc:1403] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.231s	user 0.037s	sys 0.006s
I20260709 13:07:52.393373 23819 raft_consensus.cc:359] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.394412 23819 raft_consensus.cc:385] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.394793 23819 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.384737 23845 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.412858 23820 tablet_bootstrap.cc:492] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:52.415619 23819 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.419862 23845 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:52.427809 23858 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.429086 23624 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 1: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:07:52.430697 23858 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.427280 23980 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:07:52.435007 23979 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.438884 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:52.439838 23773 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:07:52.442057 23819 ts_tablet_manager.cc:1434] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.002s
I20260709 13:07:52.397938 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:52.445767 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:52.446631 23819 tablet_bootstrap.cc:492] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:52.453123 23624 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 1: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:07:52.453629 23872 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.454186 23872 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.454638 23872 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:52.455295 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 66617.4us
I20260709 13:07:52.471451 23818 tablet_bootstrap.cc:492] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:52.472183 23818 ts_tablet_manager.cc:1403] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.406s	user 0.025s	sys 0.013s
I20260709 13:07:52.478539 23872 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.479009 23818 raft_consensus.cc:359] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.480283 23818 raft_consensus.cc:385] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.480578 23818 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.474929 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:52.482326 23907 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.482743 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:52.482885 23907 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:52.483688 23968 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.484054 23907 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.488090 23818 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.488504 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.490605 23818 ts_tablet_manager.cc:1434] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:07:52.489840 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:52.493425 23976 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.493839 23976 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.491425 23977 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:07:52.498946 23669 leader_election.cc:343] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.499787 23818 tablet_bootstrap.cc:492] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:52.482743 23979 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.500600 23669 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:52.497291 23988 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:07:52.504072 23742 leader_election.cc:343] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.498180 23976 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.495543 23857 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:07:52.504812 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:52.504587 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:52.506637 23979 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.511008 23882 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.511483 23525 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.514911 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:52.515611 23778 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:52.516906 23669 leader_election.cc:343] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.503312 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:52.523342 23968 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.534252 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:52.552093 23825 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.554664 23825 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.561424 23704 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:52.562821 23825 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.529583 23976 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.573442 23820 tablet_bootstrap.cc:654] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.573752 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:52.574323 23818 tablet_bootstrap.cc:654] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.576386 23902 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.583904 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:52.584743 23902 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:52.585173 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:52.586134 23819 tablet_bootstrap.cc:654] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:52.575587 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 87892.4us
I20260709 13:07:52.585712 23902 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:52.588725 23667 leader_election.cc:343] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.593887 23778 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:52.595698 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:52.596110 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:52.597044 23907 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.597718 23907 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:52.598116 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:52.600821 23592 leader_election.cc:343] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.600143 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:52.596362 23624 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.586601 23872 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.616825 23976 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:52.614742 23825 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.620105 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:52.620942 23701 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.624261 23907 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.628337 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:07:52.634806 23743 leader_election.cc:343] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.644779 23624 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:52.646214 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:52.647279 23974 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.652336 23701 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
W20260709 13:07:52.652592 23575 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:52.647773 23974 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:52.655426 23974 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.657040 23819 tablet_bootstrap.cc:492] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:52.657909 23819 ts_tablet_manager.cc:1403] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.211s	user 0.016s	sys 0.003s
I20260709 13:07:52.658337 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:07:52.660799 23593 leader_election.cc:343] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.661321 23976 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.661309 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:52.661959 23976 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:52.665279 24000 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.666258 23820 tablet_bootstrap.cc:492] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:52.666862 23820 ts_tablet_manager.cc:1403] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.254s	user 0.016s	sys 0.002s
I20260709 13:07:52.663419 23976 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.670552 23820 raft_consensus.cc:359] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.671269 23820 raft_consensus.cc:385] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.671530 23820 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.673583 23819 raft_consensus.cc:359] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.674152 23819 raft_consensus.cc:385] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.674398 23819 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.688949 23820 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.690372 23818 tablet_bootstrap.cc:492] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:52.691002 23818 ts_tablet_manager.cc:1403] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.194s	user 0.011s	sys 0.022s
I20260709 13:07:52.690634 23819 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.690524 24000 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.695706 24000 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.697614 23819 ts_tablet_manager.cc:1434] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:07:52.701493 24000 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.702803 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:52.703820 23777 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:52.706234 23818 raft_consensus.cc:359] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.706984 23818 raft_consensus.cc:385] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.707211 23820 ts_tablet_manager.cc:1434] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:07:52.707259 23818 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.707832 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:52.708315 23820 tablet_bootstrap.cc:492] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:52.708088 23818 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.710177 23819 tablet_bootstrap.cc:492] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:52.713191 23818 ts_tablet_manager.cc:1434] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:07:52.714478 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:52.715479 24000 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.718722 23818 tablet_bootstrap.cc:492] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:52.719839 23819 tablet_bootstrap.cc:654] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.733819 23820 tablet_bootstrap.cc:654] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.734218 24000 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.738004 23819 tablet_bootstrap.cc:492] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:52.739598 23819 ts_tablet_manager.cc:1403] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.008s
I20260709 13:07:52.738528 23818 tablet_bootstrap.cc:654] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.742331 23819 raft_consensus.cc:359] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.743016 23819 raft_consensus.cc:385] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.743304 23819 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.744089 23819 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.746392 23819 ts_tablet_manager.cc:1434] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:52.747556 23819 tablet_bootstrap.cc:492] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:52.749897 23527 catalog_manager.cc:5697] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.757515 23819 tablet_bootstrap.cc:654] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.774530 23524 catalog_manager.cc:5697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.809515 23524 catalog_manager.cc:5697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.807480 23819 tablet_bootstrap.cc:492] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:52.811515 23819 ts_tablet_manager.cc:1403] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.064s	user 0.036s	sys 0.019s
I20260709 13:07:52.814172 23819 raft_consensus.cc:359] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.816736 23819 raft_consensus.cc:385] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.817632 23819 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.821110 23818 tablet_bootstrap.cc:492] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:52.821714 23818 ts_tablet_manager.cc:1403] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.014s
I20260709 13:07:52.822363 23907 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.822938 23907 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.824949 23818 raft_consensus.cc:359] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.825697 23818 raft_consensus.cc:385] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.825990 23818 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.826887 23818 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.829257 23818 ts_tablet_manager.cc:1434] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:52.830178 23907 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.830293 23818 tablet_bootstrap.cc:492] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:52.831959 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:52.832382 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.822008 23819 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:52.833688 23669 leader_election.cc:343] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:52.834398 23667 leader_election.cc:343] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.834962 23819 ts_tablet_manager.cc:1434] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 13:07:52.834882 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:52.836156 23819 tablet_bootstrap.cc:492] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:52.836138 23907 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.839994 23976 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.840546 23976 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.842976 23976 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:52.843963 23819 tablet_bootstrap.cc:654] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.845886 23820 tablet_bootstrap.cc:492] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:52.848984 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:52.857358 23820 ts_tablet_manager.cc:1403] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.149s	user 0.020s	sys 0.015s
I20260709 13:07:52.849823 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.860112 23624 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
W20260709 13:07:52.858301 23742 leader_election.cc:343] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.863114 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:07:52.864380 23976 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.864789 23976 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.865200 23976 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.869758 23818 tablet_bootstrap.cc:654] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.872809 23976 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.883209 23819 tablet_bootstrap.cc:492] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:52.883616 23818 tablet_bootstrap.cc:492] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:52.883939 23819 ts_tablet_manager.cc:1403] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.022s
I20260709 13:07:52.884155 23818 ts_tablet_manager.cc:1403] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.004s
I20260709 13:07:52.884838 23826 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.885372 23826 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.887290 23819 raft_consensus.cc:359] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.888310 23819 raft_consensus.cc:385] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.888664 23819 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.889454 23819 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.891592 23819 ts_tablet_manager.cc:1434] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:52.892794 23819 tablet_bootstrap.cc:492] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:52.894523 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.897552 23974 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.898147 23974 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.892994 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:52.902042 23819 tablet_bootstrap.cc:654] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:52.902161 23669 leader_election.cc:343] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:52.903543 23667 leader_election.cc:343] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.904070 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:52.904958 23907 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.908831 23826 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.911779 23974 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.915071 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:52.915830 23777 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:52.917101 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:52.918264 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:52.919801 23669 leader_election.cc:343] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.920950 23968 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.921191 23826 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.921350 23968 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.921726 23968 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.921674 23826 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.926553 23819 tablet_bootstrap.cc:492] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:52.927256 23819 ts_tablet_manager.cc:1403] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.013s
I20260709 13:07:52.927601 23818 raft_consensus.cc:359] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.928354 23818 raft_consensus.cc:385] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.928647 23818 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.929622 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.930001 23826 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.930711 23820 raft_consensus.cc:359] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.931406 23820 raft_consensus.cc:385] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.931666 23820 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.932083 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:52.932614 23820 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.933889 23819 raft_consensus.cc:359] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.933918 23527 catalog_manager.cc:5697] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.944058 23819 raft_consensus.cc:385] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.944397 23819 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.945147 23819 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.945770 23974 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.936051 23976 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:52.938064 23820 ts_tablet_manager.cc:1434] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.000s
I20260709 13:07:52.949045 23820 tablet_bootstrap.cc:492] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:52.949307 23527 catalog_manager.cc:5697] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.955132 23820 tablet_bootstrap.cc:654] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.929340 23818 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:52.938457 23667 leader_election.cc:343] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.939450 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:52.957073 23704 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.958793 23819 ts_tablet_manager.cc:1434] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:07:52.960000 23819 tablet_bootstrap.cc:492] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:52.940531 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:52.961297 23624 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.967182 23819 tablet_bootstrap.cc:654] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.942513 23968 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.946372 23974 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:52.968669 23669 leader_election.cc:343] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.977101 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:52.978116 23818 ts_tablet_manager.cc:1434] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.000s
I20260709 13:07:52.978531 23826 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.979179 23968 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.982421 23704 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:52.974094 23976 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.988560 23976 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:52.990927 23976 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:52.980144 23974 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:52.992147 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.985628 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:52.993793 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:52.994992 23742 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:07:52.995556 23743 leader_election.cc:343] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.995987 23976 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:07:52.996762 23667 leader_election.cc:343] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.998354 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:52.986032 23624 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:52.986496 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:53.000087 23778 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.979302 23818 tablet_bootstrap.cc:492] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:53.001431 23976 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:52.987197 23977 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.003969 23977 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.006379 23977 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.007547 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:53.004498 23669 leader_election.cc:343] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.007856 23976 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.008301 23701 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:53.008709 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:53.009546 23974 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:53.011173 23669 leader_election.cc:343] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.011363 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:53.012168 23627 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:53.012359 23974 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.015139 23743 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:53.015506 23778 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:53.016396 23845 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.016782 23845 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.017122 23845 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.017403 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:53.018478 23977 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.021487 23820 tablet_bootstrap.cc:492] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:53.023671 23818 tablet_bootstrap.cc:654] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.024683 23974 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.025552 23974 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:53.026532 23974 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.027451 23820 ts_tablet_manager.cc:1403] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.004s
I20260709 13:07:53.029173 23845 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.034073 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:53.034824 23625 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.035863 23845 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.037781 23818 tablet_bootstrap.cc:492] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:53.038249 23818 ts_tablet_manager.cc:1403] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.001s
I20260709 13:07:53.040216 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:53.041136 23701 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:53.042829 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:53.043932 23976 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.044318 23976 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.044735 23976 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.045245 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:53.045833 23701 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.051599 23976 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.053761 23976 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.054558 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:53.054141 23524 catalog_manager.cc:5697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.042707 23818 raft_consensus.cc:359] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.058001 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:53.058321 23818 raft_consensus.cc:385] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.058650 23703 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.058785 23818 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.059756 23818 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.061177 23701 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:53.062111 23818 ts_tablet_manager.cc:1434] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:07:53.062842 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:53.063652 23818 tablet_bootstrap.cc:492] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:53.064667 23845 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.065029 23819 tablet_bootstrap.cc:492] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:53.065495 23819 ts_tablet_manager.cc:1403] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.002s
I20260709 13:07:53.065280 23527 catalog_manager.cc:5697] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.066236 23845 raft_consensus.cc:697] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:53.067152 23845 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.069582 23625 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:53.031224 23820 raft_consensus.cc:359] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.071273 23818 tablet_bootstrap.cc:654] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.071401 23820 raft_consensus.cc:385] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.072398 23820 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.072755 23819 raft_consensus.cc:359] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.073522 23819 raft_consensus.cc:385] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.073809 23819 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.075057 23819 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.084367 23778 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.086092 23819 ts_tablet_manager.cc:1434] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:07:53.088270 23818 tablet_bootstrap.cc:492] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:53.088917 23818 ts_tablet_manager.cc:1403] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.005s
I20260709 13:07:53.077636 23977 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.088196 23703 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:53.092434 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:53.092329 23818 raft_consensus.cc:359] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.093376 23818 raft_consensus.cc:385] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:53.093586 23743 consensus_peers.cc:597] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.093902 23818 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.094776 23977 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.095397 23977 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:53.094794 23818 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.096525 23977 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.094424 23819 tablet_bootstrap.cc:492] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:53.075125 23820 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.100610 23627 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.106511 23773 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.110342 23627 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:53.111187 23524 catalog_manager.cc:5697] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.114769 23818 ts_tablet_manager.cc:1434] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:07:53.116101 23820 ts_tablet_manager.cc:1434] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 13:07:53.117501 23818 tablet_bootstrap.cc:492] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:53.119422 23974 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.129205 23820 tablet_bootstrap.cc:492] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:53.134141 23974 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.135301 23818 tablet_bootstrap.cc:654] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.148483 23976 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.149063 23976 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.151232 23976 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.154114 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:53.155915 23902 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.161289 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:53.167645 23819 tablet_bootstrap.cc:654] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.187397 23976 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.191982 23976 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.182786 23743 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:53.195827 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:53.196513 23704 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:53.198930 23974 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.199831 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:53.207463 23820 tablet_bootstrap.cc:654] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.209569 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:53.213320 23527 catalog_manager.cc:5697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.207002 23976 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.233613 23976 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.272730 23818 tablet_bootstrap.cc:492] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:53.274471 23818 ts_tablet_manager.cc:1403] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.157s	user 0.020s	sys 0.013s
W20260709 13:07:53.270015 23743 leader_election.cc:343] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.272169 23976 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.284952 23976 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.289992 23907 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.299105 23907 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.299376 23818 raft_consensus.cc:359] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.302388 23818 raft_consensus.cc:385] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.302920 23818 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.304864 23818 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.309190 23819 tablet_bootstrap.cc:492] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:53.309685 23819 ts_tablet_manager.cc:1403] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.216s	user 0.014s	sys 0.008s
I20260709 13:07:53.326625 23845 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:53.336653 23819 raft_consensus.cc:359] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.338963 23819 raft_consensus.cc:385] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.339362 23819 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.341459 23819 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.372275 23819 ts_tablet_manager.cc:1434] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.003s
I20260709 13:07:53.383415 23818 ts_tablet_manager.cc:1434] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.108s	user 0.039s	sys 0.013s
I20260709 13:07:53.385293 23819 tablet_bootstrap.cc:492] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:53.389428 23820 tablet_bootstrap.cc:492] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:53.390204 23820 ts_tablet_manager.cc:1403] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.261s	user 0.033s	sys 0.050s
I20260709 13:07:53.395290 23818 tablet_bootstrap.cc:492] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:53.407073 23820 raft_consensus.cc:359] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.408730 23820 raft_consensus.cc:385] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.409207 23820 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.419359 23826 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.435906 23826 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.438058 23826 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:53.445581 23820 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.452389 23820 ts_tablet_manager.cc:1434] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.001s
I20260709 13:07:53.425540 23976 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.460115 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:53.463409 23667 leader_election.cc:343] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.472348 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:53.473182 23976 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:07:53.474377 23669 leader_election.cc:343] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.474799 23669 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:53.475615 23968 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.478338 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:53.479328 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:07:53.480165 23743 leader_election.cc:343] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.483415 23819 tablet_bootstrap.cc:654] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.483583 23820 tablet_bootstrap.cc:492] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:53.486819 23703 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.496961 23818 tablet_bootstrap.cc:654] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.503407 23625 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.504956 23703 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:53.508196 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:53.509018 23820 tablet_bootstrap.cc:654] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.509395 23977 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.510138 23977 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:53.511060 23977 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.510136 23826 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:07:53.514762 23976 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.540819 23907 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.541496 23907 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.576414 24036 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.576474 23976 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:07:53.586162 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:53.590425 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:53.592339 23667 leader_election.cc:343] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.593582 23907 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:07:53.594688 23669 leader_election.cc:343] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.595258 23669 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:53.601245 23826 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.624650 23818 tablet_bootstrap.cc:492] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:53.625466 23818 ts_tablet_manager.cc:1403] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.230s	user 0.026s	sys 0.044s
I20260709 13:07:53.627031 23820 tablet_bootstrap.cc:492] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:53.627705 23820 ts_tablet_manager.cc:1403] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.144s	user 0.026s	sys 0.026s
I20260709 13:07:53.630817 23977 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.631202 23820 raft_consensus.cc:359] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.632120 23820 raft_consensus.cc:385] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.632469 23820 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.633172 23820 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.634191 23976 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.635664 23820 ts_tablet_manager.cc:1434] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:07:53.636713 23820 tablet_bootstrap.cc:492] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:53.629136 23818 raft_consensus.cc:359] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.637663 23818 raft_consensus.cc:385] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.637984 23818 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.640311 23818 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.643994 23820 tablet_bootstrap.cc:654] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.652599 23818 ts_tablet_manager.cc:1434] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 13:07:53.653856 23818 tablet_bootstrap.cc:492] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:53.652503 23907 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.669157 23818 tablet_bootstrap.cc:654] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.673557 24036 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.706547 23819 tablet_bootstrap.cc:492] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:53.707049 23819 ts_tablet_manager.cc:1403] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.325s	user 0.013s	sys 0.009s
I20260709 13:07:53.716835 23527 catalog_manager.cc:5697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.720873 23819 raft_consensus.cc:359] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.721690 23819 raft_consensus.cc:385] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.722091 23819 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.722860 23819 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:53.726418 23804 tablet.cc:2406] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:53.742636 23818 tablet_bootstrap.cc:492] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:53.743120 23818 ts_tablet_manager.cc:1403] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.090s	user 0.030s	sys 0.033s
I20260709 13:07:53.743678 23820 tablet_bootstrap.cc:492] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:53.744247 23820 ts_tablet_manager.cc:1403] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.005s
I20260709 13:07:53.745676 23818 raft_consensus.cc:359] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.746815 23818 raft_consensus.cc:385] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.746978 23820 raft_consensus.cc:359] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.748313 23820 raft_consensus.cc:385] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.748638 23820 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.749243 23819 ts_tablet_manager.cc:1434] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.042s	user 0.000s	sys 0.007s
I20260709 13:07:53.747076 23818 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.750352 23819 tablet_bootstrap.cc:492] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:53.750181 23818 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.749325 23820 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.757121 23819 tablet_bootstrap.cc:654] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.757531 23820 ts_tablet_manager.cc:1434] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:07:53.758692 23820 tablet_bootstrap.cc:492] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:53.757078 23818 ts_tablet_manager.cc:1434] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:07:53.760831 23818 tablet_bootstrap.cc:492] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:53.764621 23820 tablet_bootstrap.cc:654] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.766965 23818 tablet_bootstrap.cc:654] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:53.764556 23575 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:53.778539 23976 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.779347 23976 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.815629 23819 tablet_bootstrap.cc:492] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:53.816354 23819 ts_tablet_manager.cc:1403] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.000s
I20260709 13:07:53.820266 23820 tablet_bootstrap.cc:492] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:53.820900 23820 ts_tablet_manager.cc:1403] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.019s
I20260709 13:07:53.824005 23820 raft_consensus.cc:359] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.822634 23819 raft_consensus.cc:359] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.824962 23820 raft_consensus.cc:385] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.825073 23819 raft_consensus.cc:385] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.825302 23820 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.826068 23820 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.825344 23819 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.830144 23820 ts_tablet_manager.cc:1434] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:53.831043 23819 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.834004 23819 ts_tablet_manager.cc:1434] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:07:53.835076 23819 tablet_bootstrap.cc:492] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:53.835664 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:53.837302 23743 leader_election.cc:343] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.838109 24036 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.838702 24036 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.841454 23819 tablet_bootstrap.cc:654] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.839217 23820 tablet_bootstrap.cc:492] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:53.842051 24036 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.844359 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:53.844867 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:53.845281 23625 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:53.846459 23976 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.854395 23818 tablet_bootstrap.cc:492] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:53.845604 23701 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:53.855198 23818 ts_tablet_manager.cc:1403] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.095s	user 0.018s	sys 0.016s
I20260709 13:07:53.855260 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:53.844602 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:53.856025 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:53.856274 23703 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:53.856364 23976 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.856920 23976 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.857156 24036 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.857324 23976 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.857723 24036 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.858124 24036 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.859225 23818 raft_consensus.cc:359] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.865978 23818 raft_consensus.cc:385] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.866506 23818 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.864115 24036 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.867352 23818 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.869849 23820 tablet_bootstrap.cc:654] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.871177 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:53.871613 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:53.872397 23703 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:53.873245 23743 leader_election.cc:343] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.874233 23818 ts_tablet_manager.cc:1434] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:07:53.875694 23818 tablet_bootstrap.cc:492] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:53.880209 23968 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.883394 24044 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.884183 24044 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.886395 23819 tablet_bootstrap.cc:492] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:53.887012 23819 ts_tablet_manager.cc:1403] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.008s
I20260709 13:07:53.883090 23976 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.890952 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:53.891629 23976 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.892319 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:53.892894 23701 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
W20260709 13:07:53.894583 23743 leader_election.cc:343] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.880837 23968 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.896673 23968 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:53.897303 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:53.897967 23625 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.898157 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:53.898500 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:53.899340 23976 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.899785 23976 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:53.900133 23667 leader_election.cc:343] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.900194 23976 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.900903 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:53.901518 23701 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.903394 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:53.905159 23669 leader_election.cc:343] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.905606 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:53.906497 23625 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:53.906591 23968 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.889341 24044 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.908198 23818 tablet_bootstrap.cc:654] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.907792 23976 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.909504 23819 raft_consensus.cc:359] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.910539 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:53.910185 23819 raft_consensus.cc:385] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.913146 23701 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:53.911477 24044 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.914000 23703 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:53.904336 24036 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.911480 23820 tablet_bootstrap.cc:492] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:53.915155 23820 ts_tablet_manager.cc:1403] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.008s
I20260709 13:07:53.915009 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:53.915563 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:53.916599 23902 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:07:53.916842 23743 leader_election.cc:343] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.917091 23902 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:53.917990 23902 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.917990 23820 raft_consensus.cc:359] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.919203 23976 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.919230 23820 raft_consensus.cc:385] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.920013 23820 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.920303 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:53.920931 23701 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.921375 24044 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:53.921064 23820 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.922313 24044 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.923986 23820 ts_tablet_manager.cc:1434] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:07:53.925354 23820 tablet_bootstrap.cc:492] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:53.926127 24036 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.926642 24036 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.929409 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:53.930095 23625 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:53.930326 23701 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:53.931275 23743 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:53.931882 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:53.932142 23976 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.932525 23976 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.932871 23976 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.933095 23977 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.933595 23977 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:53.934444 23977 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.913331 23819 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.943557 24036 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.946125 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:53.947916 23742 leader_election.cc:343] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.940737 23819 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.951500 23820 tablet_bootstrap.cc:654] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.959731 23976 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.961447 23525 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.951514 23819 ts_tablet_manager.cc:1434] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.003s
I20260709 13:07:53.963996 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:53.964584 23819 tablet_bootstrap.cc:492] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:53.962940 23976 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:53.965152 23625 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.968146 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:53.969058 23627 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:53.965297 23742 leader_election.cc:343] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.975608 23820 tablet_bootstrap.cc:492] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:53.976315 23820 ts_tablet_manager.cc:1403] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.014s
I20260709 13:07:53.975704 23819 tablet_bootstrap.cc:654] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.982117 23627 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:53.983388 23743 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:07:53.984481 23976 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.984973 23976 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:53.985832 23976 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.986627 23820 raft_consensus.cc:359] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.987464 23820 raft_consensus.cc:385] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.987843 23820 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.988646 23820 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:53.990846 23820 ts_tablet_manager.cc:1434] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:07:53.991999 23820 tablet_bootstrap.cc:492] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:54.000669 23820 tablet_bootstrap.cc:654] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.006506 23820 tablet_bootstrap.cc:492] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:54.006981 23820 ts_tablet_manager.cc:1403] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 13:07:54.007561 23968 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.008265 23818 tablet_bootstrap.cc:492] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:54.008105 23968 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.008752 23818 ts_tablet_manager.cc:1403] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.133s	user 0.018s	sys 0.013s
I20260709 13:07:54.010140 23820 raft_consensus.cc:359] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.010938 23820 raft_consensus.cc:385] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.011216 23820 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.011754 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:54.012931 23818 raft_consensus.cc:359] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.013630 23818 raft_consensus.cc:385] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.013414 23820 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:54.013793 23669 leader_election.cc:343] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.013921 23818 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.015718 23820 ts_tablet_manager.cc:1434] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:07:54.014688 23818 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.016682 23625 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.017153 23820 tablet_bootstrap.cc:492] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:54.020298 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:54.022323 23818 ts_tablet_manager.cc:1434] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:07:54.023126 23820 tablet_bootstrap.cc:654] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.023705 23818 tablet_bootstrap.cc:492] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:54.010190 23968 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.030354 23818 tablet_bootstrap.cc:654] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.040879 24044 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:54.041340 23667 leader_election.cc:343] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.041832 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:54.043680 23818 tablet_bootstrap.cc:492] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:54.044155 23818 ts_tablet_manager.cc:1403] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:07:54.047192 23818 raft_consensus.cc:359] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.047873 23818 raft_consensus.cc:385] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.048148 23818 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.048851 23818 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.050761 23974 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.051556 23818 ts_tablet_manager.cc:1434] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:07:54.052928 23818 tablet_bootstrap.cc:492] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:54.059574 23818 tablet_bootstrap.cc:654] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.060009 23977 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.060576 23977 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.062637 23977 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:54.064622 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:54.064826 23977 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.065582 23701 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:54.066525 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:54.067189 23629 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:54.071460 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:54.086026 23977 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.086647 23977 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.087116 23977 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.095837 23977 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.099702 23977 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:54.126011 23820 tablet_bootstrap.cc:492] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:54.126565 23820 ts_tablet_manager.cc:1403] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.059s
I20260709 13:07:54.105540 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:54.105188 23527 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.106029 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:54.128221 23703 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.128732 23527 catalog_manager.cc:5697] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.129348 23820 raft_consensus.cc:359] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.130077 23820 raft_consensus.cc:385] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.130395 23820 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.130585 23527 catalog_manager.cc:5697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.131142 23820 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.132321 23818 tablet_bootstrap.cc:492] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:54.132797 23818 ts_tablet_manager.cc:1403] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.080s	user 0.033s	sys 0.013s
I20260709 13:07:54.132854 23820 ts_tablet_manager.cc:1434] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:54.106410 23819 tablet_bootstrap.cc:492] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:54.134138 23820 tablet_bootstrap.cc:492] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:54.134302 23819 ts_tablet_manager.cc:1403] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.170s	user 0.018s	sys 0.000s
I20260709 13:07:54.136468 23703 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:54.136250 23818 raft_consensus.cc:359] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.136943 23818 raft_consensus.cc:385] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.137284 23818 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.137935 23818 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.139451 23818 ts_tablet_manager.cc:1434] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:07:54.140707 23818 tablet_bootstrap.cc:492] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:54.141251 23820 tablet_bootstrap.cc:654] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.141255 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:54.142753 24044 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.143244 24044 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:54.144224 24044 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.146595 23818 tablet_bootstrap.cc:654] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.153581 23820 tablet_bootstrap.cc:492] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:54.154102 23820 ts_tablet_manager.cc:1403] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:07:54.156909 23820 raft_consensus.cc:359] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.157678 23820 raft_consensus.cc:385] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.157958 23820 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.158739 23820 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.160667 23820 ts_tablet_manager.cc:1434] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:54.137029 23819 raft_consensus.cc:359] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.162060 23819 raft_consensus.cc:385] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.162046 23820 tablet_bootstrap.cc:492] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:54.162329 23627 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.162590 23819 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.163656 23819 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.165864 23819 ts_tablet_manager.cc:1434] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:07:54.167239 23819 tablet_bootstrap.cc:492] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:54.168901 23820 tablet_bootstrap.cc:654] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.173411 23825 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.174631 23819 tablet_bootstrap.cc:654] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.174163 23825 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.179606 23825 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.180284 23820 tablet_bootstrap.cc:492] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:54.180763 23820 ts_tablet_manager.cc:1403] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:07:54.181726 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:54.183316 23820 raft_consensus.cc:359] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.184237 23820 raft_consensus.cc:385] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.184514 23820 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.184948 23976 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.185679 23976 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.186393 23825 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.186834 23825 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.185153 23820 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.187752 23818 tablet_bootstrap.cc:492] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:54.188200 23818 ts_tablet_manager.cc:1403] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.005s
I20260709 13:07:54.188724 23820 ts_tablet_manager.cc:1434] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:54.189827 23820 tablet_bootstrap.cc:492] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:54.190402 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:54.190517 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:54.191202 23702 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:07:54.191169 23704 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:54.192970 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:54.192749 23818 raft_consensus.cc:359] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.193228 23593 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:54.193579 23818 raft_consensus.cc:385] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.194027 23818 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.194633 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:54.195106 23976 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:54.195876 23820 tablet_bootstrap.cc:654] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.195911 23996 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.195009 23818 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.196593 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:54.196933 23778 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
W20260709 13:07:54.198076 23743 leader_election.cc:343] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.200434 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:54.201121 23818 ts_tablet_manager.cc:1434] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:07:54.201081 23704 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:54.202585 23818 tablet_bootstrap.cc:492] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:54.206231 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:54.207703 23976 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.208287 23976 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.208736 23976 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.211462 23825 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.212347 23825 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.212790 23825 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.213229 23825 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.214157 23818 tablet_bootstrap.cc:654] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:54.244998 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49285.7us
I20260709 13:07:54.264371 23820 tablet_bootstrap.cc:492] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:54.264926 23820 ts_tablet_manager.cc:1403] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.075s	user 0.024s	sys 0.036s
I20260709 13:07:54.265508 24036 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.266086 24036 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.268251 23976 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.271418 24036 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:54.271906 23820 raft_consensus.cc:359] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.272640 23820 raft_consensus.cc:385] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.272931 23820 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.273597 23820 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.279588 23820 ts_tablet_manager.cc:1434] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:07:54.279516 23996 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.280411 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:54.280779 23820 tablet_bootstrap.cc:492] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:54.281536 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:54.282109 23703 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.286924 23996 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.287498 23996 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.288141 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:54.289533 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:54.290194 23625 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.290675 23996 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.290642 23825 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.293385 23825 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.295060 23703 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:54.298585 23627 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:54.298789 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:54.283442 23976 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:54.300832 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:54.301832 23778 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:54.287429 23742 leader_election.cc:343] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:54.304309 23743 leader_election.cc:343] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.304718 23743 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:54.308518 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:54.309680 23702 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:54.308099 23527 catalog_manager.cc:5697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:54.311851 23592 leader_election.cc:343] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.324319 23974 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.325055 23974 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.326478 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:54.327862 24044 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.328457 24090 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.328962 24090 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.327607 23974 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.330945 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:54.329371 24090 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.332463 23704 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.343340 23819 tablet_bootstrap.cc:492] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:54.344002 23819 ts_tablet_manager.cc:1403] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.177s	user 0.023s	sys 0.033s
I20260709 13:07:54.346750 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:54.346943 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:54.347882 23977 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.348608 23977 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:54.349720 23778 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:54.349572 23977 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.354517 23819 raft_consensus.cc:359] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.358608 23819 raft_consensus.cc:385] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.359381 23819 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.345501 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:54.360306 23819 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.368957 23819 ts_tablet_manager.cc:1434] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.003s
I20260709 13:07:54.374727 23819 tablet_bootstrap.cc:492] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
W20260709 13:07:54.370024 23667 leader_election.cc:343] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.400270 23818 tablet_bootstrap.cc:492] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:54.400832 23818 ts_tablet_manager.cc:1403] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.198s	user 0.027s	sys 0.034s
I20260709 13:07:54.421638 24095 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.422446 24095 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.432185 23818 raft_consensus.cc:359] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.433368 23818 raft_consensus.cc:385] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.433784 23818 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.434515 23625 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:54.434751 23818 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.438459 23704 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:54.452905 23818 ts_tablet_manager.cc:1434] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.004s
I20260709 13:07:54.453156 23527 catalog_manager.cc:5697] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.457520 23820 tablet_bootstrap.cc:654] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.479913 23977 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:54.430953 23976 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:07:54.489457 24095 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.440415 23592 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:07:54.491204 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 78164.9us
I20260709 13:07:54.493250 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:54.494031 23627 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:07:54.496124 24090 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.498508 24090 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.499143 24090 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.502430 23819 tablet_bootstrap.cc:654] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:54.505731 23743 consensus_peers.cc:597] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:54.499599 24090 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:54.508499 24090 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.513037 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:54.513088 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:54.514087 23704 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:54.517088 23592 leader_election.cc:343] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.518141 23818 tablet_bootstrap.cc:492] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
W20260709 13:07:54.520323 23669 leader_election.cc:343] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.520879 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:54.522825 24095 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.539418 24092 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.540237 24092 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.543200 24092 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.545203 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:54.544056 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:54.550261 24096 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.550848 24096 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:54.551608 23592 leader_election.cc:343] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.552374 23818 tablet_bootstrap.cc:654] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.553452 24096 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.561797 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:54.563524 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:54.566313 23669 leader_election.cc:343] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.573626 23704 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
W20260709 13:07:54.564325 23593 leader_election.cc:343] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.575213 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:54.578213 24090 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.578833 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:54.580788 23820 tablet_bootstrap.cc:492] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:54.581364 23820 ts_tablet_manager.cc:1403] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.301s	user 0.015s	sys 0.010s
I20260709 13:07:54.581599 24090 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.582306 24090 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:07:54.556375 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 103548us
I20260709 13:07:54.588788 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:54.588680 23820 raft_consensus.cc:359] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.589529 23773 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:54.591353 24090 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.592991 23819 tablet_bootstrap.cc:492] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:54.593482 23819 ts_tablet_manager.cc:1403] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.220s	user 0.011s	sys 0.011s
I20260709 13:07:54.589540 23820 raft_consensus.cc:385] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.595156 23820 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.596041 23820 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.598197 23820 ts_tablet_manager.cc:1434] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:07:54.599288 23820 tablet_bootstrap.cc:492] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:54.594226 23527 catalog_manager.cc:5697] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.606437 23818 tablet_bootstrap.cc:492] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:54.607013 23818 ts_tablet_manager.cc:1403] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.003s
I20260709 13:07:54.615600 23819 raft_consensus.cc:359] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.616554 23819 raft_consensus.cc:385] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.616878 23819 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.616823 23818 raft_consensus.cc:359] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.617610 23818 raft_consensus.cc:385] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.617909 23818 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.617707 23819 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.618541 23818 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.621266 24044 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:54.621824 24036 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.622424 23818 ts_tablet_manager.cc:1434] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 13:07:54.623502 23818 tablet_bootstrap.cc:492] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:54.629602 23819 ts_tablet_manager.cc:1434] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:07:54.620337 23977 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:07:54.642369 23819 tablet_bootstrap.cc:492] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:54.648874 24044 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.651360 24043 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:54.614065 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:54.664232 24098 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.717604 24092 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.733636 24092 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.802552 23819 tablet_bootstrap.cc:654] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.811126 23818 tablet_bootstrap.cc:700] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent opening tablet: real 0.101s	user 0.008s	sys 0.008s
W20260709 13:07:54.668443 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 54472.6us
I20260709 13:07:54.816527 23818 tablet_bootstrap.cc:654] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.833731 23820 tablet_bootstrap.cc:654] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:54.815449 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 76596.3us
I20260709 13:07:54.850170 24092 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.850538 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:54.851840 23667 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:54.854061 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:54.856824 23593 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:54.856647 23527 catalog_manager.cc:5697] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.857843 24092 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.866722 24098 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.872154 24095 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.872762 24095 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.890647 23819 tablet_bootstrap.cc:492] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:54.891352 23819 ts_tablet_manager.cc:1403] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.249s	user 0.011s	sys 0.025s
I20260709 13:07:54.866770 24096 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.905598 24096 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:54.912356 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55903.6us
I20260709 13:07:54.914011 24096 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.909446 24044 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:07:54.920017 24104 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.093s	user 0.001s	sys 0.001s
I20260709 13:07:54.982820 23818 tablet_bootstrap.cc:492] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:54.983465 23818 ts_tablet_manager.cc:1403] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.360s	user 0.020s	sys 0.022s
I20260709 13:07:54.987394 23818 raft_consensus.cc:359] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:54.994994 23818 raft_consensus.cc:385] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.995431 23818 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.978868 24095 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:54.998250 23818 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.001307 23820 tablet_bootstrap.cc:492] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:55.001811 23820 ts_tablet_manager.cc:1403] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.403s	user 0.014s	sys 0.009s
W20260709 13:07:55.008858 24109 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:07:55.016115 23818 ts_tablet_manager.cc:1434] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:07:55.029933 23818 tablet_bootstrap.cc:492] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
W20260709 13:07:55.030696 23868 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.092s	user 0.003s	sys 0.000s
I20260709 13:07:55.038740 23819 raft_consensus.cc:359] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.023919 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:55.056926 23819 raft_consensus.cc:385] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.058459 23819 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.059202 23819 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.067452 23819 ts_tablet_manager.cc:1434] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.176s	user 0.008s	sys 0.008s
W20260709 13:07:55.078166 23669 leader_election.cc:343] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.079639 23819 tablet_bootstrap.cc:492] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:55.096284 24095 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.102519 24095 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.103124 24131 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.113340 23820 raft_consensus.cc:359] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.113948 23820 raft_consensus.cc:385] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.114209 23820 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.114748 23820 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.118114 23818 tablet_bootstrap.cc:654] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.112805 24131 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.121529 24131 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:55.122094 24132 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:07:55.125957 23820 ts_tablet_manager.cc:1434] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.124s	user 0.005s	sys 0.001s
I20260709 13:07:55.128548 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:55.138927 24095 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:55.140311 23627 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.123878 24132 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:07:55.147374 23819 tablet_bootstrap.cc:654] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.152946 23820 tablet_bootstrap.cc:492] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:55.170930 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:55.177552 24096 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.183041 23820 tablet_bootstrap.cc:654] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:55.184510 24128 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
W20260709 13:07:55.183898 23667 leader_election.cc:343] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.188527 23667 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:55.189268 24096 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:55.192864 23974 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:55.196100 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:55.196944 23629 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:55.200352 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:55.200969 23773 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:55.215025 23592 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:55.231169 24090 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:55.234948 23773 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:55.235955 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:07:55.237509 23742 leader_election.cc:343] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.238242 23743 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:07:55.232260 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:55.240123 24126 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:55.247326 24123 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.247786 24123 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.248137 24123 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:55.246850 23669 leader_election.cc:343] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.250185 23777 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:55.244587 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:55.261471 23819 tablet_bootstrap.cc:492] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:55.261987 23819 ts_tablet_manager.cc:1403] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.183s	user 0.025s	sys 0.018s
I20260709 13:07:55.263111 23818 tablet_bootstrap.cc:492] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:55.263792 23818 ts_tablet_manager.cc:1403] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.235s	user 0.010s	sys 0.013s
I20260709 13:07:55.256922 23628 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:55.280068 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:55.282932 24121 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.283663 24121 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.285975 24121 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:55.287071 23818 raft_consensus.cc:359] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.287878 23818 raft_consensus.cc:385] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.289451 23818 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.292246 23818 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.292037 24092 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:55.282105 24095 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.296481 24095 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.296703 23818 ts_tablet_manager.cc:1434] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:07:55.296857 24095 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.306459 23820 tablet_bootstrap.cc:492] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:55.307185 23820 ts_tablet_manager.cc:1403] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.155s	user 0.009s	sys 0.007s
I20260709 13:07:55.316641 23818 tablet_bootstrap.cc:492] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:55.316419 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:55.310051 23825 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:55.323246 23667 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:07:55.324398 23743 leader_election.cc:343] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.322803 23820 raft_consensus.cc:359] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.325652 23820 raft_consensus.cc:385] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.326149 23820 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.331650 24120 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.331789 23820 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.332376 24120 raft_consensus.cc:697] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:55.422665 23825 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.423249 23825 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.423480 23819 raft_consensus.cc:359] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.424201 23819 raft_consensus.cc:385] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.424495 23819 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.425225 23819 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.425905 23825 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:55.427073 23819 ts_tablet_manager.cc:1434] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.165s	user 0.006s	sys 0.000s
W20260709 13:07:55.435593 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 102003us
I20260709 13:07:55.438661 23819 tablet_bootstrap.cc:492] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
W20260709 13:07:55.445796 24137 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:07:55.454995 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:55.455843 23703 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:55.460191 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:55.471849 23592 leader_election.cc:343] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.467136 24123 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.475617 24120 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.508423 23820 ts_tablet_manager.cc:1434] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.201s	user 0.019s	sys 0.048s
I20260709 13:07:55.509158 24130 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.510409 23820 tablet_bootstrap.cc:492] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:55.509987 24130 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:55.481772 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 148051us
W20260709 13:07:55.521797 24142 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:07:55.551111 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:55.552855 23695 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:55.535869 24130 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:55.549014 24095 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.561651 24123 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:55.561931 24095 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:07:55.564944 23575 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:55.566386 23819 tablet_bootstrap.cc:654] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.567512 23818 tablet_bootstrap.cc:654] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.573653 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:55.574381 23775 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.577257 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:55.577459 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:55.577911 23625 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.578065 23629 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.579804 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:55.589839 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:55.594108 23629 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
W20260709 13:07:55.597558 23743 leader_election.cc:343] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.614599 23743 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:55.613502 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:55.617311 24036 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.632422 24036 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:07:55.633831 23593 leader_election.cc:343] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.634352 23593 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:55.633706 24036 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.637601 23820 tablet_bootstrap.cc:654] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.640566 24092 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:55.645654 23775 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:55.648164 23667 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:55.649257 24118 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.649864 24118 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:55.650277 23625 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:55.650735 24118 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:55.654832 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46082.6us
I20260709 13:07:55.655824 24130 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.656481 24130 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.656993 24130 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.722461 23819 tablet_bootstrap.cc:492] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:55.723078 23819 ts_tablet_manager.cc:1403] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.290s	user 0.018s	sys 0.014s
I20260709 13:07:55.723363 24130 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:55.725252 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44634.3us
I20260709 13:07:55.725346 24130 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:55.726094 23524 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.726110 23819 raft_consensus.cc:359] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.736250 23819 raft_consensus.cc:385] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.736636 23819 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.737572 23819 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:55.739425 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 58863.4us
I20260709 13:07:55.741532 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:55.744791 23819 ts_tablet_manager.cc:1434] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:07:55.745918 23819 tablet_bootstrap.cc:492] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:55.718971 23818 tablet_bootstrap.cc:492] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:55.752241 23818 ts_tablet_manager.cc:1403] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.436s	user 0.026s	sys 0.021s
I20260709 13:07:55.728840 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:55.753563 24130 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.754045 24130 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.754473 24130 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.756534 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:07:55.758486 23743 leader_election.cc:343] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.752272 23820 tablet_bootstrap.cc:492] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:55.763020 23820 ts_tablet_manager.cc:1403] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.253s	user 0.011s	sys 0.005s
I20260709 13:07:55.763192 23818 raft_consensus.cc:359] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.763908 23818 raft_consensus.cc:385] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.764169 23818 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.764814 23818 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.767901 23818 ts_tablet_manager.cc:1434] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:07:55.767608 24130 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.769013 23818 tablet_bootstrap.cc:492] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:55.770529 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:55.770941 24130 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:55.771188 23697 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.775506 23818 tablet_bootstrap.cc:654] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.776474 23819 tablet_bootstrap.cc:654] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.780273 23697 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:55.778152 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:55.782217 23820 raft_consensus.cc:359] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.778189 23527 catalog_manager.cc:5697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.782917 23820 raft_consensus.cc:385] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.783310 23820 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.783972 23820 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.784828 23627 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:55.790665 23742 leader_election.cc:343] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.794338 23627 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:55.797224 23819 tablet_bootstrap.cc:492] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:55.797739 23819 ts_tablet_manager.cc:1403] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.001s
I20260709 13:07:55.798354 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:55.800580 23820 ts_tablet_manager.cc:1434] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:07:55.800400 23819 raft_consensus.cc:359] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.801120 23819 raft_consensus.cc:385] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.801429 23819 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.802268 23819 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.803352 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:55.804399 24121 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.804611 23819 ts_tablet_manager.cc:1434] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:55.804950 24121 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:55.805729 23819 tablet_bootstrap.cc:492] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:55.805828 24123 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.806394 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:55.801561 23820 tablet_bootstrap.cc:492] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:55.806578 24123 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:55.817014 24122 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.817615 24122 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.808102 23699 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.824375 24123 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.826009 24121 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.837383 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:55.839004 23743 leader_election.cc:343] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.840296 24122 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:55.848115 23820 tablet_bootstrap.cc:654] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.853011 23699 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:55.853664 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:55.854588 23818 tablet_bootstrap.cc:492] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:55.854895 23695 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:55.855202 23818 ts_tablet_manager.cc:1403] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.003s
I20260709 13:07:55.857787 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:55.858610 24135 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.858305 23818 raft_consensus.cc:359] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.859045 24135 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.859328 23819 tablet_bootstrap.cc:654] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.859589 24135 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.859316 23818 raft_consensus.cc:385] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.868739 23818 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.870134 23818 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.872013 23527 catalog_manager.cc:5697] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.876449 23818 ts_tablet_manager.cc:1434] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.002s
I20260709 13:07:55.877538 23818 tablet_bootstrap.cc:492] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:55.879254 23819 tablet_bootstrap.cc:492] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:55.879752 23819 ts_tablet_manager.cc:1403] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.001s
I20260709 13:07:55.882462 23819 raft_consensus.cc:359] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.883126 23819 raft_consensus.cc:385] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.883384 23819 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.883553 23818 tablet_bootstrap.cc:654] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.899087 23819 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.902550 23819 ts_tablet_manager.cc:1434] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:07:55.903175 23820 tablet_bootstrap.cc:492] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:55.903811 23819 tablet_bootstrap.cc:492] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:55.903914 23820 ts_tablet_manager.cc:1403] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.103s	user 0.031s	sys 0.019s
I20260709 13:07:55.907037 23820 raft_consensus.cc:359] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.907620 24135 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.902875 23527 catalog_manager.cc:5697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.909744 23527 catalog_manager.cc:5697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.911134 23819 tablet_bootstrap.cc:654] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.911649 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:07:55.913439 23743 leader_election.cc:343] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.907882 23820 raft_consensus.cc:385] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.919507 23820 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.920619 23820 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.923893 23820 ts_tablet_manager.cc:1434] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:07:55.925279 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:55.926054 23695 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.932631 24135 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:55.933938 23820 tablet_bootstrap.cc:492] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:55.938400 23695 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:55.945176 23820 tablet_bootstrap.cc:654] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.954061 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:55.955797 24121 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.956429 23818 tablet_bootstrap.cc:492] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:55.957019 23818 ts_tablet_manager.cc:1403] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.000s
I20260709 13:07:55.956607 24121 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:55.960759 23818 raft_consensus.cc:359] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.961472 23818 raft_consensus.cc:385] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.961738 23818 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.962430 23818 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.965651 23818 ts_tablet_manager.cc:1434] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:55.965929 24120 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:55.966758 23818 tablet_bootstrap.cc:492] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:55.969087 23820 tablet_bootstrap.cc:492] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:55.969573 23820 ts_tablet_manager.cc:1403] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.013s
I20260709 13:07:55.969640 23819 tablet_bootstrap.cc:492] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:55.970201 23819 ts_tablet_manager.cc:1403] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.067s	user 0.028s	sys 0.016s
I20260709 13:07:55.972520 24121 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.972949 23820 raft_consensus.cc:359] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.973595 23820 raft_consensus.cc:385] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.973948 23820 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.973630 23819 raft_consensus.cc:359] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.974504 23819 raft_consensus.cc:385] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.974840 23819 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.974886 23820 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.975632 23819 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.977967 23818 tablet_bootstrap.cc:654] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.978011 23819 ts_tablet_manager.cc:1434] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:55.979364 23819 tablet_bootstrap.cc:492] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:55.985392 23820 ts_tablet_manager.cc:1434] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:07:55.990554 23820 tablet_bootstrap.cc:492] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:55.991324 23819 tablet_bootstrap.cc:654] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.993636 24118 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.994175 24118 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:55.996258 24118 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.003577 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:56.005157 24149 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.005719 24149 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.007939 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:56.014233 23667 leader_election.cc:343] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.018061 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:56.018661 23818 tablet_bootstrap.cc:492] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:56.018728 23819 tablet_bootstrap.cc:492] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:56.018920 23777 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:56.019340 23818 ts_tablet_manager.cc:1403] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.013s
I20260709 13:07:56.019572 23819 ts_tablet_manager.cc:1403] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.003s
I20260709 13:07:56.020208 24149 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.021570 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:56.022315 23818 raft_consensus.cc:359] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.023077 23818 raft_consensus.cc:385] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.022791 23819 raft_consensus.cc:359] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.022748 24149 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.023788 23819 raft_consensus.cc:385] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.023934 24149 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.024142 23819 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.024474 24149 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.024842 23819 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.026971 23819 ts_tablet_manager.cc:1434] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:56.027921 23819 tablet_bootstrap.cc:492] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:56.030907 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:56.031669 23697 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:56.023494 23818 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.034739 23819 tablet_bootstrap.cc:654] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.034747 23818 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.037717 23818 ts_tablet_manager.cc:1434] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 13:07:56.039302 23818 tablet_bootstrap.cc:492] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
W20260709 13:07:56.043309 23669 leader_election.cc:343] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.043859 23669 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:56.044759 24120 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:56.047955 23818 tablet_bootstrap.cc:654] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.058421 23527 catalog_manager.cc:5697] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.062681 24149 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:56.071648 23669 consensus_peers.cc:597] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:56.078689 23820 tablet_bootstrap.cc:654] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.083046 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:56.083827 23778 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.085742 24149 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.088176 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:56.089356 23703 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.093170 23818 tablet_bootstrap.cc:492] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:56.093696 23818 ts_tablet_manager.cc:1403] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.021s
I20260709 13:07:56.103236 23703 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:56.110356 23818 raft_consensus.cc:359] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.111390 23818 raft_consensus.cc:385] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.114737 23819 tablet_bootstrap.cc:492] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:56.115275 23819 ts_tablet_manager.cc:1403] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.088s	user 0.023s	sys 0.015s
I20260709 13:07:56.117956 23819 raft_consensus.cc:359] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.118602 23819 raft_consensus.cc:385] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.118875 23819 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.122005 23818 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.123312 23818 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.119572 23819 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.125861 23820 tablet_bootstrap.cc:492] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:56.126144 23819 ts_tablet_manager.cc:1434] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:07:56.126411 23820 ts_tablet_manager.cc:1403] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.009s
I20260709 13:07:56.128170 23818 ts_tablet_manager.cc:1434] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:07:56.129245 23818 tablet_bootstrap.cc:492] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:56.129329 23820 raft_consensus.cc:359] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.130105 23820 raft_consensus.cc:385] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.130398 23820 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.131302 23820 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.133448 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:56.134509 24149 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:56.136355 24149 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:56.136880 23818 tablet_bootstrap.cc:654] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.137527 24149 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.140533 23819 tablet_bootstrap.cc:492] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:56.144870 23778 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:56.146857 23819 tablet_bootstrap.cc:654] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.152223 23775 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.152503 24122 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:56.156870 23820 ts_tablet_manager.cc:1434] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:07:56.163434 23820 tablet_bootstrap.cc:492] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:56.165421 23818 tablet_bootstrap.cc:492] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:56.165959 23818 ts_tablet_manager.cc:1403] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.002s
I20260709 13:07:56.172107 24120 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.172746 24120 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.180958 23820 tablet_bootstrap.cc:654] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.201742 23524 catalog_manager.cc:5697] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.202209 23818 raft_consensus.cc:359] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.203059 23818 raft_consensus.cc:385] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.203397 23818 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.202858 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:56.204159 23778 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:56.204718 23818 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.205574 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:56.206454 23818 ts_tablet_manager.cc:1434] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:07:56.206489 24118 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.207085 24118 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.207610 23818 tablet_bootstrap.cc:492] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:56.207538 24118 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.216624 24148 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.217216 24148 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.220178 24116 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.220960 24148 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.220839 24116 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.223289 23818 tablet_bootstrap.cc:654] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.225647 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:56.226630 23777 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:56.229087 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:56.229727 23625 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:56.231007 23592 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:56.215718 24118 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.235297 24118 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.237308 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:56.238085 23777 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.245895 24116 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.246582 24116 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.247586 24116 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.248214 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:56.249086 23773 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:56.250540 23667 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:56.253126 23777 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:56.202555 24120 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.254329 24120 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.254956 24120 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.255513 24120 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.260407 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:56.261137 23778 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:56.264660 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:56.267475 24116 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.268076 24116 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:56.269253 24149 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.269865 23819 tablet_bootstrap.cc:492] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:56.271075 23819 ts_tablet_manager.cc:1403] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.131s	user 0.029s	sys 0.024s
I20260709 13:07:56.269932 24149 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.276185 24149 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.271294 24118 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.278617 24118 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.279719 24118 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.280478 23703 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.274701 23819 raft_consensus.cc:359] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.284513 23819 raft_consensus.cc:385] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.284796 23819 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.285472 23819 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.287480 23819 ts_tablet_manager.cc:1434] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:07:56.283710 24149 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.291481 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:56.295832 23818 tablet_bootstrap.cc:492] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:56.296361 23818 ts_tablet_manager.cc:1403] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.089s	user 0.023s	sys 0.009s
I20260709 13:07:56.297855 23819 tablet_bootstrap.cc:492] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:56.300988 24149 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.301833 23818 raft_consensus.cc:359] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.302532 23818 raft_consensus.cc:385] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.302816 23818 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.302744 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:56.303637 23777 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.303828 23818 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.305490 24116 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:56.306061 24116 raft_consensus.cc:697] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:56.310268 23819 tablet_bootstrap.cc:654] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.303601 24118 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.313576 23818 ts_tablet_manager.cc:1434] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:07:56.314473 24118 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.314808 23818 tablet_bootstrap.cc:492] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:56.299201 23820 tablet_bootstrap.cc:492] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:56.316797 23820 ts_tablet_manager.cc:1403] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.154s	user 0.019s	sys 0.014s
I20260709 13:07:56.318575 24120 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.319983 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:56.320840 24120 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.322710 23818 tablet_bootstrap.cc:654] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.322572 23820 raft_consensus.cc:359] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.323287 23820 raft_consensus.cc:385] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.323578 23820 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.325019 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:56.325810 23775 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.326912 23777 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:56.327889 23819 tablet_bootstrap.cc:492] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:56.328101 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:56.328707 23819 ts_tablet_manager.cc:1403] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.007s
I20260709 13:07:56.328935 23695 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:56.329385 23592 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:56.307179 24116 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.330834 24149 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:56.331377 24149 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:56.331666 23819 raft_consensus.cc:359] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.332448 23819 raft_consensus.cc:385] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.332346 24122 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:56.332942 23819 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.332281 24149 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.333681 23819 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.334550 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:56.335645 23695 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:56.327581 23820 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.338476 23818 tablet_bootstrap.cc:492] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:56.339224 23818 ts_tablet_manager.cc:1403] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 13:07:56.339696 23820 ts_tablet_manager.cc:1434] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:07:56.341156 23820 tablet_bootstrap.cc:492] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:56.342346 23818 raft_consensus.cc:359] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.343199 23818 raft_consensus.cc:385] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.343498 23818 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.343757 24092 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.344233 24092 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.344712 23819 ts_tablet_manager.cc:1434] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:07:56.345798 23819 tablet_bootstrap.cc:492] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:56.346647 24092 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.349023 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:56.349385 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:56.349788 23621 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.350689 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:56.352375 23819 tablet_bootstrap.cc:654] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.344246 23818 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.356256 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:56.357405 23818 ts_tablet_manager.cc:1434] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:07:56.341156 23775 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:56.368130 23818 tablet_bootstrap.cc:492] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:56.363006 24122 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:07:56.373194 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:56.382771 24120 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.405486 23669 leader_election.cc:343] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.407791 24120 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.393623 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:56.417116 24120 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.421602 23527 catalog_manager.cc:5697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.404001 23621 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
W20260709 13:07:56.426862 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 65753.5us
I20260709 13:07:56.427503 23819 tablet_bootstrap.cc:492] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:56.428069 23819 ts_tablet_manager.cc:1403] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.083s	user 0.027s	sys 0.016s
I20260709 13:07:56.430016 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:56.454977 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:56.456418 24116 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:56.459174 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:56.481441 23695 raft_consensus.cc:2393] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:07:56.435930 24122 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:07:56.491070 24122 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.491793 24122 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.499652 24122 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:56.512202 23526 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.554746 23819 raft_consensus.cc:359] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.555712 23819 raft_consensus.cc:385] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.556025 23819 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.556435 23820 tablet_bootstrap.cc:654] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.557288 23819 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.559643 23819 ts_tablet_manager.cc:1434] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.131s	user 0.005s	sys 0.003s
I20260709 13:07:56.560683 23819 tablet_bootstrap.cc:492] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
W20260709 13:07:56.563858 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 133955us
W20260709 13:07:56.565303 23669 leader_election.cc:343] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.567090 24199 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:56.568145 23818 tablet_bootstrap.cc:654] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:56.570639 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 197113us
I20260709 13:07:56.571768 23667 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:56.572863 24185 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:56.573442 24185 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:56.574361 24185 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.578636 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:56.579262 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:56.580663 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:56.582525 24092 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.587904 24203 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.588502 24203 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.590916 23819 tablet_bootstrap.cc:654] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.591338 24203 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.594058 24092 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:56.599587 24199 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.600172 24199 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.602461 24199 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.612673 23820 tablet_bootstrap.cc:492] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:56.613474 23820 ts_tablet_manager.cc:1403] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.273s	user 0.017s	sys 0.005s
I20260709 13:07:56.616266 24203 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.616856 24203 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.617269 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:56.622681 24203 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:56.623062 23697 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:56.626717 23820 raft_consensus.cc:359] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.634541 23820 raft_consensus.cc:385] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.635056 23820 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.645614 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:56.648454 23820 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:56.653549 23743 leader_election.cc:343] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.654554 24122 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:07:56.661083 23820 ts_tablet_manager.cc:1434] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:07:56.665323 23667 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:56.669404 23742 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:56.678529 24123 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.679286 24200 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.679157 24123 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.682881 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:56.686280 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:56.679893 24200 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.671622 24199 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:56.681281 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:56.687549 24123 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.683825 24149 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:07:56.709810 23819 tablet_bootstrap.cc:492] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:56.710391 23819 ts_tablet_manager.cc:1403] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.150s	user 0.037s	sys 0.036s
I20260709 13:07:56.710727 24200 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:56.712921 23819 raft_consensus.cc:359] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.713574 23819 raft_consensus.cc:385] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.713829 23819 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.714506 23819 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.715929 23819 ts_tablet_manager.cc:1434] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:07:56.717020 23819 tablet_bootstrap.cc:492] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:56.695554 23621 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:56.704835 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:56.727808 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:56.730192 23743 consensus_peers.cc:597] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:56.731916 24198 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:56.736696 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48456.2us
I20260709 13:07:56.738274 23626 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.741617 23818 tablet_bootstrap.cc:492] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:56.742182 23818 ts_tablet_manager.cc:1403] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.379s	user 0.023s	sys 0.013s
W20260709 13:07:56.751864 23575 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:07:56.759886 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 70516.8us
W20260709 13:07:56.762245 23667 leader_election.cc:343] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:56.763454 23667 leader_election.cc:343] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:56.770546 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 82131.2us
I20260709 13:07:56.772746 23818 raft_consensus.cc:359] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.773478 23818 raft_consensus.cc:385] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.773738 23818 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.774415 23818 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:56.778932 23669 leader_election.cc:343] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.780020 23820 tablet_bootstrap.cc:492] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:56.781684 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:56.785311 23818 ts_tablet_manager.cc:1434] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.002s
I20260709 13:07:56.775592 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:56.787750 24213 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:56.787559 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:56.765048 24123 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:56.808950 24198 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:56.794296 24116 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.825217 23778 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:07:56.825940 24116 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.842965 24123 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:07:56.850304 23743 leader_election.cc:343] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.839270 24116 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:56.863654 23669 leader_election.cc:343] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.865573 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:56.890300 23818 tablet_bootstrap.cc:492] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:56.874645 24203 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:56.875756 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:56.953317 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:56.955418 24148 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:57.153244 24185 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.153997 24185 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:57.167999 24214 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
W20260709 13:07:57.172597 24215 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
W20260709 13:07:57.181052 24210 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.055s	user 0.000s	sys 0.007s
W20260709 13:07:57.182879 23742 leader_election.cc:343] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:57.183401 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:56.899097 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:57.184492 24202 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:57.186358 23819 tablet_bootstrap.cc:700] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76: Time spent opening tablet: real 0.302s	user 0.047s	sys 0.023s
I20260709 13:07:57.187206 23819 tablet_bootstrap.cc:654] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.188388 23820 tablet_bootstrap.cc:654] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.184926 23621 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.995940 23524 catalog_manager.cc:5697] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.220717 24197 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.218087 24185 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:57.205710 24211 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:07:57.221328 24197 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.273228 24116 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.287209 23696 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:57.287917 24116 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:57.288043 23621 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
W20260709 13:07:57.283576 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 85076.4us
I20260709 13:07:57.292138 23818 tablet_bootstrap.cc:654] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.296592 23819 tablet_bootstrap.cc:492] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:57.301707 23819 ts_tablet_manager.cc:1403] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.585s	user 0.060s	sys 0.030s
W20260709 13:07:57.311532 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 78181.4us
I20260709 13:07:57.301091 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:57.310148 24197 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:57.351040 23819 raft_consensus.cc:359] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.352206 23819 raft_consensus.cc:385] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.352629 23819 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.360867 23819 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.386689 23819 ts_tablet_manager.cc:1434] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.001s
I20260709 13:07:57.391237 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:57.392634 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:57.386300 24092 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:07:57.376158 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:57.395387 23777 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:07:57.396171 23742 leader_election.cc:343] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:57.397228 23820 tablet_bootstrap.cc:492] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:57.397735 23820 ts_tablet_manager.cc:1403] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.618s	user 0.045s	sys 0.011s
I20260709 13:07:57.400349 23820 raft_consensus.cc:359] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.401497 23820 raft_consensus.cc:385] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.401793 23820 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.402696 23820 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:57.418326 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 122235us
I20260709 13:07:57.421705 23820 ts_tablet_manager.cc:1434] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:07:57.416745 24222 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.439963 23820 tablet_bootstrap.cc:492] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:57.453994 24222 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.552592 24222 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:07:57.558630 24228 log.cc:927] Time spent T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:07:57.537650 24192 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:07:57.601207 23818 tablet_bootstrap.cc:492] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:57.602247 23818 ts_tablet_manager.cc:1403] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.712s	user 0.053s	sys 0.159s
I20260709 13:07:57.604794 23819 tablet_bootstrap.cc:492] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:57.606316 23818 raft_consensus.cc:359] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.607985 23818 raft_consensus.cc:385] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.608398 23818 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.609668 23820 tablet_bootstrap.cc:654] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.609218 23818 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.627365 23818 ts_tablet_manager.cc:1434] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:07:57.631248 23818 tablet_bootstrap.cc:492] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:57.633085 24116 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.621549 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 199419us
I20260709 13:07:57.633682 24116 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.649328 24120 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:57.655714 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:57.657857 24120 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:57.644380 24116 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:57.664358 23743 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:07:57.665802 23819 tablet_bootstrap.cc:654] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.668081 24204 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:57.669381 24204 raft_consensus.cc:697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:07:57.670620 23667 leader_election.cc:343] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:57.673743 23743 leader_election.cc:343] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:57.674285 23743 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:57.671533 24204 consensus_queue.cc:237] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.676498 24135 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:57.681857 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:57.683482 23818 tablet_bootstrap.cc:654] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:57.687026 23667 leader_election.cc:343] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:57.695174 23820 tablet_bootstrap.cc:492] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:57.695698 23820 ts_tablet_manager.cc:1403] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.256s	user 0.028s	sys 0.008s
I20260709 13:07:57.696071 23818 tablet_bootstrap.cc:492] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:57.696609 23818 ts_tablet_manager.cc:1403] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.001s
I20260709 13:07:57.702167 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:57.702965 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 281785us
I20260709 13:07:57.704388 23820 raft_consensus.cc:359] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.705351 23820 raft_consensus.cc:385] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.705725 23820 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.706629 23820 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:57.708047 23669 consensus_peers.cc:597] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:57.711620 24239 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:07:57.716830 23669 leader_election.cc:343] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:57.718194 23669 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:57.734805 24185 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:57.735772 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:57.740168 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:57.715291 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:57.746064 23820 ts_tablet_manager.cc:1434] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.001s
I20260709 13:07:57.754570 23819 tablet_bootstrap.cc:492] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:57.860270 23819 ts_tablet_manager.cc:1403] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.256s	user 0.015s	sys 0.007s
W20260709 13:07:57.869943 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 153144us
I20260709 13:07:57.872184 24216 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.873356 23622 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:07:57.882328 23820 tablet_bootstrap.cc:492] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:57.877656 24199 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
W20260709 13:07:57.951309 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 74717.8us
W20260709 13:07:57.952528 23669 leader_election.cc:343] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:57.889791 24216 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.957818 23669 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:57.959968 23818 raft_consensus.cc:359] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.961251 23818 raft_consensus.cc:385] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.961576 23818 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.963914 23818 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.969090 24249 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:57.970885 24247 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:07:57.972878 23819 raft_consensus.cc:359] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.975241 23819 raft_consensus.cc:385] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.975839 23819 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.976639 23819 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:57.974349 24216 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:57.981598 23819 ts_tablet_manager.cc:1434] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.121s	user 0.003s	sys 0.005s
I20260709 13:07:57.989332 23818 ts_tablet_manager.cc:1434] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.292s	user 0.006s	sys 0.009s
I20260709 13:07:57.993716 24200 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.994271 24200 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.003228 23818 tablet_bootstrap.cc:492] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:58.003552 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:58.004278 23778 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:58.006428 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:58.006456 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:58.011083 24200 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:58.010555 23592 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:58.016163 24250 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:58.013329 24249 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.016909 24249 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.028146 24230 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:58.017313 24249 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.037545 24129 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.040596 24129 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.042220 23820 tablet_bootstrap.cc:654] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.055634 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:58.042974 24129 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:58.076395 23819 tablet_bootstrap.cc:492] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:58.087141 23818 tablet_bootstrap.cc:654] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:58.087224 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 72415.5us
I20260709 13:07:58.088820 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:58.104933 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 98531.8us
I20260709 13:07:58.141382 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:58.082013 24249 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.144764 23702 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:58.145073 24249 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:07:58.149299 23593 leader_election.cc:343] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.152580 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:58.155476 23819 tablet_bootstrap.cc:654] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.157614 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:58.158306 23778 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.128824 24200 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.161331 24252 log.cc:927] Time spent T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:07:58.175803 23820 tablet_bootstrap.cc:492] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:58.177428 23820 ts_tablet_manager.cc:1403] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.297s	user 0.015s	sys 0.004s
W20260709 13:07:58.193056 23743 leader_election.cc:343] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.194363 23743 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:58.195982 23778 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:58.163501 24200 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.203547 23820 raft_consensus.cc:359] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.204748 23820 raft_consensus.cc:385] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.206708 23820 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.207603 23820 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.199259 24123 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:58.213829 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:58.214946 24186 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.217419 23820 ts_tablet_manager.cc:1434] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:07:58.217793 24186 raft_consensus.cc:697] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:07:58.231860 23669 leader_election.cc:343] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.238005 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:58.242535 23625 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:58.244122 23669 leader_election.cc:343] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.251561 23624 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.253026 24200 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:58.254122 23818 tablet_bootstrap.cc:492] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:58.255687 23818 ts_tablet_manager.cc:1403] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.253s	user 0.016s	sys 0.008s
W20260709 13:07:58.260274 23575 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:58.265221 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:58.265952 23628 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:58.267130 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:58.268961 23742 leader_election.cc:343] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.268496 24186 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.270862 23743 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:07:58.274968 24212 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.275430 24212 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.275839 24212 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.278321 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:58.291808 23820 tablet_bootstrap.cc:492] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:58.293898 23819 tablet_bootstrap.cc:492] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:58.294425 23819 ts_tablet_manager.cc:1403] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.218s	user 0.015s	sys 0.015s
I20260709 13:07:58.294631 24135 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:58.300976 23818 raft_consensus.cc:359] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.301985 23818 raft_consensus.cc:385] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.302379 23818 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.316484 24212 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.324103 23778 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:07:58.349083 24212 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:58.358616 23819 raft_consensus.cc:359] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.359539 23819 raft_consensus.cc:385] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.359913 23819 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.360607 23819 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.360996 24120 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.361543 24120 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.362322 23818 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.362749 23819 ts_tablet_manager.cc:1434] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.068s	user 0.003s	sys 0.003s
I20260709 13:07:58.366437 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:58.369030 23667 leader_election.cc:343] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.375437 23592 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:58.365659 24120 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:58.378530 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:58.382431 23669 leader_election.cc:343] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.383153 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:58.385346 23818 ts_tablet_manager.cc:1434] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.129s	user 0.011s	sys 0.000s
I20260709 13:07:58.381264 24148 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.391530 23818 tablet_bootstrap.cc:492] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:58.395429 23819 tablet_bootstrap.cc:492] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:58.405925 24135 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:58.408157 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:07:58.415788 23742 leader_election.cc:343] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.386657 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:58.403228 24120 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:58.425680 24148 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:58.430655 23820 tablet_bootstrap.cc:654] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:58.451372 24264 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:07:58.451406 23527 catalog_manager.cc:5697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.456801 24116 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.457502 24116 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.458474 23818 tablet_bootstrap.cc:654] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.465821 24116 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:58.471042 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:58.472049 23770 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:58.473791 23626 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:58.474862 23667 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:58.476570 24120 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.477321 24120 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.477646 24120 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.480923 23743 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:07:58.481736 24135 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.482285 24135 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:58.491750 24135 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.496865 23820 tablet_bootstrap.cc:492] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:58.498320 23820 ts_tablet_manager.cc:1403] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.207s	user 0.013s	sys 0.002s
I20260709 13:07:58.500046 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:58.502840 23819 tablet_bootstrap.cc:654] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:58.510268 23669 leader_election.cc:343] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.512511 24186 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.518236 24120 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.518365 24186 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.520537 24120 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:58.520932 24186 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:58.514943 23820 raft_consensus.cc:359] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.521747 23820 raft_consensus.cc:385] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.522042 23820 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.523751 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:58.524478 23770 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.522665 23820 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.525102 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:07:58.530032 23669 leader_election.cc:343] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.531297 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:58.533063 23820 ts_tablet_manager.cc:1434] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.003s
I20260709 13:07:58.525106 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:58.534143 23820 tablet_bootstrap.cc:492] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
W20260709 13:07:58.535171 23669 leader_election.cc:343] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:58.538448 23667 leader_election.cc:343] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.538878 23667 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:07:58.539896 24116 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:58.588397 23818 tablet_bootstrap.cc:492] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:58.588972 23818 ts_tablet_manager.cc:1403] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.198s	user 0.014s	sys 0.014s
I20260709 13:07:58.609937 23770 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:58.615721 23819 tablet_bootstrap.cc:492] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:58.616323 23819 ts_tablet_manager.cc:1403] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.221s	user 0.018s	sys 0.027s
I20260709 13:07:58.619664 23667 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:58.624109 23819 raft_consensus.cc:359] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.624620 24216 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.624841 23819 raft_consensus.cc:385] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.625149 23819 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.625303 24216 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:58.625783 23819 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.627899 23819 ts_tablet_manager.cc:1434] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:07:58.628823 23819 tablet_bootstrap.cc:492] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:58.627068 24216 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.632766 23820 tablet_bootstrap.cc:654] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.645753 23524 catalog_manager.cc:5697] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.653076 23818 raft_consensus.cc:359] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.655620 23818 raft_consensus.cc:385] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.655997 23818 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.658129 23820 tablet_bootstrap.cc:492] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:58.658692 23820 ts_tablet_manager.cc:1403] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.125s	user 0.024s	sys 0.006s
I20260709 13:07:58.656667 23818 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.670750 23818 ts_tablet_manager.cc:1434] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.001s
W20260709 13:07:58.673520 23669 consensus_peers.cc:597] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.679200 23818 tablet_bootstrap.cc:492] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:58.680574 23820 raft_consensus.cc:359] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.681509 23820 raft_consensus.cc:385] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.681847 23820 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.682788 24149 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.683418 24149 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.686586 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:58.687326 23698 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:58.687353 24212 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.689217 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:58.690510 24092 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.690965 24092 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.691335 24092 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.690171 24212 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.694022 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:58.695043 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:58.696553 23743 leader_election.cc:343] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.696229 23524 catalog_manager.cc:5697] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:58.697599 23592 leader_election.cc:343] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.700354 24212 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:58.700193 23527 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.703681 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:58.704492 23698 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:58.705335 24149 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:58.682777 23820 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.708357 23742 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:58.709610 24135 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.710048 24135 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.710389 24135 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.711971 24092 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.718861 23820 ts_tablet_manager.cc:1434] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.006s
I20260709 13:07:58.723944 23820 tablet_bootstrap.cc:492] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:58.724927 23819 tablet_bootstrap.cc:654] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.731951 24092 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:58.734149 23820 tablet_bootstrap.cc:654] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.737555 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:07:58.743887 23592 leader_election.cc:343] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.746672 23820 tablet_bootstrap.cc:492] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:58.747236 23820 ts_tablet_manager.cc:1403] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 13:07:58.750195 23820 raft_consensus.cc:359] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.751019 23820 raft_consensus.cc:385] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.751328 23820 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.751413 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:58.752174 23699 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.752504 23820 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.726017 24135 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.758451 23820 ts_tablet_manager.cc:1434] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:07:58.758818 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:58.759582 23624 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.759675 23820 tablet_bootstrap.cc:492] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:58.761727 23699 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:58.766886 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:58.768868 24149 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.769455 24149 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:58.770684 24135 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:58.729012 23818 tablet_bootstrap.cc:654] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.770460 24149 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.773743 24120 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:58.776904 23820 tablet_bootstrap.cc:654] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.790232 24216 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.801822 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:58.824404 24216 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.830039 23624 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:58.831614 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:58.833388 24212 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.842958 24212 raft_consensus.cc:697] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:58.849390 24212 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.853492 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:58.838873 23699 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:58.855134 23669 leader_election.cc:343] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.856444 23820 tablet_bootstrap.cc:492] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:58.856920 23820 ts_tablet_manager.cc:1403] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.005s
I20260709 13:07:58.861290 23820 raft_consensus.cc:359] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.841643 24216 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:58.861860 23820 raft_consensus.cc:385] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.863662 23820 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.868781 23820 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.863010 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:58.872792 23774 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:58.875239 23819 tablet_bootstrap.cc:492] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:58.875810 23819 ts_tablet_manager.cc:1403] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.247s	user 0.014s	sys 0.006s
I20260709 13:07:58.877421 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:58.879985 24186 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.880365 24186 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.880713 24186 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.895287 23818 tablet_bootstrap.cc:492] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:58.895910 23818 ts_tablet_manager.cc:1403] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.217s	user 0.035s	sys 0.023s
I20260709 13:07:58.899634 23820 ts_tablet_manager.cc:1434] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.002s
I20260709 13:07:58.900935 23820 tablet_bootstrap.cc:492] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:58.904172 23818 raft_consensus.cc:359] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.910624 23818 raft_consensus.cc:385] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.911000 23818 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.904608 24186 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.911792 23818 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.887084 23819 raft_consensus.cc:359] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.912819 23819 raft_consensus.cc:385] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.913090 23819 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.914047 23819 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.919947 23699 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:58.931402 23818 ts_tablet_manager.cc:1434] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:07:58.932485 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:58.935508 23819 ts_tablet_manager.cc:1434] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:07:58.935858 24186 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:58.936798 23819 tablet_bootstrap.cc:492] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:58.932713 23818 tablet_bootstrap.cc:492] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
W20260709 13:07:58.935559 23669 leader_election.cc:343] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.947124 23818 tablet_bootstrap.cc:654] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.946592 23524 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:58.964846 23742 consensus_peers.cc:597] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.966741 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:58.967427 23778 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.968995 23818 tablet_bootstrap.cc:492] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:58.969467 23818 ts_tablet_manager.cc:1403] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:07:58.972684 23818 raft_consensus.cc:359] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.973543 23818 raft_consensus.cc:385] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.973906 23818 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.974931 23778 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:58.974615 23818 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.977067 23818 ts_tablet_manager.cc:1434] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:58.978133 23818 tablet_bootstrap.cc:492] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:58.978297 24288 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.978899 24288 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:58.987398 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:58.989410 24116 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.989895 24116 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:58.991179 23527 catalog_manager.cc:5697] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.990945 24116 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.001179 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:59.001839 23699 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:59.002985 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:59.004097 23820 tablet_bootstrap.cc:654] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.004352 24149 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.004873 24149 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.005214 24149 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.007398 24251 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.007505 23819 tablet_bootstrap.cc:654] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.007905 23818 tablet_bootstrap.cc:654] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.007997 24251 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.010270 24251 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:59.012333 24288 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:59.014248 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:59.015372 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:07:59.017092 23669 leader_election.cc:343] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:59.019230 23592 leader_election.cc:343] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.023871 24149 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.029887 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:07:59.031208 23592 leader_election.cc:343] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.031823 24149 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:59.038175 23820 tablet_bootstrap.cc:492] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:59.038980 23820 ts_tablet_manager.cc:1403] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.138s	user 0.015s	sys 0.004s
I20260709 13:07:59.042610 23820 raft_consensus.cc:359] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.043568 23820 raft_consensus.cc:385] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.043943 23820 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.051684 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:59.052459 23699 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.054342 23820 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.059512 23820 ts_tablet_manager.cc:1434] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:07:59.062033 23820 tablet_bootstrap.cc:492] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:59.073017 23699 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:59.074234 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:59.075281 24149 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.075826 24149 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:59.076628 24149 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.078881 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:59.079528 23778 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 0.
I20260709 13:07:59.078740 23524 catalog_manager.cc:5697] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.088289 23820 tablet_bootstrap.cc:654] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.086431 24201 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:07:59.090838 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:59.093694 24186 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.094090 24186 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.094399 24186 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.101783 23819 tablet_bootstrap.cc:492] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:59.102308 23819 ts_tablet_manager.cc:1403] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.166s	user 0.026s	sys 0.004s
I20260709 13:07:59.101804 24186 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.106241 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:59.106815 23819 raft_consensus.cc:359] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.107789 23819 raft_consensus.cc:385] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.108047 23819 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
W20260709 13:07:59.108654 23669 leader_election.cc:343] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.108732 23819 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:59.110973 23669 consensus_peers.cc:597] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.112466 23819 ts_tablet_manager.cc:1434] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:07:59.118180 24186 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:59.113515 23819 tablet_bootstrap.cc:492] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:59.120685 24288 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.122375 24288 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.127316 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:59.128189 23774 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:07:59.131836 24288 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:59.134130 23524 catalog_manager.cc:5697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.136966 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:59.140753 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:59.142840 24255 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.158869 23820 tablet_bootstrap.cc:492] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:59.164170 23820 ts_tablet_manager.cc:1403] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.102s	user 0.005s	sys 0.006s
I20260709 13:07:59.167143 23820 raft_consensus.cc:359] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.162746 24232 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.171095 24232 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.173521 24232 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:59.160537 23819 tablet_bootstrap.cc:654] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.175446 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:59.177069 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:59.177618 23820 raft_consensus.cc:385] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.177740 23699 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
W20260709 13:07:59.177877 23592 leader_election.cc:343] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.179430 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:59.180459 24232 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.180825 24232 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.181149 24232 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.182258 23819 tablet_bootstrap.cc:492] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:59.182909 23819 ts_tablet_manager.cc:1403] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.070s	user 0.003s	sys 0.007s
I20260709 13:07:59.168836 24255 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.186870 23819 raft_consensus.cc:359] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.187891 23819 raft_consensus.cc:385] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.188247 23819 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.189123 23819 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.191980 23819 ts_tablet_manager.cc:1434] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.008s
I20260709 13:07:59.191679 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:59.194415 23819 tablet_bootstrap.cc:492] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
I20260709 13:07:59.190246 24232 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.197474 24232 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:59.198472 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:07:59.178018 23820 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.205471 23820 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.207027 23820 ts_tablet_manager.cc:1434] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.042s	user 0.000s	sys 0.004s
I20260709 13:07:59.208055 23820 tablet_bootstrap.cc:492] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:59.200937 23819 tablet_bootstrap.cc:654] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.201792 23774 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.203516 23818 tablet_bootstrap.cc:492] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
W20260709 13:07:59.204211 23592 leader_election.cc:343] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.211757 23818 ts_tablet_manager.cc:1403] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.234s	user 0.047s	sys 0.058s
I20260709 13:07:59.212853 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:59.214272 23699 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.219973 24251 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.226442 23818 raft_consensus.cc:359] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.231827 23699 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:07:59.234684 23774 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:07:59.235538 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:07:59.239619 24232 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.240620 24232 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:07:59.241582 24232 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.243129 23820 tablet_bootstrap.cc:654] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.227495 23818 raft_consensus.cc:385] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.247356 23818 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.248410 23818 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.253897 23819 tablet_bootstrap.cc:492] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:59.254614 23819 ts_tablet_manager.cc:1403] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.060s	user 0.026s	sys 0.017s
I20260709 13:07:59.260372 23818 ts_tablet_manager.cc:1434] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.003s
I20260709 13:07:59.261484 23818 tablet_bootstrap.cc:492] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:59.264142 24212 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.264887 24212 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.268992 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:59.270350 24251 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.271251 24251 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:07:59.274195 24251 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.278636 23818 tablet_bootstrap.cc:654] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.280138 24212 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:59.283717 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:59.287372 24149 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.290040 23820 tablet_bootstrap.cc:492] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:59.290596 23820 ts_tablet_manager.cc:1403] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.003s
W20260709 13:07:59.291214 23743 leader_election.cc:343] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.291261 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:59.293754 23820 raft_consensus.cc:359] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.294457 23702 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:59.294613 23820 raft_consensus.cc:385] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.294966 23820 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.295812 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:59.296638 24212 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.297161 24212 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.298290 24212 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.287357 23819 raft_consensus.cc:359] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.299835 23819 raft_consensus.cc:385] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.300180 23819 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.300928 23819 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.301888 23818 tablet_bootstrap.cc:492] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:59.302380 23818 ts_tablet_manager.cc:1403] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.006s
I20260709 13:07:59.303421 23819 ts_tablet_manager.cc:1434] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:07:59.307876 23818 raft_consensus.cc:359] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.308739 23818 raft_consensus.cc:385] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.310128 23818 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.295836 23820 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.309162 23524 catalog_manager.cc:5697] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.310942 23818 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.312529 23820 ts_tablet_manager.cc:1434] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:07:59.313643 23820 tablet_bootstrap.cc:492] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:59.314013 23818 ts_tablet_manager.cc:1434] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:07:59.316080 23818 tablet_bootstrap.cc:492] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:59.304576 23819 tablet_bootstrap.cc:492] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Bootstrap starting.
W20260709 13:07:59.319657 23592 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.339051 23818 tablet_bootstrap.cc:654] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.374006 24212 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.376391 23820 tablet_bootstrap.cc:654] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.376462 24212 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:07:59.383920 23575 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:59.401373 24258 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.407073 24258 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.430159 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:59.430835 23704 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.432386 24201 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.432880 24201 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.435353 24201 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:59.440387 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:59.438759 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:59.444769 24135 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.447794 24135 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.424249 24258 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:59.450937 23526 catalog_manager.cc:5697] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 0 to 1, leader changed from <none> to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.463943 24135 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:59.453735 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:59.467442 23696 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:59.473742 23819 tablet_bootstrap.cc:654] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.476034 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:59.479454 23704 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
W20260709 13:07:59.489980 23743 leader_election.cc:343] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:59.490430 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 48089.9us
I20260709 13:07:59.494191 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:59.495126 23696 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 1: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:07:59.496282 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:07:59.496744 23743 leader_election.cc:343] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.497103 23698 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:59.497442 23820 tablet_bootstrap.cc:492] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:59.497994 23820 ts_tablet_manager.cc:1403] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.185s	user 0.010s	sys 0.021s
I20260709 13:07:59.497838 24201 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.503129 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:59.504061 23622 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:59.515980 23743 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:59.516867 23697 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.517942 24253 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.518404 24253 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.518776 24253 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.520853 23820 raft_consensus.cc:359] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.521646 23820 raft_consensus.cc:385] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.521915 23820 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.526068 23818 tablet_bootstrap.cc:492] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:59.526580 23818 ts_tablet_manager.cc:1403] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.212s	user 0.018s	sys 0.020s
I20260709 13:07:59.530717 23818 raft_consensus.cc:359] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.531549 23818 raft_consensus.cc:385] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.531587 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:59.531978 23818 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.532497 24135 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.524209 23820 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.536088 24135 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.536471 24135 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.536721 23819 tablet_bootstrap.cc:492] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: No bootstrap required, opened a new log
I20260709 13:07:59.537274 23819 ts_tablet_manager.cc:1403] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Time spent bootstrapping tablet: real 0.233s	user 0.017s	sys 0.036s
I20260709 13:07:59.538942 23820 ts_tablet_manager.cc:1434] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 13:07:59.540025 23820 tablet_bootstrap.cc:492] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:59.533316 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:59.541191 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:07:59.541500 23819 raft_consensus.cc:359] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.542274 23819 raft_consensus.cc:385] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.542573 23819 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.543619 24198 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.544137 24198 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:59.544899 24198 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.547591 24212 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.556561 24200 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.533138 23818 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.558485 24253 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:07:59.533185 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 89081.6us
I20260709 13:07:59.543267 23819 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.561640 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:07:59.561854 24253 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:59.562423 23626 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.564638 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:59.565315 23698 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.556576 24212 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.567270 23819 ts_tablet_manager.cc:1434] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:07:59.558948 23818 ts_tablet_manager.cc:1434] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:07:59.569806 23818 tablet_bootstrap.cc:492] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:59.570139 24135 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.574689 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:07:59.580713 23743 leader_election.cc:343] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.585868 23818 tablet_bootstrap.cc:654] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.588789 23626 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:59.596259 24232 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.600817 24232 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.601476 23820 tablet_bootstrap.cc:654] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.603232 24232 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:59.597784 23818 tablet_bootstrap.cc:492] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:59.605594 23818 ts_tablet_manager.cc:1403] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.012s
I20260709 13:07:59.608525 23818 raft_consensus.cc:359] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.609287 23818 raft_consensus.cc:385] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.609612 23818 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.604355 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:59.599110 23698 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:59.600862 23743 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:07:59.615903 24200 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.619668 24200 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:59.621137 24200 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.629190 24135 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:59.611387 23818 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.631440 23818 ts_tablet_manager.cc:1434] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:07:59.634537 23818 tablet_bootstrap.cc:492] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9: Bootstrap starting.
I20260709 13:07:59.640260 24309 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.641088 23818 tablet_bootstrap.cc:654] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.637564 23526 catalog_manager.cc:5697] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.657023 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:59.657821 23818 tablet_bootstrap.cc:492] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9: No bootstrap required, opened a new log
I20260709 13:07:59.658479 23818 ts_tablet_manager.cc:1403] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 13:07:59.665284 23818 raft_consensus.cc:359] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.666342 23818 raft_consensus.cc:385] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.669798 23818 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Initialized, Role: FOLLOWER
W20260709 13:07:59.671082 23592 consensus_peers.cc:597] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.671039 23818 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.673696 23820 tablet_bootstrap.cc:492] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:07:59.674286 23818 ts_tablet_manager.cc:1434] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:07:59.674468 23820 ts_tablet_manager.cc:1403] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.135s	user 0.032s	sys 0.038s
I20260709 13:07:59.678251 24216 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.682040 24288 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.683044 23624 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.684746 23820 raft_consensus.cc:359] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.685530 23820 raft_consensus.cc:385] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.685820 23820 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.687630 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:07:59.688349 23698 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.686493 23820 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.696643 24310 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.702607 23820 ts_tablet_manager.cc:1434] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:07:59.704073 23593 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:59.706722 23820 tablet_bootstrap.cc:492] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:07:59.710001 24148 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.712531 24148 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.714882 24148 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:59.706772 24288 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:07:59.722076 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:59.724400 23704 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:07:59.725201 23698 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:07:59.728101 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:59.729856 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:07:59.729358 23526 catalog_manager.cc:5697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.731189 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:07:59.740940 24323 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.736243 24135 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.763795 24232 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.764354 24232 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.763207 24135 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:07:59.792570 24255 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.823820 24258 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.843516 24258 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.856765 24258 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:59.858960 23820 tablet_bootstrap.cc:654] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.811450 24135 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.888737 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:07:59.894500 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:59.895432 23698 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:59.891919 23626 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 0.
I20260709 13:07:59.898801 23742 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:59.900807 24200 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.901224 24200 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.901559 24200 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.887744 24232 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:07:59.938207 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:07:59.941016 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:07:59.944664 23696 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 0.
I20260709 13:07:59.952872 23774 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.953356 24326 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.956182 24286 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.960940 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:07:59.960795 24286 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:07:59.962047 24330 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.963532 24330 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.964001 24330 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:59.968418 23669 consensus_peers.cc:597] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.971081 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:07:59.964205 24331 log.cc:927] Time spent T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:59.983162 24286 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:07:59.992365 24323 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:00.012851 24200 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.014154 23771 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:00.016520 23820 tablet_bootstrap.cc:492] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:08:00.017048 23820 ts_tablet_manager.cc:1403] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.311s	user 0.022s	sys 0.013s
I20260709 13:08:00.024483 23820 raft_consensus.cc:359] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.025305 23820 raft_consensus.cc:385] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.025596 23820 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.063638 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:00.065600 24200 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:00.074868 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:00.019124 24330 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.079941 23622 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 1: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:08:00.082132 24334 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:00.026234 23820 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.085991 24326 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.086848 23820 ts_tablet_manager.cc:1434] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.001s
I20260709 13:08:00.086510 24326 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.091972 24212 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:00.092617 24212 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.093397 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:00.095347 24212 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:00.092001 24326 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:00.095592 23820 tablet_bootstrap.cc:492] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:08:00.092644 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:00.099691 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:00.101085 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:00.102133 24326 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:00.113998 23524 catalog_manager.cc:5697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.117934 23774 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.123970 23820 tablet_bootstrap.cc:654] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.127453 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:00.128211 23699 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.132388 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:00.137463 24330 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:00.138043 23699 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:00.139343 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:00.144371 23742 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:00.144385 23773 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 1: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:00.145390 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:00.148572 24200 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:00.149142 24330 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.149924 24330 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:00.151283 24330 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.148739 23742 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:00.158529 24200 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:00.159127 23820 tablet_bootstrap.cc:492] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:08:00.159597 23820 ts_tablet_manager.cc:1403] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.009s
I20260709 13:08:00.162698 23820 raft_consensus.cc:359] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.163398 23820 raft_consensus.cc:385] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.163748 23820 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.164386 23820 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.165036 24200 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.166496 23820 ts_tablet_manager.cc:1434] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:08:00.167501 23820 tablet_bootstrap.cc:492] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065: Bootstrap starting.
I20260709 13:08:00.174467 23820 tablet_bootstrap.cc:654] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.177584 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:00.188584 23820 tablet_bootstrap.cc:492] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065: No bootstrap required, opened a new log
I20260709 13:08:00.189445 24326 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.189112 23820 ts_tablet_manager.cc:1403] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.007s
I20260709 13:08:00.190044 24326 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.193576 24326 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:00.194087 23820 raft_consensus.cc:359] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.194815 23820 raft_consensus.cc:385] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.195111 23820 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.195823 23820 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:00.197613 23820 ts_tablet_manager.cc:1434] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:08:00.202625 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:00.205750 23742 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:00.208720 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:00.209393 24212 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:00.212956 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:00.213961 24212 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.214735 24323 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:00.220250 24200 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:00.231804 24200 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.238260 23527 catalog_manager.cc:5697] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.284463 23628 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.327625 23628 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.334774 24135 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.372359 24200 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.401818 23628 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.428853 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:00.441622 24348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:00.453930 24349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:00.454383 24351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:00.460384 22480 server_base.cc:1061] running on GCE node
I20260709 13:08:00.463320 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:00.463801 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:00.464092 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602480464070 us; error 0 us; skew 500 ppm
I20260709 13:08:00.465139 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:00.471693 22480 webserver.cc:533] Webserver started at http://127.21.244.4:35145/ using document root <none> and password file <none>
I20260709 13:08:00.473759 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:00.474164 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:00.474638 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:00.476441 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-3-root/instance:
uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
format_stamp: "Formatted at 2026-07-09 13:08:00 on dist-test-slave-j314"
I20260709 13:08:00.489389 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.012s	user 0.012s	sys 0.000s
I20260709 13:08:00.494349 24356 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:00.495281 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:08:00.495641 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-3-root
uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
format_stamp: "Formatted at 2026-07-09 13:08:00 on dist-test-slave-j314"
I20260709 13:08:00.496096 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:00.527366 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:00.528831 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:00.530290 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:00.533571 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:00.533862 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:00.534197 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:00.534449 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:00.629696 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.4:36767
I20260709 13:08:00.629823 24418 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.4:36767 every 8 connection(s)
I20260709 13:08:00.638573 22480 auto_leader_rebalancer-test.cc:384] add a tserver: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:00.671768 24419 heartbeater.cc:344] Connected to a master server at 127.21.244.62:36967
I20260709 13:08:00.672374 24419 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:00.673601 24419 heartbeater.cc:507] Master 127.21.244.62:36967 requested a full tablet report, sending...
I20260709 13:08:00.677037 23527 ts_manager.cc:194] Registered new tserver with Master: b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:00.679296 23527 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34376
I20260709 13:08:00.706081 24323 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:00.721557 24323 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:01.603554 23622 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:01.618494 23773 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:01.620461 24323 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:01.622848 23698 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:01.624550 24426 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:01.645083 23593 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1f8fde8107545d5a59c6b12b0822584. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:01.648325 24323 raft_consensus.cc:2955] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.650987 23698 raft_consensus.cc:2955] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.653288 23774 raft_consensus.cc:2955] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.686184 24419 heartbeater.cc:499] Master 127.21.244.62:36967 was elected leader, sending a full tablet report...
I20260709 13:08:01.714226 23527 catalog_manager.cc:5697] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.738288 23774 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:01.749680 23622 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:01.752431 24427 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:01.757081 23700 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:01.764614 24427 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:01.771203 23742 consensus_peers.cc:597] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dbdbb7d679eb4d0d935669cb839c12c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:01.771571 23622 raft_consensus.cc:2955] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.776024 24201 raft_consensus.cc:2955] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.815490 23526 catalog_manager.cc:5697] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.839695 23700 raft_consensus.cc:2955] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.870124 23698 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:01.883849 23774 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:01.886034 24216 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:01.892349 23622 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:01.894369 24216 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:01.899590 23668 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7656d11fa2f4f27beac8e46f9f20be9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:01.900679 24185 raft_consensus.cc:2955] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.905257 23774 raft_consensus.cc:2955] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.917479 23622 raft_consensus.cc:2955] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.921365 23700 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:01.928144 23524 catalog_manager.cc:5697] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.936096 23774 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:01.937670 24216 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:01.939543 23668 consensus_peers.cc:597] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a17c243311054979a1c285f2ef18d20e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:01.943866 23622 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:01.948376 24216 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.963243 24185 raft_consensus.cc:2955] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.965010 23773 raft_consensus.cc:2955] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.966789 23622 raft_consensus.cc:2955] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:01.983044 23527 catalog_manager.cc:5697] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.021080 24453 ts_tablet_manager.cc:933] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:02.024252 24453 tablet_copy_client.cc:323] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.1:37537
I20260709 13:08:02.039358 23639 tablet_copy_service.cc:140] P 9ab488f10c434878a749f261e99a8065: Received BeginTabletCopySession request for tablet e1f8fde8107545d5a59c6b12b0822584 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:58448)
I20260709 13:08:02.040141 23639 tablet_copy_service.cc:161] P 9ab488f10c434878a749f261e99a8065: Beginning new tablet copy session on tablet e1f8fde8107545d5a59c6b12b0822584 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:58448: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-e1f8fde8107545d5a59c6b12b0822584
I20260709 13:08:02.052664 23639 tablet_copy_source_session.cc:215] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:02.057493 24453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f8fde8107545d5a59c6b12b0822584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.078114 24453 tablet_copy_client.cc:806] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:02.078929 24453 tablet_copy_client.cc:670] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:02.085242 24453 tablet_copy_client.cc:538] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:02.096232 24453 tablet_bootstrap.cc:492] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:02.124223 24453 tablet_bootstrap.cc:492] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:02.125347 24453 tablet_bootstrap.cc:492] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:02.126106 24453 ts_tablet_manager.cc:1403] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.005s
I20260709 13:08:02.130326 24453 raft_consensus.cc:359] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:02.131319 24453 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:02.132134 24453 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:02.142059 24453 ts_tablet_manager.cc:1434] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.004s
I20260709 13:08:02.144254 23639 tablet_copy_service.cc:342] P 9ab488f10c434878a749f261e99a8065: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-e1f8fde8107545d5a59c6b12b0822584 received from {username='slave'} at 127.0.0.1:58448
I20260709 13:08:02.144776 23639 tablet_copy_service.cc:434] P 9ab488f10c434878a749f261e99a8065: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-e1f8fde8107545d5a59c6b12b0822584 on tablet e1f8fde8107545d5a59c6b12b0822584 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:02.271337 24453 ts_tablet_manager.cc:933] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:02.273978 24453 tablet_copy_client.cc:323] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.3:45959
I20260709 13:08:02.290452 23788 tablet_copy_service.cc:140] P 4466bf6d6cf84ee89e84ea074e3964c9: Received BeginTabletCopySession request for tablet dbdbb7d679eb4d0d935669cb839c12c0 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:42298)
I20260709 13:08:02.291061 23788 tablet_copy_service.cc:161] P 4466bf6d6cf84ee89e84ea074e3964c9: Beginning new tablet copy session on tablet dbdbb7d679eb4d0d935669cb839c12c0 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:42298: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-dbdbb7d679eb4d0d935669cb839c12c0
I20260709 13:08:02.302373 23788 tablet_copy_source_session.cc:215] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:02.306620 24453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdbb7d679eb4d0d935669cb839c12c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.320952 24453 tablet_copy_client.cc:806] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:02.321501 24453 tablet_copy_client.cc:670] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:02.325147 24453 tablet_copy_client.cc:538] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:02.332623 24453 tablet_bootstrap.cc:492] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:02.349647 24453 tablet_bootstrap.cc:492] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:02.350596 24453 tablet_bootstrap.cc:492] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:02.351270 24453 ts_tablet_manager.cc:1403] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:08:02.354104 24453 raft_consensus.cc:359] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:02.354964 24453 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:02.355517 24453 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:02.357745 24453 ts_tablet_manager.cc:1434] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.004s
I20260709 13:08:02.359614 23788 tablet_copy_service.cc:342] P 4466bf6d6cf84ee89e84ea074e3964c9: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-dbdbb7d679eb4d0d935669cb839c12c0 received from {username='slave'} at 127.0.0.1:42298
I20260709 13:08:02.360069 23788 tablet_copy_service.cc:434] P 4466bf6d6cf84ee89e84ea074e3964c9: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-dbdbb7d679eb4d0d935669cb839c12c0 on tablet dbdbb7d679eb4d0d935669cb839c12c0 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:02.367909 24453 ts_tablet_manager.cc:933] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:02.370126 24453 tablet_copy_client.cc:323] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.2:44167
I20260709 13:08:02.405608 23714 tablet_copy_service.cc:140] P c885217113574e7489e6c3afb6950f76: Received BeginTabletCopySession request for tablet a17c243311054979a1c285f2ef18d20e from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:54670)
I20260709 13:08:02.406246 23714 tablet_copy_service.cc:161] P c885217113574e7489e6c3afb6950f76: Beginning new tablet copy session on tablet a17c243311054979a1c285f2ef18d20e from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:54670: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-a17c243311054979a1c285f2ef18d20e
I20260709 13:08:02.414433 23714 tablet_copy_source_session.cc:215] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:02.417970 24453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17c243311054979a1c285f2ef18d20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.451252 24453 tablet_copy_client.cc:806] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:02.451891 24453 tablet_copy_client.cc:670] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:02.453850 24463 ts_tablet_manager.cc:933] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:02.458696 24453 tablet_copy_client.cc:538] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:02.460027 24463 tablet_copy_client.cc:323] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.2:44167
I20260709 13:08:02.461773 23714 tablet_copy_service.cc:140] P c885217113574e7489e6c3afb6950f76: Received BeginTabletCopySession request for tablet b7656d11fa2f4f27beac8e46f9f20be9 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:54670)
I20260709 13:08:02.462368 23714 tablet_copy_service.cc:161] P c885217113574e7489e6c3afb6950f76: Beginning new tablet copy session on tablet b7656d11fa2f4f27beac8e46f9f20be9 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:54670: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-b7656d11fa2f4f27beac8e46f9f20be9
I20260709 13:08:02.470664 24453 tablet_bootstrap.cc:492] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:02.476034 23714 tablet_copy_source_session.cc:215] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:02.479584 24463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7656d11fa2f4f27beac8e46f9f20be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.494499 24463 tablet_copy_client.cc:806] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:02.495091 24453 tablet_bootstrap.cc:492] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:02.495301 24463 tablet_copy_client.cc:670] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:02.496037 24453 tablet_bootstrap.cc:492] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:02.497314 24453 ts_tablet_manager.cc:1403] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.011s
I20260709 13:08:02.500218 24453 raft_consensus.cc:359] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:02.500974 24453 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:02.501540 24453 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:02.506544 24394 raft_consensus.cc:1217] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:02.510509 24453 ts_tablet_manager.cc:1434] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:02.512470 24463 tablet_copy_client.cc:538] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:02.512861 23714 tablet_copy_service.cc:342] P c885217113574e7489e6c3afb6950f76: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-a17c243311054979a1c285f2ef18d20e received from {username='slave'} at 127.0.0.1:54670
I20260709 13:08:02.513434 23714 tablet_copy_service.cc:434] P c885217113574e7489e6c3afb6950f76: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-a17c243311054979a1c285f2ef18d20e on tablet a17c243311054979a1c285f2ef18d20e with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:02.529604 24463 tablet_bootstrap.cc:492] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:02.555181 24463 tablet_bootstrap.cc:492] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:02.556161 24463 tablet_bootstrap.cc:492] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:02.556850 24463 ts_tablet_manager.cc:1403] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.011s
I20260709 13:08:02.559859 24463 raft_consensus.cc:359] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:02.560726 24463 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:02.561349 24463 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:02.563756 24463 ts_tablet_manager.cc:1434] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:08:02.565618 23714 tablet_copy_service.cc:342] P c885217113574e7489e6c3afb6950f76: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-b7656d11fa2f4f27beac8e46f9f20be9 received from {username='slave'} at 127.0.0.1:54670
I20260709 13:08:02.566047 23714 tablet_copy_service.cc:434] P c885217113574e7489e6c3afb6950f76: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-b7656d11fa2f4f27beac8e46f9f20be9 on tablet b7656d11fa2f4f27beac8e46f9f20be9 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:02.772997 24394 raft_consensus.cc:1217] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:02.843405 24394 raft_consensus.cc:1217] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:02.931226 24394 raft_consensus.cc:1217] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:03.025283 24426 raft_consensus.cc:1064] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:03.027802 24426 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:03.035593 24394 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.037060 23773 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.039165 23698 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.039042 24323 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.040086 24426 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.042076 24148 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:03.074702 24323 raft_consensus.cc:2955] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.082764 23773 raft_consensus.cc:2955] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.085597 23700 raft_consensus.cc:2955] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.091476 24394 raft_consensus.cc:2955] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.102172 23524 catalog_manager.cc:5697] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.135435 23628 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:03.143344 24394 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:03.144663 23775 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:03.144776 24323 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:03.146255 24426 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:03.156795 24426 raft_consensus.cc:2955] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.158506 23775 raft_consensus.cc:2955] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.176693 23513 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e1f8fde8107545d5a59c6b12b0822584 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:03.179555 23527 catalog_manager.cc:5697] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.188221 24394 raft_consensus.cc:2955] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.198596 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet e1f8fde8107545d5a59c6b12b0822584 with delete_type TABLET_DATA_TOMBSTONED (TS c885217113574e7489e6c3afb6950f76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45060
I20260709 13:08:03.201785 24476 tablet_replica.cc:333] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:08:03.202970 24476 raft_consensus.cc:2243] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:03.203811 24476 raft_consensus.cc:2272] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:03.210773 24476 ts_tablet_manager.cc:1916] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:03.252068 24476 ts_tablet_manager.cc:1929] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:03.252578 24476 log.cc:1199] T e1f8fde8107545d5a59c6b12b0822584 P c885217113574e7489e6c3afb6950f76: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/wals/e1f8fde8107545d5a59c6b12b0822584
I20260709 13:08:03.254323 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet e1f8fde8107545d5a59c6b12b0822584 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:03.289359 24216 raft_consensus.cc:1064] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:03.291261 24216 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:03.297081 23775 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.297083 24394 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.298629 24185 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.299214 23628 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.300077 24216 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:03.301995 24216 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.323657 24116 raft_consensus.cc:2955] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.325399 24394 raft_consensus.cc:2955] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.336340 23773 raft_consensus.cc:2955] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.338056 24483 raft_consensus.cc:1064] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:03.329784 23622 raft_consensus.cc:2955] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.355522 24428 raft_consensus.cc:1064] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:03.361258 23527 catalog_manager.cc:5697] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.362691 24428 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:03.386536 23700 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.387017 24393 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.394006 24212 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:08:03.396983 24212 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.379240 24483 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:03.413690 23628 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.415851 23698 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:03.433936 23628 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:03.435817 24116 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:03.439339 24484 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:03.441184 24394 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:03.444077 24481 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:03.455192 24185 raft_consensus.cc:2955] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.452903 24428 raft_consensus.cc:2955] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.464183 24394 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.465190 23773 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.467101 23629 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.470202 24392 raft_consensus.cc:2955] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.474099 24393 raft_consensus.cc:2955] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.482614 23512 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a17c243311054979a1c285f2ef18d20e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:03.486081 23622 raft_consensus.cc:2955] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.492937 24481 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:03.494629 24185 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.503548 24116 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:03.505151 23526 catalog_manager.cc:5697] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.515408 23698 raft_consensus.cc:2955] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.561034 23768 tablet_service.cc:1558] Processing DeleteTablet for tablet a17c243311054979a1c285f2ef18d20e with delete_type TABLET_DATA_TOMBSTONED (TS 4466bf6d6cf84ee89e84ea074e3964c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43444
I20260709 13:08:03.566239 23524 catalog_manager.cc:5697] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.589759 23624 raft_consensus.cc:2955] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:08:03.623011 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 77471.2us
I20260709 13:08:03.622949 24495 tablet_replica.cc:333] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:08:03.629518 24495 raft_consensus.cc:2243] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:03.636070 24495 raft_consensus.cc:2272] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:03.630642 24185 raft_consensus.cc:2955] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.633361 24393 raft_consensus.cc:2955] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.652274 23775 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:03.658056 24495 ts_tablet_manager.cc:1916] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:03.670583 24393 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:03.672456 24484 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:03.690246 24495 ts_tablet_manager.cc:1929] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:03.690755 24495 log.cc:1199] T a17c243311054979a1c285f2ef18d20e P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/wals/a17c243311054979a1c285f2ef18d20e
I20260709 13:08:03.687340 24487 raft_consensus.cc:2955] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.693738 23511 catalog_manager.cc:5028] TS 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): tablet a17c243311054979a1c285f2ef18d20e (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:03.677328 23775 raft_consensus.cc:2955] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.694443 23629 raft_consensus.cc:2955] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.694291 23527 catalog_manager.cc:5697] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.698662 24393 raft_consensus.cc:2955] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.717825 23698 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:03.732506 23511 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dbdbb7d679eb4d0d935669cb839c12c0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:03.732668 24427 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:03.743782 23525 catalog_manager.cc:5697] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.748944 23698 raft_consensus.cc:2955] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.755085 23702 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:03.760646 24393 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:03.762461 24481 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:03.772233 24216 raft_consensus.cc:2955] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.773303 23614 tablet_service.cc:1558] Processing DeleteTablet for tablet dbdbb7d679eb4d0d935669cb839c12c0 with delete_type TABLET_DATA_TOMBSTONED (TS 9ab488f10c434878a749f261e99a8065 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52038
I20260709 13:08:03.773885 24393 raft_consensus.cc:2955] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.784874 23629 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:03.789599 24498 tablet_replica.cc:333] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:08:03.790688 24498 raft_consensus.cc:2243] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:03.791378 24498 raft_consensus.cc:2272] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:03.792440 24185 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:03.795923 24498 ts_tablet_manager.cc:1916] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:03.808274 23512 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b7656d11fa2f4f27beac8e46f9f20be9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:03.811497 23527 catalog_manager.cc:5697] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.815497 23629 raft_consensus.cc:2955] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:03.822883 23768 tablet_service.cc:1558] Processing DeleteTablet for tablet b7656d11fa2f4f27beac8e46f9f20be9 with delete_type TABLET_DATA_TOMBSTONED (TS 4466bf6d6cf84ee89e84ea074e3964c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43444
I20260709 13:08:03.823702 24498 ts_tablet_manager.cc:1929] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:03.823879 24495 tablet_replica.cc:333] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:08:03.824203 24498 log.cc:1199] T dbdbb7d679eb4d0d935669cb839c12c0 P 9ab488f10c434878a749f261e99a8065: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/wals/dbdbb7d679eb4d0d935669cb839c12c0
I20260709 13:08:03.826536 23513 catalog_manager.cc:5028] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): tablet dbdbb7d679eb4d0d935669cb839c12c0 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:03.831243 24495 raft_consensus.cc:2243] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:03.832124 24495 raft_consensus.cc:2272] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:03.835187 24495 ts_tablet_manager.cc:1916] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:03.851624 24495 ts_tablet_manager.cc:1929] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:03.851994 24495 log.cc:1199] T b7656d11fa2f4f27beac8e46f9f20be9 P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/wals/b7656d11fa2f4f27beac8e46f9f20be9
I20260709 13:08:03.853741 23511 catalog_manager.cc:5028] TS 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): tablet b7656d11fa2f4f27beac8e46f9f20be9 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:04.889086 23775 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:04.895465 23704 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:04.896039 23742 consensus_peers.cc:597] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2de1999cb30f49b981475a62d0d0feb9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.896100 23624 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:04.897040 24427 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.897904 24484 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.907930 24427 raft_consensus.cc:2955] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:04.916131 23704 raft_consensus.cc:2955] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:04.916721 23624 raft_consensus.cc:2955] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:04.924913 23774 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:04.926133 23527 catalog_manager.cc:5697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:04.940172 23742 consensus_peers.cc:597] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8b889a8b97443f781c7eef38dba2f96. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.940410 23698 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:04.944216 23628 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:04.950282 24427 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.958264 24427 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:05.039902 24484 raft_consensus.cc:2955] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:05.050731 23704 raft_consensus.cc:2955] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:05.056919 23628 raft_consensus.cc:2955] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:05.092036 23628 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:05.116359 23525 catalog_manager.cc:5697] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:05.125635 23593 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44b7b7e4ddb143138d48247cb9feb2d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.127630 23775 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:05.129365 24475 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.129508 23702 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:05.132308 24475 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.145347 24505 raft_consensus.cc:2955] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:05.153808 23774 raft_consensus.cc:2955] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:05.156838 23702 raft_consensus.cc:2955] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:05.169890 23628 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:05.183135 23525 catalog_manager.cc:5697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:05.199074 23775 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:05.203212 23593 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb27ed2f4a5b46d5a40126f9893f0c3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.204607 23698 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:05.203698 24515 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:05.206595 24475 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.219740 24475 raft_consensus.cc:2955] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:05.224557 23774 raft_consensus.cc:2955] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:05.228670 23702 raft_consensus.cc:2955] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:05.246734 23527 catalog_manager.cc:5697] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:05.401971 24519 ts_tablet_manager.cc:933] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:05.404008 24519 tablet_copy_client.cc:323] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.3:45959
I20260709 13:08:05.407346 23788 tablet_copy_service.cc:140] P 4466bf6d6cf84ee89e84ea074e3964c9: Received BeginTabletCopySession request for tablet b8b889a8b97443f781c7eef38dba2f96 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:42298)
I20260709 13:08:05.408028 23788 tablet_copy_service.cc:161] P 4466bf6d6cf84ee89e84ea074e3964c9: Beginning new tablet copy session on tablet b8b889a8b97443f781c7eef38dba2f96 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:42298: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-b8b889a8b97443f781c7eef38dba2f96
I20260709 13:08:05.426772 23788 tablet_copy_source_session.cc:215] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:05.432862 24519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b889a8b97443f781c7eef38dba2f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:05.454365 24519 tablet_copy_client.cc:806] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:05.455108 24519 tablet_copy_client.cc:670] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:05.459442 24519 tablet_copy_client.cc:538] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:05.468921 24519 tablet_bootstrap.cc:492] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:05.499825 24519 tablet_bootstrap.cc:492] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:05.501597 24519 tablet_bootstrap.cc:492] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:05.502269 24519 ts_tablet_manager.cc:1403] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.008s
I20260709 13:08:05.506222 24519 raft_consensus.cc:359] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:05.511432 24519 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:05.515427 24519 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:05.521167 24519 ts_tablet_manager.cc:1434] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:08:05.523411 24522 ts_tablet_manager.cc:933] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:05.523283 23788 tablet_copy_service.cc:342] P 4466bf6d6cf84ee89e84ea074e3964c9: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-b8b889a8b97443f781c7eef38dba2f96 received from {username='slave'} at 127.0.0.1:42298
I20260709 13:08:05.524645 23788 tablet_copy_service.cc:434] P 4466bf6d6cf84ee89e84ea074e3964c9: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-b8b889a8b97443f781c7eef38dba2f96 on tablet b8b889a8b97443f781c7eef38dba2f96 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:05.530972 24522 tablet_copy_client.cc:323] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.3:45959
I20260709 13:08:05.534207 23788 tablet_copy_service.cc:140] P 4466bf6d6cf84ee89e84ea074e3964c9: Received BeginTabletCopySession request for tablet 2de1999cb30f49b981475a62d0d0feb9 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:42298)
I20260709 13:08:05.534852 23788 tablet_copy_service.cc:161] P 4466bf6d6cf84ee89e84ea074e3964c9: Beginning new tablet copy session on tablet 2de1999cb30f49b981475a62d0d0feb9 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:42298: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-2de1999cb30f49b981475a62d0d0feb9
I20260709 13:08:05.542541 23788 tablet_copy_source_session.cc:215] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:05.546162 24522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de1999cb30f49b981475a62d0d0feb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:05.564508 24522 tablet_copy_client.cc:806] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:05.565135 24522 tablet_copy_client.cc:670] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:05.568899 24522 tablet_copy_client.cc:538] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:05.577270 24522 tablet_bootstrap.cc:492] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:05.597184 24522 tablet_bootstrap.cc:492] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:05.598268 24522 tablet_bootstrap.cc:492] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:05.598999 24522 ts_tablet_manager.cc:1403] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.022s	user 0.021s	sys 0.000s
I20260709 13:08:05.601962 24522 raft_consensus.cc:359] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:05.602816 24522 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:05.603500 24522 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:05.605805 24522 ts_tablet_manager.cc:1434] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:05.609714 23788 tablet_copy_service.cc:342] P 4466bf6d6cf84ee89e84ea074e3964c9: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-2de1999cb30f49b981475a62d0d0feb9 received from {username='slave'} at 127.0.0.1:42298
I20260709 13:08:05.610162 23788 tablet_copy_service.cc:434] P 4466bf6d6cf84ee89e84ea074e3964c9: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-2de1999cb30f49b981475a62d0d0feb9 on tablet 2de1999cb30f49b981475a62d0d0feb9 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:05.649281 24522 ts_tablet_manager.cc:933] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:05.650840 24522 tablet_copy_client.cc:323] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.1:37537
I20260709 13:08:05.652717 23639 tablet_copy_service.cc:140] P 9ab488f10c434878a749f261e99a8065: Received BeginTabletCopySession request for tablet eb27ed2f4a5b46d5a40126f9893f0c3c from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:58448)
I20260709 13:08:05.653303 23639 tablet_copy_service.cc:161] P 9ab488f10c434878a749f261e99a8065: Beginning new tablet copy session on tablet eb27ed2f4a5b46d5a40126f9893f0c3c from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:58448: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-eb27ed2f4a5b46d5a40126f9893f0c3c
I20260709 13:08:05.661851 23639 tablet_copy_source_session.cc:215] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:05.665337 24522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb27ed2f4a5b46d5a40126f9893f0c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:05.685866 24522 tablet_copy_client.cc:806] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:05.686590 24522 tablet_copy_client.cc:670] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:05.690819 24522 tablet_copy_client.cc:538] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:05.702793 24522 tablet_bootstrap.cc:492] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:05.722903 24519 ts_tablet_manager.cc:933] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:05.724810 24519 tablet_copy_client.cc:323] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.1:37537
I20260709 13:08:05.726729 23639 tablet_copy_service.cc:140] P 9ab488f10c434878a749f261e99a8065: Received BeginTabletCopySession request for tablet 44b7b7e4ddb143138d48247cb9feb2d4 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:58448)
I20260709 13:08:05.727335 23639 tablet_copy_service.cc:161] P 9ab488f10c434878a749f261e99a8065: Beginning new tablet copy session on tablet 44b7b7e4ddb143138d48247cb9feb2d4 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:58448: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-44b7b7e4ddb143138d48247cb9feb2d4
I20260709 13:08:05.727902 24522 tablet_bootstrap.cc:492] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:05.729259 24522 tablet_bootstrap.cc:492] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:05.729806 24522 ts_tablet_manager.cc:1403] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.006s
I20260709 13:08:05.732420 24522 raft_consensus.cc:359] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:05.733172 24522 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:05.733752 24522 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:05.735571 23639 tablet_copy_source_session.cc:215] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:05.738536 24522 ts_tablet_manager.cc:1434] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:05.739655 24519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b7b7e4ddb143138d48247cb9feb2d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:05.747418 23639 tablet_copy_service.cc:342] P 9ab488f10c434878a749f261e99a8065: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-eb27ed2f4a5b46d5a40126f9893f0c3c received from {username='slave'} at 127.0.0.1:58448
I20260709 13:08:05.748109 23639 tablet_copy_service.cc:434] P 9ab488f10c434878a749f261e99a8065: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-eb27ed2f4a5b46d5a40126f9893f0c3c on tablet eb27ed2f4a5b46d5a40126f9893f0c3c with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:05.769380 24519 tablet_copy_client.cc:806] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:05.770243 24519 tablet_copy_client.cc:670] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:05.775218 24519 tablet_copy_client.cc:538] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:05.786170 24519 tablet_bootstrap.cc:492] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:05.807706 24519 tablet_bootstrap.cc:492] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:05.809054 24519 tablet_bootstrap.cc:492] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:05.809885 24519 ts_tablet_manager.cc:1403] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.024s	user 0.023s	sys 0.001s
I20260709 13:08:05.813500 24519 raft_consensus.cc:359] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:05.814571 24519 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:05.815322 24519 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:05.820974 24519 ts_tablet_manager.cc:1434] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:08:05.822882 23639 tablet_copy_service.cc:342] P 9ab488f10c434878a749f261e99a8065: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-44b7b7e4ddb143138d48247cb9feb2d4 received from {username='slave'} at 127.0.0.1:58448
I20260709 13:08:05.823390 23639 tablet_copy_service.cc:434] P 9ab488f10c434878a749f261e99a8065: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-44b7b7e4ddb143138d48247cb9feb2d4 on tablet 44b7b7e4ddb143138d48247cb9feb2d4 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:05.940537 24393 raft_consensus.cc:1217] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:06.043512 24393 raft_consensus.cc:1217] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:06.198998 24393 raft_consensus.cc:1217] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:06.298252 24393 raft_consensus.cc:1217] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:06.344787 24212 raft_consensus.cc:1064] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:06.347388 24212 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:06.356957 23702 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:06.360054 24506 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:06.361866 24393 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:06.368960 24532 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:06.405577 23621 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:06.412606 24506 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:08:06.461990 24535 raft_consensus.cc:2955] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:06.481446 23702 raft_consensus.cc:2955] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:06.483292 24393 raft_consensus.cc:2955] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:06.514386 23524 catalog_manager.cc:5697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:08:06.810606 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 283116us
I20260709 13:08:06.819878 24515 raft_consensus.cc:1064] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:06.822958 24515 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:06.852679 23629 raft_consensus.cc:2955] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:06.872869 24475 raft_consensus.cc:1064] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:06.876168 24475 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:06.944051 24392 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:06.946751 24530 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:06.947232 23775 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:06.960435 24551 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:06.997211 24392 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.007823 24212 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:07.013252 23698 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.014981 24532 raft_consensus.cc:1064] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:07.029526 24392 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.033612 23700 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.035342 23700 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.029268 24532 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:07.052284 24556 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:07.053444 24475 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.050973 24555 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 13:08:07.088227 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 54225.5us
I20260709 13:08:07.112807 23774 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.114920 23624 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.116698 24484 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:07.118340 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 43905.2us
I20260709 13:08:07.124799 23774 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.155990 24475 raft_consensus.cc:2955] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.159168 24484 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.158371 23704 raft_consensus.cc:2955] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.158759 24556 raft_consensus.cc:2955] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.170468 24392 raft_consensus.cc:2955] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.178802 23525 catalog_manager.cc:5697] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.185599 23704 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.188270 24393 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.192878 24506 raft_consensus.cc:2955] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.201021 24393 raft_consensus.cc:2955] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.205075 23620 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:07.187009 23695 raft_consensus.cc:2955] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.212709 23525 catalog_manager.cc:5697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.215108 23704 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.217923 24556 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.219532 24555 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.222570 24391 raft_consensus.cc:2955] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.229290 24532 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:07.234357 24556 raft_consensus.cc:2955] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.236140 24532 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:07.241084 23511 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b8b889a8b97443f781c7eef38dba2f96 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:07.243155 24394 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.247205 23704 raft_consensus.cc:2955] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.251952 23513 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eb27ed2f4a5b46d5a40126f9893f0c3c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:07.253396 23698 raft_consensus.cc:2955] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.273339 23527 catalog_manager.cc:5697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.277720 23524 catalog_manager.cc:5697] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.285491 24537 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:07.293584 23768 tablet_service.cc:1558] Processing DeleteTablet for tablet eb27ed2f4a5b46d5a40126f9893f0c3c with delete_type TABLET_DATA_TOMBSTONED (TS 4466bf6d6cf84ee89e84ea074e3964c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43444
I20260709 13:08:07.311003 24391 raft_consensus.cc:2955] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.320034 23614 tablet_service.cc:1558] Processing DeleteTablet for tablet b8b889a8b97443f781c7eef38dba2f96 with delete_type TABLET_DATA_TOMBSTONED (TS 9ab488f10c434878a749f261e99a8065 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52038
I20260709 13:08:07.324105 24484 raft_consensus.cc:2955] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.330216 24393 raft_consensus.cc:2955] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.343302 23776 raft_consensus.cc:2955] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.346072 24569 tablet_replica.cc:333] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:08:07.347308 24569 raft_consensus.cc:2243] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.348204 24569 raft_consensus.cc:2272] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.351853 24568 tablet_replica.cc:333] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:08:07.357959 24568 raft_consensus.cc:2243] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.358716 24568 raft_consensus.cc:2272] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.353425 24569 ts_tablet_manager.cc:1916] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:07.364545 24568 ts_tablet_manager.cc:1916] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:07.367985 23624 raft_consensus.cc:2955] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.392204 23527 catalog_manager.cc:5697] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.426656 23776 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:07.435434 23620 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.437376 24393 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.440897 24532 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:08:07.445768 24484 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.447909 23695 raft_consensus.cc:2955] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.458098 24506 raft_consensus.cc:2955] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.468842 24393 raft_consensus.cc:2955] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.482131 24569 ts_tablet_manager.cc:1929] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 13:08:07.488317 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46419.7us
I20260709 13:08:07.488503 23525 catalog_manager.cc:5697] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.497984 24568 ts_tablet_manager.cc:1929] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 13:08:07.498483 24568 log.cc:1199] T eb27ed2f4a5b46d5a40126f9893f0c3c P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/wals/eb27ed2f4a5b46d5a40126f9893f0c3c
I20260709 13:08:07.498004 24569 log.cc:1199] T b8b889a8b97443f781c7eef38dba2f96 P 9ab488f10c434878a749f261e99a8065: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/wals/b8b889a8b97443f781c7eef38dba2f96
I20260709 13:08:07.500433 23511 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2de1999cb30f49b981475a62d0d0feb9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:07.501304 23511 catalog_manager.cc:5028] TS 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): tablet eb27ed2f4a5b46d5a40126f9893f0c3c (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:07.501773 23513 catalog_manager.cc:5028] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): tablet b8b889a8b97443f781c7eef38dba2f96 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:07.511938 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet 2de1999cb30f49b981475a62d0d0feb9 with delete_type TABLET_DATA_TOMBSTONED (TS c885217113574e7489e6c3afb6950f76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45060
I20260709 13:08:07.546460 23620 raft_consensus.cc:2955] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.598357 24570 tablet_replica.cc:333] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:08:07.606146 24570 raft_consensus.cc:2243] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.607208 24570 raft_consensus.cc:2272] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.613641 24570 ts_tablet_manager.cc:1916] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:07.635936 24570 ts_tablet_manager.cc:1929] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:07.636375 24570 log.cc:1199] T 2de1999cb30f49b981475a62d0d0feb9 P c885217113574e7489e6c3afb6950f76: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/wals/2de1999cb30f49b981475a62d0d0feb9
I20260709 13:08:07.638463 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet 2de1999cb30f49b981475a62d0d0feb9 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
W20260709 13:08:07.708369 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08000af840 after lost signal to thread 22483
W20260709 13:08:07.709393 23650 debug-util.cc:398] Leaking SignalData structure 0x7b080019c5a0 after lost signal to thread 23561
W20260709 13:08:07.710358 23650 debug-util.cc:398] Leaking SignalData structure 0x7b080030d820 after lost signal to thread 23653
W20260709 13:08:07.711246 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08002f22c0 after lost signal to thread 23728
W20260709 13:08:07.712167 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08002415c0 after lost signal to thread 23802
W20260709 13:08:07.713001 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08003122c0 after lost signal to thread 24418
I20260709 13:08:07.757035 23620 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:07.763702 24393 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.763875 23775 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.765738 24555 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.767903 24537 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.774287 24530 raft_consensus.cc:2955] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.785955 23775 raft_consensus.cc:2955] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.786156 24391 raft_consensus.cc:2955] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.815023 23527 catalog_manager.cc:5697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:07.819955 23513 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44b7b7e4ddb143138d48247cb9feb2d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:07.836735 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet 44b7b7e4ddb143138d48247cb9feb2d4 with delete_type TABLET_DATA_TOMBSTONED (TS c885217113574e7489e6c3afb6950f76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45060
I20260709 13:08:07.837741 24570 tablet_replica.cc:333] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:08:07.839002 24570 raft_consensus.cc:2243] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.839825 24570 raft_consensus.cc:2272] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.848465 24570 ts_tablet_manager.cc:1916] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:07.901420 24570 ts_tablet_manager.cc:1929] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:07.901815 24570 log.cc:1199] T 44b7b7e4ddb143138d48247cb9feb2d4 P c885217113574e7489e6c3afb6950f76: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/wals/44b7b7e4ddb143138d48247cb9feb2d4
I20260709 13:08:07.903306 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet 44b7b7e4ddb143138d48247cb9feb2d4 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:08.944556 23700 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
W20260709 13:08:08.967875 23668 consensus_peers.cc:597] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7479a1f927d94d5e873a594847f4ee10. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:08.979820 23629 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:08.981984 24572 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:08.982980 23774 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:08.985330 24572 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.993206 24542 raft_consensus.cc:2955] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:08.998934 23774 raft_consensus.cc:2955] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.002031 23629 raft_consensus.cc:2955] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.023615 23527 catalog_manager.cc:5697] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.062724 23698 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
W20260709 13:08:09.161000 23668 consensus_peers.cc:597] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d52390cad487467d9b1b0b951d9300b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:09.164047 23775 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:09.167789 24577 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:09.171866 23620 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:09.177637 24578 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:09.182188 24577 raft_consensus.cc:2955] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.184794 23775 raft_consensus.cc:2955] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.207309 23525 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.218227 23625 raft_consensus.cc:2955] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.227265 23620 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:09.275528 23702 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:09.275911 23593 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2cf8733dc7d947f08af2274d90145039. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:09.278113 23774 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:09.278899 24581 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:09.281665 24581 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:09.298911 24585 raft_consensus.cc:2955] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.307070 23702 raft_consensus.cc:2955] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.325397 23774 raft_consensus.cc:2955] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.344048 23620 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:09.347649 23525 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
W20260709 13:08:09.379191 23593 consensus_peers.cc:597] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80466d92afe9453b9cd96ab9f7f593dc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:09.379360 23775 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:09.383515 23695 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:09.385927 24571 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:09.388064 24571 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:09.404424 24581 raft_consensus.cc:2955] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.406813 23775 raft_consensus.cc:2955] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.406836 23702 raft_consensus.cc:2955] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:09.429116 23525 catalog_manager.cc:5697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:09.556131 24596 ts_tablet_manager.cc:933] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:09.563447 24596 tablet_copy_client.cc:323] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.2:44167
I20260709 13:08:09.566469 23714 tablet_copy_service.cc:140] P c885217113574e7489e6c3afb6950f76: Received BeginTabletCopySession request for tablet 7479a1f927d94d5e873a594847f4ee10 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:54670)
I20260709 13:08:09.567111 23714 tablet_copy_service.cc:161] P c885217113574e7489e6c3afb6950f76: Beginning new tablet copy session on tablet 7479a1f927d94d5e873a594847f4ee10 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:54670: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-7479a1f927d94d5e873a594847f4ee10
I20260709 13:08:09.581035 23714 tablet_copy_source_session.cc:215] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:09.586020 24596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7479a1f927d94d5e873a594847f4ee10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.616559 24596 tablet_copy_client.cc:806] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:09.617373 24596 tablet_copy_client.cc:670] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:09.625389 24596 tablet_copy_client.cc:538] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:09.653327 24596 tablet_bootstrap.cc:492] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:09.680555 24598 ts_tablet_manager.cc:933] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:09.715390 24598 tablet_copy_client.cc:323] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.2:44167
I20260709 13:08:09.718447 23714 tablet_copy_service.cc:140] P c885217113574e7489e6c3afb6950f76: Received BeginTabletCopySession request for tablet d52390cad487467d9b1b0b951d9300b7 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:54670)
I20260709 13:08:09.719090 23714 tablet_copy_service.cc:161] P c885217113574e7489e6c3afb6950f76: Beginning new tablet copy session on tablet d52390cad487467d9b1b0b951d9300b7 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:54670: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-d52390cad487467d9b1b0b951d9300b7
I20260709 13:08:09.727294 23714 tablet_copy_source_session.cc:215] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:09.724318 24596 tablet_bootstrap.cc:492] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:09.737555 24596 tablet_bootstrap.cc:492] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:09.736562 24601 ts_tablet_manager.cc:933] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:09.738384 24596 ts_tablet_manager.cc:1403] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.006s
I20260709 13:08:09.739046 24598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52390cad487467d9b1b0b951d9300b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.745884 24596 raft_consensus.cc:359] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:09.747282 24596 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:09.748210 24596 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:09.775594 24596 ts_tablet_manager.cc:1434] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.012s
I20260709 13:08:09.785295 24601 tablet_copy_client.cc:323] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.1:37537
I20260709 13:08:09.785306 23714 tablet_copy_service.cc:342] P c885217113574e7489e6c3afb6950f76: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-7479a1f927d94d5e873a594847f4ee10 received from {username='slave'} at 127.0.0.1:54670
I20260709 13:08:09.786393 23714 tablet_copy_service.cc:434] P c885217113574e7489e6c3afb6950f76: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-7479a1f927d94d5e873a594847f4ee10 on tablet 7479a1f927d94d5e873a594847f4ee10 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:09.787631 23639 tablet_copy_service.cc:140] P 9ab488f10c434878a749f261e99a8065: Received BeginTabletCopySession request for tablet 2cf8733dc7d947f08af2274d90145039 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:58448)
I20260709 13:08:09.788223 23639 tablet_copy_service.cc:161] P 9ab488f10c434878a749f261e99a8065: Beginning new tablet copy session on tablet 2cf8733dc7d947f08af2274d90145039 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:58448: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-2cf8733dc7d947f08af2274d90145039
I20260709 13:08:09.788220 24598 tablet_copy_client.cc:806] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:09.791103 24598 tablet_copy_client.cc:670] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:09.806581 23639 tablet_copy_source_session.cc:215] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:09.808375 24598 tablet_copy_client.cc:538] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:09.820492 24601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf8733dc7d947f08af2274d90145039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.830483 24598 tablet_bootstrap.cc:492] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:09.970031 24596 ts_tablet_manager.cc:933] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:09.989384 24596 tablet_copy_client.cc:323] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.1:37537
I20260709 13:08:09.991318 23639 tablet_copy_service.cc:140] P 9ab488f10c434878a749f261e99a8065: Received BeginTabletCopySession request for tablet 80466d92afe9453b9cd96ab9f7f593dc from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:58448)
I20260709 13:08:09.991904 23639 tablet_copy_service.cc:161] P 9ab488f10c434878a749f261e99a8065: Beginning new tablet copy session on tablet 80466d92afe9453b9cd96ab9f7f593dc from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:58448: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-80466d92afe9453b9cd96ab9f7f593dc
I20260709 13:08:09.999632 23639 tablet_copy_source_session.cc:215] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:10.003171 24596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80466d92afe9453b9cd96ab9f7f593dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:10.026646 24596 tablet_copy_client.cc:806] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:10.031453 24596 tablet_copy_client.cc:670] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:10.038558 24596 tablet_copy_client.cc:538] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:10.057039 24596 tablet_bootstrap.cc:492] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:10.073271 24598 tablet_bootstrap.cc:492] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:10.096213 24391 raft_consensus.cc:1217] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:10.089564 24598 tablet_bootstrap.cc:492] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:10.100517 24598 ts_tablet_manager.cc:1403] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.270s	user 0.078s	sys 0.086s
I20260709 13:08:10.103659 24598 raft_consensus.cc:359] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:10.104575 24598 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:10.105226 24598 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:10.107632 24598 ts_tablet_manager.cc:1434] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:08:10.111219 24601 tablet_copy_client.cc:806] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:10.125720 24601 tablet_copy_client.cc:670] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:10.132269 23714 tablet_copy_service.cc:342] P c885217113574e7489e6c3afb6950f76: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-d52390cad487467d9b1b0b951d9300b7 received from {username='slave'} at 127.0.0.1:54670
I20260709 13:08:10.132736 23714 tablet_copy_service.cc:434] P c885217113574e7489e6c3afb6950f76: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-d52390cad487467d9b1b0b951d9300b7 on tablet d52390cad487467d9b1b0b951d9300b7 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:10.171226 24391 raft_consensus.cc:1217] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:10.176833 24601 tablet_copy_client.cc:538] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:10.224884 24601 tablet_bootstrap.cc:492] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:10.225776 24596 tablet_bootstrap.cc:492] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:10.226874 24596 tablet_bootstrap.cc:492] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:10.227636 24596 ts_tablet_manager.cc:1403] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.180s	user 0.049s	sys 0.045s
I20260709 13:08:10.239686 24596 raft_consensus.cc:359] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:10.250324 24596 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:10.251072 24596 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:10.254376 24596 ts_tablet_manager.cc:1434] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 13:08:10.259678 23639 tablet_copy_service.cc:342] P 9ab488f10c434878a749f261e99a8065: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-80466d92afe9453b9cd96ab9f7f593dc received from {username='slave'} at 127.0.0.1:58448
I20260709 13:08:10.260195 23639 tablet_copy_service.cc:434] P 9ab488f10c434878a749f261e99a8065: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-80466d92afe9453b9cd96ab9f7f593dc on tablet 80466d92afe9453b9cd96ab9f7f593dc with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:10.268541 24601 tablet_bootstrap.cc:492] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:10.269796 24601 tablet_bootstrap.cc:492] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:10.270673 24601 ts_tablet_manager.cc:1403] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.004s
I20260709 13:08:10.274823 24601 raft_consensus.cc:359] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:10.275876 24601 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:10.276645 24601 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:10.286579 24601 ts_tablet_manager.cc:1434] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:08:10.290091 23639 tablet_copy_service.cc:342] P 9ab488f10c434878a749f261e99a8065: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-2cf8733dc7d947f08af2274d90145039 received from {username='slave'} at 127.0.0.1:58448
I20260709 13:08:10.290598 23639 tablet_copy_service.cc:434] P 9ab488f10c434878a749f261e99a8065: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-2cf8733dc7d947f08af2274d90145039 on tablet 2cf8733dc7d947f08af2274d90145039 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:10.492300 24391 raft_consensus.cc:1217] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:10.644415 24577 raft_consensus.cc:1064] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:10.647365 24577 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:10.657987 23774 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.662114 24542 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.662595 24391 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.667270 24605 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.678076 24391 raft_consensus.cc:1217] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:10.680855 24542 raft_consensus.cc:1064] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:10.683230 24542 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:10.708099 24391 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.709540 23775 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.709936 24605 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:10.716528 24605 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:10.763429 23629 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.768837 23620 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:08:10.799872 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 84295.7us
I20260709 13:08:10.805750 24605 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:10.821491 24605 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:10.831635 24617 raft_consensus.cc:2955] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:10.839514 24577 raft_consensus.cc:2955] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:10.854300 23776 raft_consensus.cc:2955] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:10.868140 23774 raft_consensus.cc:2955] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:10.870024 24391 raft_consensus.cc:2955] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:10.885102 24393 raft_consensus.cc:2955] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:10.931082 23525 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:10.937634 23525 catalog_manager.cc:5697] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:10.972867 23629 raft_consensus.cc:2955] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:10.985347 23627 raft_consensus.cc:2955] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.157442 24556 raft_consensus.cc:1064] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:11.167011 24556 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:11.287262 23700 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:11.302562 24632 raft_consensus.cc:1064] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:11.319846 24393 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:11.322703 24605 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:11.334755 24393 raft_consensus.cc:2955] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.337814 24629 raft_consensus.cc:2955] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.345506 24632 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:11.362875 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.292062 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 82509.2us
I20260709 13:08:11.379792 23774 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:11.387658 23700 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:11.418113 23774 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:11.420080 23774 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:11.422848 24393 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:11.425176 24542 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:11.426957 24577 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:08:11.437543 24392 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:11.439838 23704 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:11.449894 23526 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.457191 24617 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:11.478048 23774 raft_consensus.cc:2955] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.484725 24633 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:11.493875 24636 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:11.493713 24577 raft_consensus.cc:2955] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.503144 24393 raft_consensus.cc:2955] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.495210 23614 tablet_service.cc:1558] Processing DeleteTablet for tablet d52390cad487467d9b1b0b951d9300b7 with delete_type TABLET_DATA_TOMBSTONED (TS 9ab488f10c434878a749f261e99a8065 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52038
W20260709 13:08:11.522492 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 69104.4us
I20260709 13:08:11.527583 23512 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d52390cad487467d9b1b0b951d9300b7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:11.527508 24634 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:08:11.546460 23700 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:11.554052 24393 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:11.549365 23527 catalog_manager.cc:5697] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.557061 24556 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:11.578691 24636 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:11.590128 23614 tablet_service.cc:1558] Processing DeleteTablet for tablet 7479a1f927d94d5e873a594847f4ee10 with delete_type TABLET_DATA_TOMBSTONED (TS 9ab488f10c434878a749f261e99a8065 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52038
I20260709 13:08:11.606300 23774 raft_consensus.cc:2955] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.612181 24640 tablet_replica.cc:333] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:08:11.614298 23775 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:11.596680 23512 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7479a1f927d94d5e873a594847f4ee10 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:11.613394 24640 raft_consensus.cc:2243] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.644330 24636 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:11.651096 24640 raft_consensus.cc:2272] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:11.743642 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 63612.2us
I20260709 13:08:11.751801 24636 raft_consensus.cc:2955] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.753314 24640 ts_tablet_manager.cc:1916] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:11.816574 24556 raft_consensus.cc:2955] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:08:11.856738 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 98096us
I20260709 13:08:11.857509 23774 raft_consensus.cc:2955] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.873829 24391 raft_consensus.cc:2955] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:08:11.878078 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 136260us
I20260709 13:08:11.878476 23773 raft_consensus.cc:2955] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.889604 23526 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.894140 24393 raft_consensus.cc:2955] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.933753 23700 raft_consensus.cc:2955] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.936549 23698 raft_consensus.cc:2955] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.957062 24640 ts_tablet_manager.cc:1929] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:11.986012 23525 catalog_manager.cc:5697] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:11.991480 24640 log.cc:1199] T d52390cad487467d9b1b0b951d9300b7 P 9ab488f10c434878a749f261e99a8065: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/wals/d52390cad487467d9b1b0b951d9300b7
I20260709 13:08:11.993798 23513 catalog_manager.cc:5028] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): tablet d52390cad487467d9b1b0b951d9300b7 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:12.003468 24640 tablet_replica.cc:333] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:08:12.004930 24640 raft_consensus.cc:2243] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:12.005770 24640 raft_consensus.cc:2272] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:12.019626 24640 ts_tablet_manager.cc:1916] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:12.024507 23629 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:12.025378 23627 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:12.041873 24391 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:12.043646 24636 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:12.053067 24393 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:12.053067 23773 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:12.055626 24636 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:12.057051 24585 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:12.067117 24637 raft_consensus.cc:2955] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:12.084899 23773 raft_consensus.cc:2955] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:12.087442 24393 raft_consensus.cc:2955] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:12.090966 24640 ts_tablet_manager.cc:1929] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:12.091460 24640 log.cc:1199] T 7479a1f927d94d5e873a594847f4ee10 P 9ab488f10c434878a749f261e99a8065: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/wals/7479a1f927d94d5e873a594847f4ee10
I20260709 13:08:12.093152 23513 catalog_manager.cc:5028] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): tablet 7479a1f927d94d5e873a594847f4ee10 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:12.106738 24631 raft_consensus.cc:2955] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:12.118265 24391 raft_consensus.cc:2955] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:12.128516 23697 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:12.124234 23526 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:12.164815 23513 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2cf8733dc7d947f08af2274d90145039 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:12.169006 24581 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:12.178579 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cf8733dc7d947f08af2274d90145039 with delete_type TABLET_DATA_TOMBSTONED (TS c885217113574e7489e6c3afb6950f76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45060
I20260709 13:08:12.192713 23513 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 80466d92afe9453b9cd96ab9f7f593dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:12.214319 24657 tablet_replica.cc:333] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:08:12.215183 23524 catalog_manager.cc:5697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.226276 24657 raft_consensus.cc:2243] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:12.227128 23697 raft_consensus.cc:2955] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:12.244072 23768 tablet_service.cc:1558] Processing DeleteTablet for tablet 80466d92afe9453b9cd96ab9f7f593dc with delete_type TABLET_DATA_TOMBSTONED (TS 4466bf6d6cf84ee89e84ea074e3964c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43444
I20260709 13:08:12.246424 24657 raft_consensus.cc:2272] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:12.259572 24658 tablet_replica.cc:333] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:08:12.260830 24658 raft_consensus.cc:2243] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:12.261982 24658 raft_consensus.cc:2272] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:12.267014 24658 ts_tablet_manager.cc:1916] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:12.270833 24657 ts_tablet_manager.cc:1916] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:12.285130 24658 ts_tablet_manager.cc:1929] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:12.285889 24658 log.cc:1199] T 80466d92afe9453b9cd96ab9f7f593dc P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/wals/80466d92afe9453b9cd96ab9f7f593dc
I20260709 13:08:12.288662 23511 catalog_manager.cc:5028] TS 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): tablet 80466d92afe9453b9cd96ab9f7f593dc (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:12.290302 24657 ts_tablet_manager.cc:1929] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:12.291630 24657 log.cc:1199] T 2cf8733dc7d947f08af2274d90145039 P c885217113574e7489e6c3afb6950f76: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/wals/2cf8733dc7d947f08af2274d90145039
I20260709 13:08:12.294064 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet 2cf8733dc7d947f08af2274d90145039 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:13.326893 23776 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:13.334051 23625 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:13.334663 23742 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de67ca6156e842db9c8994e493d241ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:13.335947 23697 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:13.337499 24609 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.339380 24592 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.372540 24609 raft_consensus.cc:2955] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.375347 23627 raft_consensus.cc:2955] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.385488 23702 raft_consensus.cc:2955] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.396242 23524 catalog_manager.cc:5697] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.399143 23773 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:13.459028 23697 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:13.462028 23627 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:13.464840 23742 consensus_peers.cc:597] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc5bb39aaf4940fb9d34ec725193ca2c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:13.466169 24642 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.468134 24642 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.497826 24592 raft_consensus.cc:2955] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.515446 23629 raft_consensus.cc:2955] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.516048 23697 raft_consensus.cc:2955] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.522369 23627 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:13.530067 23527 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:13.600466 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48755.8us
I20260709 13:08:13.602337 23776 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:13.604687 23697 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:13.610006 24631 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.612095 24631 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:13.614130 23593 consensus_peers.cc:597] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 161b847a6eca457eb80fb6cb57531127. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:13.624301 24631 raft_consensus.cc:2955] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.630059 23776 raft_consensus.cc:2955] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.636407 23697 raft_consensus.cc:2955] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.653568 23702 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:13.666848 23526 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.705552 23776 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:13.706881 24659 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:13.709496 23668 consensus_peers.cc:597] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee650b0b99c4413293e36b0fa9631151. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:13.714797 23627 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:13.716638 24659 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:13.718914 24577 raft_consensus.cc:2955] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.728392 23776 raft_consensus.cc:2955] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.752121 23627 raft_consensus.cc:2955] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.757433 23524 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:13.938527 24680 ts_tablet_manager.cc:933] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:13.942042 24680 tablet_copy_client.cc:323] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.3:45959
I20260709 13:08:13.944216 23788 tablet_copy_service.cc:140] P 4466bf6d6cf84ee89e84ea074e3964c9: Received BeginTabletCopySession request for tablet de67ca6156e842db9c8994e493d241ca from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:42298)
I20260709 13:08:13.944803 23788 tablet_copy_service.cc:161] P 4466bf6d6cf84ee89e84ea074e3964c9: Beginning new tablet copy session on tablet de67ca6156e842db9c8994e493d241ca from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:42298: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-de67ca6156e842db9c8994e493d241ca
I20260709 13:08:13.958766 23788 tablet_copy_source_session.cc:215] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:13.972247 24680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de67ca6156e842db9c8994e493d241ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:13.977206 24682 ts_tablet_manager.cc:933] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:13.990917 24682 tablet_copy_client.cc:323] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.3:45959
I20260709 13:08:13.992966 23788 tablet_copy_service.cc:140] P 4466bf6d6cf84ee89e84ea074e3964c9: Received BeginTabletCopySession request for tablet bc5bb39aaf4940fb9d34ec725193ca2c from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:42298)
I20260709 13:08:13.993567 23788 tablet_copy_service.cc:161] P 4466bf6d6cf84ee89e84ea074e3964c9: Beginning new tablet copy session on tablet bc5bb39aaf4940fb9d34ec725193ca2c from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:42298: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-bc5bb39aaf4940fb9d34ec725193ca2c
I20260709 13:08:14.006348 23788 tablet_copy_source_session.cc:215] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:14.017153 24680 tablet_copy_client.cc:806] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:14.018989 24680 tablet_copy_client.cc:670] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:14.020787 24682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5bb39aaf4940fb9d34ec725193ca2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:14.047350 24680 tablet_copy_client.cc:538] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:14.052589 24682 tablet_copy_client.cc:806] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:14.053352 24682 tablet_copy_client.cc:670] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:14.063891 24682 tablet_copy_client.cc:538] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:14.068751 24680 tablet_bootstrap.cc:492] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:14.074885 24682 tablet_bootstrap.cc:492] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:14.132786 24686 ts_tablet_manager.cc:933] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:14.142980 24686 tablet_copy_client.cc:323] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.1:37537
I20260709 13:08:14.144943 23639 tablet_copy_service.cc:140] P 9ab488f10c434878a749f261e99a8065: Received BeginTabletCopySession request for tablet 161b847a6eca457eb80fb6cb57531127 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:58448)
I20260709 13:08:14.145539 23639 tablet_copy_service.cc:161] P 9ab488f10c434878a749f261e99a8065: Beginning new tablet copy session on tablet 161b847a6eca457eb80fb6cb57531127 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:58448: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-161b847a6eca457eb80fb6cb57531127
I20260709 13:08:14.158053 24682 tablet_bootstrap.cc:492] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:14.159386 24682 tablet_bootstrap.cc:492] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:14.155586 23639 tablet_copy_source_session.cc:215] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:14.164768 24686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161b847a6eca457eb80fb6cb57531127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:14.168210 24682 ts_tablet_manager.cc:1403] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.094s	user 0.032s	sys 0.005s
I20260709 13:08:14.172230 24682 raft_consensus.cc:359] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:14.173183 24682 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:14.174983 24682 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:14.188689 24680 tablet_bootstrap.cc:492] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:14.189823 24680 tablet_bootstrap.cc:492] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:14.190620 24680 ts_tablet_manager.cc:1403] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.016s
I20260709 13:08:14.193701 24682 ts_tablet_manager.cc:1434] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:08:14.196069 23788 tablet_copy_service.cc:342] P 4466bf6d6cf84ee89e84ea074e3964c9: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-bc5bb39aaf4940fb9d34ec725193ca2c received from {username='slave'} at 127.0.0.1:42298
I20260709 13:08:14.196643 23788 tablet_copy_service.cc:434] P 4466bf6d6cf84ee89e84ea074e3964c9: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-bc5bb39aaf4940fb9d34ec725193ca2c on tablet bc5bb39aaf4940fb9d34ec725193ca2c with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:14.201879 24680 raft_consensus.cc:359] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:14.202905 24680 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:14.203665 24680 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:14.206529 24680 ts_tablet_manager.cc:1434] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:08:14.209928 24686 tablet_copy_client.cc:806] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:14.211902 23788 tablet_copy_service.cc:342] P 4466bf6d6cf84ee89e84ea074e3964c9: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-de67ca6156e842db9c8994e493d241ca received from {username='slave'} at 127.0.0.1:42298
I20260709 13:08:14.214964 23788 tablet_copy_service.cc:434] P 4466bf6d6cf84ee89e84ea074e3964c9: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-de67ca6156e842db9c8994e493d241ca on tablet de67ca6156e842db9c8994e493d241ca with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:14.218003 24686 tablet_copy_client.cc:670] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:14.222312 24686 tablet_copy_client.cc:538] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:14.234938 24686 tablet_bootstrap.cc:492] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:14.266942 24686 tablet_bootstrap.cc:492] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:14.268041 24686 tablet_bootstrap.cc:492] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
W20260709 13:08:14.268368 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50967.7us
I20260709 13:08:14.268769 24686 ts_tablet_manager.cc:1403] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.008s
I20260709 13:08:14.272178 24686 raft_consensus.cc:359] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:14.273036 24686 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:14.273722 24686 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:14.276320 24686 ts_tablet_manager.cc:1434] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:08:14.278832 23639 tablet_copy_service.cc:342] P 9ab488f10c434878a749f261e99a8065: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-161b847a6eca457eb80fb6cb57531127 received from {username='slave'} at 127.0.0.1:58448
I20260709 13:08:14.279297 23639 tablet_copy_service.cc:434] P 9ab488f10c434878a749f261e99a8065: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-161b847a6eca457eb80fb6cb57531127 on tablet 161b847a6eca457eb80fb6cb57531127 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:14.297926 24686 ts_tablet_manager.cc:933] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:14.398823 24686 tablet_copy_client.cc:323] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.2:44167
I20260709 13:08:14.401268 23714 tablet_copy_service.cc:140] P c885217113574e7489e6c3afb6950f76: Received BeginTabletCopySession request for tablet ee650b0b99c4413293e36b0fa9631151 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:54670)
I20260709 13:08:14.401961 23714 tablet_copy_service.cc:161] P c885217113574e7489e6c3afb6950f76: Beginning new tablet copy session on tablet ee650b0b99c4413293e36b0fa9631151 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:54670: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-ee650b0b99c4413293e36b0fa9631151
I20260709 13:08:14.411298 23714 tablet_copy_source_session.cc:215] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:14.441793 24686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee650b0b99c4413293e36b0fa9631151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:14.473984 24686 tablet_copy_client.cc:806] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:14.474972 24686 tablet_copy_client.cc:670] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:14.495584 24686 tablet_copy_client.cc:538] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:14.510030 24686 tablet_bootstrap.cc:492] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:14.559263 24686 tablet_bootstrap.cc:492] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:14.564898 24686 tablet_bootstrap.cc:492] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:14.565779 24686 ts_tablet_manager.cc:1403] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.056s	user 0.033s	sys 0.010s
I20260709 13:08:14.569355 24686 raft_consensus.cc:359] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:14.570389 24686 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:14.571107 24686 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:14.589890 24393 raft_consensus.cc:1217] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:14.602942 24686 ts_tablet_manager.cc:1434] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:08:14.604475 24393 raft_consensus.cc:1217] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:14.641152 23714 tablet_copy_service.cc:342] P c885217113574e7489e6c3afb6950f76: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-ee650b0b99c4413293e36b0fa9631151 received from {username='slave'} at 127.0.0.1:54670
I20260709 13:08:14.641667 23714 tablet_copy_service.cc:434] P c885217113574e7489e6c3afb6950f76: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-ee650b0b99c4413293e36b0fa9631151 on tablet ee650b0b99c4413293e36b0fa9631151 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:14.664017 24393 raft_consensus.cc:1217] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:14.731758 24393 raft_consensus.cc:1217] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:08:14.745035 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 67714.6us
W20260709 13:08:14.810113 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 55403.1us
W20260709 13:08:14.825850 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 76062us
W20260709 13:08:14.840636 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 87011.7us
I20260709 13:08:14.980330 24609 raft_consensus.cc:1064] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:14.982980 24609 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:15.007627 23629 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.009909 23702 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.012671 24391 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.017063 24690 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:15.019380 24693 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:15.021149 24592 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:15.036939 24690 raft_consensus.cc:1064] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:15.043946 24690 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:15.055923 24642 raft_consensus.cc:2955] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.067269 23697 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.067659 24391 raft_consensus.cc:2955] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.073180 24592 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:15.075749 24393 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.082072 24609 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:15.096786 23629 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.096920 23527 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.099316 23629 raft_consensus.cc:2955] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.108860 24609 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:15.116201 24393 raft_consensus.cc:2955] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.112231 24690 raft_consensus.cc:2955] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.141871 23702 raft_consensus.cc:2955] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.176753 24696 raft_consensus.cc:1064] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:15.180991 24696 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:15.188684 23695 raft_consensus.cc:2955] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.199456 23776 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.201647 24393 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.204943 24687 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:15.216045 24687 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:08:15.242854 24655 raft_consensus.cc:1064] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:15.248539 23695 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.250701 24655 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:15.272861 24687 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:15.279171 23629 raft_consensus.cc:2955] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.303328 24672 raft_consensus.cc:2955] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.306830 24392 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.307847 23625 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.310283 24659 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:15.310549 24392 raft_consensus.cc:2955] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.312711 24659 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:15.322178 23774 raft_consensus.cc:2955] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.308063 23776 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.327232 24709 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:15.363243 24659 raft_consensus.cc:2955] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.371449 23774 raft_consensus.cc:2955] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.393702 23629 raft_consensus.cc:2955] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.394559 23695 raft_consensus.cc:2955] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.415102 23778 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:15.383668 24391 raft_consensus.cc:2955] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.423964 24392 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:15.428488 24609 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:15.432581 23702 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:15.432418 23525 catalog_manager.cc:5697] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.434234 23525 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:15.436371 23525 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.437026 24719 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:15.446326 24592 raft_consensus.cc:2955] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.449043 24392 raft_consensus.cc:2955] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.458674 23511 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc5bb39aaf4940fb9d34ec725193ca2c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:15.459317 23695 raft_consensus.cc:2955] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.470227 23702 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:15.478432 23627 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:15.481230 24392 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:15.482976 24709 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:15.497983 23774 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:15.502372 24709 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:15.493034 23526 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.506925 24577 raft_consensus.cc:2955] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.514933 23778 raft_consensus.cc:2955] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.515771 23774 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:15.520992 23614 tablet_service.cc:1558] Processing DeleteTablet for tablet bc5bb39aaf4940fb9d34ec725193ca2c with delete_type TABLET_DATA_TOMBSTONED (TS 9ab488f10c434878a749f261e99a8065 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52038
I20260709 13:08:15.522903 24393 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:15.524621 24690 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:15.531526 24719 raft_consensus.cc:2955] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.532692 23629 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:15.533313 24393 raft_consensus.cc:2955] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.546902 24690 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:15.549660 23511 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet de67ca6156e842db9c8994e493d241ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:15.553222 24394 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:15.555218 24696 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:15.556695 23512 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee650b0b99c4413293e36b0fa9631151 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:15.555102 23629 raft_consensus.cc:2955] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.539276 24391 raft_consensus.cc:2955] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.566111 24687 raft_consensus.cc:2955] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.571570 24394 raft_consensus.cc:2955] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.587836 23526 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:15.591288 23702 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:15.593087 24696 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:15.602758 23695 raft_consensus.cc:2955] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.604698 23513 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 161b847a6eca457eb80fb6cb57531127 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:15.604400 24720 tablet_replica.cc:333] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:08:15.621460 23527 catalog_manager.cc:5697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.627823 23527 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:15.630589 23614 tablet_service.cc:1558] Processing DeleteTablet for tablet ee650b0b99c4413293e36b0fa9631151 with delete_type TABLET_DATA_TOMBSTONED (TS 9ab488f10c434878a749f261e99a8065 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52038
I20260709 13:08:15.633879 24720 raft_consensus.cc:2243] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.639614 24720 raft_consensus.cc:2272] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.645107 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet de67ca6156e842db9c8994e493d241ca with delete_type TABLET_DATA_TOMBSTONED (TS c885217113574e7489e6c3afb6950f76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45060
I20260709 13:08:15.647171 24723 tablet_replica.cc:333] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:08:15.648264 24723 raft_consensus.cc:2243] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.649068 24723 raft_consensus.cc:2272] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.653853 24723 ts_tablet_manager.cc:1916] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:15.654513 23768 tablet_service.cc:1558] Processing DeleteTablet for tablet 161b847a6eca457eb80fb6cb57531127 with delete_type TABLET_DATA_TOMBSTONED (TS 4466bf6d6cf84ee89e84ea074e3964c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43444
I20260709 13:08:15.671458 24720 ts_tablet_manager.cc:1916] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:15.677868 24723 ts_tablet_manager.cc:1929] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:15.678517 24723 log.cc:1199] T de67ca6156e842db9c8994e493d241ca P c885217113574e7489e6c3afb6950f76: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/wals/de67ca6156e842db9c8994e493d241ca
I20260709 13:08:15.680971 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet de67ca6156e842db9c8994e493d241ca (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:15.687758 24724 tablet_replica.cc:333] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:08:15.688802 24724 raft_consensus.cc:2243] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.689481 24724 raft_consensus.cc:2272] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.692510 24724 ts_tablet_manager.cc:1916] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:15.694099 24720 ts_tablet_manager.cc:1929] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:15.694612 24720 log.cc:1199] T bc5bb39aaf4940fb9d34ec725193ca2c P 9ab488f10c434878a749f261e99a8065: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/wals/bc5bb39aaf4940fb9d34ec725193ca2c
I20260709 13:08:15.696692 24720 tablet_replica.cc:333] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:08:15.696805 23513 catalog_manager.cc:5028] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): tablet bc5bb39aaf4940fb9d34ec725193ca2c (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:15.697886 24720 raft_consensus.cc:2243] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:15.698594 24720 raft_consensus.cc:2272] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.702457 24720 ts_tablet_manager.cc:1916] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:15.709406 24724 ts_tablet_manager.cc:1929] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:15.709846 24724 log.cc:1199] T 161b847a6eca457eb80fb6cb57531127 P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/wals/161b847a6eca457eb80fb6cb57531127
I20260709 13:08:15.711503 23511 catalog_manager.cc:5028] TS 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): tablet 161b847a6eca457eb80fb6cb57531127 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:15.718258 24720 ts_tablet_manager.cc:1929] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:15.718629 24720 log.cc:1199] T ee650b0b99c4413293e36b0fa9631151 P 9ab488f10c434878a749f261e99a8065: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/wals/ee650b0b99c4413293e36b0fa9631151
I20260709 13:08:15.720081 23513 catalog_manager.cc:5028] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): tablet ee650b0b99c4413293e36b0fa9631151 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:16.721206 23629 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:16.728631 23778 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:16.729130 23593 consensus_peers.cc:597] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5499c62f40a046f2a8efb671c77f08b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:16.730795 23702 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:16.731266 24672 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:16.732446 24687 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:16.740818 24687 raft_consensus.cc:2955] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.744421 23702 raft_consensus.cc:2955] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.747434 23774 raft_consensus.cc:2955] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.757202 23627 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:16.771257 23524 catalog_manager.cc:5697] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.782961 23774 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:16.786001 24730 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:16.792258 23593 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01ec1d400f174350acc92722149e02d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:16.799458 23702 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:16.801756 24730 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:16.804631 24672 raft_consensus.cc:2955] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.807376 23774 raft_consensus.cc:2955] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.834134 23774 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:16.836902 23702 raft_consensus.cc:2955] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.841756 23527 catalog_manager.cc:5697] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.857128 23702 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:16.860150 23742 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa38658745b04f268c400fe20554d483. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:16.861356 24690 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:16.863385 23627 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:16.866413 24690 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:16.873452 24725 raft_consensus.cc:2955] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.874347 23702 raft_consensus.cc:2955] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.891150 23629 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:16.897599 23527 catalog_manager.cc:5697] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.898552 23627 raft_consensus.cc:2955] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
W20260709 13:08:16.921975 23593 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36da9377816744739720cb01b6191368. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:16.924608 23774 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:16.925072 23702 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:16.926533 24730 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:16.928426 24730 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:16.942227 24730 raft_consensus.cc:2955] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.943769 23695 raft_consensus.cc:2955] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.945797 23774 raft_consensus.cc:2955] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:16.967582 23527 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:17.181603 24747 ts_tablet_manager.cc:933] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:17.183581 24747 tablet_copy_client.cc:323] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.1:37537
I20260709 13:08:17.185185 23639 tablet_copy_service.cc:140] P 9ab488f10c434878a749f261e99a8065: Received BeginTabletCopySession request for tablet 5499c62f40a046f2a8efb671c77f08b3 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:58448)
I20260709 13:08:17.185653 23639 tablet_copy_service.cc:161] P 9ab488f10c434878a749f261e99a8065: Beginning new tablet copy session on tablet 5499c62f40a046f2a8efb671c77f08b3 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:58448: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-5499c62f40a046f2a8efb671c77f08b3
I20260709 13:08:17.190783 23639 tablet_copy_source_session.cc:215] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:17.193567 24747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5499c62f40a046f2a8efb671c77f08b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.199505 24749 ts_tablet_manager.cc:933] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:17.204296 24749 tablet_copy_client.cc:323] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.1:37537
I20260709 13:08:17.207240 23639 tablet_copy_service.cc:140] P 9ab488f10c434878a749f261e99a8065: Received BeginTabletCopySession request for tablet 01ec1d400f174350acc92722149e02d4 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:58448)
I20260709 13:08:17.207827 23639 tablet_copy_service.cc:161] P 9ab488f10c434878a749f261e99a8065: Beginning new tablet copy session on tablet 01ec1d400f174350acc92722149e02d4 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:58448: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-01ec1d400f174350acc92722149e02d4
I20260709 13:08:17.213210 24747 tablet_copy_client.cc:806] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:17.213930 24747 tablet_copy_client.cc:670] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:17.215960 23639 tablet_copy_source_session.cc:215] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:17.218484 24747 tablet_copy_client.cc:538] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:17.219650 24749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ec1d400f174350acc92722149e02d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.229698 24747 tablet_bootstrap.cc:492] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:17.237221 24749 tablet_copy_client.cc:806] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:17.237967 24749 tablet_copy_client.cc:670] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:17.249131 24749 tablet_copy_client.cc:538] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:17.308013 24747 tablet_bootstrap.cc:492] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:17.309300 24747 tablet_bootstrap.cc:492] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:17.314222 24747 ts_tablet_manager.cc:1403] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.085s	user 0.027s	sys 0.006s
I20260709 13:08:17.330848 24749 tablet_bootstrap.cc:492] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:17.343914 24747 raft_consensus.cc:359] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:17.344946 24747 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:17.345731 24747 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:17.359529 24747 ts_tablet_manager.cc:1434] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.003s
I20260709 13:08:17.365571 23639 tablet_copy_service.cc:342] P 9ab488f10c434878a749f261e99a8065: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-5499c62f40a046f2a8efb671c77f08b3 received from {username='slave'} at 127.0.0.1:58448
I20260709 13:08:17.366086 23639 tablet_copy_service.cc:434] P 9ab488f10c434878a749f261e99a8065: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-5499c62f40a046f2a8efb671c77f08b3 on tablet 5499c62f40a046f2a8efb671c77f08b3 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:17.377286 24755 ts_tablet_manager.cc:933] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:17.386723 24755 tablet_copy_client.cc:323] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.3:45959
I20260709 13:08:17.386950 24749 tablet_bootstrap.cc:492] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:17.388142 24749 tablet_bootstrap.cc:492] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:17.388641 23788 tablet_copy_service.cc:140] P 4466bf6d6cf84ee89e84ea074e3964c9: Received BeginTabletCopySession request for tablet aa38658745b04f268c400fe20554d483 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:42298)
I20260709 13:08:17.389007 24749 ts_tablet_manager.cc:1403] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.019s
I20260709 13:08:17.389298 23788 tablet_copy_service.cc:161] P 4466bf6d6cf84ee89e84ea074e3964c9: Beginning new tablet copy session on tablet aa38658745b04f268c400fe20554d483 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:42298: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-aa38658745b04f268c400fe20554d483
I20260709 13:08:17.397904 23788 tablet_copy_source_session.cc:215] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:17.400750 24749 raft_consensus.cc:359] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:17.403414 24749 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:17.404054 24755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa38658745b04f268c400fe20554d483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.404284 24749 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:17.411772 24749 ts_tablet_manager.cc:1434] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 13:08:17.415455 23639 tablet_copy_service.cc:342] P 9ab488f10c434878a749f261e99a8065: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-01ec1d400f174350acc92722149e02d4 received from {username='slave'} at 127.0.0.1:58448
I20260709 13:08:17.416030 23639 tablet_copy_service.cc:434] P 9ab488f10c434878a749f261e99a8065: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-01ec1d400f174350acc92722149e02d4 on tablet 01ec1d400f174350acc92722149e02d4 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:17.428319 24755 tablet_copy_client.cc:806] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:17.429148 24755 tablet_copy_client.cc:670] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:17.430723 24749 ts_tablet_manager.cc:933] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:17.438134 24749 tablet_copy_client.cc:323] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.1:37537
I20260709 13:08:17.440788 23639 tablet_copy_service.cc:140] P 9ab488f10c434878a749f261e99a8065: Received BeginTabletCopySession request for tablet 36da9377816744739720cb01b6191368 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:58448)
I20260709 13:08:17.441407 23639 tablet_copy_service.cc:161] P 9ab488f10c434878a749f261e99a8065: Beginning new tablet copy session on tablet 36da9377816744739720cb01b6191368 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:58448: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-36da9377816744739720cb01b6191368
I20260709 13:08:17.446942 24755 tablet_copy_client.cc:538] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:17.454599 23639 tablet_copy_source_session.cc:215] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:17.464849 24755 tablet_bootstrap.cc:492] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:17.465456 24749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36da9377816744739720cb01b6191368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.500422 24755 tablet_bootstrap.cc:492] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:17.501814 24755 tablet_bootstrap.cc:492] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:17.502606 24755 ts_tablet_manager.cc:1403] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.038s	user 0.027s	sys 0.007s
I20260709 13:08:17.506484 24755 raft_consensus.cc:359] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:17.507459 24755 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:17.508337 24755 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:17.511370 24755 ts_tablet_manager.cc:1434] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:17.513852 23788 tablet_copy_service.cc:342] P 4466bf6d6cf84ee89e84ea074e3964c9: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-aa38658745b04f268c400fe20554d483 received from {username='slave'} at 127.0.0.1:42298
I20260709 13:08:17.514297 23788 tablet_copy_service.cc:434] P 4466bf6d6cf84ee89e84ea074e3964c9: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-aa38658745b04f268c400fe20554d483 on tablet aa38658745b04f268c400fe20554d483 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:17.517273 24749 tablet_copy_client.cc:806] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:17.518024 24749 tablet_copy_client.cc:670] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:17.524386 24749 tablet_copy_client.cc:538] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:17.537274 24749 tablet_bootstrap.cc:492] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:17.559325 24749 tablet_bootstrap.cc:492] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:17.560204 24749 tablet_bootstrap.cc:492] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:17.560842 24749 ts_tablet_manager.cc:1403] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.000s
I20260709 13:08:17.563314 24749 raft_consensus.cc:359] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:17.564091 24749 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:17.564639 24749 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:17.566799 24749 ts_tablet_manager.cc:1434] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:17.569070 23639 tablet_copy_service.cc:342] P 9ab488f10c434878a749f261e99a8065: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-36da9377816744739720cb01b6191368 received from {username='slave'} at 127.0.0.1:58448
I20260709 13:08:17.569552 23639 tablet_copy_service.cc:434] P 9ab488f10c434878a749f261e99a8065: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-36da9377816744739720cb01b6191368 on tablet 36da9377816744739720cb01b6191368 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:17.613075 24394 raft_consensus.cc:1217] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:17.807782 24394 raft_consensus.cc:1217] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:17.871203 24394 raft_consensus.cc:1217] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:17.985647 24391 raft_consensus.cc:1217] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:18.002167 24672 raft_consensus.cc:1064] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:18.004304 24672 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:18.018895 23778 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.020291 24391 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.021025 23702 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.021836 24763 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.022830 24761 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.025545 24761 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.042732 24761 raft_consensus.cc:2955] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.044406 24394 raft_consensus.cc:2955] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.046996 23778 raft_consensus.cc:2955] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.059108 23527 catalog_manager.cc:5697] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.073282 23695 raft_consensus.cc:2955] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.114903 23627 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:18.126221 24394 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.126835 23778 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.128439 24730 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.130332 24761 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.137903 24672 raft_consensus.cc:2955] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.139984 23778 raft_consensus.cc:2955] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.141755 24394 raft_consensus.cc:2955] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.148828 23513 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5499c62f40a046f2a8efb671c77f08b3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:18.165973 23526 catalog_manager.cc:5697] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.185475 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet 5499c62f40a046f2a8efb671c77f08b3 with delete_type TABLET_DATA_TOMBSTONED (TS c885217113574e7489e6c3afb6950f76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45060
I20260709 13:08:18.190330 24772 tablet_replica.cc:333] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:08:18.191336 24772 raft_consensus.cc:2243] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.192096 24772 raft_consensus.cc:2272] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.195765 24772 ts_tablet_manager.cc:1916] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:18.212116 24772 ts_tablet_manager.cc:1929] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:18.212622 24772 log.cc:1199] T 5499c62f40a046f2a8efb671c77f08b3 P c885217113574e7489e6c3afb6950f76: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/wals/5499c62f40a046f2a8efb671c77f08b3
I20260709 13:08:18.214187 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet 5499c62f40a046f2a8efb671c77f08b3 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:18.247696 24672 raft_consensus.cc:1064] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:18.250267 24672 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:18.256282 24394 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.258833 23778 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.260387 24761 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.261236 23702 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.267360 24761 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.269528 24761 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.288445 24672 raft_consensus.cc:2955] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.290549 24394 raft_consensus.cc:2955] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.292397 23702 raft_consensus.cc:2955] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.303099 23778 raft_consensus.cc:2955] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.310422 23525 catalog_manager.cc:5697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.331598 23627 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:18.338356 23702 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.338423 24394 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.340056 24672 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:08:18.342705 24763 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.351372 24730 raft_consensus.cc:2955] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.356498 24394 raft_consensus.cc:2955] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.356545 23702 raft_consensus.cc:2955] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.372243 23525 catalog_manager.cc:5697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.383905 24690 raft_consensus.cc:1064] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:18.385835 23513 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01ec1d400f174350acc92722149e02d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:18.387319 24690 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:18.411101 23702 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.412087 24391 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.412511 24719 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.419046 23627 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.420056 24690 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:18.424335 23768 tablet_service.cc:1558] Processing DeleteTablet for tablet 01ec1d400f174350acc92722149e02d4 with delete_type TABLET_DATA_TOMBSTONED (TS 4466bf6d6cf84ee89e84ea074e3964c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43444
I20260709 13:08:18.427888 24762 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:18.464967 23625 raft_consensus.cc:2955] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.463316 24690 raft_consensus.cc:2955] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.486555 24780 tablet_replica.cc:333] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:08:18.487820 24780 raft_consensus.cc:2243] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.488646 24780 raft_consensus.cc:2272] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.490666 23702 raft_consensus.cc:2955] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.494019 24391 raft_consensus.cc:2955] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.502514 24780 ts_tablet_manager.cc:1916] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:18.502444 23524 catalog_manager.cc:5697] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.536322 24780 ts_tablet_manager.cc:1929] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:18.537456 24780 log.cc:1199] T 01ec1d400f174350acc92722149e02d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/wals/01ec1d400f174350acc92722149e02d4
I20260709 13:08:18.539662 23511 catalog_manager.cc:5028] TS 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): tablet 01ec1d400f174350acc92722149e02d4 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:18.548187 23774 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:18.562600 24393 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.565769 24719 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:18.572763 23629 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.579449 24690 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.582896 24762 raft_consensus.cc:2955] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.593295 24391 raft_consensus.cc:2955] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.594528 23627 raft_consensus.cc:2955] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.596647 23511 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa38658745b04f268c400fe20554d483 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:18.606104 24777 raft_consensus.cc:1064] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:18.609073 24777 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:18.622812 23526 catalog_manager.cc:5697] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.637778 24391 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.638456 23774 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.641557 24763 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:18.641969 23695 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.646567 24672 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.653118 24777 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.654708 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet aa38658745b04f268c400fe20554d483 with delete_type TABLET_DATA_TOMBSTONED (TS c885217113574e7489e6c3afb6950f76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45060
I20260709 13:08:18.655841 24772 tablet_replica.cc:333] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:08:18.657001 24772 raft_consensus.cc:2243] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.657925 24772 raft_consensus.cc:2272] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.668923 24772 ts_tablet_manager.cc:1916] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:18.708768 24777 raft_consensus.cc:2955] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.715592 24391 raft_consensus.cc:2955] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.723318 23699 raft_consensus.cc:2955] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.732385 23524 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.742455 23774 raft_consensus.cc:2955] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.744112 24772 ts_tablet_manager.cc:1929] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:18.744695 24772 log.cc:1199] T aa38658745b04f268c400fe20554d483 P c885217113574e7489e6c3afb6950f76: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/wals/aa38658745b04f268c400fe20554d483
I20260709 13:08:18.747828 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet aa38658745b04f268c400fe20554d483 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:18.756131 23629 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:18.761586 24391 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.764225 24777 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.772221 23699 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.785112 24763 raft_consensus.cc:2955] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.799335 24761 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:18.803871 24391 raft_consensus.cc:2955] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.813776 23513 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36da9377816744739720cb01b6191368 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:18.818094 23702 raft_consensus.cc:2955] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:18.823791 23526 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.842517 23768 tablet_service.cc:1558] Processing DeleteTablet for tablet 36da9377816744739720cb01b6191368 with delete_type TABLET_DATA_TOMBSTONED (TS 4466bf6d6cf84ee89e84ea074e3964c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43444
I20260709 13:08:18.843614 24780 tablet_replica.cc:333] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:08:18.844790 24780 raft_consensus.cc:2243] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.845485 24780 raft_consensus.cc:2272] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.849378 24780 ts_tablet_manager.cc:1916] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:18.864230 24780 ts_tablet_manager.cc:1929] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:18.864642 24780 log.cc:1199] T 36da9377816744739720cb01b6191368 P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/wals/36da9377816744739720cb01b6191368
I20260709 13:08:18.866207 23511 catalog_manager.cc:5028] TS 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): tablet 36da9377816744739720cb01b6191368 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:19.925488 23774 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:19.932627 23629 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:19.935317 23699 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:19.935195 24762 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:19.937224 23742 consensus_peers.cc:597] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3473b09c073142659e12a365e9aed3f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.940341 24762 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:19.944247 24690 raft_consensus.cc:2955] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:19.947808 23629 raft_consensus.cc:2955] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:19.960664 23702 raft_consensus.cc:2955] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:19.961596 23774 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:19.965384 23526 catalog_manager.cc:5697] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.970911 23697 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:19.973347 24762 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:19.981624 23629 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:19.982309 23742 consensus_peers.cc:597] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37a8de42d0d8417f9ad5486f22fdbf73. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.984700 24762 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.995350 23697 raft_consensus.cc:2955] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:19.998603 23629 raft_consensus.cc:2955] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:19.993274 24762 raft_consensus.cc:2955] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:20.017499 23627 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:20.026938 23525 catalog_manager.cc:5697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:20.037741 23593 consensus_peers.cc:597] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2906fc04ac3a43e5a91763bfbd1ff990. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.037969 23697 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:20.038043 23774 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:20.040292 24761 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.043382 24788 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.053894 24761 raft_consensus.cc:2955] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:20.056126 23774 raft_consensus.cc:2955] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:20.062027 23699 raft_consensus.cc:2955] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:20.073472 23697 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:20.074236 23526 catalog_manager.cc:5697] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.095666 23774 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:20.096127 23629 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:20.096146 23668 consensus_peers.cc:597] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec11dcde267d48f4b479e4ffb468a0bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.097038 24753 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.098116 24709 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.114905 24753 raft_consensus.cc:2955] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:20.117537 23774 raft_consensus.cc:2955] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:20.119542 23629 raft_consensus.cc:2955] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:20.138955 23524 catalog_manager.cc:5697] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 2, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:20.352332 24808 ts_tablet_manager.cc:933] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:20.356423 24808 tablet_copy_client.cc:323] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.3:45959
I20260709 13:08:20.358129 23788 tablet_copy_service.cc:140] P 4466bf6d6cf84ee89e84ea074e3964c9: Received BeginTabletCopySession request for tablet 3473b09c073142659e12a365e9aed3f3 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:42298)
I20260709 13:08:20.358918 23788 tablet_copy_service.cc:161] P 4466bf6d6cf84ee89e84ea074e3964c9: Beginning new tablet copy session on tablet 3473b09c073142659e12a365e9aed3f3 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:42298: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-3473b09c073142659e12a365e9aed3f3
I20260709 13:08:20.366524 23788 tablet_copy_source_session.cc:215] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:20.369867 24808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3473b09c073142659e12a365e9aed3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.388887 24808 tablet_copy_client.cc:806] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:20.389621 24808 tablet_copy_client.cc:670] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:20.394493 24808 tablet_copy_client.cc:538] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:20.405193 24808 tablet_bootstrap.cc:492] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:20.436339 24808 tablet_bootstrap.cc:492] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:20.437405 24808 tablet_bootstrap.cc:492] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:20.438031 24808 ts_tablet_manager.cc:1403] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.033s	user 0.024s	sys 0.008s
I20260709 13:08:20.440907 24808 raft_consensus.cc:359] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:20.441572 24808 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:20.442219 24808 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:20.447081 24808 ts_tablet_manager.cc:1434] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:20.449220 23788 tablet_copy_service.cc:342] P 4466bf6d6cf84ee89e84ea074e3964c9: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-3473b09c073142659e12a365e9aed3f3 received from {username='slave'} at 127.0.0.1:42298
I20260709 13:08:20.449702 23788 tablet_copy_service.cc:434] P 4466bf6d6cf84ee89e84ea074e3964c9: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-3473b09c073142659e12a365e9aed3f3 on tablet 3473b09c073142659e12a365e9aed3f3 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:20.507607 24808 ts_tablet_manager.cc:933] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:20.512364 24808 tablet_copy_client.cc:323] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.1:37537
I20260709 13:08:20.514047 23639 tablet_copy_service.cc:140] P 9ab488f10c434878a749f261e99a8065: Received BeginTabletCopySession request for tablet 2906fc04ac3a43e5a91763bfbd1ff990 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:58448)
I20260709 13:08:20.514837 23639 tablet_copy_service.cc:161] P 9ab488f10c434878a749f261e99a8065: Beginning new tablet copy session on tablet 2906fc04ac3a43e5a91763bfbd1ff990 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:58448: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-2906fc04ac3a43e5a91763bfbd1ff990
I20260709 13:08:20.520800 23639 tablet_copy_source_session.cc:215] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:20.523581 24808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2906fc04ac3a43e5a91763bfbd1ff990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.538048 24808 tablet_copy_client.cc:806] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:20.538616 24808 tablet_copy_client.cc:670] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:20.543804 24808 tablet_copy_client.cc:538] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:20.550244 24813 ts_tablet_manager.cc:933] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:20.554000 24813 tablet_copy_client.cc:323] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.3:45959
I20260709 13:08:20.555549 24808 tablet_bootstrap.cc:492] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:20.555755 23788 tablet_copy_service.cc:140] P 4466bf6d6cf84ee89e84ea074e3964c9: Received BeginTabletCopySession request for tablet 37a8de42d0d8417f9ad5486f22fdbf73 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:42298)
I20260709 13:08:20.556324 23788 tablet_copy_service.cc:161] P 4466bf6d6cf84ee89e84ea074e3964c9: Beginning new tablet copy session on tablet 37a8de42d0d8417f9ad5486f22fdbf73 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:42298: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-37a8de42d0d8417f9ad5486f22fdbf73
I20260709 13:08:20.577366 23788 tablet_copy_source_session.cc:215] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:20.595146 24813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a8de42d0d8417f9ad5486f22fdbf73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.595315 24815 ts_tablet_manager.cc:933] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:20.606299 24815 tablet_copy_client.cc:323] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.2:44167
I20260709 13:08:20.607366 24808 tablet_bootstrap.cc:492] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:20.608222 23714 tablet_copy_service.cc:140] P c885217113574e7489e6c3afb6950f76: Received BeginTabletCopySession request for tablet ec11dcde267d48f4b479e4ffb468a0bc from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:54670)
I20260709 13:08:20.608490 24808 tablet_bootstrap.cc:492] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:20.608877 23714 tablet_copy_service.cc:161] P c885217113574e7489e6c3afb6950f76: Beginning new tablet copy session on tablet ec11dcde267d48f4b479e4ffb468a0bc from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:54670: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-ec11dcde267d48f4b479e4ffb468a0bc
I20260709 13:08:20.609277 24808 ts_tablet_manager.cc:1403] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.054s	user 0.029s	sys 0.002s
I20260709 13:08:20.613528 24808 raft_consensus.cc:359] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:20.614451 24808 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:20.615164 24808 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:20.618010 24808 ts_tablet_manager.cc:1434] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:08:20.619807 23639 tablet_copy_service.cc:342] P 9ab488f10c434878a749f261e99a8065: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-2906fc04ac3a43e5a91763bfbd1ff990 received from {username='slave'} at 127.0.0.1:58448
I20260709 13:08:20.620275 23639 tablet_copy_service.cc:434] P 9ab488f10c434878a749f261e99a8065: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-2906fc04ac3a43e5a91763bfbd1ff990 on tablet 2906fc04ac3a43e5a91763bfbd1ff990 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:20.623225 23714 tablet_copy_source_session.cc:215] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:20.628551 24815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec11dcde267d48f4b479e4ffb468a0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.644887 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:20.646970 24813 tablet_copy_client.cc:806] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:20.647558 24813 tablet_copy_client.cc:670] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:20.651855 24813 tablet_copy_client.cc:538] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:20.654953 24815 tablet_copy_client.cc:806] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:20.655661 24815 tablet_copy_client.cc:670] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:20.660252 24815 tablet_copy_client.cc:538] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:20.665186 24813 tablet_bootstrap.cc:492] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:20.671679 24815 tablet_bootstrap.cc:492] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:20.720045 24813 tablet_bootstrap.cc:492] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:20.721076 24813 tablet_bootstrap.cc:492] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:20.721881 24813 ts_tablet_manager.cc:1403] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.005s
I20260709 13:08:20.724992 24813 raft_consensus.cc:359] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:20.727346 24813 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:20.728528 24813 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:20.732306 24813 ts_tablet_manager.cc:1434] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:08:20.737126 23788 tablet_copy_service.cc:342] P 4466bf6d6cf84ee89e84ea074e3964c9: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-37a8de42d0d8417f9ad5486f22fdbf73 received from {username='slave'} at 127.0.0.1:42298
I20260709 13:08:20.737653 23788 tablet_copy_service.cc:434] P 4466bf6d6cf84ee89e84ea074e3964c9: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-37a8de42d0d8417f9ad5486f22fdbf73 on tablet 37a8de42d0d8417f9ad5486f22fdbf73 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:20.747933 24815 tablet_bootstrap.cc:492] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:20.749176 24815 tablet_bootstrap.cc:492] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:20.749920 24815 ts_tablet_manager.cc:1403] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.078s	user 0.037s	sys 0.022s
I20260709 13:08:20.757267 24815 raft_consensus.cc:359] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:20.758323 24815 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:20.759060 24815 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:20.762027 24815 ts_tablet_manager.cc:1434] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:08:20.764823 23714 tablet_copy_service.cc:342] P c885217113574e7489e6c3afb6950f76: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-ec11dcde267d48f4b479e4ffb468a0bc received from {username='slave'} at 127.0.0.1:54670
I20260709 13:08:20.765287 23714 tablet_copy_service.cc:434] P c885217113574e7489e6c3afb6950f76: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-ec11dcde267d48f4b479e4ffb468a0bc on tablet ec11dcde267d48f4b479e4ffb468a0bc with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:20.819039 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:20.819701 23778 raft_consensus.cc:606] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:20.824031 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:20.824605 23778 raft_consensus.cc:606] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:20.828599 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:20.829118 23778 raft_consensus.cc:606] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:20.859891 24391 raft_consensus.cc:1217] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:20.864771 23702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:48074
I20260709 13:08:20.865443 23702 raft_consensus.cc:606] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:20.872483 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:20.873327 23778 raft_consensus.cc:606] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:20.876061 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:20.876724 23778 raft_consensus.cc:606] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:20.877911 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:20.879240 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:20.961910 24391 raft_consensus.cc:1217] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:20.977034 24690 raft_consensus.cc:993] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:08:20.977519 24690 raft_consensus.cc:1081] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Signalling peer b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:08:20.980036 24391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:46580
I20260709 13:08:20.981590 24391 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.982057 24391 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.991218 24391 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:20.993963 24391 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:20.994928 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:20.995615 23629 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.997017 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:20.997846 23778 raft_consensus.cc:3055] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:20.998332 23778 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:20.998485 24789 raft_consensus.cc:993] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:20.999010 24789 raft_consensus.cc:1081] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:20.999094 23778 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:21.000516 23778 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.000908 23627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
I20260709 13:08:21.001449 23627 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.001749 23627 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.005214 23629 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:21.006863 24359 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:21.007588 23778 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:21.008562 24811 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.014124 24391 raft_consensus.cc:1217] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:21.015798 23627 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.021064 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:21.021528 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:21.022048 23699 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.022320 23778 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.022840 23778 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:21.023816 23778 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.025306 23778 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.024564 23627 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:21.037468 24789 raft_consensus.cc:993] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:21.037992 24789 raft_consensus.cc:1081] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:21.045715 23778 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:21.048154 23592 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:21.054833 24761 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.055997 24761 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:21.057188 24761 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.072911 24393 raft_consensus.cc:1217] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:21.081650 23625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
I20260709 13:08:21.082297 23625 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.082683 23625 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.094008 23526 catalog_manager.cc:5697] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.106145 24753 raft_consensus.cc:993] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:21.106792 24709 raft_consensus.cc:1081] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:21.103648 23699 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:21.117085 23625 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.128276 23627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52050
I20260709 13:08:21.129225 23627 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.129683 23627 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.140286 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:21.140957 23699 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.151887 23627 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.157150 23699 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:21.143436 24811 raft_consensus.cc:697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:21.216483 23627 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:21.218034 24811 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:21.253321 23625 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:21.246464 24828 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:08:21.309818 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:21.310695 23778 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.310999 23778 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:21.311831 23778 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.313210 23778 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.315691 24690 raft_consensus.cc:1064] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:21.335639 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:21.336651 23774 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.354092 24690 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:21.359368 23774 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:21.360102 23778 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
W20260709 13:08:21.392704 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 244059us
W20260709 13:08:21.414535 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 52496.7us
I20260709 13:08:21.403298 23524 catalog_manager.cc:5697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 2 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.427719 24393 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.439064 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:21.440366 23702 raft_consensus.cc:3055] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.440842 23702 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:21.442287 24832 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:21.442266 23702 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.468109 23702 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.482043 23699 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.492370 24826 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:21.503154 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:21.507478 23624 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.516511 24761 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.513571 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:21.526202 24761 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:21.538995 24838 raft_consensus.cc:993] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:21.530941 24761 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.554071 24843 raft_consensus.cc:1064] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:21.558338 24845 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.569491 24845 raft_consensus.cc:697] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:21.569134 24843 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:21.571133 24845 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.573091 24832 raft_consensus.cc:1081] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
W20260709 13:08:21.573848 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49624.4us
I20260709 13:08:21.592967 24762 raft_consensus.cc:993] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:21.593850 24762 raft_consensus.cc:1081] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:21.597718 24832 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:21.600414 23702 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:21.611893 24391 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.615317 24709 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:21.615826 23698 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:21.629403 23773 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.633090 24846 raft_consensus.cc:1064] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:21.636772 24846 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:21.648407 23624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
I20260709 13:08:21.650116 23624 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.650679 23624 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.648231 23625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
I20260709 13:08:21.656212 23625 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.662792 23625 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.680075 24838 raft_consensus.cc:1064] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:21.681388 24807 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:21.689076 24838 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:21.677814 23625 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.697970 23624 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.700364 23625 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:21.704272 23624 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:21.705876 23774 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:21.706707 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:21.707533 23771 raft_consensus.cc:3055] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.707924 23771 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:21.733502 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:21.734181 23778 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.734573 23778 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:21.735522 23778 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.730406 23771 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.750730 23771 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.753470 24788 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:21.754916 24788 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:21.764544 24391 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.800690 23778 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:21.833830 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 62095.2us
I20260709 13:08:21.853109 23774 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.859076 23629 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.860440 23771 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:21.867050 23778 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:21.868808 23629 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.869504 24761 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:21.873485 24859 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:21.875330 23592 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:21.879546 23592 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:21.880605 24761 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.881431 24788 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.881723 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:21.882083 24788 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:21.882480 23702 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.883949 24761 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:21.883262 24788 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.887491 23695 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.890120 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:21.890769 23698 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.895211 23774 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.898561 24811 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:08:21.904371 23702 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:21.913599 24394 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 LEARNER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.912799 24761 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:21.917536 24811 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:21.941411 23698 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:21.947382 23702 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.950641 23629 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.933238 24762 raft_consensus.cc:2955] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:21.944207 24832 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:08:21.990376 23696 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:22.011487 24789 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:08:22.017876 24835 raft_consensus.cc:2955] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:21.990886 24843 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:08:22.048753 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63189.6us
W20260709 13:08:22.073812 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 108699us
W20260709 13:08:22.144271 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 155925us
I20260709 13:08:22.147665 24830 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:22.167212 24833 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:08:22.203776 23697 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.208632 23700 raft_consensus.cc:2955] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:22.256834 23778 raft_consensus.cc:2955] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:08:22.263224 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 76195.2us
I20260709 13:08:22.288619 23622 raft_consensus.cc:2955] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:22.349208 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:22.357234 24393 raft_consensus.cc:2955] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:22.397183 23628 raft_consensus.cc:2955] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:08:22.406064 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 203937us
I20260709 13:08:22.431829 24788 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:22.528784 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 203215us
W20260709 13:08:22.530180 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 210203us
I20260709 13:08:22.532596 23526 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 2, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.535175 24390 raft_consensus.cc:2955] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:22.580281 23774 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.568023 23526 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.603852 23526 catalog_manager.cc:5697] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.612222 23526 catalog_manager.cc:5697] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:22.626228 24879 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:08:22.598490 24788 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:08:22.632064 24878 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:08:22.646618 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 307510us
W20260709 13:08:22.667368 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 60287.1us
I20260709 13:08:22.671811 23776 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.687232 24846 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:22.756513 24853 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:08:22.806937 23778 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.859767 24867 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:08:22.860713 23778 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.868157 24867 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:08:22.912511 24883 raft_consensus.cc:2955] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:22.923424 24835 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.924003 24835 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:22.926380 24835 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:22.918356 24872 raft_consensus.cc:2955] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:22.931538 24394 raft_consensus.cc:2955] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:22.939257 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:22.940109 23770 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:22.921828 23620 raft_consensus.cc:2955] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:22.942842 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:22.945134 24884 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:22.945797 24884 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.946273 24884 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:22.939994 23775 raft_consensus.cc:2955] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:08:22.975957 23669 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.016s	sys 0.032s
W20260709 13:08:22.976397 23669 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.017s	sys 0.032s
W20260709 13:08:22.977448 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 657565us
I20260709 13:08:23.054145 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:23.047864 24884 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:23.079743 23704 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:23.073984 24811 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.060s	sys 0.113s
I20260709 13:08:23.090318 23702 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:23.090729 24811 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.061s	sys 0.113s
W20260709 13:08:23.104526 23628 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.035s	sys 0.104s
W20260709 13:08:23.138942 23628 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.035s	sys 0.104s
I20260709 13:08:23.156996 23702 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:23.158962 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:23.158321 24884 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:23.187455 23702 raft_consensus.cc:2955] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:08:23.183660 23769 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.019s	sys 0.059s
I20260709 13:08:23.209154 23703 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:08:23.206939 23769 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.020s	sys 0.059s
I20260709 13:08:23.269429 24909 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:23.270085 24909 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:23.274484 24909 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:23.279232 24903 log.cc:927] Time spent T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:08:23.301362 23697 raft_consensus.cc:2955] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.335109 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:23.338843 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:23.354338 24881 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:23.357053 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:23.358263 24867 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:23.363586 24911 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.122s	user 0.000s	sys 0.004s
I20260709 13:08:23.372180 24896 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:23.373867 24389 raft_consensus.cc:2955] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.378150 24881 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:23.380671 24867 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:23.381068 24867 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:23.382001 24867 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:23.383204 24867 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.384275 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:23.433758 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:23.434562 24892 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:23.476436 23526 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 207) took 1119 ms. Trace:
I20260709 13:08:23.487679 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:23.489941 24892 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:23.490975 23525 catalog_manager.cc:5697] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.476868 23526 rpcz_store.cc:276] 0709 13:08:22.359710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.362737 (+  3027us) service_pool.cc:224] Handling call
0709 13:08:23.476341 (+1113604us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:23.186595 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:23.252677 (+ 66082us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:23.252729 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:08:23.252763 (+    34us) tablet.cc:662] Decoding operations
0709 13:08:23.253588 (+   825us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:23.253671 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:23.253719 (+    48us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:23.254258 (+   539us) tablet.cc:701] Row locks acquired
0709 13:08:23.254287 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:08:23.254492 (+   205us) write_op.cc:270] Start()
0709 13:08:23.254653 (+   161us) write_op.cc:276] Timestamp: P: 1783602503254434 usec, L: 0
0709 13:08:23.254687 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:08:23.290743 (+ 36056us) log.cc:844] Serialized 1693 byte log entry
0709 13:08:23.426443 (+135700us) op_driver.cc:464] REPLICATION: finished
0709 13:08:23.453531 (+ 27088us) write_op.cc:301] APPLY: starting
0709 13:08:23.453649 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:23.453881 (+   232us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:23.454030 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:23.454779 (+   749us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:23.455036 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:08:23.455107 (+    71us) write_op.cc:312] APPLY: finished
0709 13:08:23.455418 (+   311us) log.cc:844] Serialized 40 byte log entry
0709 13:08:23.455596 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.455688 (+    92us) write_op.cc:454] Released schema lock
0709 13:08:23.458715 (+  3027us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:23.465601 (+  6886us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.465645 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":26825,"apply.run_cpu_time_us":2571,"apply.run_wall_time_us":5523,"num_ops":4,"prepare.queue_time_us":569356,"prepare.run_cpu_time_us":14877,"prepare.run_wall_time_us":137212,"raft.queue_time_us":84816,"raft.run_cpu_time_us":1039,"raft.run_wall_time_us":31892,"replication_time_us":171594,"thread_start_us":631127,"threads_started":4,"wal-append.queue_time_us":43999}]]}
I20260709 13:08:23.494568 23525 catalog_manager.cc:5697] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.510041 23525 catalog_manager.cc:5697] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.539943 23525 catalog_manager.cc:5697] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index 2 to 3, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.553903 23770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:23.554740 23770 raft_consensus.cc:606] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:23.592723 23625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:08:23.593307 23625 raft_consensus.cc:606] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Received request to transfer leadership to TS 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:23.597086 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a97c483343c425ea75f1f6632924819"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:23.597766 23771 raft_consensus.cc:606] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:23.601539 23696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
mode: GRACEFUL
new_leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:48074
I20260709 13:08:23.602309 23696 raft_consensus.cc:606] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Received request to transfer leadership to TS 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:23.606060 23770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a325d91f6c384021a7930b39886904d2"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:23.606848 23770 raft_consensus.cc:606] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:23.612334 23770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa38658745b04f268c400fe20554d483"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:23.615878 23770 raft_consensus.cc:606] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:23.614132 23771 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:23.624369 23696 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:23.642443 23778 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:23.652542 23625 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:23.654362 23770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:23.655088 23770 raft_consensus.cc:606] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:23.655750 24392 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:23.660549 23620 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:23.659317 24889 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:08:23.662649 24883 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:23.669816 23704 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:23.671566 24788 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:23.675707 24389 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:23.678299 24788 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:23.682631 24389 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:23.683699 24883 raft_consensus.cc:2955] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.686069 24832 raft_consensus.cc:993] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:08:23.684568 24843 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:08:23.688300 24391 raft_consensus.cc:2955] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.692471 23770 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:23.697218 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:08:23.696401 24788 raft_consensus.cc:2955] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.688366 24832 raft_consensus.cc:1081] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Signalling peer b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:08:23.699113 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:23.700058 24394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:46580
I20260709 13:08:23.700663 24394 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.701046 24394 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.699124 24389 raft_consensus.cc:2955] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.712543 24394 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:23.704101 23704 raft_consensus.cc:2955] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.720332 24753 raft_consensus.cc:2955] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.724376 23513 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2906fc04ac3a43e5a91763bfbd1ff990 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:23.723383 24390 raft_consensus.cc:2955] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.736682 23511 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 37a8de42d0d8417f9ad5486f22fdbf73 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:23.729823 24909 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:23.750623 23525 catalog_manager.cc:5697] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 3 to 4, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New cstate: current_term: 1 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.753154 24394 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:23.757376 24394 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:08:23.793434 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 57027.6us
I20260709 13:08:23.805492 23704 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:23.805536 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:23.809616 23696 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.806543 23512 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec11dcde267d48f4b479e4ffb468a0bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:23.816859 23768 tablet_service.cc:1558] Processing DeleteTablet for tablet 2906fc04ac3a43e5a91763bfbd1ff990 with delete_type TABLET_DATA_TOMBSTONED (TS 4466bf6d6cf84ee89e84ea074e3964c9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43444
I20260709 13:08:23.816526 23527 catalog_manager.cc:5697] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New cstate: current_term: 1 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.818009 23696 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:23.766160 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:23.821080 23770 raft_consensus.cc:3055] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:23.821511 23770 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:23.822467 23770 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:23.847240 24358 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:23.852320 23770 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.852331 24886 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:08:23.858201 23622 raft_consensus.cc:2955] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.864243 24835 raft_consensus.cc:993] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: : Instructing follower 4466bf6d6cf84ee89e84ea074e3964c9 to start an election
I20260709 13:08:23.865974 24811 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:23.870512 24884 raft_consensus.cc:1081] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Signalling peer 4466bf6d6cf84ee89e84ea074e3964c9 to start an election
I20260709 13:08:23.894078 24928 tablet_replica.cc:333] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:08:23.895645 24928 raft_consensus.cc:2243] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:23.917481 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 58907.2us
W20260709 13:08:23.920167 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63566.4us
I20260709 13:08:23.925943 23524 catalog_manager.cc:5697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 3 to 4, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.919530 23777 raft_consensus.cc:2955] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:23.899263 24838 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:08:23.941936 24928 raft_consensus.cc:2272] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:23.974633 24811 raft_consensus.cc:697] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:23.994413 24811 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:24.020700 24928 ts_tablet_manager.cc:1916] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:24.026213 24868 raft_consensus.cc:993] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:08:24.026889 24868 raft_consensus.cc:1081] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Signalling peer b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:08:24.029341 24394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa38658745b04f268c400fe20554d483"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:46580
I20260709 13:08:24.030082 24394 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:24.030526 24394 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.043659 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet 37a8de42d0d8417f9ad5486f22fdbf73 with delete_type TABLET_DATA_TOMBSTONED (TS c885217113574e7489e6c3afb6950f76 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45060
I20260709 13:08:24.053431 24394 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:24.065399 23614 tablet_service.cc:1558] Processing DeleteTablet for tablet ec11dcde267d48f4b479e4ffb468a0bc with delete_type TABLET_DATA_TOMBSTONED (TS 9ab488f10c434878a749f261e99a8065 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52038
I20260709 13:08:24.088608 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:24.089563 23626 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.086654 24394 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:24.111217 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 189809us
I20260709 13:08:24.120900 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:24.121603 23777 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:24.121908 23777 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:24.122611 23777 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:24.140993 23777 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.155328 23777 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:24.158135 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:24.159245 24811 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:24.184880 23626 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:24.218091 23770 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:24.210318 24932 raft_consensus.cc:2955] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:24.207619 24938 tablet_replica.cc:333] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:08:24.237816 24939 tablet_replica.cc:333] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:08:24.238349 24935 raft_consensus.cc:993] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:08:24.238914 24935 raft_consensus.cc:1081] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:08:24.243794 24901 raft_consensus.cc:993] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: : Instructing follower 4466bf6d6cf84ee89e84ea074e3964c9 to start an election
I20260709 13:08:24.244415 24896 raft_consensus.cc:1081] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Signalling peer 4466bf6d6cf84ee89e84ea074e3964c9 to start an election
W20260709 13:08:24.263912 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 67522.2us
I20260709 13:08:24.275192 24811 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:24.282606 23777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:43460
I20260709 13:08:24.283351 23777 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:24.283831 23777 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.279175 23770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:43456
I20260709 13:08:24.295243 23770 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:24.295743 23770 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:24.296722 23777 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:24.302282 24811 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:24.306015 23777 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:24.328081 24928 ts_tablet_manager.cc:1929] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:24.336130 24928 log.cc:1199] T 2906fc04ac3a43e5a91763bfbd1ff990 P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/wals/2906fc04ac3a43e5a91763bfbd1ff990
W20260709 13:08:24.597605 24949 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:08:24.765793 24938 raft_consensus.cc:2243] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:24.766970 24938 raft_consensus.cc:2272] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:24.769642 24938 ts_tablet_manager.cc:1916] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:24.793583 24938 ts_tablet_manager.cc:1929] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:24.794027 24938 log.cc:1199] T 37a8de42d0d8417f9ad5486f22fdbf73 P c885217113574e7489e6c3afb6950f76: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/wals/37a8de42d0d8417f9ad5486f22fdbf73
I20260709 13:08:24.801643 24932 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:24.802248 24932 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:24.806623 24932 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:24.826965 24939 raft_consensus.cc:2243] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:24.716817 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:24.868570 23770 consensus_meta.cc:287] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.006s
I20260709 13:08:24.869081 23770 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:24.872094 23770 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:24.858739 23525 catalog_manager.cc:5697] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 2 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.892401 23777 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:24.894219 24943 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:24.895327 23776 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:24.898185 24943 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:24.907284 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet 37a8de42d0d8417f9ad5486f22fdbf73 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:24.932615 23701 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:24.945086 24939 raft_consensus.cc:2272] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:24.954195 23622 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:24.957760 24843 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:24.958343 24843 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:24.961313 24843 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:24.964130 23696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a97c483343c425ea75f1f6632924819"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:08:24.965075 23696 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:24.965190 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:24.965548 23696 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.965793 23704 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:24.966228 23704 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:24.965689 23697 raft_consensus.cc:2955] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:24.966928 23704 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:24.967842 23704 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.974431 24939 ts_tablet_manager.cc:1916] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:24.974756 23704 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:24.998018 23776 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:24.990909 24943 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:08:25.023692 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:25.009285 24960 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:25.031950 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 141815us
I20260709 13:08:25.027331 24822 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:25.036502 24822 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.033689 24960 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.045070 24964 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:08:25.048063 24951 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:25.048625 24951 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.050839 24951 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:25.054860 24822 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:25.071624 24788 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:25.074885 24788 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.057132 23696 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.081007 24788 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:25.086421 24944 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:25.100425 24944 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:25.103536 24944 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:25.107185 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 76926.6us
I20260709 13:08:25.109681 24958 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 13:08:25.119565 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 80998us
I20260709 13:08:25.134871 24960 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:25.138379 23696 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:25.135927 23511 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3473b09c073142659e12a365e9aed3f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:25.136128 24958 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.184679 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:25.191944 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:25.192188 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:25.201403 23625 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.205519 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:25.194882 23777 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:25.196743 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:25.206229 23772 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.206467 23775 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:25.206625 23772 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:25.202670 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:25.201063 24943 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:25.209343 24943 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:25.202756 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:25.203451 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:25.196295 24811 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:25.211766 24811 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:25.212966 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:25.213752 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:25.214346 24811 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:25.194527 23511 catalog_manager.cc:5028] TS 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): tablet 2906fc04ac3a43e5a91763bfbd1ff990 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:25.202163 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:25.151824 24958 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:25.216461 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:25.207635 23772 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.221661 23772 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.222878 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:25.228521 24943 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:25.216152 23622 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:25.229265 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:25.232231 24357 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:25.233626 24943 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.237411 23592 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:25.238372 24822 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:25.238881 24822 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.239315 24822 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:25.239785 24939 ts_tablet_manager.cc:1929] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:25.240219 24939 log.cc:1199] T ec11dcde267d48f4b479e4ffb468a0bc P 9ab488f10c434878a749f261e99a8065: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/wals/ec11dcde267d48f4b479e4ffb468a0bc
I20260709 13:08:25.240334 24958 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.241441 24939 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52038 (request call id 75) took 1176 ms. Trace:
I20260709 13:08:25.241663 24958 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.244436 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:25.237315 24387 raft_consensus.cc:2955] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:25.245648 24935 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:25.246088 24935 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:25.246081 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:25.247439 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47294us
I20260709 13:08:25.246503 24935 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.253435 23772 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:25.246493 23593 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:25.255465 23625 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
W20260709 13:08:25.263191 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 135723us
I20260709 13:08:25.272840 24947 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.241837 24939 rpcz_store.cc:276] 0709 13:08:24.064674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.064981 (+   307us) service_pool.cc:224] Handling call
0709 13:08:24.203089 (+138108us) ts_tablet_manager.cc:1151] Deleting tablet ec11dcde267d48f4b479e4ffb468a0bc
0709 13:08:24.204040 (+   951us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:25.206336 (+1002296us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:25.239626 (+ 33290us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:25.241357 (+  1731us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":705150,"tablet-delete.queue_time_us":121183,"thread_start_us":80545,"threads_started":1}
I20260709 13:08:25.273481 23743 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:25.268860 24822 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.275043 23513 catalog_manager.cc:5028] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): tablet ec11dcde267d48f4b479e4ffb468a0bc (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:25.279951 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:25.278805 24934 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:25.283419 24934 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:25.284454 24934 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.290697 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:25.291424 23620 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.295886 23527 catalog_manager.cc:5697] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 2 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:25.297909 24951 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:25.301806 24951 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:25.304155 24951 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:25.305724 24822 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:25.306900 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:25.308049 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:25.311932 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:25.312637 24965 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:25.313235 24965 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.312891 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:25.312831 23697 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:25.317140 24843 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:25.317718 24843 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:25.320356 23701 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.321192 23699 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:25.324878 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:25.326943 24843 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:25.330271 24965 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:25.334447 23667 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:25.337798 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:25.338393 24966 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.339919 23701 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:25.341679 24966 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:25.345386 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:25.370007 24966 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:25.350749 23620 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:25.353235 23525 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 115) took 1093 ms. Trace:
I20260709 13:08:25.360140 24935 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.363142 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:25.363387 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:25.364147 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:25.379575 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:25.365059 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:25.376822 23704 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:25.379694 23702 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:25.381325 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:25.371912 23525 rpcz_store.cc:276] 0709 13:08:24.260083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.260233 (+   150us) service_pool.cc:224] Handling call
0709 13:08:25.353178 (+1092945us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:25.065869 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:25.066751 (+   882us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:25.066806 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:08:25.066825 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:25.067234 (+   409us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:25.067309 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:25.067343 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:25.067541 (+   198us) tablet.cc:701] Row locks acquired
0709 13:08:25.067561 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:25.067718 (+   157us) write_op.cc:270] Start()
0709 13:08:25.067879 (+   161us) write_op.cc:276] Timestamp: P: 1783602505067665 usec, L: 0
0709 13:08:25.067903 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:25.107203 (+ 39300us) log.cc:844] Serialized 532 byte log entry
0709 13:08:25.303395 (+196192us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b180010cea0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:08:25.348350 (+ 44955us) op_driver.cc:464] REPLICATION: finished
0709 13:08:25.349818 (+  1468us) write_op.cc:301] APPLY: starting
0709 13:08:25.349904 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:25.350012 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:25.350034 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:25.350273 (+   239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:25.350432 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:25.350479 (+    47us) write_op.cc:312] APPLY: finished
0709 13:08:25.350812 (+   333us) log.cc:844] Serialized 22 byte log entry
0709 13:08:25.350980 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.351054 (+    74us) write_op.cc:454] Released schema lock
0709 13:08:25.351096 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:25.356215 (+  5119us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.356257 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":414648,"reported_tablets":2,"spinlock_wait_cycles":100480,"child_traces":[["op",{"apply.queue_time_us":1165,"apply.run_cpu_time_us":1537,"apply.run_wall_time_us":1685,"num_ops":1,"prepare.queue_time_us":181519,"prepare.run_cpu_time_us":17328,"prepare.run_wall_time_us":154129,"raft.queue_time_us":47789,"raft.run_cpu_time_us":1894,"raft.run_wall_time_us":16420,"replication_time_us":280291,"spinlock_wait_cycles":42583552,"thread_start_us":323111,"threads_started":4,"wal-append.queue_time_us":121255}]]}
I20260709 13:08:25.392270 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:25.392944 23774 raft_consensus.cc:606] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:25.399312 24935 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:25.399698 23772 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:25.405984 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:25.406821 23627 raft_consensus.cc:2368] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4.
I20260709 13:08:25.371186 24966 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.408136 23743 leader_election.cc:400] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4.
I20260709 13:08:25.408452 23743 leader_election.cc:403] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:25.410179 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:25.410820 23774 raft_consensus.cc:606] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:25.415990 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa38658745b04f268c400fe20554d483"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:25.416712 23774 raft_consensus.cc:606] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Received request to transfer leadership to TS b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:25.417235 23774 raft_consensus.cc:614] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:25.419950 23702 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:25.426263 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:25.437391 23628 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:25.440407 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:25.389480 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:25.453038 23772 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:25.453987 24932 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4.
I20260709 13:08:25.485495 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:25.486459 23774 raft_consensus.cc:606] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:25.774305 24943 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:25.775111 24943 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:25.778007 24943 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:25.780689 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:25.794157 24942 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:25.794965 24942 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.798128 24942 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:25.798864 24942 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:25.802336 24953 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:25.803145 24953 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.806279 24953 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:25.808085 24934 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:25.808826 24934 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:25.811892 24953 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:25.812563 24953 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.815026 24953 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:25.799562 24942 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:25.818243 24942 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:25.811654 24934 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:25.838200 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:25.848227 24838 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:25.848658 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:25.848868 24838 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.849048 24934 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:25.849931 24934 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:25.851109 24838 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:25.851922 24838 raft_consensus.cc:993] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:08:25.863080 24942 raft_consensus.cc:1081] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Signalling peer b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:08:25.863133 24934 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:25.954749 24936 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.955489 24936 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:26.280887 24936 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:26.334179 24932 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:26.334901 24932 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:26.337790 24932 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:26.386611 24934 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:26.406801 24936 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:26.422607 24811 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:26.446950 24387 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:46580
I20260709 13:08:26.463400 24387 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.463112 24811 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.463903 24387 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.465517 24811 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:26.466017 24811 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:26.466432 24811 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.468842 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:26.459791 24838 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:26.469496 24936 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:26.470101 24838 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:26.471946 24936 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:26.472189 24838 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:26.474982 24387 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.463068 24934 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.477397 24387 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:26.461985 24978 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:26.477699 24934 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:26.478894 24811 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:26.478456 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:26.482138 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:26.483026 23774 raft_consensus.cc:3055] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:26.483409 23774 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:26.484172 23774 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.485129 23774 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.486610 24942 raft_consensus.cc:993] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:08:26.487126 24942 raft_consensus.cc:1081] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Signalling peer b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:08:26.479066 24980 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:26.488314 24980 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.488696 24387 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:46580
I20260709 13:08:26.489347 24387 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.489710 24387 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.479710 24978 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.496831 24387 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.498478 24980 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:26.500353 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:26.500479 24387 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:26.500442 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:26.500991 23776 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:26.501343 23770 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:26.502941 24357 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:26.501340 23776 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:26.503608 24980 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:26.504070 24980 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:26.499897 24978 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:26.504588 24980 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.504415 23776 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.504384 23774 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:26.505628 23776 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.506353 24357 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:26.512137 24978 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:26.512550 24980 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.513058 24978 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:26.514755 24978 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.515870 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:26.516798 23774 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.512383 23776 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:26.514845 24980 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:26.523093 24357 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:26.524375 24980 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:26.525363 24980 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:26.526327 24980 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.528133 24953 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:26.528887 23774 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:26.528683 24953 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:26.530110 24357 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:26.530959 24811 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:26.531340 24982 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:26.531926 24982 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:26.537204 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 922) took 1230 ms. Trace:
I20260709 13:08:26.549441 24811 raft_consensus.cc:697] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:26.552881 24982 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:26.541677 23772 rpcz_store.cc:276] 0709 13:08:25.306478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.306612 (+   134us) service_pool.cc:224] Handling call
0709 13:08:26.536870 (+1230258us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b54000a41d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:26.537067 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211867520}
I20260709 13:08:26.555984 24953 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:26.552789 24811 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.562265 24980 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:26.562912 24980 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.566049 24980 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:26.566593 23743 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.657s (SENT)
I20260709 13:08:26.568724 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:26.570230 23772 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:26.572337 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:26.573712 24811 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:26.574112 24811 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:26.574541 24811 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.578485 24980 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:26.579142 24980 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.581670 24980 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:26.582237 24980 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:26.582741 24980 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.585465 24980 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:26.584661 24811 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.588068 24811 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:26.589145 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:26.589849 23772 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.593392 23527 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 213) took 1308 ms. Trace:
I20260709 13:08:26.593427 24811 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:26.594242 24811 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:26.593972 23527 rpcz_store.cc:276] 0709 13:08:25.284557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.284721 (+   164us) service_pool.cc:224] Handling call
0709 13:08:26.593316 (+1308595us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:25.327688 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:25.328587 (+   899us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:25.328617 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:08:25.328632 (+    15us) tablet.cc:662] Decoding operations
0709 13:08:25.328979 (+   347us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:25.329022 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:25.329049 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:25.329235 (+   186us) tablet.cc:701] Row locks acquired
0709 13:08:25.329254 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:25.329400 (+   146us) write_op.cc:270] Start()
0709 13:08:25.329531 (+   131us) write_op.cc:276] Timestamp: P: 1783602505329342 usec, L: 0
0709 13:08:25.329552 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:25.330169 (+   617us) log.cc:844] Serialized 532 byte log entry
0709 13:08:25.359758 (+ 29589us) op_driver.cc:464] REPLICATION: finished
0709 13:08:25.360136 (+   378us) write_op.cc:301] APPLY: starting
0709 13:08:25.385925 (+ 25789us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:25.425241 (+ 39316us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:25.446158 (+ 20917us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:25.446477 (+   319us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:25.452066 (+  5589us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:25.452126 (+    60us) write_op.cc:312] APPLY: finished
0709 13:08:25.452438 (+   312us) log.cc:844] Serialized 22 byte log entry
0709 13:08:25.452634 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.452718 (+    84us) write_op.cc:454] Released schema lock
0709 13:08:25.452760 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:25.453117 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.453154 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":137,"apply.run_cpu_time_us":2226,"apply.run_wall_time_us":92905,"num_ops":1,"prepare.queue_time_us":11510,"prepare.run_cpu_time_us":2494,"prepare.run_wall_time_us":2726,"replication_time_us":30043}]]}
I20260709 13:08:26.600560 24811 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:26.602816 23558 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8ba0 after lost signal to thread 22483
W20260709 13:08:26.604084 23558 debug-util.cc:398] Leaking SignalData structure 0x7b080003ef80 after lost signal to thread 23561
W20260709 13:08:26.605398 23558 debug-util.cc:398] Leaking SignalData structure 0x7b080031d280 after lost signal to thread 23653
W20260709 13:08:26.656020 23558 debug-util.cc:398] Leaking SignalData structure 0x7b080012cbc0 after lost signal to thread 23728
W20260709 13:08:26.657338 23558 debug-util.cc:398] Leaking SignalData structure 0x7b080034b1a0 after lost signal to thread 23802
W20260709 13:08:26.658357 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 1.22052e+06us
W20260709 13:08:26.658737 23558 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2820 after lost signal to thread 24418
W20260709 13:08:26.720726 23697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.020s	sys 0.002s
W20260709 13:08:26.721203 23697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.020s	sys 0.002s
I20260709 13:08:27.082424 24979 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.083209 24979 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.085805 24979 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.086566 24979 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.096995 24979 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.104305 24979 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.106204 24979 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.106966 24979 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.109488 24979 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.110150 24979 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.110790 24979 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.113351 24979 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.114063 24979 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:27.114737 24979 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.117476 24979 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.118175 24979 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:27.118791 24979 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.121537 24979 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.122244 24979 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:27.122896 24979 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.125592 24979 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.126245 24979 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.126921 24979 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.129565 24979 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.206039 24995 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:27.206734 24995 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.214610 24993 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.215432 24993 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.218614 24993 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.225641 24979 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.244987 24999 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.242357 24942 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:08:27.262979 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 348525us
I20260709 13:08:27.248747 24985 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.261847 24995 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.268417 25000 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.259506 24979 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.269189 25000 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.278620 24979 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.279028 25000 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.279444 24979 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.280637 23771 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:27.281086 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:27.281168 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:27.281737 23775 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:27.282003 24390 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:27.264588 24999 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.284122 23770 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:27.285497 24994 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.264097 24942 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:27.289324 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.289682 24999 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:27.290213 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.282320 24838 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:27.292027 24953 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.292152 24838 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.292587 24953 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.294425 24838 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.294539 24953 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.295027 24838 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.295640 23777 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:27.286039 24994 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.300906 24950 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:27.300977 24967 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:27.300755 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 20) took 1926 ms. Trace:
I20260709 13:08:27.305433 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:27.306279 23776 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:27.298038 24942 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.302279 23697 rpcz_store.cc:276] 0709 13:08:25.372989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.375587 (+  2598us) service_pool.cc:224] Handling call
0709 13:08:25.376142 (+   555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.419646 (+ 43504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.419677 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.439469 (+ 19792us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.721693 (+1282224us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:26.723515 (+  1822us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.299463 (+575948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.299537 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.299586 (+    49us) raft_consensus.cc:1685] finished
0709 13:08:27.299601 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.299747 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":979907,"prepare.queue_time_us":1703,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":43308,"raft.run_cpu_time_us":3029,"raft.run_wall_time_us":22170,"thread_start_us":1283128,"threads_started":2,"wal-append.queue_time_us":403767}
I20260709 13:08:27.268013 24985 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.300033 24843 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.308817 24956 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.309293 24843 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.309844 24357 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:27.300061 24953 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:27.287598 24979 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.312806 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:27.301718 24967 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.295542 24838 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.416935 24388 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:27.301553 24950 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.414700 24953 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.426080 24357 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:27.427527 24994 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.428471 24953 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.429260 25000 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:27.309404 24956 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.430786 24995 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.431242 24995 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:27.312826 24996 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:08:27.432521 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:27.431620 24995 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.313938 24999 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.435132 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:27.437665 23776 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:27.438185 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:27.313035 24993 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:08:27.437680 24999 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.443145 24999 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.446635 24979 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.448406 24985 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.451046 24838 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.453670 24950 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.454537 24936 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.455075 24936 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.455556 24936 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.451150 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:27.460966 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:27.461706 24391 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:27.462944 23742 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:27.468470 24993 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.434155 24967 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.462082 24953 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.468284 24994 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.470818 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:27.472723 24388 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:27.472497 24994 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.472173 24993 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.473309 24994 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.476114 23742 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:27.479421 24993 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:27.479518 24979 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.480131 24979 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.474150 24953 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.481899 24953 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:27.474237 23772 consensus_meta.cc:287] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.884s	user 0.012s	sys 0.009s
I20260709 13:08:27.483083 23772 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:27.484387 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:27.485464 24993 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:27.486341 24993 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:27.487251 24843 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.480517 24979 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.499373 24995 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.500990 24393 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:27.503521 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:27.504515 23772 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.511821 24357 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:27.512751 24996 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.513248 24996 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.513676 24996 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.518669 24994 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.520462 24956 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.524121 24993 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.532678 24388 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:27.534487 24936 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.524461 24999 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.528810 24987 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.538728 24987 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.541191 24987 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.541399 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:27.542068 24390 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.543381 24999 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.543915 24995 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.530308 24996 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.545246 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:27.548005 24967 consensus_queue.cc:1059] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:08:27.550786 24391 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:27.550976 24967 consensus_queue.cc:1243] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer b1e32a12daf44ebbbd71cc3ce41d7d8e log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:27.547060 24990 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:27.551527 24967 raft_consensus.cc:3055] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:27.551771 24936 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.551995 24967 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:27.543121 24953 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.549454 24390 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:27.553303 24996 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.553113 24967 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.547636 24979 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.554385 24967 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.554314 23742 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:27.549185 23772 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:27.551620 24990 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.549878 24994 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.562438 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:27.562862 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 2.12232e+06us
I20260709 13:08:27.563217 23774 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 2: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:27.564881 24998 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:27.566699 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:27.567456 23775 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 2: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:27.569267 23525 catalog_manager.cc:5697] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 3 to 4, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New cstate: current_term: 1 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.564931 24392 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:27.573472 24357 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:27.565688 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:27.562209 24936 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:27.573805 23525 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 2, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.573316 24950 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.582993 25007 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:27.583213 24987 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.583263 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:27.583910 24987 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.584652 24393 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:27.585309 24979 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.585958 24990 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.586092 24987 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.583153 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:27.580881 24995 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:27.587535 24995 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:27.584113 24950 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.581911 24956 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.590512 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:27.592427 24985 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:27.592566 24393 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:27.592566 24900 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:27.593010 24985 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.593465 24900 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.596479 24900 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.578215 24951 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:27.565424 24998 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.584170 24881 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.579958 24388 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.597280 24843 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.582949 24936 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:27.588788 24953 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.608672 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:27.609473 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:27.595589 24985 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.607692 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:27.609019 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:27.619560 23773 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:27.583663 25007 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:27.623845 25005 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:08:27.607631 25008 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:27.599115 24956 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.635453 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:27.637705 24387 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:27.643869 24956 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.644093 23778 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:27.603819 24951 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:27.640177 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 43738.6us
I20260709 13:08:27.646559 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:27.624365 24966 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.605540 24881 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.625957 24985 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.652554 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:27.652891 25003 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:08:27.608848 24843 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.648420 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:27.657011 23725 debug-util.cc:398] Leaking SignalData structure 0x7b080015fc00 after lost signal to thread 22483
I20260709 13:08:27.660175 24985 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.601910 24995 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.667816 23770 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:27.668473 23774 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:27.668570 25001 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:27.670070 24985 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.648181 24966 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.673422 24966 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.683207 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:27.689013 23667 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:08:27.695314 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.697937 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:27.701085 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:27.691514 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.705430 25006 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.706108 25006 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.706640 25006 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.648612 25008 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.689293 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:27.685297 24896 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:27.717072 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:27.692013 24951 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.692776 25001 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.692229 24990 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:27.717689 23778 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:27.712531 23725 debug-util.cc:398] Leaking SignalData structure 0x7b0800100bc0 after lost signal to thread 23561
I20260709 13:08:27.719754 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:27.722397 23775 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:27.675835 24936 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.720454 23769 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:27.724500 25001 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.726358 24990 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.744349 24950 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.756981 24843 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:27.752961 23725 debug-util.cc:398] Leaking SignalData structure 0x7b08003582a0 after lost signal to thread 23653
I20260709 13:08:27.720749 24896 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:27.750468 24947 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:08:27.770692 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 103390us
I20260709 13:08:27.758230 24998 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.773911 25006 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:27.774784 23725 debug-util.cc:398] Leaking SignalData structure 0x7b0800358220 after lost signal to thread 23654
I20260709 13:08:27.797250 25022 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:27.797962 25022 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:27.799953 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.800665 25022 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:27.798511 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:27.802789 24998 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:27.804082 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:27.805496 24998 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:27.809952 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:27.891697 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:27.921217 23700 raft_consensus.cc:2368] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4.
I20260709 13:08:27.918816 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.919174 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.919575 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.734560 25014 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:08:27.924443 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.924877 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.927043 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.885216 24843 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:27.864106 25006 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:27.932374 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 230973us
W20260709 13:08:27.931157 23725 debug-util.cc:398] Leaking SignalData structure 0x7b08003477c0 after lost signal to thread 23728
I20260709 13:08:27.816494 25013 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.934839 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:27.935101 24900 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:27.937012 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:27.940842 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.942740 23695 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:27.935576 24867 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:08:27.936595 23725 debug-util.cc:398] Leaking SignalData structure 0x7b0800347800 after lost signal to thread 23729
I20260709 13:08:27.957512 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.952176 23698 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:27.952006 24393 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
W20260709 13:08:27.958916 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 261060us
I20260709 13:08:27.935676 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:27.970461 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.926229 24881 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:27.972659 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.974097 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:27.975184 23668 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:27.954562 25014 consensus_queue.cc:1243] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer b1e32a12daf44ebbbd71cc3ce41d7d8e log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:27.978992 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.959676 24859 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:27.783763 24947 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.944551 25008 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:27.992352 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.977685 23703 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:28.020797 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:27.961282 24959 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:27.954378 25013 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:28.027241 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:27.957078 24950 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:08:28.027984 23703 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:27.957871 24867 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.019434 24951 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.019618 24956 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.020004 25022 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:08:28.028220 23725 debug-util.cc:398] Leaking SignalData structure 0x7b08003368c0 after lost signal to thread 23802
W20260709 13:08:28.049736 23725 debug-util.cc:398] Leaking SignalData structure 0x7b0800331da0 after lost signal to thread 23803
I20260709 13:08:28.050423 24966 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:28.051045 23725 debug-util.cc:398] Leaking SignalData structure 0x7b080024f380 after lost signal to thread 24418
I20260709 13:08:27.985010 24392 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:28.027868 25013 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.054435 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.021849 24881 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:28.038625 24998 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.065387 24881 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:28.066217 24998 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:27.971114 24900 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.034183 24951 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:28.032510 25008 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:28.045802 24896 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:28.034066 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.032219 25023 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:28.018953 24859 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.036811 24956 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:28.049157 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.045615 24950 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:28.141317 23699 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:28.070604 23668 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:28.072117 24951 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.047569 24388 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
W20260709 13:08:28.145589 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 75077.8us
I20260709 13:08:28.128192 24881 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:28.129880 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 57493.8us
I20260709 13:08:28.071034 24998 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.080266 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:28.068564 24990 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.132642 24900 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:28.159641 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 63617.7us
I20260709 13:08:28.036791 24959 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.139905 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.157320 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.157711 23592 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:28.127815 25013 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:28.181612 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.217831 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 60431.7us
I20260709 13:08:28.142784 24956 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.143438 25008 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:28.141674 24950 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:28.072446 25022 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:28.223483 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.143420 25038 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:28.229755 25030 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:28.159585 25014 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.231392 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.145470 25001 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.159389 24987 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.143980 25028 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:08:28.244753 23743 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.657s (SENT)
I20260709 13:08:28.159413 23701 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:28.145198 25033 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:28.243234 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 163102us
I20260709 13:08:28.247390 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.247454 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.252902 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:28.247715 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.254158 23699 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:28.253028 23627 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:28.253754 23628 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:28.228916 24990 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:28.238571 25008 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:28.255620 25014 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:28.258751 24967 consensus_meta.cc:287] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.005s
I20260709 13:08:28.259786 23700 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:28.258543 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.276321 25029 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:28.276731 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:28.277216 25029 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.277503 23667 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:28.231297 25037 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:28.142109 25023 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.252758 24987 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:28.287150 25021 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:28.285782 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.293618 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:28.294260 23774 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.288352 23624 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:28.321866 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.259855 25038 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.288368 24900 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:28.324592 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.325229 23773 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:28.325347 23620 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:28.296245 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.280400 24990 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.296768 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.289202 24987 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.333120 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.283805 24881 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:28.332290 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.334200 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.364785 23778 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:28.364424 23624 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:28.258749 25030 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.367432 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.284526 24985 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:08:28.371985 23629 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:28.328377 24990 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:28.373577 23774 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:28.375120 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.331864 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.375793 23629 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:28.377817 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.381244 23624 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:28.381588 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.382251 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.382655 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.383889 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.380371 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.378504 24859 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.265942 25033 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.324371 24900 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:28.384886 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.379370 25035 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:28.386878 23629 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:28.335371 24994 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:08:28.374305 24990 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.289412 25028 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.379153 25023 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.392556 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.370500 25044 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:28.396322 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:28.328054 24950 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:28.399986 25036 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.161s	user 0.000s	sys 0.002s
I20260709 13:08:28.369946 24881 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:28.287865 25021 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.402439 25041 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:28.422295 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.402536 25032 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.400209 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.398586 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.406852 25008 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:28.408167 25013 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.410284 23629 raft_consensus.cc:2376] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3. Re-sending same reply.
I20260709 13:08:28.419137 23626 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:28.321589 25037 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.403026 25045 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:28.423439 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 146854us
I20260709 13:08:28.416280 25035 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:28.424716 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.422149 25038 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.461206 23742 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:28.461863 25033 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.462142 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:28.451776 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.455519 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.406533 24951 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:28.448330 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 290693us
I20260709 13:08:28.421418 23623 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:28.469180 23778 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:28.470882 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.424906 25032 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:28.469180 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:28.470324 24393 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:28.471668 23774 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:28.473753 23774 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:28.441646 24959 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.474171 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.448305 25023 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.417255 25044 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.450309 25029 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.476378 23777 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:28.462844 24859 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:28.489784 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.463028 25045 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.464618 25040 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:28.552986 23776 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:28.446833 25041 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:28.492707 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.468034 24953 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.511925 24393 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:28.511693 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.613468 23698 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:28.614322 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.598906 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.596767 24386 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:28.601763 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.601954 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:28.602231 23621 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.618470 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.493531 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.604211 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.600067 25045 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:28.627801 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.492823 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.608274 25040 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.609233 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:28.495198 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:28.474915 25032 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.631285 23776 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:28.596205 23593 connection.cc:256] RPC call timeout handler was delayed by -1.5604511660000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 13:08:28.617779 23624 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:28.508340 25050 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:28.612464 24953 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:28.617287 25028 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.483443 25023 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.510545 25047 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.510773 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:28.556576 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:28.619365 25037 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.596187 25022 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.629269 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.610334 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.492661 25007 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:28.631451 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:28.631490 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:28.632508 23695 raft_consensus.cc:2368] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4.
I20260709 13:08:28.616142 24859 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.632424 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.603638 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:28.633386 23593 connection.cc:256] RPC call timeout handler was delayed by -1.5460511659999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260709 13:08:28.633548 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 138463us
I20260709 13:08:28.507846 25035 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:28.633675 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:28.915257 23593 connection.cc:256] RPC call timeout handler was delayed by -1.5345130760000529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 13:08:28.915964 23593 connection.cc:256] RPC call timeout handler was delayed by -1.4611504380000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 13:08:28.916484 23593 connection.cc:256] RPC call timeout handler was delayed by -1.419750438000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 13:08:28.918551 23593 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:28.913785 23629 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:28.913686 24393 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:28.934403 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:28.933450 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.589640 25021 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.951905 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.951481 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.950774 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.956051 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.957149 23667 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:28.950912 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.950676 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.966063 23776 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
W20260709 13:08:28.966084 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 47610.1us
I20260709 13:08:28.966492 23695 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:28.967260 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:28.966602 23622 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:28.940169 23703 raft_consensus.cc:2376] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3. Re-sending same reply.
I20260709 13:08:28.942313 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.899905 23621 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:28.969018 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:28.971203 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.633244 25050 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:28.969825 24965 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:28.925457 24953 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.974061 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:28.975085 25050 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.854362 25041 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:28.980316 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.644114 24979 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:28.977610 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.978433 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.643666 23696 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:28.958416 24951 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:28.629180 24956 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:28.980432 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:28.970395 24987 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.000s
I20260709 13:08:28.941623 25047 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:28.971712 23667 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:28.969728 23698 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:28.971159 25028 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:28.987000 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:28.975970 24901 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:28.975274 24965 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:29.000519 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.982251 25037 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:08:28.985123 25049 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.004374 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.974578 25021 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:08:29.004765 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.006707 24391 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.009727 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.008075 24843 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:29.015334 23667 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:29.003042 24859 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.020274 23695 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:29.011170 24901 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.033893 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:29.034509 23698 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.030434 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:29.035543 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.037041 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.011289 25047 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.004419 25044 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.016124 24965 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.039461 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:28.990855 25041 consensus_queue.cc:1059] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:08:29.019282 25040 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.024477 24985 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:29.043814 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.033356 24901 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.011134 24987 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.058946 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.050267 23696 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:29.064301 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.064913 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1482) took 1016 ms. Trace:
I20260709 13:08:29.065366 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.029467 24843 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:29.065256 23699 rpcz_store.cc:276] 0709 13:08:28.048864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.231057 (+182193us) service_pool.cc:224] Handling call
0709 13:08:29.064745 (+833688us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b540008a2d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.064861 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16381184}
I20260709 13:08:29.067001 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.067490 23699 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:29.067034 24843 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.067926 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1483) took 1018 ms. Trace:
I20260709 13:08:29.062996 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.063657 24947 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.067983 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.065555 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.068972 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.033481 25026 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:29.061616 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.042212 25046 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.069905 23699 rpcz_store.cc:276] 0709 13:08:28.049220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.066814 (+1017594us) service_pool.cc:224] Handling call
0709 13:08:29.067862 (+  1048us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:29.038039 25028 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:08:29.048682 25037 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:08:29.079025 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 87700.8us
I20260709 13:08:29.079612 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.046922 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.054589 25021 consensus_queue.cc:1243] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:29.057754 24985 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:29.091805 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.096662 23620 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:29.097664 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.098767 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.099552 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.100435 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.101234 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.102041 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.091166 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.092103 23698 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:29.093417 24956 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:29.095213 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.095152 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.103078 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.103627 23622 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:29.103205 23702 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:29.104123 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:29.104394 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.104545 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1487) took 1054 ms. Trace:
I20260709 13:08:29.104918 23702 rpcz_store.cc:276] 0709 13:08:28.050536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.069481 (+1018945us) service_pool.cc:224] Handling call
0709 13:08:29.104495 (+ 35014us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:29.105389 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.105758 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.106412 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.107085 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.107548 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.107923 23702 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:29.108783 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:29.110535 25021 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:29.103210 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.112479 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.113834 25023 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.110119 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.114414 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.115556 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.069859 24994 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:29.128733 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.108783 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.124202 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.125783 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:29.124202 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.130100 23775 raft_consensus.cc:2410] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:29.134841 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.141251 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.142982 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.144560 23778 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.135198 23699 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:29.081812 25037 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:29.149114 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.163802 25037 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.164914 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.155524 23696 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:29.145855 25041 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:29.169423 25041 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:29.170112 25041 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.154762 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:29.150058 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.089195 25026 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:29.153698 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.116394 24985 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.156170 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.157302 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 26) took 1007 ms. Trace:
I20260709 13:08:29.158340 25058 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:29.165961 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.168809 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.172333 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.181119 23699 rpcz_store.cc:276] 0709 13:08:28.149792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.103866 (+954074us) service_pool.cc:224] Handling call
0709 13:08:29.157220 (+ 53354us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:29.178586 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.183835 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.165228 25037 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.189245 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.189455 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.189051 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.189129 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.200537 23773 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:29.202116 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.202720 23776 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.203306 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.204252 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.204771 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:29.134405 25049 consensus_queue.cc:1059] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:08:29.208235 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.211635 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.212067 25026 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.213457 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.213560 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:29.208309 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 96897.4us
I20260709 13:08:29.138827 24994 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.215224 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.215875 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.216831 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.217955 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.218431 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.221824 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:08:29.222078 23742 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.657s (SENT)
I20260709 13:08:29.222218 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.222568 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.191618 24900 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:29.205773 25028 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:08:29.225073 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.226887 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.227227 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.229189 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.228664 24900 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.229954 23622 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:29.231146 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.231793 23622 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:29.233108 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.234786 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.235993 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.235993 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.237164 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.237751 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.237665 25047 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.239233 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.239759 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.240097 23622 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:29.240255 25047 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:29.240638 23772 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.241237 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.243211 24995 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:29.243882 24993 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:29.243716 24995 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.244397 24993 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.245062 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.246107 24995 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.246366 24993 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.242558 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.246392 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.238209 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.247942 23698 raft_consensus.cc:2376] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2. Re-sending same reply.
I20260709 13:08:29.249181 24987 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:29.249675 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:29.250597 25032 consensus_meta.cc:287] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.003s
I20260709 13:08:29.250202 23699 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce71536613184c6d869077ae232876cc"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
mode: GRACEFUL
new_leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:48074
I20260709 13:08:29.251243 23699 raft_consensus.cc:606] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Received request to transfer leadership to TS 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:29.251816 24953 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.252336 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48074 (request call id 2) took 1104 ms. Trace:
I20260709 13:08:29.252729 23699 rpcz_store.cc:276] 0709 13:08:28.148152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.250070 (+1101918us) service_pool.cc:224] Handling call
0709 13:08:29.252240 (+  2170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:29.247390 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:29.252907 25014 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.254081 23699 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:29.254081 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.254773 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 38) took 1099 ms. Trace:
I20260709 13:08:29.254964 24995 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:29.255370 24995 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:29.255118 23699 rpcz_store.cc:276] 0709 13:08:28.154980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.253531 (+1098551us) service_pool.cc:224] Handling call
0709 13:08:29.253776 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.254552 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.254718 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:29.255923 24995 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.256309 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1465) took 1392 ms. Trace:
I20260709 13:08:29.256821 24901 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.256731 23697 rpcz_store.cc:276] 0709 13:08:27.864160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.864275 (+   115us) service_pool.cc:224] Handling call
0709 13:08:28.259800 (+395525us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b580000ff98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:08:28.260050 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.388301 (+128251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.388342 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:28.388374 (+    32us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:28.388393 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.256082 (+867689us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400357354. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:29.256132 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.256250 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297113088}
I20260709 13:08:29.191919 25058 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.260423 23620 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:29.251042 25032 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.261540 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.259871 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:29.263799 23525 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 175) took 2739 ms. Trace:
I20260709 13:08:29.264880 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.264575 23525 rpcz_store.cc:276] 0709 13:08:26.524335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.524483 (+   148us) service_pool.cc:224] Handling call
0709 13:08:29.263683 (+2739200us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:27.636851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:27.638197 (+  1346us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:27.638243 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:08:27.638274 (+    31us) tablet.cc:662] Decoding operations
0709 13:08:27.639066 (+   792us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:27.639179 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:27.639221 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:27.639561 (+   340us) tablet.cc:701] Row locks acquired
0709 13:08:27.639578 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:27.639708 (+   130us) write_op.cc:270] Start()
0709 13:08:27.639859 (+   151us) write_op.cc:276] Timestamp: P: 1783602507639665 usec, L: 0
0709 13:08:27.639885 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:08:27.642230 (+  2345us) log.cc:844] Serialized 918 byte log entry
0709 13:08:27.918923 (+276693us) op_driver.cc:464] REPLICATION: finished
0709 13:08:28.041104 (+122181us) write_op.cc:301] APPLY: starting
0709 13:08:28.041228 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:28.041381 (+   153us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:28.041534 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:28.042070 (+   536us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:28.042278 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:08:28.042337 (+    59us) write_op.cc:312] APPLY: finished
0709 13:08:28.042559 (+   222us) log.cc:844] Serialized 29 byte log entry
0709 13:08:28.042751 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:28.042865 (+   114us) write_op.cc:454] Released schema lock
0709 13:08:28.042911 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:28.043273 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:28.043307 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":121911,"apply.run_cpu_time_us":2166,"apply.run_wall_time_us":2165,"num_ops":2,"prepare.queue_time_us":45229,"prepare.run_cpu_time_us":4452,"prepare.run_wall_time_us":6518,"raft.queue_time_us":181929,"raft.run_cpu_time_us":52467,"raft.run_wall_time_us":107493,"replication_time_us":278893,"thread_start_us":333089,"threads_started":4,"wal-append.queue_time_us":996,"wal-append.run_cpu_time_us":46208,"wal-append.run_wall_time_us":1402728}]]}
I20260709 13:08:29.239200 25050 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.269112 24996 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:29.269610 24996 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:29.270006 24996 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.270427 24953 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:29.273411 23698 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:29.274201 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 34) took 1121 ms. Trace:
I20260709 13:08:29.274538 23698 rpcz_store.cc:276] 0709 13:08:28.153237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.259924 (+1106687us) service_pool.cc:224] Handling call
0709 13:08:29.273101 (+ 13177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.273894 (+   793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.274143 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:29.275692 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.275918 23770 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:29.275764 23614 tablet_service.cc:1558] Processing DeleteTablet for tablet 3473b09c073142659e12a365e9aed3f3 with delete_type TABLET_DATA_TOMBSTONED (TS 9ab488f10c434878a749f261e99a8065 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52038
I20260709 13:08:29.276612 23698 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.243763 24900 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:08:29.264158 25017 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.279160 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.264897 24993 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:29.275815 25045 consensus_meta.cc:287] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.646s	user 0.013s	sys 0.004s
I20260709 13:08:29.266673 25047 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:29.279409 24953 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.285847 23698 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.292781 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1454) took 1046 ms. Trace:
I20260709 13:08:29.287230 23742 leader_election.cc:400] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4.
I20260709 13:08:29.280071 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.286862 25035 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:29.293285 23626 rpcz_store.cc:276] 0709 13:08:28.246789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.247146 (+   357us) service_pool.cc:224] Handling call
0709 13:08:29.292617 (+1045471us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002b5a54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.292732 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382339456}
I20260709 13:08:29.294193 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.278812 25057 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:29.310654 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50854.5us
I20260709 13:08:29.290635 25045 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.298760 23772 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.314316 24965 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:29.290390 24990 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.877s	user 0.014s	sys 0.007s
I20260709 13:08:29.287009 24993 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:29.317384 24947 raft_consensus.cc:3055] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:29.287938 25064 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.322940 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.323319 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:29.317216 25058 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:29.324332 25035 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:29.337297 24947 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:29.329376 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:29.329782 25050 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:29.326472 25047 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.339851 23625 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:29.342466 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:29.326480 25049 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:29.332329 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45258.3us
I20260709 13:08:29.344445 23703 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:29.350451 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:08:29.336040 23743 leader_election.cc:336] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.684s (SENT)
I20260709 13:08:29.338932 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:29.323518 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 43629.5us
I20260709 13:08:29.337299 25057 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:08:29.349805 23776 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.333801 24867 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.337370 25030 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.337910 24993 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.367100 23775 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:29.355382 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:29.337865 24990 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.280426 25062 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.347067 23771 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 4: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:29.382472 23743 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.345112 24901 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.350625 24385 raft_consensus.cc:1813] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Handling vote request from an unknown peer 9ab488f10c434878a749f261e99a8065
W20260709 13:08:29.393296 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 57265.6us
I20260709 13:08:29.389183 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:29.351840 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.345708 25032 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.397835 25050 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.398144 25065 tablet_replica.cc:333] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:08:29.429869 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:29.431981 23775 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:29.399246 23776 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:29.432147 23704 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.339591 24985 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:29.440415 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 91856.4us
I20260709 13:08:29.396134 25064 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:29.345973 25044 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:08:29.449106 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.345599 25035 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.480413 25035 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.398859 24947 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.450054 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:29.436004 25030 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:08:29.450688 25057 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:29.451697 24995 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.452642 25065 raft_consensus.cc:2243] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.457190 24965 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.489797 25032 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:29.492173 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1463) took 1158 ms. Trace:
I20260709 13:08:29.458130 25040 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:29.492309 25056 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:29.492540 25032 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:29.458972 23771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1184) took 1756 ms (client timeout 1680 ms). Trace:
I20260709 13:08:29.492575 23627 rpcz_store.cc:276] 0709 13:08:28.333915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.334058 (+   143us) service_pool.cc:224] Handling call
0709 13:08:28.334322 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.449340 (+115018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.449369 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:28.449413 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:28.449449 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.491909 (+1042460us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400324bd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:29.491959 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.492114 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264052480}
I20260709 13:08:29.494177 23702 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:29.460492 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.461046 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 43) took 1172 ms. Trace:
I20260709 13:08:29.461094 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1490) took 1409 ms. Trace:
I20260709 13:08:29.495904 23703 rpcz_store.cc:276] 0709 13:08:28.051533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.977176 (+925643us) service_pool.cc:224] Handling call
0709 13:08:29.460894 (+483718us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400405454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.461028 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818735488}
I20260709 13:08:29.460003 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.457227 25045 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:29.462838 23623 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:29.464401 25017 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:29.467000 24994 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:29.470326 24967 raft_consensus.cc:993] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: : Instructing follower 4466bf6d6cf84ee89e84ea074e3964c9 to start an election
I20260709 13:08:29.471005 24996 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.454874 24385 raft_consensus.cc:2410] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:29.473136 25047 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:29.340152 25048 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:08:29.476613 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:08:29.482007 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 92835.8us
I20260709 13:08:29.347904 25046 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
W20260709 13:08:29.520740 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 44193.5us
I20260709 13:08:29.484081 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.483379 24966 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:29.487824 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:29.487838 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.492856 25056 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:29.496835 23743 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.497205 23703 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:29.511327 24990 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.525599 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.526790 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.495080 23628 rpcz_store.cc:276] 0709 13:08:28.289062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.289201 (+   139us) service_pool.cc:224] Handling call
0709 13:08:28.289483 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.423316 (+133833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.423352 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:28.423398 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:28.423427 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.460781 (+1037354us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400098154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:29.460843 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.460962 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307345152}
I20260709 13:08:29.529040 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.481508 25023 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.495705 25050 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:29.534379 25050 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.534754 25050 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:29.535034 24985 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.454460 25041 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.536439 24947 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.487538 24953 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:08:29.527374 23627 raft_consensus.cc:2376] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2. Re-sending same reply.
I20260709 13:08:29.492725 25040 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:29.490113 25057 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:29.516881 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 61243us
I20260709 13:08:29.495921 25001 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:29.508579 25037 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:29.493546 23771 rpcz_store.cc:269] 0709 13:08:27.702833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.712143 (+  9310us) service_pool.cc:224] Handling call
0709 13:08:28.370708 (+658565us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b5800003c98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:08:29.004645 (+633937us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b5800003c98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7eee 0000000000375939 00007f2b4625b1e0 00007f2b463240c4 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:08:29.458693 (+454048us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400430dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.458858 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738260352}
I20260709 13:08:29.456067 25064 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:29.524173 24394 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.524889 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.503274 25017 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:29.530941 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:29.514112 25065 raft_consensus.cc:2272] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.533226 23743 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.576802 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.577425 23623 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
W20260709 13:08:29.577585 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44434us
I20260709 13:08:29.578116 24995 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:29.578399 23743 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.578799 25054 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:29.530654 24881 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:29.534690 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.508054 23702 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.513355 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.521282 25026 raft_consensus.cc:1081] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Signalling peer 4466bf6d6cf84ee89e84ea074e3964c9 to start an election
I20260709 13:08:29.568992 23622 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:08:29.554258 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54116.8us
I20260709 13:08:29.554028 24393 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:29.531692 23769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1190) took 1246 ms. Trace:
I20260709 13:08:29.572794 23698 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:29.572721 23695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 29) took 1422 ms (client timeout 1822 ms). Trace:
I20260709 13:08:29.524690 25030 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:29.574993 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 50216us
W20260709 13:08:29.593374 23695 rpcz_store.cc:269] 0709 13:08:28.150717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.968988 (+818271us) service_pool.cc:224] Handling call
0709 13:08:29.572480 (+603492us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b540015cf54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.572647 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86579584}
I20260709 13:08:29.593684 25071 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:08:29.594904 23695 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.594717 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.575155 23628 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
W20260709 13:08:29.576478 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 45627.6us
I20260709 13:08:29.571465 25057 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.577638 24994 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.601557 23593 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:29.573779 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:29.581547 25059 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:29.533906 25053 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:29.528398 24859 raft_consensus.cc:3055] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:29.531740 24967 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:29.553282 25045 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:29.539932 23527 catalog_manager.cc:5697] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 2 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.552728 25041 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.626778 23703 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.584190 25021 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:29.586191 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.589440 23621 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:29.636826 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1171) took 1027 ms. Trace:
I20260709 13:08:29.589810 25065 ts_tablet_manager.cc:1916] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:29.579546 24998 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.575829 25064 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.580358 25032 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.605990 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 913) took 1130 ms. Trace:
I20260709 13:08:29.600603 24843 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.576362 25037 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:29.644397 23704 rpcz_store.cc:276] 0709 13:08:28.475664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.262094 (+786430us) service_pool.cc:224] Handling call
0709 13:08:29.262269 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.449060 (+186791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.605682 (+156622us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400131fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:29.605903 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390289664}
W20260709 13:08:29.647909 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 158401us
I20260709 13:08:29.599255 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.623303 24967 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.611245 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 923) took 1011 ms. Trace:
W20260709 13:08:29.609422 23593 raft_consensus.cc:2686] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:29.613680 25053 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:29.616788 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 314) took 1081 ms. Trace:
I20260709 13:08:29.604082 24990 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.620734 24996 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:29.622453 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.622184 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 927) took 1155 ms. Trace:
I20260709 13:08:29.624737 23527 catalog_manager.cc:5697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 2 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.625996 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 28) took 1475 ms. Trace:
I20260709 13:08:29.627938 25071 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.628082 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1155) took 1023 ms. Trace:
I20260709 13:08:29.629097 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.630007 23525 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.664222 23626 rpcz_store.cc:276] 0709 13:08:28.604690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.331753 (+727063us) service_pool.cc:224] Handling call
0709 13:08:29.332053 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.381719 (+ 49666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.381757 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:29.381802 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:29.381839 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.627876 (+246037us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b54000a8a54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:29.627919 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.628033 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113736576}
I20260709 13:08:29.663468 23527 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 2, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 2 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.631911 24950 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.623024 25059 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:29.634261 23775 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.530184 25056 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.651546 23623 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.641510 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1162) took 1034 ms. Trace:
I20260709 13:08:29.613526 24859 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:08:29.649137 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49989.9us
I20260709 13:08:29.579535 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.623617 25045 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:29.593196 23769 rpcz_store.cc:276] 0709 13:08:28.285387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.288020 (+  2633us) service_pool.cc:224] Handling call
0709 13:08:29.459872 (+1171852us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b5800003c98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7eee 0000000000375939 00007f2b4625b1e0 00007f2b463240c4 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:08:29.529515 (+ 69643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4591488}
I20260709 13:08:29.650195 23702 rpcz_store.cc:276] 0709 13:08:28.600121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.585842 (+985721us) service_pool.cc:224] Handling call
0709 13:08:29.610768 (+ 24926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.610951 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.610975 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:29.611012 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:29.611042 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.611094 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.611194 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:29.650346 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 48848.8us
I20260709 13:08:29.651707 24394 rpcz_store.cc:276] 0709 13:08:28.535042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.535219 (+   177us) service_pool.cc:224] Handling call
0709 13:08:29.355498 (+820279us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800010e98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:08:29.356100 (+   602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.574559 (+218459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.616471 (+ 41912us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540060a4d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:29.616676 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390569088}
I20260709 13:08:29.637252 23621 rpcz_store.cc:276] 0709 13:08:28.609316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.148817 (+539501us) service_pool.cc:224] Handling call
0709 13:08:29.636624 (+487807us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54002b4b54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.636766 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687408000}
I20260709 13:08:29.582417 25001 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.651373 25032 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.673543 23627 rpcz_store.cc:276] 0709 13:08:28.606617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.612220 (+1005603us) service_pool.cc:224] Handling call
0709 13:08:29.641085 (+ 28865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.641233 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.641255 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:29.641290 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:29.641317 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.641364 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.641460 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:29.652496 24967 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:29.662285 25053 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.703413 25001 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.704903 24990 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:29.705473 24990 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.705590 25017 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.707008 25017 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.708458 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 922) took 1111 ms. Trace:
I20260709 13:08:29.708828 23703 rpcz_store.cc:276] 0709 13:08:28.597230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.523621 (+926391us) service_pool.cc:224] Handling call
0709 13:08:29.626498 (+102877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.642644 (+ 16146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.708264 (+ 65620us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540042b650. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.708390 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235726720}
I20260709 13:08:29.687976 25008 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:29.683497 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 104041us
I20260709 13:08:29.685649 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.670578 25059 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.685331 24953 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:29.685426 25045 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.664069 23696 rpcz_store.cc:276] 0709 13:08:28.150421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.065085 (+914664us) service_pool.cc:224] Handling call
0709 13:08:29.625702 (+560617us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b540042b654. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.625907 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53671296}
I20260709 13:08:29.647380 25040 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.707571 24990 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.710103 25008 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.724900 25008 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.703219 25071 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.671898 24996 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:08:29.662178 23770 rpcz_store.cc:276] 0709 13:08:28.466784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.469834 (+  3050us) service_pool.cc:224] Handling call
0709 13:08:28.510199 (+ 40365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.276484 (+766285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.621817 (+345333us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400345dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:29.622076 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754313600}
I20260709 13:08:29.684178 25022 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:08:29.671871 24901 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:08:29.714578 24953 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:29.712850 25019 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.717957 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.711694 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:29.663825 25050 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:29.760516 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 48961.9us
I20260709 13:08:29.761408 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.762627 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:08:29.764950 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47640.1us
I20260709 13:08:29.765940 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.770236 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.774026 23700 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:29.774307 24900 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:29.774807 24900 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:29.775271 23700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1484) took 1725 ms (client timeout 1736 ms). Trace:
I20260709 13:08:29.776281 23699 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:29.777755 25001 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.777973 25055 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:29.764458 24953 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:29.775694 23700 rpcz_store.cc:269] 0709 13:08:28.049558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.471275 (+421717us) service_pool.cc:224] Handling call
0709 13:08:29.775069 (+1303794us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000893d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.775193 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2703495936}
I20260709 13:08:29.779783 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:29.783567 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 134559us
I20260709 13:08:29.785285 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:29.786513 23669 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:29.765264 24994 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.776643 25058 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:29.777124 24990 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:29.788100 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.798231 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.800268 23625 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:29.776966 24987 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.776968 25032 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.769443 25008 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:29.804962 23774 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 4: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:29.809816 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:29.787575 24998 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.812477 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.812659 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:29.769961 24947 consensus_queue.cc:1059] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:08:29.816802 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:29.817663 23777 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 2: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:29.816071 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.787638 24950 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.824311 23773 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:29.787766 25019 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:29.790751 25022 consensus_queue.cc:1243] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:29.828043 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:29.792076 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:29.827293 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:29.813537 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:29.829795 24391 raft_consensus.cc:2376] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2. Re-sending same reply.
I20260709 13:08:29.830336 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 39) took 1562 ms. Trace:
I20260709 13:08:29.830639 23699 rpcz_store.cc:276] 0709 13:08:28.268140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.256238 (+988098us) service_pool.cc:224] Handling call
0709 13:08:29.775977 (+519739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.776655 (+   678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.830150 (+ 53495us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54000893d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.830282 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1194589440}
I20260709 13:08:29.831373 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:29.832342 23773 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce71536613184c6d869077ae232876cc"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:43460
I20260709 13:08:29.832604 25035 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:29.832888 23773 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:29.833247 23773 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.833132 25035 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.835356 25035 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:29.838827 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.840009 23593 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.839855 23773 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.841045 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:08:29.841598 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.841832 25028 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.842535 25028 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.842546 23773 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:29.844269 23593 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.844925 25062 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.845461 25028 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.846623 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.847376 25028 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.847815 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.848532 25028 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.849469 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.850051 25035 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.801370 25058 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:29.816746 25001 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:08:29.859915 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:29.860098 23770 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:29.860569 25001 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:29.860965 25001 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:29.776459 25037 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.854205 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.854597 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1167) took 1246 ms. Trace:
I20260709 13:08:29.866348 23629 rpcz_store.cc:276] 0709 13:08:28.608034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.630933 (+1022899us) service_pool.cc:224] Handling call
0709 13:08:29.639071 (+  8138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.639311 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.639349 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:29.639409 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:29.639452 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.639528 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.854431 (+214903us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b540037e450. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.854539 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17987968}
I20260709 13:08:29.867902 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.850430 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.855683 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.808516 25026 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:29.826488 24998 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:29.871592 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.872192 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.864086 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 918) took 1268 ms. Trace:
I20260709 13:08:29.873128 23698 rpcz_store.cc:276] 0709 13:08:28.595762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.292854 (+697092us) service_pool.cc:224] Handling call
0709 13:08:29.572618 (+279764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.597727 (+ 25109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.859318 (+261591us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b540015cf50. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:29.864033 (+  4715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642618624}
I20260709 13:08:29.853696 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:08:29.864301 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 235270us
I20260709 13:08:29.801610 24996 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:08:29.870452 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:08:29.870755 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.861120 24993 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.874487 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.875206 23773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:29.883363 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.883531 23773 raft_consensus.cc:606] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.878044 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:29.863230 25047 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:29.863189 25058 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.819031 25008 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.884526 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.888644 23620 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:29.890679 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.892138 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.892850 23703 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:29.893668 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:29.886335 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.891588 23699 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:29.894237 23703 raft_consensus.cc:2376] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2. Re-sending same reply.
I20260709 13:08:29.894968 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:29.816785 24987 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.895015 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:29.885085 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.897933 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:29.893577 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.855479 25019 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.898828 23704 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:29.898324 23698 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:29.899838 25022 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.902598 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.903788 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.862049 25001 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:29.913511 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.905129 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:29.906968 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.917773 23704 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:29.907979 23627 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:29.875702 25035 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.886334 23769 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 2: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:29.908967 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.910722 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:29.921007 23698 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:29.891927 24947 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.924387 23620 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:29.902765 24388 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.808069 25055 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:08:29.927073 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:29.928771 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.927179 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:08:29.932556 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 58993.3us
I20260709 13:08:29.881971 25057 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.938956 25057 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:29.901432 25028 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:08:29.886402 24998 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.943715 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.927181 24390 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.944664 23624 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:29.940461 25001 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.914933 25064 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.946220 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.908401 25030 consensus_queue.cc:1059] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:08:29.947489 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.920882 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:29.932433 25054 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.959012 23698 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:29.961899 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.962291 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.963007 23622 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:29.958853 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.966948 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.916790 25062 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:08:29.971583 23624 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:29.972196 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.974452 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.974736 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.975842 25072 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:08:29.940475 24867 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:08:29.977324 25072 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:29.977772 25072 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:29.978212 25072 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.975427 23698 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:29.977634 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.934732 25033 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:29.971278 24953 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.942173 25045 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.927698 25023 consensus_queue.cc:1059] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:08:29.961777 25050 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:29.994910 25050 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:29.972396 25022 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:08:29.996656 24995 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:29.997187 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:29.997258 24995 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:29.998116 23695 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:29.998929 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:30.000000 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:30.000361 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.000787 23698 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:30.001259 23695 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:30.001608 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:30.002162 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.002789 23695 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:30.002861 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:30.002987 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.003219 23695 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:30.003651 23698 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:30.004346 23695 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:29.982213 25074 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:08:30.005625 24881 raft_consensus.cc:3055] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:29.981772 25064 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:29.983407 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.943224 25071 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.985078 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:29.981120 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:30.022111 23626 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:29.988535 23624 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 2: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:29.989459 24867 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:29.988783 23701 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:29.993233 25045 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:30.005662 23695 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.008872 23775 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:29.984313 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:29.999469 24995 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:29.996706 25022 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:30.015993 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:30.022897 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:29.967882 23696 raft_consensus.cc:2376] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2. Re-sending same reply.
W20260709 13:08:30.076323 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 60413us
I20260709 13:08:30.077931 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:30.042773 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:30.020591 23622 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:30.001638 24900 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:30.038246 24867 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:30.006175 23772 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:30.006109 24881 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:08:30.075690 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 52902.3us
I20260709 13:08:30.087342 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:08:30.078275 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.987511 25033 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.043990 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:29.986773 25028 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:08:30.039968 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:30.082433 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:30.045763 25050 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:30.122896 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:29.987171 25053 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.036509 23698 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:30.079074 23700 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
I20260709 13:08:30.096433 24881 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.097924 24867 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.086360 24951 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:30.120481 25075 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.188s
I20260709 13:08:30.131632 24951 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:30.132148 24951 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.132578 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.133082 24985 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:30.133612 24985 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:30.134007 24985 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.134409 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.135916 25026 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:30.131980 24881 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:30.103863 25064 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:30.136451 25026 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:30.110641 23695 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:30.081583 25013 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:30.116631 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:30.140300 23627 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:30.118234 24953 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:30.119397 24998 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:30.074811 25022 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:30.128052 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:30.150303 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:30.078094 25045 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.113788 24967 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.159704 25045 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:30.160527 25045 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:30.161736 25045 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.164548 23703 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:30.142128 25013 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:30.165792 25013 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.165445 24951 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.155433 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.129762 25050 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:30.172356 25050 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:30.175324 25064 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:30.157410 25055 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:30.138958 25026 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:30.177937 23702 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:30.192683 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 237291us
I20260709 13:08:30.203866 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:08:30.193904 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 315933us
I20260709 13:08:30.206355 24359 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:08:30.207392 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 296725us
I20260709 13:08:30.208256 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.090371 25019 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:30.138111 24993 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:30.211838 24359 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.215473 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:30.181280 25008 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:30.137859 23621 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:30.219020 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.233965 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.249049 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:30.235459 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:30.235783 23743 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.256541 23777 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:30.260494 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 48663.4us
I20260709 13:08:30.261250 23702 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:30.263634 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44679us
I20260709 13:08:30.264570 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:30.251933 23743 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.270090 23743 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.269377 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:08:30.271757 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.237265 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.238502 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:30.239182 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:30.240351 23770 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.286623 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:30.299925 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:30.281422 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:30.304741 25033 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:30.305334 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:30.306594 25053 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:30.307116 24393 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.283768 25064 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:30.284994 25084 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.282313 24859 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:30.244920 25028 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.316282 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:30.316692 24859 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.316924 24953 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:30.319706 25059 consensus_meta.cc:287] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.007s
I20260709 13:08:30.320446 25054 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.320786 23702 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:30.223034 25071 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.320259 25059 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.322835 23776 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.216116 25081 raft_consensus.cc:993] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:08:30.322877 23778 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:30.298290 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.290045 23743 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:08:30.337458 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.339708 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49793us
I20260709 13:08:30.233824 25085 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.340549 23743 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:30.341811 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:30.297195 24994 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:30.324786 25080 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:30.345112 23743 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.350898 23743 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.296294 24993 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:30.296319 25062 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:30.336534 25054 raft_consensus.cc:1081] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:08:30.355499 23668 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:30.315532 25013 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.360086 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:30.359187 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:30.364329 23704 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:30.345788 25055 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:30.346269 25081 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.349097 24953 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:30.358069 24994 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:30.371120 24994 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.374969 24391 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.360616 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:30.356232 24392 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.376443 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:30.332618 25047 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:30.365393 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:30.343907 25059 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:30.385958 25013 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:30.386682 25013 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:30.379105 25082 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.360244 25014 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.381302 25058 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.382099 25026 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.396024 23702 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:30.382313 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:30.397951 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:30.398375 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:30.357743 25086 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.392527 24953 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:08:30.399991 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 248310us
I20260709 13:08:30.401511 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:30.401885 23701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 27) took 2251 ms (client timeout 2029 ms). Trace:
I20260709 13:08:30.402592 23697 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:30.397989 24359 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.368290 24987 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:30.383188 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:30.357298 24993 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:30.374454 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:30.385478 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:30.386776 23700 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.379432 25001 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.356441 25080 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:30.406041 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.414342 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:30.414994 23775 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:30.415599 24359 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.416009 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:30.362645 25030 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:08:30.402325 23701 rpcz_store.cc:269] 0709 13:08:28.150122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.048050 (+897928us) service_pool.cc:224] Handling call
0709 13:08:30.401707 (+1353657us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400088ed4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:30.401823 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2115631488}
I20260709 13:08:30.407692 23773 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.376287 25085 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:30.410812 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:30.411854 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:30.410177 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:30.406693 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.417440 23774 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.453469 23626 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:30.421252 24359 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.437562 25083 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.455791 23777 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:30.456382 24359 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:30.451988 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:30.413430 24993 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.410414 24996 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.460135 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:30.417976 25080 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.422029 25071 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.468561 25075 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.483109 25026 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:30.481303 25047 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:30.486775 24359 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:08:30.485319 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.413218 25035 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:08:30.463610 25074 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.468173 23667 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:30.469197 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:30.484217 25052 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.518798 24985 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.520720 25058 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:30.513188 25064 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 13:08:30.538219 25072 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.560s	user 0.012s	sys 0.000s
I20260709 13:08:30.539134 25072 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:30.524077 24996 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:30.541594 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 73520.2us
I20260709 13:08:30.533574 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:30.533877 25095 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:08:30.557161 23695 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.557912 24388 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.553020 25052 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:30.496095 25085 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:08:30.552680 25082 raft_consensus.cc:2764] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:08:30.577744 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:30.584532 24950 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.586615 25008 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:30.587967 25008 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:30.588946 25008 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:30.589298 25008 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:30.586522 24950 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:30.590039 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:30.496129 24953 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.591528 25033 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:30.596047 25033 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:30.596940 25033 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.494634 25055 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.598393 25033 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.583294 24987 consensus_queue.cc:1059] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:08:30.617897 25050 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:30.632262 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:30.633987 25050 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:30.643888 25084 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.612473 24998 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:08:30.651913 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:30.666121 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:30.645576 24993 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:30.672674 23777 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.680517 25074 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.687561 24985 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:30.688019 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1161) took 2081 ms. Trace:
I20260709 13:08:30.692436 24394 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:30.667611 25072 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:30.638974 25008 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.699385 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:30.686869 25056 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.704890 24386 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.688452 23623 rpcz_store.cc:276] 0709 13:08:28.606361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.579050 (+972689us) service_pool.cc:224] Handling call
0709 13:08:29.642695 (+ 63645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.674554 (+ 31859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.686611 (+1012057us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b5400097c50. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:30.687944 (+  1333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139147008}
I20260709 13:08:30.729717 24900 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:30.730254 24900 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:30.733247 25030 raft_consensus.cc:3055] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:30.733738 25030 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:30.734745 25030 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:30.737424 25022 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:30.739156 25022 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.741360 23698 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.726790 25047 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:08:30.751233 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 40) took 2468 ms. Trace:
I20260709 13:08:30.752090 23697 rpcz_store.cc:276] 0709 13:08:28.282689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.258084 (+975395us) service_pool.cc:224] Handling call
0709 13:08:30.402259 (+1144175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.403080 (+   821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.750970 (+347890us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400088ed0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:30.751151 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2630591232}
I20260709 13:08:30.696844 24985 consensus_queue.cc:1059] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 13:08:30.858625 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.750268 25008 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.873857 23697 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:30.875176 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.878702 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.888154 23700 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:30.892349 24859 consensus_meta.cc:287] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.004s
I20260709 13:08:30.893584 23628 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:30.898154 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:30.871610 25057 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:30.731372 24900 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:30.926218 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.929513 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.882817 24947 raft_consensus.cc:3055] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:30.870756 25050 consensus_queue.cc:1059] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 13:08:30.934262 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.953001 23700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:08:30.918715 25030 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.960608 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:30.955370 23700 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:08:30.938540 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.964287 23700 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.965613 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:30.968523 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:30.932173 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.923941 25057 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:30.920714 24994 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:30.894783 24998 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:08:30.970007 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:30.974334 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:30.924743 25059 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:08:30.989243 25040 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:30.990290 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.948635 24947 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:30.984187 23699 raft_consensus.cc:2410] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:30.985797 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.985582 24994 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:30.994118 24389 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:30.992827 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 946) took 1084 ms. Trace:
I20260709 13:08:30.994762 23699 rpcz_store.cc:276] 0709 13:08:29.908243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.910547 (+  2304us) service_pool.cc:224] Handling call
0709 13:08:30.974178 (+1063631us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b580000ff98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:08:30.992735 (+ 18557us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25062144}
I20260709 13:08:30.963711 24822 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:08:30.998679 24994 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:30.971190 25083 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.983649 25063 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:31.010069 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:31.001142 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1497) took 1841 ms. Trace:
I20260709 13:08:31.000093 25065 ts_tablet_manager.cc:1929] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:31.011894 25057 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.004768 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1517) took 1099 ms. Trace:
I20260709 13:08:31.033017 23695 rpcz_store.cc:276] 0709 13:08:29.904959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.147708 (+242749us) service_pool.cc:224] Handling call
0709 13:08:30.148108 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.558772 (+410664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.004460 (+445688us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540015de54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:31.004690 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940303744}
I20260709 13:08:31.019860 24390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 324) took 1298 ms. Trace:
I20260709 13:08:31.020761 24947 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:30.992574 25041 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.021703 23770 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:31.009645 25017 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:08:31.024768 23628 rpcz_store.cc:276] 0709 13:08:29.160038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.633510 (+473472us) service_pool.cc:224] Handling call
0709 13:08:29.633863 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.893966 (+1260103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.000833 (+106867us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002026d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:31.001068 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2896094592}
I20260709 13:08:30.961398 25074 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:08:31.036293 25065 log.cc:1199] T 3473b09c073142659e12a365e9aed3f3 P 9ab488f10c434878a749f261e99a8065: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/wals/3473b09c073142659e12a365e9aed3f3
I20260709 13:08:31.028436 25097 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.028503 24998 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:31.010318 25086 consensus_meta.cc:287] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.003s
I20260709 13:08:31.031256 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:31.022233 25063 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:31.061007 25097 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:08:31.036146 23620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.049s	sys 0.078s
I20260709 13:08:31.017921 25032 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:31.062513 23620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.049s	sys 0.078s
I20260709 13:08:31.043345 23700 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.030988 24993 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:31.068187 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.027015 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.057708 24998 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:31.060887 25086 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.065040 25097 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.065788 24951 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.071035 24967 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.071593 25057 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.073383 25019 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:31.037381 24390 rpcz_store.cc:276] 0709 13:08:29.721724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.727659 (+  5935us) service_pool.cc:224] Handling call
0709 13:08:29.728198 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.945051 (+216853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.016981 (+1071930us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54006e0ad4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:31.019781 (+  2800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422890368}
W20260709 13:08:31.073822 25071 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.568s	user 0.000s	sys 0.009s
I20260709 13:08:31.086000 23626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:08:31.086810 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:31.089931 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:31.062285 24947 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.113879 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1524) took 1207 ms. Trace:
I20260709 13:08:31.080734 24998 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.061805 25063 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.068769 24843 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:08:31.096167 25080 consensus_meta.cc:287] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.005s
I20260709 13:08:31.125123 25035 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:31.109071 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:31.049532 25041 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.073839 25026 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:08:31.114487 23703 rpcz_store.cc:276] 0709 13:08:29.906632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.926791 (+ 20159us) service_pool.cc:224] Handling call
0709 13:08:31.113613 (+1186822us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540042b154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:31.113797 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525909760}
I20260709 13:08:31.116217 25013 raft_consensus.cc:3055] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.125507 25097 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.120102 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:31.120761 25071 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.122133 25014 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.129240 25065 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52038 (request call id 76) took 1865 ms. Trace:
I20260709 13:08:31.124423 25064 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:31.126965 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:31.159897 23624 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.127862 23700 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.130672 24843 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:31.120216 24994 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:08:31.136667 25033 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.002s
I20260709 13:08:31.136734 25035 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:31.157328 25019 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:31.173066 24994 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:31.234347 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:31.150553 25014 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:08:31.158574 25081 consensus_meta.cc:287] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.001s
I20260709 13:08:31.141590 25080 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.144111 25013 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:31.274456 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:31.278688 23622 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.278945 25081 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.159529 25064 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:31.248317 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:31.243013 25071 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.268751 25057 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:31.268697 25072 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.304312 24387 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:31.305296 23625 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:31.323650 24843 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.238144 25019 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.330335 23624 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:31.268265 25014 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.318742 25041 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:31.321755 25095 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:08:31.317811 23769 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.008s	sys 0.017s
W20260709 13:08:31.422427 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.332312 25074 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.320393 24822 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.319664 25057 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.425858 23622 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:31.293915 24994 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.482446 25080 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.483429 24994 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.432689 23624 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:31.468582 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.440973 24900 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:31.432145 23769 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.008s	sys 0.017s
W20260709 13:08:31.502080 23702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.101s	sys 0.245s
I20260709 13:08:31.428195 25030 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.518509 23702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.101s	sys 0.245s
W20260709 13:08:31.522531 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.526043 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:31.452890 25014 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.159237 25065 rpcz_store.cc:276] 0709 13:08:29.264079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.265537 (+  1458us) service_pool.cc:224] Handling call
0709 13:08:29.379691 (+114154us) ts_tablet_manager.cc:1151] Deleting tablet 3473b09c073142659e12a365e9aed3f3
0709 13:08:29.384666 (+  4975us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:30.371520 (+986854us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:30.999906 (+628386us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:31.125751 (+125845us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11665,"tablet-delete.queue_time_us":103028,"thread_start_us":58576,"threads_started":1}
I20260709 13:08:31.514644 25033 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:31.487058 24822 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.528225 25052 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:31.323051 25064 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.530856 25026 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:31.538973 25040 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.453168 25074 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.559154 23513 catalog_manager.cc:5028] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): tablet 3473b09c073142659e12a365e9aed3f3 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:08:31.541759 23621 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.529966 25030 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.540970 24947 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:31.551570 24901 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:31.513412 25062 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.423398 25013 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.318046 25071 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.558379 25033 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.597415 25062 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:08:31.602674 25101 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.554s	user 0.007s	sys 0.000s
I20260709 13:08:31.585148 25064 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.595293 24985 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.570806 25026 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.609014 23626 raft_consensus.cc:606] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Received request to transfer leadership to TS b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:31.616456 23626 raft_consensus.cc:614] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:31.611299 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.617322 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.603066 25013 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.583065 25040 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:31.619343 23742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.034s	sys 0.053s
W20260709 13:08:31.636564 23742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.035s	sys 0.053s
W20260709 13:08:31.641012 23774 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.020s	sys 0.090s
W20260709 13:08:31.641579 23774 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.020s	sys 0.090s
I20260709 13:08:31.597622 24947 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.599370 24901 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.612133 24985 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:08:31.658628 24357 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.016s	sys 0.029s
W20260709 13:08:31.793833 24357 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.016s	sys 0.029s
W20260709 13:08:31.794561 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 832541us
I20260709 13:08:31.796012 24843 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:31.797142 24843 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.802140 24843 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:31.802901 24843 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.763024 23593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.012s	sys 0.021s
I20260709 13:08:31.803711 24843 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:31.765333 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.808418 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:31.809677 24901 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.809894 23626 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:31.810670 24901 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:31.811924 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:31.811877 24901 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.765949 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1515) took 1885 ms. Trace:
I20260709 13:08:31.815016 24901 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:31.767978 23592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.041s	sys 0.071s
I20260709 13:08:31.815809 24901 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:08:31.816128 23592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.041s	sys 0.072s
I20260709 13:08:31.816642 24901 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:31.768095 23668 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.005s	sys 0.036s
W20260709 13:08:31.819463 23668 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.006s	sys 0.036s
W20260709 13:08:31.820150 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 1.04842e+06us
I20260709 13:08:31.821491 24947 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.822327 24947 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.823170 24947 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.824256 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:31.769464 23670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.000s	sys 0.004s
I20260709 13:08:31.824860 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:08:31.825519 23670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.001s	sys 0.005s
I20260709 13:08:31.825673 24389 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 2: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:31.825940 24386 raft_consensus.cc:2376] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2. Re-sending same reply.
I20260709 13:08:31.826224 24947 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:31.826679 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.773869 23695 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:31.721730 24990 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.828320 24990 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:31.828517 25030 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.828852 24953 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.828035 24985 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.829452 25030 consensus_queue.cc:1059] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:31.829600 24953 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.830233 24985 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:31.716987 24998 consensus_meta.cc:287] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.001s
I20260709 13:08:31.831398 25030 raft_consensus.cc:3055] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:31.832598 25030 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:31.832682 24998 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.834374 25030 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.836433 25030 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.836313 25001 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:31.837766 25001 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:31.649106 25045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.005s	sys 0.031s
I20260709 13:08:31.776242 23700 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:31.839644 25045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.005s	sys 0.031s
I20260709 13:08:31.723253 25019 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:31.841678 25033 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:31.780205 23741 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.013s	sys 0.030s
I20260709 13:08:31.842756 24996 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.788093 23743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.003s	sys 0.039s
I20260709 13:08:31.812917 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
W20260709 13:08:31.843964 23743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.003s	sys 0.039s
I20260709 13:08:31.843619 24996 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.846298 25035 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.843665 25040 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.849356 25001 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:31.849617 23593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.013s	sys 0.022s
I20260709 13:08:31.849835 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:08:31.850234 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 888339us
I20260709 13:08:31.850737 23628 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.717614 25026 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.852399 25026 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.853039 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:31.853314 25026 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.854031 23622 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:31.855147 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:31.813392 23627 rpcz_store.cc:276] 0709 13:08:29.880200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.304511 (+424311us) service_pool.cc:224] Handling call
0709 13:08:30.304861 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.378448 (+ 73587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.378487 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.384475 (+  5988us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.693720 (+309245us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:30.693772 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.751067 (+ 57295us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b54003af554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:30.751114 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.422218 (+671104us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:08:31.765102 (+342884us) raft_consensus.cc:1685] finished
0709 13:08:31.765185 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.765721 (+   536us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11676,"raft.queue_time_us":12988,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"spinlock_wait_cycles":147888256,"thread_start_us":305697,"threads_started":1,"wal-append.queue_time_us":656682}
I20260709 13:08:31.855490 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:31.857020 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:31.859047 23627 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.864449 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:31.843055 23741 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.014s	sys 0.030s
I20260709 13:08:31.865638 23626 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:31.868531 23624 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:31.869189 24387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 272) took 1309 ms. Trace:
I20260709 13:08:31.712857 25074 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:31.872197 23625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1504) took 2052 ms (client timeout 1551 ms). Trace:
I20260709 13:08:31.873716 23776 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:31.674489 25057 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:31.876894 25058 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.014s	sys 0.032s
I20260709 13:08:31.888710 25071 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:31.889842 25058 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.014s	sys 0.032s
I20260709 13:08:31.655493 25062 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:31.830278 24990 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:31.662766 25056 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.954s	user 0.013s	sys 0.000s
I20260709 13:08:31.892004 25062 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.893496 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:31.895196 23700 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
W20260709 13:08:31.673156 25050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.000s	sys 0.037s
I20260709 13:08:31.881619 24867 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:31.896193 25050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.000s	sys 0.038s
I20260709 13:08:31.896260 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:31.897522 25050 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.898211 25050 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:31.882119 25052 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:31.900223 25052 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.900678 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:31.901199 25050 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:31.901799 25071 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.903523 25063 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.903875 25071 consensus_queue.cc:1059] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:31.884066 24996 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.886299 24993 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:31.890595 24822 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:31.900772 25026 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:31.721078 25097 consensus_meta.cc:287] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.000s
I20260709 13:08:31.957623 25014 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.958570 25014 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:31.714017 25102 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:08:31.715373 25107 log.cc:927] Time spent T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:31.880414 25035 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:31.905828 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 53534.1us
I20260709 13:08:31.992812 23668 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:08:31.994635 24994 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.510s	user 0.013s	sys 0.004s
I20260709 13:08:31.885335 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:31.953022 25033 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:08:31.996013 23629 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:31.997066 25026 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:31.997784 25026 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:31.998503 23770 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.000424 25119 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.001187 25119 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.003425 25119 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.898185 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:31.887918 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:31.887744 24953 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:31.822973 23621 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:31.949831 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:31.819473 24901 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:31.930953 24993 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.951377 25019 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:08:31.944056 24998 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:31.968356 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.960539 23669 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.527s (SENT) [suppressed 57 similar messages]
I20260709 13:08:31.970530 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:31.981985 24394 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:32.003929 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 60469.1us
W20260709 13:08:32.004513 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 73639.4us
I20260709 13:08:32.004812 24822 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.005707 24947 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.889544 23625 rpcz_store.cc:269] 0709 13:08:29.819321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.853432 (+ 34111us) service_pool.cc:224] Handling call
0709 13:08:31.871704 (+2018272us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400064ad4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:31.871914 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3243588480}
I20260709 13:08:32.007695 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:31.887833 24387 rpcz_store.cc:276] 0709 13:08:30.560009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.561157 (+  1148us) service_pool.cc:224] Handling call
0709 13:08:30.562959 (+  1802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.322443 (+759484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.868538 (+546095us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54006e00d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:31.868962 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1700020608}
I20260709 13:08:31.969712 24843 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.011664 23628 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
W20260709 13:08:32.029909 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.030742 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.988914 25014 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.015856 24993 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.999225 25026 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.014130 23623 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
W20260709 13:08:32.076505 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 94421.2us
I20260709 13:08:32.045889 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.083099 23624 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.085793 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:08:32.083528 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 132057us
I20260709 13:08:32.091871 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.045984 24822 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:32.093423 23777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.071s	user 0.000s	sys 0.011s
W20260709 13:08:32.093886 23777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.000s	sys 0.012s
W20260709 13:08:32.093997 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.094518 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:32.095050 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:32.095271 23623 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.095538 24822 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.096393 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.097184 23625 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:32.098495 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.099256 23770 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
W20260709 13:08:32.100456 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.035881 24947 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:32.106405 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.106889 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.081394 25014 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:32.109607 23627 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.135027 23628 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.110548 24996 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.112681 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.112623 25014 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.145773 25113 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:32.146751 25113 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.147318 24822 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.147771 23771 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:32.148087 24822 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:32.149089 23701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.016s	sys 0.032s
W20260709 13:08:32.149488 23701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.016s	sys 0.033s
W20260709 13:08:32.150058 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.150471 24822 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.151017 24822 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:32.152004 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.143384 24947 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.160130 24393 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 2: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
W20260709 13:08:32.161618 25013 consensus_meta.cc:287] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.007s
I20260709 13:08:32.162286 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.163065 23627 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.157552 23624 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.168879 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.149483 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.151518 24822 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.167928 24996 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:32.186786 23620 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.014s	sys 0.063s
W20260709 13:08:32.187996 23620 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.015s	sys 0.063s
I20260709 13:08:32.189396 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 68) took 1837 ms. Trace:
W20260709 13:08:32.191066 25109 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.473s	user 0.002s	sys 0.000s
I20260709 13:08:32.191471 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.191789 25112 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:32.189811 23620 rpcz_store.cc:276] 0709 13:08:30.351668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.455290 (+103622us) service_pool.cc:224] Handling call
0709 13:08:30.455626 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.465601 (+  9975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.465636 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.466069 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.062911 (+596842us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:32.188500 (+1125589us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.188915 (+   415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.189058 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.189114 (+    56us) raft_consensus.cc:1685] finished
0709 13:08:32.189126 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.189319 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9534,"prepare.queue_time_us":1120215,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"raft.queue_time_us":12535,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":4997,"thread_start_us":1710381,"threads_started":2,"wal-append.queue_time_us":1078095}
I20260709 13:08:32.193071 23769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1251) took 1531 ms. Trace:
I20260709 13:08:32.192891 25112 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.194000 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:32.200057 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.203020 25019 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.204246 25084 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.207316 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:32.207741 23629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1507) took 2387 ms (client timeout 1664 ms). Trace:
W20260709 13:08:32.220901 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 319705us
I20260709 13:08:32.208384 23623 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.210558 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 91) took 1245 ms. Trace:
I20260709 13:08:32.193540 23769 rpcz_store.cc:276] 0709 13:08:30.661499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.664334 (+  2835us) service_pool.cc:224] Handling call
0709 13:08:30.664776 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.665237 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.665272 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.707444 (+ 42172us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.537178 (+829734us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:31.540478 (+  3300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.548864 (+  8386us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.188650 (+639786us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:08:32.192502 (+  3852us) raft_consensus.cc:1685] finished
0709 13:08:32.192532 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.192897 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3564,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"spinlock_wait_cycles":576539520,"thread_start_us":808735,"threads_started":1,"wal-append.queue_time_us":952090}
W20260709 13:08:32.213738 25105 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.480s	user 0.005s	sys 0.000s
W20260709 13:08:32.215552 25110 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.512s	user 0.001s	sys 0.005s
I20260709 13:08:32.216375 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.218079 24357 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:32.220608 24822 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.203327 25112 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:32.221778 25126 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.075s	user 0.001s	sys 0.003s
I20260709 13:08:32.221933 25052 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.223634 23620 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:32.227115 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:32.223605 23629 rpcz_store.cc:269] 0709 13:08:29.820095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.867595 (+ 47500us) service_pool.cc:224] Handling call
0709 13:08:32.207496 (+2339901us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b54000dc0d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:32.207639 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4654848256}
I20260709 13:08:32.228582 25033 raft_consensus.cc:3055] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.257417 25033 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:32.258944 25052 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.259073 24990 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.259917 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 88) took 1377 ms. Trace:
I20260709 13:08:32.229180 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:32.260797 23625 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.262091 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:08:32.263278 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45391.3us
I20260709 13:08:32.231689 25014 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.223450 25019 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.233369 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.233783 23627 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.224908 25084 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.236860 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:32.237870 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.239012 23628 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.185184 25113 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:32.247419 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.256568 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.264762 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:32.224597 24953 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.269536 25128 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.277458 23626 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
W20260709 13:08:32.278239 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.237866 23774 rpcz_store.cc:276] 0709 13:08:30.899431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.903637 (+  4206us) service_pool.cc:224] Handling call
0709 13:08:30.904024 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.904897 (+   873us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:31.788481 (+883584us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.089436 (+300955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.109211 (+ 19775us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:32.134079 (+ 24868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.140666 (+  6587us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.144329 (+  3663us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62287,"prepare.queue_time_us":824770,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":472,"raft.queue_time_us":16237,"raft.run_cpu_time_us":5147,"raft.run_wall_time_us":50808,"thread_start_us":958352,"threads_started":2,"wal-append.queue_time_us":324135}
I20260709 13:08:32.285876 23778 raft_consensus.cc:3055] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.286123 25117 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.286537 23778 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:32.286669 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.287566 23772 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.288080 25074 raft_consensus.cc:3055] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:32.288484 25074 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:32.288777 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.290225 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1533) took 1198 ms. Trace:
I20260709 13:08:32.290642 25054 raft_consensus.cc:3055] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.291242 25054 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:32.292119 23622 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.293155 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.293772 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.295224 24389 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 2: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:32.296754 24390 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 2: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:32.296958 25084 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:32.297235 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.298652 23771 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:32.301014 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.301997 23773 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:32.302989 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.303943 23628 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:32.279551 25112 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.305191 25112 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.308146 23624 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.309646 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.309959 23629 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.310420 23699 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.311299 25014 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.312004 25014 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.312475 24996 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.312670 25083 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.313195 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 60) took 2099 ms. Trace:
I20260709 13:08:32.270754 25019 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.314613 25019 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.314242 24953 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.314913 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.315181 25019 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:32.316309 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.316859 24953 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:32.317569 25019 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.283207 25072 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.317757 23778 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.318816 23778 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.318606 25072 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.320245 23700 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:32.320766 23700 pending_rounds.cc:85] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 1
I20260709 13:08:32.321069 25072 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:32.322002 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.260277 23777 rpcz_store.cc:276] 0709 13:08:30.882559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.883340 (+   781us) service_pool.cc:224] Handling call
0709 13:08:30.884225 (+   885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.896942 (+ 12717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.896987 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.917279 (+ 20292us) log.cc:844] Serialized 26 byte log entry
0709 13:08:32.094413 (+1177134us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:32.094485 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.094590 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.259643 (+165053us) raft_consensus.cc:1685] finished
0709 13:08:32.259663 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.259851 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58967,"raft.queue_time_us":36107,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":37278,"spinlock_wait_cycles":1975040,"thread_start_us":1125615,"threads_started":1,"wal-append.queue_time_us":1324437}
I20260709 13:08:32.323622 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.324712 23770 raft_consensus.cc:2393] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:32.325889 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.326802 23770 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:32.294773 25128 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.259148 25033 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.328728 25033 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.329814 25128 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:32.330899 25075 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:32.332050 25064 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.719s	user 0.017s	sys 0.004s
I20260709 13:08:32.331632 25075 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.333633 23774 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.290720 23621 rpcz_store.cc:276] 0709 13:08:31.092104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.228255 (+136151us) service_pool.cc:224] Handling call
0709 13:08:32.289981 (+1061726us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54000654d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:32.290154 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515426176}
I20260709 13:08:32.334650 25075 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:32.338694 23625 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.289557 23772 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.358685 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.364686 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.365017 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.288123 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 64) took 1048 ms. Trace:
W20260709 13:08:32.366971 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.343921 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:32.289575 25074 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.345010 25062 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.369653 24822 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.370229 25062 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.370399 24822 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.313611 23702 rpcz_store.cc:276] 0709 13:08:30.213163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.567637 (+354474us) service_pool.cc:224] Handling call
0709 13:08:30.568126 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.568609 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.568657 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.569201 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.519033 (+949832us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:31.519090 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.519188 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.212662 (+693474us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:08:32.270529 (+ 57867us) raft_consensus.cc:1685] finished
0709 13:08:32.270562 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.312996 (+ 42434us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3909,"raft.queue_time_us":1131,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":6248,"spinlock_wait_cycles":526699776,"thread_start_us":920149,"threads_started":1,"wal-append.queue_time_us":1144497}
I20260709 13:08:32.345814 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.372026 25063 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:32.372412 24822 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.372412 25062 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.369697 25074 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.345885 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:32.293982 23769 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:32.331974 25112 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.379413 23775 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:32.380805 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.381533 23622 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:32.321136 23700 pending_rounds.cc:107] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:32.362329 23778 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.382287 23700 raft_consensus.cc:2889] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:32.363396 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.363608 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.365039 23771 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:32.339855 23623 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.365835 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.365585 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.365648 23621 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 2: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:32.371376 25017 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:32.362651 25108 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.012s	sys 0.016s
I20260709 13:08:32.424579 24359 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:08:32.424894 25108 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.012s	sys 0.016s
I20260709 13:08:32.425624 25071 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.426066 25071 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.383256 23698 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:32.383602 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.426461 25071 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.426946 23703 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.428165 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:32.419318 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.385408 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 106272us
I20260709 13:08:32.386647 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.387547 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.388480 24993 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.388984 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:32.389700 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.375049 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.390793 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:32.390552 25084 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.394029 23699 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:32.394153 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.394891 25111 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.396090 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.397137 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.397724 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.399753 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.441208 24386 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:32.441530 23770 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.442095 24993 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.424247 25017 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.442622 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.438371 25030 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.443881 25030 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.444506 25017 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.400036 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.446064 23769 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.446213 25030 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.447284 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.447983 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.449056 23769 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:32.449208 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet b55528b161184b85a266eb8c58844016: Illegal state: Replica c885217113574e7489e6c3afb6950f76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:32.449908 23770 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:32.400779 25014 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.366603 23701 rpcz_store.cc:276] 0709 13:08:31.235596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.238484 (+  2888us) service_pool.cc:224] Handling call
0709 13:08:31.273513 (+ 35029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.273896 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.273934 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.274406 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:08:32.150068 (+875662us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:32.150567 (+   499us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.150817 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.150906 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.221286 (+ 70380us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b24000fddd8. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e0a59c4 00007f2b3e0a3acb 00007f2b3e25edc9 00007f2b3e25ea55 00007f2b3e25e09d 00007f2b40e9010e 00007f2b40ea788c 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221
0709 13:08:32.265859 (+ 44573us) raft_consensus.cc:1685] finished
0709 13:08:32.279935 (+ 14076us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.283408 (+  3473us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1513,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":2149,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":7419,"spinlock_wait_cycles":14941568,"thread_start_us":832844,"threads_started":1,"wal-append.queue_time_us":857170}
I20260709 13:08:32.402523 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:32.403864 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.452394 24394 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
W20260709 13:08:32.453027 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.453852 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.407897 23773 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.390419 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.455531 24390 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.413779 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.457149 24391 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.413944 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.414769 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.416018 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.420357 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.420423 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.421206 24822 raft_consensus.cc:3055] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.403190 25054 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.461423 25111 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.419485 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.422784 24357 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:32.423516 25112 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.384301 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.427397 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:32.466379 23629 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:32.426450 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.467315 23774 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.467659 23704 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:32.433614 24393 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.468662 23695 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:32.464366 25054 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.461861 24822 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:32.465914 23771 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:32.461513 25081 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:32.470577 25081 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.470474 24822 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.472050 24822 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.473129 25081 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:32.473929 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 86348us
I20260709 13:08:32.470346 24996 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.474606 24996 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.475180 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:32.474963 25071 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.435242 23777 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
W20260709 13:08:32.436139 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.436453 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.433087 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:32.438007 23778 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.439339 24867 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.434947 25084 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.439409 24387 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.440600 23772 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.458901 23700 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.435261 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:32.477780 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46317.4us
I20260709 13:08:32.479975 25075 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:32.485077 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 96195.8us
I20260709 13:08:32.481714 24359 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:32.481253 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:32.460623 25014 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.489315 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:32.489645 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.490120 23629 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.490638 23776 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:32.491081 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.491514 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.474992 24996 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.482987 25026 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:32.494196 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.494104 25026 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.495353 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.496102 23621 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:32.497430 25026 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.497988 25066 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.498761 25066 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.484807 23696 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.492447 24990 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.500221 24990 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.500481 25084 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.504132 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.505471 25128 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:32.506698 23527 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 116) took 5238 ms. Trace:
I20260709 13:08:32.499281 25066 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.511869 24359 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:32.512764 23629 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:32.507642 25128 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.514783 25128 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:32.500766 24990 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.515223 24867 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:32.515962 25128 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.517374 25128 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.508891 23524 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 2, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.525530 23526 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52058 (request call id 186) took 4469 ms. Trace:
I20260709 13:08:32.526019 23526 rpcz_store.cc:276] 0709 13:08:28.055927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.056231 (+   304us) service_pool.cc:224] Handling call
0709 13:08:32.525287 (+4469056us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":923086,"reported_tablets":1}
I20260709 13:08:32.528054 23525 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 215) took 2999 ms. Trace:
I20260709 13:08:32.527845 25014 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.528832 25071 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:32.530478 25014 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.509356 25111 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.531440 25111 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:32.531929 25111 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.528527 23525 rpcz_store.cc:276] 0709 13:08:29.528063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.528200 (+   137us) service_pool.cc:224] Handling call
0709 13:08:32.527822 (+2999622us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:29.806947 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:29.823448 (+ 16501us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:29.824141 (+   693us) write_op.cc:435] Acquired schema lock
0709 13:08:29.827631 (+  3490us) tablet.cc:662] Decoding operations
0709 13:08:29.888620 (+ 60989us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:29.902763 (+ 14143us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:29.909246 (+  6483us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:29.926646 (+ 17400us) tablet.cc:701] Row locks acquired
0709 13:08:29.931396 (+  4750us) write_op.cc:260] PREPARE: finished
0709 13:08:29.954216 (+ 22820us) write_op.cc:270] Start()
0709 13:08:29.965822 (+ 11606us) write_op.cc:276] Timestamp: P: 1783602509947541 usec, L: 0
0709 13:08:29.967999 (+  2177us) op_driver.cc:348] REPLICATION: starting
0709 13:08:30.080871 (+112872us) log.cc:844] Serialized 538 byte log entry
0709 13:08:31.728689 (+1647818us) op_driver.cc:464] REPLICATION: finished
0709 13:08:32.225663 (+496974us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b3e2020ac 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b44d42ef0
0709 13:08:32.366906 (+141243us) write_op.cc:301] APPLY: starting
0709 13:08:32.367060 (+   154us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:32.367226 (+   166us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:32.367262 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:32.367614 (+   352us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:32.367960 (+   346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:32.368031 (+    71us) write_op.cc:312] APPLY: finished
0709 13:08:32.368507 (+   476us) log.cc:844] Serialized 23 byte log entry
0709 13:08:32.368722 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:32.368818 (+    96us) write_op.cc:454] Released schema lock
0709 13:08:32.368874 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:32.425271 (+ 56397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:32.425302 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":635378,"apply.run_cpu_time_us":2518,"apply.run_wall_time_us":2517,"num_ops":1,"prepare.queue_time_us":139985,"prepare.run_cpu_time_us":21720,"prepare.run_wall_time_us":550399,"raft.queue_time_us":1928435,"raft.run_cpu_time_us":31163,"raft.run_wall_time_us":753177,"replication_time_us":1735351,"spinlock_wait_cycles":531465472,"thread_start_us":1507991,"threads_started":4,"wal-append.queue_time_us":312305}]]}
I20260709 13:08:32.547475 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:08:32.548360 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 73271.1us
I20260709 13:08:32.543467 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:32.552287 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:32.553498 24867 raft_consensus.cc:2764] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:32.555799 25030 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:32.556510 25030 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.556991 25030 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:32.543145 25066 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.553184 25112 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.560595 25066 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:32.560343 25112 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.562791 25112 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.563424 25081 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.545639 23769 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.564962 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:32.572646 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:32.507180 23527 rpcz_store.cc:276] 0709 13:08:27.268550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.268701 (+   151us) service_pool.cc:224] Handling call
0709 13:08:32.506428 (+5237727us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:30.392177 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:30.509861 (+117684us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:30.512655 (+  2794us) write_op.cc:435] Acquired schema lock
0709 13:08:30.524490 (+ 11835us) tablet.cc:662] Decoding operations
0709 13:08:30.588028 (+ 63538us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:30.588075 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:30.588105 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:30.588435 (+   330us) tablet.cc:701] Row locks acquired
0709 13:08:30.588452 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:30.588608 (+   156us) write_op.cc:270] Start()
0709 13:08:30.588722 (+   114us) write_op.cc:276] Timestamp: P: 1783602510588550 usec, L: 0
0709 13:08:30.588743 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:30.589442 (+   699us) log.cc:844] Serialized 1289 byte log entry
0709 13:08:32.426136 (+1836694us) op_driver.cc:464] REPLICATION: finished
0709 13:08:32.428124 (+  1988us) write_op.cc:301] APPLY: starting
0709 13:08:32.428229 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:32.428434 (+   205us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:32.430904 (+  2470us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:32.434639 (+  3735us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:32.434800 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:08:32.434855 (+    55us) write_op.cc:312] APPLY: finished
0709 13:08:32.436972 (+  2117us) log.cc:844] Serialized 35 byte log entry
0709 13:08:32.447764 (+ 10792us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:32.447943 (+   179us) write_op.cc:454] Released schema lock
0709 13:08:32.447991 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:32.448424 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:32.448469 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":311351,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":1581,"apply.run_cpu_time_us":3107,"apply.run_wall_time_us":20239,"mutex_wait_us":1154,"num_ops":3,"prepare.queue_time_us":693535,"prepare.run_cpu_time_us":4071,"prepare.run_wall_time_us":212980,"replication_time_us":1837193}]]}
I20260709 13:08:32.574314 23629 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.572121 25080 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.575069 24985 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.565531 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:32.576278 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:08:32.577934 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63586.3us
I20260709 13:08:32.578028 23627 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.581332 23592 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:32.575194 25080 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.553068 25014 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.583344 25134 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:32.565878 24953 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:08:32.582756 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.585678 24867 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.579612 25112 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.586737 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:32.592155 25017 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.593348 24985 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.593784 25017 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.593917 24985 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:32.596267 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55615us
I20260709 13:08:32.590669 24867 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:32.585927 25080 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.592294 25112 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:32.600739 24985 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.601080 25017 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.607043 25112 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.599429 25062 raft_consensus.cc:2764] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:08:32.596897 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:32.610971 23592 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:32.617230 23629 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:32.617651 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.618439 24394 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:32.618551 24359 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:32.619488 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.619843 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.592257 25134 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:32.621711 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:32.599290 24867 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.613734 25063 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.623139 24387 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:32.623343 25063 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:32.623967 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.628708 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.628975 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.630643 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.631326 23771 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.632014 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.632325 23776 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:32.632684 23777 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.628418 25063 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.635715 25111 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.636132 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.638059 23775 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.608331 25014 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.641726 25014 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.637027 25134 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.621160 24985 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.648973 24985 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.649523 24985 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.645757 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:32.648082 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.653270 23775 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:32.649544 23524 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 176) took 2786 ms. Trace:
I20260709 13:08:32.654742 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.654872 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:32.655444 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.656947 23592 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:32.657749 23592 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:32.659037 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:32.659137 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:32.661725 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:32.630064 25117 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:32.665939 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.614187 25017 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:08:32.659013 24822 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.645757 25063 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.663414 25035 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.664008 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.682806 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.690266 23628 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:32.664431 23769 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:32.661007 25062 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.682878 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:32.663055 25117 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:32.663650 24947 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.692262 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:32.686928 23627 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:32.693164 25035 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.700528 25141 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.698997 24947 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.703188 25141 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.692817 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:32.703493 24996 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.715781 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:32.705513 25075 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.701260 25111 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.701308 24822 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.717964 24822 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.718217 23772 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:32.719189 23770 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:32.721159 25063 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.724016 25074 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:32.724977 25074 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:32.725292 25074 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:32.725965 24867 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.727023 25112 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.709017 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:32.709604 25071 consensus_queue.cc:1059] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:32.710640 25017 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.731493 23593 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:32.691767 25026 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.714164 23623 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:32.714121 25030 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.714699 25117 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.718405 24822 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.701887 25035 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.698057 25062 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.696787 25081 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:08:32.707221 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:32.713521 24947 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.734290 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:32.741863 24394 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:32.701205 24359 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:32.707181 24990 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.698019 23621 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:32.727764 25074 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.654965 23524 rpcz_store.cc:276] 0709 13:08:29.871230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.881495 (+ 10265us) service_pool.cc:224] Handling call
0709 13:08:32.649463 (+2767968us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:32.638425 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:32.640650 (+  2225us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:32.640699 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:08:32.640717 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:32.641298 (+   581us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:32.641397 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:32.641427 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:32.641725 (+   298us) tablet.cc:701] Row locks acquired
0709 13:08:32.641771 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:08:32.641995 (+   224us) write_op.cc:270] Start()
0709 13:08:32.642133 (+   138us) write_op.cc:276] Timestamp: P: 1783602512641868 usec, L: 0
0709 13:08:32.642152 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:08:32.642803 (+   651us) log.cc:844] Serialized 533 byte log entry
0709 13:08:32.645055 (+  2252us) op_driver.cc:464] REPLICATION: finished
0709 13:08:32.645486 (+   431us) write_op.cc:301] APPLY: starting
0709 13:08:32.645559 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:32.645655 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:32.645736 (+    81us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:32.645978 (+   242us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:32.646124 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:32.646165 (+    41us) write_op.cc:312] APPLY: finished
0709 13:08:32.646353 (+   188us) log.cc:844] Serialized 23 byte log entry
0709 13:08:32.646515 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:32.646591 (+    76us) write_op.cc:454] Released schema lock
0709 13:08:32.646631 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:32.646970 (+   339us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:32.646996 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54062,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":227,"apply.run_cpu_time_us":1427,"apply.run_wall_time_us":1428,"num_ops":1,"prepare.queue_time_us":104622,"prepare.run_cpu_time_us":3268,"prepare.run_wall_time_us":6159,"replication_time_us":2757,"thread_start_us":44041,"threads_started":1}]]}
I20260709 13:08:32.713789 25141 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.743784 25075 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:32.744210 25140 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.742455 25033 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.751423 25033 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.751958 25074 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.750967 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.752620 25081 raft_consensus.cc:3055] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.753160 25081 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:32.752024 25033 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.754498 25081 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.736893 24994 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.744570 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:32.745211 23743 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:32.745898 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:32.745801 25064 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:32.736225 25063 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.731717 25017 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.739961 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:32.757557 23627 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:32.741344 25062 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.761265 25017 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.772023 25054 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.738817 25128 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:08:32.759500 25014 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.758255 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.780241 23770 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.783861 25014 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.749521 24867 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.739250 25026 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.758273 25063 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:32.814991 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 69880.7us
I20260709 13:08:32.761302 25075 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:32.832617 24394 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.834090 25026 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.837440 24996 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.837792 25030 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.839046 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.839833 23772 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:32.839995 24990 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.852480 25062 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.853099 25084 raft_consensus.cc:3055] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:32.853591 25084 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:32.854532 25084 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.855298 25062 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.854921 25017 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.856120 25084 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.856544 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.832643 25075 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.860718 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.853129 23770 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:32.865924 23592 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:32.865976 25080 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.867288 25030 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:32.867369 24393 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:32.867920 25030 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:32.869278 25128 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:32.868886 25030 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.870546 25112 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.816804 25063 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.879958 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:32.881575 23743 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:32.882432 25064 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:32.883011 25111 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.883312 25064 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.883922 25064 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:32.828002 24985 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.883958 25054 raft_consensus.cc:3055] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:32.886195 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:08:32.888326 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.889245 24953 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.889958 24994 raft_consensus.cc:3055] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.889640 24822 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.884953 25064 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.889708 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.889793 24953 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.890770 24994 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:08:32.897769 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.893114 24947 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.870900 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.891369 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:32.893286 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:32.897769 25035 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.887363 25054 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:32.906220 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.911315 23775 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:32.909612 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 149076us
W20260709 13:08:32.903630 25139 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:08:32.901225 25081 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.887447 24985 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:32.921625 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 111485us
I20260709 13:08:32.886405 25017 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:32.922567 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:32.922943 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.926239 23770 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:32.929142 25033 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.929422 25054 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.931908 25054 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.932766 25112 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:32.933416 25112 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.910789 25062 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.922596 25128 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.935074 25128 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:32.929354 24357 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:32.933678 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:32.936991 23627 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.902912 24822 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.919299 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:32.938383 23624 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:32.943325 24391 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:32.944940 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:32.945537 24393 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.886672 25141 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.952836 25143 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.953456 25143 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:32.953629 24947 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.953752 24953 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:32.954442 25143 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.935629 25112 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.940327 25014 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:32.957079 25035 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.957185 25014 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.957901 23743 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:32.943147 25074 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.935984 25128 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.963042 25111 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.964221 25080 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.970852 23627 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:32.932354 25033 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:32.972628 24359 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:32.897964 24994 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:32.980285 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.981304 23778 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.982885 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:32.986441 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 73205.9us
I20260709 13:08:32.984555 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:32.977970 25080 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:33.000218 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.002753 23771 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:33.008719 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.016013 25035 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.016829 25035 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.981787 24953 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:08:32.989132 25014 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.032565 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:33.034019 25026 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:33.034408 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 76604.4us
I20260709 13:08:33.035207 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:33.038508 25033 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.039116 25033 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.040777 25064 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:33.041344 25033 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.041393 25064 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:33.048031 23778 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:33.008507 25080 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:33.051831 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:33.056164 25150 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:08:33.057104 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.056949 23592 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:33.044479 25064 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:32.995994 25063 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.060050 24994 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.060931 25035 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:33.061192 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet 8a0f95eab8184aa59b6fcef0d9f32b0f: Illegal state: Replica 9ab488f10c434878a749f261e99a8065 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
W20260709 13:08:33.071219 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.070631 24393 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:33.074839 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:33.072139 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.094475 23775 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:33.090782 23778 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:33.095877 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:33.096140 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:33.085883 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:33.093382 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:33.096766 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.102813 23777 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:33.103704 25112 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:33.104185 23592 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:33.104270 25112 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.105134 24947 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:33.105615 24947 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:33.106570 25112 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.106511 24947 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.107180 25112 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:33.108188 25080 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.110729 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:33.111189 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.111379 23778 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:33.113421 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:33.107520 25112 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.081068 25062 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:33.085151 25014 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:33.117071 25035 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.128564 25035 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:33.129038 25035 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.117314 25033 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.117165 25026 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:33.118368 25112 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.126673 25062 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:33.136888 25063 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.137113 25062 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.137806 23769 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:33.130131 24985 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:33.139215 23592 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:33.139547 24985 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:33.140256 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet e8c18a99e9414e39bff9dea9564bd61b: Illegal state: Replica 9ab488f10c434878a749f261e99a8065 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:33.140417 25026 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:33.141476 25026 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.132555 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:33.113322 23771 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:33.121156 25128 raft_consensus.cc:2764] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:08:33.143890 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:33.204291 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:33.206465 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 122374us
I20260709 13:08:33.156381 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:33.142058 24985 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.214040 24393 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:33.176182 25063 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:33.216039 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:33.180213 25146 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.143018 25033 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:33.181180 25147 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.137807 25141 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.135058 25014 raft_consensus.cc:697] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:33.135134 25143 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 13:08:33.257314 23743 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:08:33.219283 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 75450.8us
I20260709 13:08:33.220419 24391 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:33.286231 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.137135 23772 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:33.254740 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:08:33.321034 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.341300 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 86643.8us
W20260709 13:08:33.345005 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.290591 25146 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.304072 25033 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.249462 25019 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:33.286207 25063 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:33.222735 24953 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.139s
I20260709 13:08:33.352721 24947 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:33.372784 24822 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:33.372998 24867 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:33.373579 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet 0fcdc335ab6748159bae3d8308e238ae: Illegal state: Replica c885217113574e7489e6c3afb6950f76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:33.380050 24947 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:33.380203 24822 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.381176 24947 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.380230 24867 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.383693 24822 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.385179 24867 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:33.375226 25153 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.219s	user 0.004s	sys 0.000s
I20260709 13:08:33.376351 25063 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.298583 25035 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.400133 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:33.405498 24391 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
W20260709 13:08:33.380153 25156 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:08:33.364171 25141 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.407173 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:33.364903 25146 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.340421 25147 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.422896 25143 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.423485 25143 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:33.424857 25157 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:08:33.425946 25143 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.426546 25143 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:33.426317 25141 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.427126 25143 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:33.427989 24391 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:33.427517 25014 consensus_queue.cc:237] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.428210 25143 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.429767 25030 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:33.369990 25019 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:33.406894 25064 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:08:33.442581 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 192883us
I20260709 13:08:33.417531 24822 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:33.459246 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.459471 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.437909 25019 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:33.468845 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 69233.1us
I20260709 13:08:33.461175 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:33.413960 24985 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:33.462754 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.484797 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:33.484987 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:33.485623 23624 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:33.488562 23629 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:08:33.488993 23629 pending_rounds.cc:85] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 2
W20260709 13:08:33.498828 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.500116 25147 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.502267 25033 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.472378 25064 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:33.504522 25064 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.510344 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:33.526494 23629 pending_rounds.cc:107] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:08:33.527064 23629 raft_consensus.cc:2889] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:33.531953 23628 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.536918 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:33.539144 23621 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.554976 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:33.583142 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 89668.9us
I20260709 13:08:33.525312 25165 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:33.590066 25165 raft_consensus.cc:697] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:33.591265 25165 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:33.592785 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.533911 25164 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:33.487778 24985 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.596278 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:33.550558 25147 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:08:33.603931 25161 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:08:33.608569 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:33.605250 25164 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.613320 25164 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.601322 24994 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.621047 24994 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.623346 24994 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:33.621055 25112 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.624353 23627 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:33.624469 25019 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.625207 25033 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:33.626320 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 143873us
I20260709 13:08:33.638628 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:33.635716 23769 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:33.632949 24822 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:08:33.652154 25166 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:08:33.628990 25035 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.658316 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:33.662647 23627 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
W20260709 13:08:33.662667 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54177.1us
I20260709 13:08:33.665081 23669 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:33.665457 25168 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:33.666332 25168 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:33.666780 25158 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.322s	user 0.002s	sys 0.000s
I20260709 13:08:33.668469 25167 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:33.669014 25167 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:33.668619 24822 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.669757 25141 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.666854 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:33.669453 25167 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.628440 25147 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.649626 24867 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:33.694152 23628 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.695655 23622 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:33.699285 25112 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.713214 25019 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.714174 25019 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:33.714660 25019 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:33.715147 25019 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.718765 25147 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.720062 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:33.746734 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.682385 25030 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:08:33.770887 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 102989us
I20260709 13:08:33.779451 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:33.782193 23625 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:33.794207 23622 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:33.794358 23629 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:33.684973 24867 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.770538 25081 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:33.778535 24947 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:33.778016 25075 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.800628 23626 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:33.778635 25030 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.800231 23628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ec1d400f174350acc92722149e02d4"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:08:33.816026 23628 raft_consensus.cc:606] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Received request to transfer leadership to TS b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:33.816362 23628 raft_consensus.cc:614] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:33.816828 25030 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.817307 24867 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:33.805009 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 138285us
I20260709 13:08:33.819674 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:33.820446 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:33.822935 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:33.823143 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:33.823704 24393 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 2: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:33.805492 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:33.800221 24947 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.824460 25143 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:33.824872 25143 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:33.825258 25143 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.825394 25168 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.825732 24947 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.807894 25172 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:33.826645 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:33.801770 24985 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.802378 25081 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.810930 25064 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.813314 25019 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.814148 25186 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.803999 25075 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.826471 25172 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.808830 25146 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.828176 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:33.830120 25180 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.830780 25064 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.832415 25081 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:33.830749 25181 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.833791 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:33.838122 25167 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.840245 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.842605 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:33.857091 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.843657 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.844079 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:33.858242 23695 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:33.858304 23776 raft_consensus.cc:2376] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2. Re-sending same reply.
I20260709 13:08:33.858439 25143 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.859848 23624 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:33.860350 23769 raft_consensus.cc:606] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Received request to transfer leadership to TS b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:33.860775 23769 raft_consensus.cc:614] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:33.861897 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.863076 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.865296 25181 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:33.865769 25181 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.844372 25075 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:33.844828 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.868968 23775 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:33.845023 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:33.876915 25128 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:33.877576 25128 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:33.881067 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.854065 25186 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.882064 25081 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.882576 25081 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.883534 25146 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.883786 25186 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.854094 25180 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.884410 25180 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.845441 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.845706 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:33.921094 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:33.921741 23704 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:33.921897 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 93822.8us
I20260709 13:08:33.922765 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:33.924104 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.924476 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.924759 23699 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
W20260709 13:08:33.847568 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.848764 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:33.925738 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:33.926204 23628 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:33.926337 23775 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.927701 23695 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.927903 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.849278 25172 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.849798 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:33.843369 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.857091 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.932303 23778 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:33.884562 25081 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.933915 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:33.934653 24387 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:33.935144 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.884562 25167 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.935308 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.935565 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:33.929651 23769 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:33.917450 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.936729 23697 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:33.935875 23773 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:33.921756 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:33.849045 25019 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:33.931339 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.933194 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.943337 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.933825 23627 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:33.913990 23770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a97c483343c425ea75f1f6632924819"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:33.934789 23702 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.933928 25150 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:33.936771 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.919610 25143 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:33.940699 23778 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:33.939155 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.930579 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:33.942736 23775 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:33.944020 23698 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:33.935329 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.947115 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.947201 23695 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:33.927386 25146 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:33.949221 23696 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:33.931073 25033 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.950254 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:33.950922 25150 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:33.951891 25075 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.952455 25075 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:33.953181 25150 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:33.954445 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:33.955369 24394 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:33.956303 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:33.956966 23695 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.958448 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:33.959408 23701 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:33.941982 24947 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:33.961580 24947 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:33.962522 25165 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:33.963063 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:33.955191 25146 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.961019 25019 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:33.964315 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:33.943828 24867 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.965687 23777 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:33.966552 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.967202 23592 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:33.969182 23700 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:33.951527 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:33.972105 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:33.950600 25033 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.972384 24822 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:33.974311 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:33.958288 23770 raft_consensus.cc:606] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:33.974483 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:33.974999 23770 raft_consensus.cc:614] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:33.975466 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:33.975615 25128 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:33.974599 24822 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:33.957505 25172 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.971822 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:33.946233 25182 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:08:33.976071 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.984074 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:33.992746 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:34.008658 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:34.091890 23775 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:33.967775 24947 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:33.964152 25146 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:34.001932 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:34.090159 23697 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:34.129107 24393 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 2: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:34.133878 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:34.134265 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:34.134562 23773 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:34.134902 23698 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.135296 23700 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:33.998689 23772 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:34.136272 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.008008 25186 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 13:08:34.136854 23700 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:34.137701 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.138191 23700 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:34.138657 23695 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:34.138909 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:08:34.071473 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.976168 23771 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:34.139643 23700 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:34.008934 25177 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 13:08:34.139557 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.144060 23695 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
W20260709 13:08:34.047176 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 49878.6us
I20260709 13:08:34.145500 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:34.072165 23704 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:33.983961 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:34.016695 23702 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:34.148742 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:34.149569 23628 raft_consensus.cc:2376] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2. Re-sending same reply.
I20260709 13:08:34.152860 23703 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:34.155695 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:34.156558 23698 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:34.157874 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:34.159929 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:34.161044 23695 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.155695 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:34.097543 23524 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 2 to 3, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 3 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.167948 23524 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 2, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 2 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.173228 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:34.087291 25141 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.175479 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:34.003974 25064 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:33.991830 25019 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:33.977118 25033 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.180187 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:34.181155 23697 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:34.174371 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:34.186721 23628 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:34.183243 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:34.188506 23627 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:34.189541 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:34.172367 25168 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.971853 25030 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.208s
I20260709 13:08:34.178128 25128 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:34.199958 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:34.160351 24947 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.116513 24993 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:08:34.008742 25187 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.176s
I20260709 13:08:34.196249 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:34.185932 23524 catalog_manager.cc:5697] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 3, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 3 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.174480 25165 raft_consensus.cc:2764] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:08:34.211082 24953 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.211876 24953 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.215510 23620 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:34.215529 23769 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:34.200771 25168 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:34.215689 23524 catalog_manager.cc:5697] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 2, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:34.219170 23524 catalog_manager.cc:5697] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 3, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 3 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.135370 24822 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:34.198747 23695 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:33.973184 24867 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.147104 25172 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:34.232539 25146 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:34.202776 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 71948.1us
I20260709 13:08:34.233649 25172 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:34.233745 24867 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:34.214411 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.234630 23704 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:34.225548 23627 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:34.235431 23629 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.236570 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:34.238121 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:34.238823 23627 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.239555 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:08:34.225164 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.240422 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.241019 24947 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:34.241123 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:34.241652 24947 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:34.243103 23771 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:34.222443 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:34.243495 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:34.244038 23625 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:34.244203 23769 raft_consensus.cc:606] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:34.245157 23625 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.246243 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:34.246697 24867 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.243582 25165 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:08:34.228379 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:34.242662 24947 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:34.226511 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 293990us
I20260709 13:08:34.252727 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:34.254451 25064 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:34.240384 25172 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.259675 23593 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:34.259965 23629 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:34.200467 25128 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.265028 25168 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:34.265290 23623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:08:34.272626 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:34.276839 25111 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.277196 25081 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.277752 25081 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:34.266427 25112 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:34.278957 23703 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:34.280035 23623 raft_consensus.cc:606] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Received request to transfer leadership to TS b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:34.280171 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.280587 23623 raft_consensus.cc:614] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:34.280934 23701 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:34.283341 23701 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:34.284044 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.280126 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.283473 23704 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:34.265671 23625 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:34.284680 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:34.202634 25062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.010s	sys 0.017s
I20260709 13:08:34.190092 25141 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.286950 23703 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:34.285069 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.288600 23697 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:34.231086 23626 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:34.281651 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:34.299314 23628 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:34.299307 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:34.301976 23698 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:34.310508 23627 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:34.273350 25128 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.273636 24994 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.266197 25075 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:34.213270 25019 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.230448 23524 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 3, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 3 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.269447 25150 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 13:08:34.267386 25172 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:34.550976 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 291366us
I20260709 13:08:34.551994 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:34.420507 23695 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:08:34.548609 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 249363us
I20260709 13:08:34.274585 25165 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.546844 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:34.557112 24393 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:34.316866 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:08:34.558799 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 242024us
I20260709 13:08:34.560105 23698 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:08:34.296775 25062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.010s	sys 0.017s
I20260709 13:08:34.296170 25030 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:34.286214 25081 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:34.280273 25112 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:08:34.561975 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 274480us
I20260709 13:08:34.563340 24394 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:34.564138 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:34.579842 23773 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:34.565653 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:34.580821 23776 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:34.582085 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.573410 23777 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:08:34.556237 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.377121 23623 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
W20260709 13:08:34.377769 25192 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:08:34.296380 25014 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.546648 25141 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:34.411048 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:34.411715 25190 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:34.582773 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:08:34.583761 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.582379 24357 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:34.582816 23698 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:34.580809 23743 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:34.584631 23620 raft_consensus.cc:2368] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3.
W20260709 13:08:34.563455 25180 consensus_meta.cc:287] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.010s
I20260709 13:08:34.602419 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:34.613083 24391 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:34.564147 24994 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.584192 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.564631 24867 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.564345 25080 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:34.565016 24822 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.577001 25177 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.581880 25112 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.619024 23742 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:34.577229 25194 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:08:34.582163 25081 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:34.563119 25186 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:08:34.666778 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:34.679427 24393 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:34.584240 24947 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:34.628465 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45754.5us
I20260709 13:08:34.684932 24391 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:34.677047 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 58146.5us
I20260709 13:08:34.661252 25074 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:34.623281 25064 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:34.720490 23698 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:34.603353 25187 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.643556 25080 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.654187 25165 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:34.725863 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 113687us
I20260709 13:08:34.652872 24953 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:34.654615 25146 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:34.718878 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 136547us
I20260709 13:08:34.603142 25164 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 13:08:34.595803 25030 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.689028 25074 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.729957 25064 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.663204 24994 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:34.624255 25141 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.649781 25014 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:34.681862 24947 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:34.678869 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.743664 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.689145 25111 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:34.736246 25080 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.754501 23698 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:34.747757 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 387823us
I20260709 13:08:34.736379 25165 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.753479 24359 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:34.741456 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:34.643556 24867 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:34.681391 25081 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:34.678695 24822 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:34.743069 25084 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.750260 25074 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:34.623643 25180 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:34.756312 25064 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:34.749192 25063 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:34.736850 25187 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.736024 25177 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.778004 25165 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.785749 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:34.816071 23698 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:34.766189 25190 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 13:08:34.793375 25196 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:08:34.770359 24947 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.796015 25172 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:34.741987 25204 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:08:34.773089 25111 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.764617 25141 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.830700 25150 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:34.789346 25194 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.894062 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.895674 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 156515us
W20260709 13:08:34.841943 25181 consensus_meta.cc:287] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.976s	user 0.011s	sys 0.002s
I20260709 13:08:34.809950 25209 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:34.849081 25063 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.867391 24822 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:34.858486 24391 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:34.865376 25081 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:34.873379 25014 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:34.878785 25198 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
I20260709 13:08:34.879566 23699 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:34.880836 25180 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:34.882299 25030 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:34.837045 25205 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:08:34.847906 25033 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.003s
I20260709 13:08:34.907217 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:34.922873 23629 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:34.857757 25187 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:34.910000 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:34.893690 25111 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.813820 25084 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.894140 25150 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:34.905833 25209 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.902194 25177 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:34.906319 24994 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:08:34.908450 25181 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.982546 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:34.908643 25194 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:34.983101 25209 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.033098 25084 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:35.033440 25150 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:35.051316 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 972) took 1118 ms. Trace:
I20260709 13:08:35.029780 25128 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:35.037119 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.979137 25033 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:34.921864 25213 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:08:35.095364 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:34.983603 23667 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Timed out: RequestConsensusVote RPC to 127.21.244.3:45959 timed out after 1.718s (SENT)
I20260709 13:08:35.098259 23695 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:35.065028 25190 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.005988 25035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.019s	sys 0.017s
W20260709 13:08:35.100841 25035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.026s	sys 0.024s
I20260709 13:08:35.100628 25190 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:35.078264 23699 rpcz_store.cc:276] 0709 13:08:33.932862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.932971 (+   109us) service_pool.cc:224] Handling call
0709 13:08:35.051026 (+1118055us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b540008a2d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:35.051209 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2150984448}
I20260709 13:08:35.102661 25190 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:35.122336 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.127279 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 387419us
I20260709 13:08:35.130574 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:35.054064 25207 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.137990 25081 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:35.138715 25081 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:35.080113 25141 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:35.140250 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 229255us
I20260709 13:08:35.152132 23700 raft_consensus.cc:2368] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:35.078591 24867 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:35.131826 23769 raft_consensus.cc:2393] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:35.163134 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:35.170280 23621 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:35.162319 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:35.062533 24947 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:35.062896 25165 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:35.174077 23695 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:35.160915 25197 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:08:35.175079 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.176319 23773 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
W20260709 13:08:35.176775 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 194897us
I20260709 13:08:35.176788 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:35.177366 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.177698 24391 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:35.180032 23695 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.180326 23703 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.180987 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.182542 23776 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:35.191428 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:08:35.200757 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 293396us
I20260709 13:08:35.209017 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.194370 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.214285 23699 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:35.218956 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1258) took 1030 ms. Trace:
I20260709 13:08:35.178529 25150 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:35.180794 23696 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:35.222775 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:35.160653 25207 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:35.226688 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:35.234696 23743 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:35.219528 23622 rpcz_store.cc:276] 0709 13:08:34.188070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.275910 (+ 87840us) service_pool.cc:224] Handling call
0709 13:08:34.303464 (+ 27554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.303751 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:34.754705 (+450954us) log.cc:844] Serialized 14 byte log entry
0709 13:08:35.218517 (+463812us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:35.218587 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:35.218644 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.218742 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.218882 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9362,"prepare.queue_time_us":106847,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":1594,"thread_start_us":812789,"threads_started":2}
I20260709 13:08:35.226126 23702 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:35.230703 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.235255 25190 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.222743 25204 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:35.272837 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 81538.1us
I20260709 13:08:35.274171 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.275496 23697 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:35.269486 25190 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:35.299453 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.299274 25224 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.317384 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.320111 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.304134 25186 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:35.327711 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 93123.9us
I20260709 13:08:35.297631 25204 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:35.305415 25033 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:35.315311 25190 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.338493 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:35.333839 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.335711 23702 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:35.337615 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63853.5us
I20260709 13:08:35.321676 25224 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.378285 23622 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:35.338860 25221 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:08:35.385931 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:35.396252 23628 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:35.339641 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:35.401278 23629 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:35.414479 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:35.415616 23627 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:35.439049 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:35.458832 23622 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:35.326130 25064 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:35.387261 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.387251 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:35.387593 23625 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:35.388918 23621 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.392132 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.325627 25194 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:35.467062 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.475863 23695 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:35.332585 25128 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:35.330749 25241 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:35.472226 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.478297 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.479753 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.384509 25224 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.383534 23699 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
W20260709 13:08:35.488087 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 101204us
I20260709 13:08:35.461840 23696 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.494418 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.498224 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.499248 23699 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
W20260709 13:08:35.477528 25223 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:08:35.500639 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.468870 25165 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:35.503760 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.516054 23702 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:35.381631 25111 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:35.505795 23773 raft_consensus.cc:2393] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:08:35.530182 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.530412 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.502349 24947 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:35.532644 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 105) took 1256 ms. Trace:
I20260709 13:08:35.532748 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.533128 23624 rpcz_store.cc:276] 0709 13:08:34.276169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.301896 (+ 25727us) service_pool.cc:224] Handling call
0709 13:08:34.302314 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.302727 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.302764 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:34.557075 (+254311us) log.cc:844] Serialized 26 byte log entry
0709 13:08:34.978351 (+421276us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:34.978393 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.978464 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:35.532442 (+553978us) raft_consensus.cc:1685] finished
0709 13:08:35.532463 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.532591 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13571,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":30456,"thread_start_us":332542,"threads_started":1,"wal-append.queue_time_us":590442}
I20260709 13:08:35.518054 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.537851 23701 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:35.477507 25241 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:35.529783 23623 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.551076 23774 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:35.550781 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.552879 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:35.557453 25204 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:35.559450 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.535573 25207 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:35.561510 25207 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:35.561630 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.562090 25207 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:35.562860 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.567677 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:08:35.555526 25229 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
W20260709 13:08:35.541620 25217 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:08:35.571636 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.598268 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:35.565237 25228 log.cc:927] Time spent T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:08:35.608609 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.551821 25241 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:35.553791 25239 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.599802 25233 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:08:35.615828 23773 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3.
I20260709 13:08:35.618395 25081 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:35.620501 25234 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:08:35.621606 25230 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:08:35.602164 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.623924 25239 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:35.628355 25236 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:08:35.628566 25081 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.614544 25062 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.630713 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:35.636031 23701 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:35.632476 25080 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.833s	user 0.010s	sys 0.003s
I20260709 13:08:35.624245 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.652529 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:35.653590 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.641597 25062 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.654467 23775 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 4: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:08:35.654896 25112 consensus_meta.cc:287] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.974s	user 0.012s	sys 0.001s
I20260709 13:08:35.647605 25207 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:35.659833 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.658142 25062 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.669576 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.672971 25247 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:35.678099 23624 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.658453 25064 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:35.681386 23701 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:35.681751 23628 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.682250 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.686117 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.651882 25080 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:35.696216 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.696357 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:35.679399 25207 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.703102 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:35.703819 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:35.705058 23628 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:35.705544 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:35.706094 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:35.706939 23628 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.702054 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:35.711170 23623 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 2: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:35.712275 23623 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:35.713454 25150 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:35.714903 25074 consensus_meta.cc:287] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.892s	user 0.012s	sys 0.000s
I20260709 13:08:35.715308 25074 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:35.717401 25074 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:35.718079 23777 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:35.719308 25150 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:35.720904 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:35.721228 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.713639 23623 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.675253 25112 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:35.657434 25238 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:08:35.734401 23701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
mode: GRACEFUL
new_leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:48074
I20260709 13:08:35.734786 25259 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:35.736091 25019 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:35.753264 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.735878 25242 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:08:35.734427 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:35.738229 25112 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:35.732124 25033 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:35.708638 25207 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:35.739137 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.739578 23628 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:35.740347 25181 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:35.749285 23701 raft_consensus.cc:606] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Received request to transfer leadership to TS 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:35.702970 25111 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:35.754766 23775 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.690593 25213 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:08:35.708415 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.691510 25248 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:08:35.777200 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.781741 23770 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:35.783063 25250 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:35.783628 25250 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:35.784036 23700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1000) took 1506 ms (client timeout 1506 ms). Trace:
I20260709 13:08:35.784634 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.785773 25250 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:35.784408 23700 rpcz_store.cc:269] 0709 13:08:34.277589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.279821 (+  2232us) service_pool.cc:224] Handling call
0709 13:08:35.783823 (+1504002us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b5400195854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:35.783972 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967467520}
I20260709 13:08:35.786171 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.788403 23776 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.789703 23776 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:35.791612 25246 log.cc:927] Time spent T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:08:35.793725 24387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 275) took 1005 ms. Trace:
I20260709 13:08:35.793900 25186 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:35.794328 25186 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.799357 25080 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:35.800671 24359 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:35.801862 25239 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:35.763531 25259 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:35.803442 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.804076 23772 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.804421 25259 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:35.805171 25258 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.723001 25064 consensus_queue.cc:1059] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:08:35.786633 24357 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:35.805729 25258 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.779850 23771 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 4: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:35.773646 25207 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.794178 24387 rpcz_store.cc:276] 0709 13:08:34.788608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.800864 (+ 12256us) service_pool.cc:224] Handling call
0709 13:08:34.832658 (+ 31794us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.978304 (+145646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.980551 (+  2247us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:35.097704 (+117153us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.294420 (+196716us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:35.294484 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.793306 (+498822us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b54002f7454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:35.793361 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:35.793416 (+    55us) raft_consensus.cc:1685] finished
0709 13:08:35.793430 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.793641 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2196,"raft.run_cpu_time_us":6907,"raft.run_wall_time_us":63611,"spinlock_wait_cycles":135677696,"thread_start_us":118536,"threads_started":1,"wal-append.queue_time_us":281261}
I20260709 13:08:35.824203 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.874171 23776 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.825773 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:35.875290 24391 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.754228 25187 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:08:35.754503 25074 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:08:35.847656 25033 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.856871 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:35.858067 23593 leader_election.cc:336] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.595s (SENT)
I20260709 13:08:35.859397 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:35.829730 25075 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.805500 25063 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:35.824177 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:35.904677 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:35.908099 24394 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:35.916272 25261 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.833066 25258 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.916862 25261 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:35.932217 25260 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:35.904181 25033 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:35.937140 25245 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.937760 25245 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:35.910043 25075 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.946419 25075 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:35.949306 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 91292.4us
I20260709 13:08:35.952369 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.970237 25251 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:35.970956 25212 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:35.971334 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:35.971963 25212 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:35.973289 24867 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:35.972391 25212 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:35.976442 25212 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:35.994465 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.993217 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:36.002149 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:36.003060 23775 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:36.003849 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:35.972342 25252 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.013962 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:36.004169 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:35.989689 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:36.008224 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 287395us
I20260709 13:08:36.027568 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:35.997923 25212 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.025271 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:36.031198 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:36.032745 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:36.036599 23621 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:08:36.042883 25224 consensus_meta.cc:287] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.547s	user 0.014s	sys 0.004s
I20260709 13:08:36.045686 25224 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.027177 25019 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.027418 25128 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.056059 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:36.058668 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:36.059551 23770 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 4: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:08:36.063302 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.063753 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:36.064512 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:36.066239 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:36.030723 25182 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.063750 23771 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:36.061921 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:36.080291 23773 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:36.042382 25213 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.069115 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:36.070598 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:36.055661 25033 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:36.072208 25257 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:36.041919 25245 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:36.098905 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:36.115386 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:36.105633 24357 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:36.073475 24394 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:36.071863 25237 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.085788 24391 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:36.092183 23592 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:36.086869 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:36.062947 25128 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:36.086661 25213 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:36.094322 25141 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.106845 25033 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.118310 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:08:36.135099 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 428602us
I20260709 13:08:36.133723 23773 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.134882 23776 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:36.102615 25224 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:36.136395 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:36.148602 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:36.129626 25270 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.132139 25084 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:36.138813 25227 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:36.163339 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:08:36.156841 25190 consensus_meta.cc:287] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.773s	user 0.008s	sys 0.004s
W20260709 13:08:36.159021 25209 consensus_meta.cc:287] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 1.059s	user 0.015s	sys 0.008s
I20260709 13:08:36.170230 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:36.193475 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:36.158466 25238 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.157943 25224 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.195328 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:36.196456 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 78257.9us
I20260709 13:08:36.159433 25033 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.201306 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:36.201503 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:36.164959 25256 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.190249 25243 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:36.190820 25064 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.231575 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:36.116624 25257 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.190418 25277 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:36.238736 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:36.202690 25270 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:36.202436 23771 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:36.242436 24394 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:36.204195 25182 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.204344 25248 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:36.204516 25242 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:36.168766 25239 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:08:36.139292 25237 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.164942 25084 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.248647 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:36.194273 25209 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.235078 24994 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.254769 24391 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:36.217386 25238 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:36.202148 25190 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.239871 25243 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.164667 25128 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.250336 25277 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:36.264190 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45727.1us
I20260709 13:08:36.265614 23775 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:36.253305 25242 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.267421 25242 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.254604 25111 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.251271 25248 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:36.218295 25250 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:08:36.270228 23778 raft_consensus.cc:2368] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3.
W20260709 13:08:36.271916 25274 log.cc:927] Time spent T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:08:36.273002 25190 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:36.278241 25241 consensus_meta.cc:287] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.000s
I20260709 13:08:36.281060 25261 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:36.281903 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:36.285055 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:36.285274 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:36.264190 25243 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.267768 25276 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.258993 25262 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.233843 25256 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.303869 23774 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:36.288560 25248 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.268814 25277 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.252497 25182 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.258311 25280 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:08:36.298223 25247 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.297421 25239 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:36.291980 25128 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.300184 25181 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:08:36.301421 25033 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:08:36.346025 25291 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:36.301803 25241 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.351641 23743 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:36.317451 25239 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:08:36.353381 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 57789.4us
I20260709 13:08:36.319006 23771 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:36.358624 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:36.359180 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:36.360745 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:36.323331 25209 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:36.316505 25247 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:36.296521 25270 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.370833 23777 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:36.367216 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:08:36.365456 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 361914us
I20260709 13:08:36.378875 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:36.379153 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:36.391389 24394 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:36.382437 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:36.392416 23624 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.371698 25224 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:36.376775 25081 consensus_meta.cc:287] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.000s
I20260709 13:08:36.358166 25276 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.386736 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:36.321681 25283 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:08:36.394569 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:36.390514 25291 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:36.405313 25261 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:08:36.413162 25261 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:36.413556 25261 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:08:36.414312 25207 consensus_meta.cc:287] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.010s
I20260709 13:08:36.414417 25261 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.414849 25207 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.405978 25081 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:36.415825 25261 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.416100 25081 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.418179 25081 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:36.418686 25275 log.cc:927] Time spent T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:08:36.420740 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:36.422495 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:36.423128 23775 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:36.423776 25064 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:36.424265 25064 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.424703 25064 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.433549 23592 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:36.435639 25081 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:36.436244 25261 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:36.438628 25261 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.440986 25261 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.441068 25084 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:36.443073 25182 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:36.443679 25111 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.455968 23624 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:36.447255 25247 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.462387 25247 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:36.462570 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.467082 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 181877us
I20260709 13:08:36.469717 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:36.439515 25181 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.410739 25291 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.449296 25276 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:36.470752 23769 raft_consensus.cc:2410] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:36.475139 23774 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:36.427243 25257 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:36.450168 25237 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:36.477547 23593 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.570s (SENT)
I20260709 13:08:36.364588 25239 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.479614 25290 raft_consensus.cc:2764] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:36.479849 25278 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.364001 25238 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.491140 25226 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:36.493059 25256 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:36.487202 25062 consensus_meta.cc:287] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.803s	user 0.009s	sys 0.004s
I20260709 13:08:36.482887 25291 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.494524 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:36.486353 25276 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.500801 23774 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:36.496628 25277 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.513156 25241 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:36.501850 25062 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.536653 25062 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:36.543292 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:36.544137 24394 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:36.538288 25075 consensus_meta.cc:287] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.591s	user 0.004s	sys 0.008s
I20260709 13:08:36.494179 25257 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:08:36.503958 25276 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:36.542569 23772 consensus_meta.cc:287] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.004s
I20260709 13:08:36.508953 25261 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.520913 25226 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.571008 25277 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:36.571619 25224 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.531302 25243 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:36.589418 25284 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:08:36.581041 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.614313 24394 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:36.535545 25064 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.576423 23772 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:36.593029 25227 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.552971 25075 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.628348 23770 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:36.618211 25186 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.001s
I20260709 13:08:36.630759 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42286 (request call id 8) took 1022 ms. Trace:
I20260709 13:08:36.617247 25277 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.633476 23773 rpcz_store.cc:276] 0709 13:08:35.601184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.559473 (+958289us) service_pool.cc:224] Handling call
0709 13:08:36.623835 (+ 64362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:36.607228 25207 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:36.637676 24357 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:36.640265 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:36.632891 25227 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.643699 24391 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:36.640414 25214 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:36.592000 25213 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.643549 25277 raft_consensus.cc:697] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:36.655627 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1289) took 1175 ms. Trace:
I20260709 13:08:36.656090 23778 rpcz_store.cc:276] 0709 13:08:35.478222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.479448 (+  1226us) service_pool.cc:224] Handling call
0709 13:08:36.653833 (+1174385us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b5400347e54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:36.654085 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1816209792}
I20260709 13:08:36.636216 25186 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:36.665872 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 291465us
W20260709 13:08:36.670300 25264 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.532s	user 0.006s	sys 0.000s
W20260709 13:08:36.673641 23593 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.891s (SENT)
I20260709 13:08:36.674196 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:36.675872 25207 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.679177 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:36.679566 25243 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:36.680992 25248 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.681264 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:36.697018 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:36.697476 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:36.713976 23778 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.695988 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:36.698509 23592 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:36.699117 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:36.717258 23774 raft_consensus.cc:2393] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:36.703990 24359 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:36.683197 23668 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:08:36.695988 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet f5cd55b231da4c27b7547a2714bb43d9: Illegal state: Replica 4466bf6d6cf84ee89e84ea074e3964c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:36.723412 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:36.724233 23624 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.725610 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:36.727943 23626 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:36.730557 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:36.731460 23774 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.664150 25214 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:08:36.741600 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 379764us
I20260709 13:08:36.689301 25293 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.694615 25213 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:36.745108 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.751405 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.683768 25186 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:36.684036 24387 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:36.749771 23775 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:36.692515 25261 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:36.733223 25245 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.732677 25062 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.758744 23624 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:36.744158 25257 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:36.761679 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 323822us
I20260709 13:08:36.754382 25293 raft_consensus.cc:697] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:36.769337 25214 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.770888 25283 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:36.771690 25280 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:36.781847 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:36.784976 25248 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:36.748216 25128 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.785696 25293 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.786013 25128 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.788201 25064 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:36.788444 25128 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:36.788759 23524 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 117) took 3031 ms. Trace:
I20260709 13:08:36.789484 25075 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:36.784175 25062 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:36.792191 25062 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.752743 25270 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:36.796450 25033 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.797019 25033 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.798460 25019 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:36.798871 25019 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:36.782420 25261 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.750425 25226 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:36.783643 25277 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.796343 25270 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.763299 25257 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:36.781489 25258 consensus_meta.cc:287] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.817s	user 0.002s	sys 0.010s
I20260709 13:08:36.799702 25019 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:36.774086 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.782079 25283 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.781994 25245 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:36.803027 25261 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.804162 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1314) took 1028 ms. Trace:
I20260709 13:08:36.804327 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1299) took 1318 ms. Trace:
W20260709 13:08:36.839917 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 120307us
I20260709 13:08:36.776640 23778 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:36.847190 23770 rpcz_store.cc:276] 0709 13:08:35.775826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.153034 (+377208us) service_pool.cc:224] Handling call
0709 13:08:36.628166 (+475132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.632803 (+  4637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.803880 (+171077us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54000591d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:36.804078 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785749888}
I20260709 13:08:36.851169 23592 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:36.848399 23777 rpcz_store.cc:276] 0709 13:08:35.485441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.071756 (+586315us) service_pool.cc:224] Handling call
0709 13:08:36.072087 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.371317 (+299230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.804120 (+432803us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54002c9cd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:36.804274 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686579072}
I20260709 13:08:36.851480 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:36.789127 23524 rpcz_store.cc:276] 0709 13:08:33.757424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.757670 (+   246us) service_pool.cc:224] Handling call
0709 13:08:36.788698 (+3031028us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:34.796443 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:34.797008 (+   565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:34.797039 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:08:34.797053 (+    14us) tablet.cc:662] Decoding operations
0709 13:08:34.797810 (+   757us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:34.797863 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:34.797889 (+    26us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:08:34.798377 (+   488us) tablet.cc:701] Row locks acquired
0709 13:08:34.798390 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:08:34.798536 (+   146us) write_op.cc:270] Start()
0709 13:08:34.798632 (+    96us) write_op.cc:276] Timestamp: P: 1783602514798492 usec, L: 0
0709 13:08:34.798646 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:08:34.910127 (+111481us) log.cc:844] Serialized 2434 byte log entry
0709 13:08:35.054784 (+144657us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b3e2020ac 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b
0709 13:08:35.985520 (+930736us) op_driver.cc:464] REPLICATION: finished
0709 13:08:36.156035 (+170515us) write_op.cc:301] APPLY: starting
0709 13:08:36.156132 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:36.156304 (+   172us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:36.156325 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:36.218884 (+ 62559us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:36.251240 (+ 32356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:08:36.254962 (+  3722us) write_op.cc:312] APPLY: finished
0709 13:08:36.270058 (+ 15096us) log.cc:844] Serialized 53 byte log entry
0709 13:08:36.296354 (+ 26296us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.296467 (+   113us) write_op.cc:454] Released schema lock
0709 13:08:36.296515 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:36.296889 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.296933 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":154112,"apply.run_cpu_time_us":3616,"apply.run_wall_time_us":146923,"num_ops":6,"prepare.queue_time_us":211959,"prepare.run_cpu_time_us":43389,"prepare.run_wall_time_us":479530,"raft.queue_time_us":306862,"raft.run_cpu_time_us":44460,"raft.run_wall_time_us":70146,"replication_time_us":1186713,"spinlock_wait_cycles":22841088,"thread_start_us":667686,"threads_started":4,"wal-append.queue_time_us":463049}]]}
I20260709 13:08:36.848802 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:36.822321 25297 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 13:08:36.859899 23774 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
W20260709 13:08:36.816001 25242 consensus_meta.cc:287] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.007s
I20260709 13:08:36.871277 23592 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:36.871847 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:36.822278 25270 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:36.872284 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 92923.4us
W20260709 13:08:36.874503 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.812139 23769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1037) took 1309 ms (client timeout 1563 ms). Trace:
I20260709 13:08:36.878078 25019 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.878358 25260 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:36.878997 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:36.879626 25242 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.880769 25245 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.831842 25033 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:36.822671 25257 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.810177 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:36.875485 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:36.809798 25262 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.908260 23771 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:36.908695 23776 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:36.838173 25283 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:36.911868 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.896306 25300 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
W20260709 13:08:36.901464 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet 55436fc3614f4f558828ea5de361e5f0: Illegal state: Replica 4466bf6d6cf84ee89e84ea074e3964c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:36.873023 25080 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.889712 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:36.863483 25238 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.824105 25258 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.862789 25227 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.886215 25084 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.832532 25276 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:36.943362 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:36.901768 25260 raft_consensus.cc:697] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:36.917852 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:36.945693 25286 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.967913 25177 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:36.813360 25291 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:36.980728 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1044) took 1030 ms. Trace:
I20260709 13:08:36.903066 25074 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:08:36.981253 24394 raft_consensus.cc:2368] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:36.974480 25238 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:08:36.983561 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 93937.4us
W20260709 13:08:37.010702 24358 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.114s (SENT) [suppressed 65 similar messages]
I20260709 13:08:36.981940 23527 catalog_manager.cc:5697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 2, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:36.886008 23769 rpcz_store.cc:269] 0709 13:08:35.503164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.559174 (+ 56010us) service_pool.cc:224] Handling call
0709 13:08:36.811824 (+1252650us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b540032f854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:36.812050 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935674752}
W20260709 13:08:37.011667 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.973563 25033 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:08:36.983256 23776 rpcz_store.cc:276] 0709 13:08:35.950607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.355362 (+404755us) service_pool.cc:224] Handling call
0709 13:08:36.357675 (+  2313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.909112 (+551437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.980484 (+ 71372us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540014ee54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:36.980669 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1266776320}
I20260709 13:08:37.018333 23527 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 5, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 5 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:37.022159 23527 catalog_manager.cc:5697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 4, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:37.022938 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 43886.8us
I20260709 13:08:36.980695 25286 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:37.025779 23527 catalog_manager.cc:5697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 2, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:37.013509 24994 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:37.028262 23527 catalog_manager.cc:5697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 2, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:37.031052 23527 catalog_manager.cc:5697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 2, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:37.034219 25258 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:37.034399 25270 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:37.038703 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:37.036952 23527 catalog_manager.cc:5697] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 2, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:37.043020 23624 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:37.047546 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.054333 23624 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:37.057382 23527 catalog_manager.cc:5697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 3, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:37.060859 23527 catalog_manager.cc:5697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 2, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:37.063136 23527 catalog_manager.cc:5697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 2, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:37.065056 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 322642us
I20260709 13:08:37.066913 24359 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:37.069949 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:37.035344 25177 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:37.086452 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:37.090803 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:37.091972 23778 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3.
I20260709 13:08:37.093652 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:37.094451 23776 raft_consensus.cc:2410] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:37.094780 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:37.077250 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:37.096041 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:37.097508 23625 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:37.097630 23626 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.080538 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:37.077549 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:37.099324 23624 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.099596 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:37.100857 23667 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:37.106339 25181 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:37.106416 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:37.106746 23772 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:37.107298 25181 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.096412 25298 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:37.107313 23625 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:37.111804 25194 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:37.112435 25194 raft_consensus.cc:697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:37.113437 25194 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:37.117192 25261 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:37.071265 25260 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.118640 25289 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:37.119248 25289 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:37.099138 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:37.122370 23620 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.097106 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:37.125828 23624 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:37.068953 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:37.127457 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:37.135007 23669 leader_election.cc:400] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3.
I20260709 13:08:37.135556 23669 leader_election.cc:403] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.144671 25239 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.144905 25293 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3.
I20260709 13:08:37.148882 25227 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:37.144719 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 50533.9us
I20260709 13:08:37.155486 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:37.158638 25270 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:37.159659 25295 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:37.160388 25291 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:37.161762 25276 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:37.108075 25298 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:37.124611 25286 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.166049 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:37.167613 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:37.168959 23778 raft_consensus.cc:2393] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:37.170370 23774 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:37.172292 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:37.173492 23777 raft_consensus.cc:2410] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:37.074920 25283 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:08:37.131996 25033 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.151829 25277 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:37.190816 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:37.192085 24387 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:37.155115 23769 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.177141 23626 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:37.097654 25310 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:37.176429 23776 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 4: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:08:37.208455 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 53086.9us
W20260709 13:08:37.204144 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 193469us
I20260709 13:08:37.210381 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:37.139043 25019 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:08:37.182019 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:37.216801 24394 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:08:37.183374 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48797.2us
W20260709 13:08:37.218039 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:37.218505 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.180810 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:37.163174 25298 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:37.230383 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49679.2us
I20260709 13:08:37.154806 25257 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.189540 25242 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:37.197978 25283 consensus_queue.cc:1243] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:37.186885 25207 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:08:37.161814 25177 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:37.163998 25238 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.285907 23622 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:08:37.250919 25035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.018s	sys 0.035s
I20260709 13:08:37.287823 23620 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
W20260709 13:08:37.293459 25307 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:08:37.294369 25312 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:37.294834 24387 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:37.261910 25293 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:08:37.251883 25299 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:08:37.231631 25212 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:37.297187 25213 consensus_meta.cc:287] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.000s
I20260709 13:08:37.231792 25316 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:37.200220 25289 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:37.303697 25035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.019s	sys 0.035s
I20260709 13:08:37.285058 25276 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:08:37.347340 23775 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:37.326155 25141 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.340720 25295 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.343230 25316 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.344161 25033 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:37.397782 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 177817us
I20260709 13:08:37.388046 25289 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.398180 25283 raft_consensus.cc:993] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: : Instructing follower 4466bf6d6cf84ee89e84ea074e3964c9 to start an election
I20260709 13:08:37.394580 25277 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:37.393788 25316 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.383450 25226 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:08:37.388893 25141 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.394025 25295 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:37.420217 25280 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:37.436156 25295 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:37.436148 25141 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:37.437099 25295 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:37.443405 24387 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:37.450280 25084 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:37.451359 24390 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:37.434211 25280 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:37.453956 25280 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:37.457612 23769 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:37.423797 25310 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:37.455479 25280 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:37.468457 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 258148us
I20260709 13:08:37.469264 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:37.476481 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:37.477700 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 111901us
I20260709 13:08:37.479969 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:37.464891 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:37.466123 25181 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:37.468062 25295 raft_consensus.cc:1081] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Signalling peer 4466bf6d6cf84ee89e84ea074e3964c9 to start an election
I20260709 13:08:37.464725 25277 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:37.516827 25313 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.326s	user 0.003s	sys 0.001s
W20260709 13:08:37.523542 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.486419 25329 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:37.505695 25332 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:37.522244 25181 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:37.522502 25080 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:37.525249 25213 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.513943 25331 consensus_queue.cc:1059] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:37.527827 25330 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:37.532135 25332 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:37.555115 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:37.556529 23776 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
W20260709 13:08:37.545934 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:37.557835 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:37.561764 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 81896.1us
I20260709 13:08:37.530830 25310 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.533344 25329 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.564599 25033 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.565227 25329 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:37.554006 25213 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.545374 25080 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:37.576711 25080 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:37.578265 25080 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.537848 25333 consensus_queue.cc:1059] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:08:37.580740 25333 raft_consensus.cc:3055] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:37.581238 25333 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:37.582317 25333 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:37.584481 25326 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:08:37.587663 25316 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.589659 25033 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:37.592352 25257 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:37.595078 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.596138 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:37.596674 25317 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:08:37.597424 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:37.595101 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:37.598491 25311 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.406s	user 0.002s	sys 0.000s
I20260709 13:08:37.599867 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:37.569437 25332 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.558281 25330 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.575327 25181 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:37.600039 23770 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:37.600365 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:37.600570 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.569686 25213 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:37.567966 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:37.607767 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:37.630882 23622 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.629817 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:37.602646 23667 leader_election.cc:400] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3.
I20260709 13:08:37.557067 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:37.632085 23667 leader_election.cc:403] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.634141 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:37.635587 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:37.637260 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:37.639518 23776 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:37.644132 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:37.644189 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:37.645562 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 77671.4us
I20260709 13:08:37.622887 23777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:43460
I20260709 13:08:37.646983 23777 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.647398 23777 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.626724 25291 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:37.645345 23700 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:37.646668 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:37.652084 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.652412 23743 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:37.650928 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:37.654937 23698 raft_consensus.cc:2376] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3. Re-sending same reply.
I20260709 13:08:37.656618 25239 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:37.658360 25337 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:08:37.658231 25291 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:37.650058 25288 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.660386 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.661324 23701 raft_consensus.cc:2410] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:37.640933 25295 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3.
I20260709 13:08:37.645886 25332 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.648805 25250 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:37.643455 25346 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:37.645769 25289 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.645991 25342 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.679009 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.680152 23698 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:37.649017 25343 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:37.685333 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.686105 23701 raft_consensus.cc:2376] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3. Re-sending same reply.
I20260709 13:08:37.703512 25330 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:37.648609 25033 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:08:37.689991 23777 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:37.704514 25033 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:37.704850 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:37.718550 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.675030 25250 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.722620 23697 raft_consensus.cc:2410] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:37.724500 23777 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:37.685323 25343 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.730185 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:37.684068 25316 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:37.734896 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:37.705308 25033 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:37.721796 25213 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:37.723037 25080 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:37.683579 25289 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.728667 25250 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.724442 25330 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:37.749788 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 97440us
I20260709 13:08:37.737558 25343 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.756759 23622 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:37.759815 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:37.732398 25216 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.761495 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:37.762957 23701 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:37.763092 23698 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:37.765465 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.767320 23698 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:37.753870 25080 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:37.770561 25344 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:08:37.771060 25080 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:37.765969 25216 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.774613 25216 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:37.777727 25350 log.cc:927] Time spent T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:08:37.777835 25315 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.586s	user 0.002s	sys 0.000s
I20260709 13:08:37.752025 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:37.787278 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.788261 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:37.791059 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:37.791932 23700 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.788655 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:37.793151 23696 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.796244 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.788991 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:37.797905 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.798314 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.800144 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:37.801148 23703 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:08:37.807945 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.799414 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.809414 23695 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:37.759531 25213 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:37.811321 23702 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:37.760641 25239 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:08:37.815222 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49888.6us
I20260709 13:08:37.784549 25288 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:37.824298 25213 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.826462 25334 raft_consensus.cc:3055] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:37.826987 25334 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:37.827247 25289 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:37.827893 25334 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:37.829075 25334 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.762355 25330 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:37.834267 25349 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:08:37.810959 24387 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.810364 25033 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.865798 25289 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.866446 25289 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.868261 25330 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:38.154529 25141 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:37.940671 25288 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:38.164213 25288 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:37.912575 23696 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:37.920454 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:37.971102 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.171908 23771 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:38.159368 23699 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:37.873224 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.160125 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.160127 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.173677 23703 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:38.173807 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.174014 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.174417 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.174695 23697 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:38.174974 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.175460 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.174973 23703 raft_consensus.cc:2376] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4. Re-sending same reply.
I20260709 13:08:38.176788 23695 raft_consensus.cc:2410] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:38.176985 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.177520 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.177593 23703 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:38.178577 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:37.939453 23775 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:08:38.114528 25298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.015s	sys 0.001s
W20260709 13:08:38.179391 25298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.018s	sys 0.001s
I20260709 13:08:37.899885 25239 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.179565 23703 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:37.984917 25353 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.180639 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.180966 25353 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.146624 25343 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:37.974896 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 134718us
I20260709 13:08:38.187772 25343 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:38.190049 25177 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.190716 25177 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:38.191870 23622 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:38.193250 25177 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:38.169924 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.170557 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.043098 25314 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.829s	user 0.002s	sys 0.001s
I20260709 13:08:38.041611 25291 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:37.882225 25250 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:37.897104 25289 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:38.148818 25033 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:38.173049 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.251082 25250 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:37.919322 25243 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:38.176013 23697 raft_consensus.cc:2376] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3. Re-sending same reply.
I20260709 13:08:38.253022 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.160964 25141 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:38.178653 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.200575 25286 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.256275 23695 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:37.926409 23700 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
W20260709 13:08:38.052464 25308 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 1.017s	user 0.007s	sys 0.001s
I20260709 13:08:38.181136 23699 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:38.181739 23703 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:08:37.882192 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet 0ab3e50aa3864da9beb30247f660a030: Illegal state: Replica 9ab488f10c434878a749f261e99a8065 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:37.870369 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.257928 24394 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:08:38.148403 24358 leader_election.cc:336] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.772s (SENT)
W20260709 13:08:37.986639 25306 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.794s	user 0.002s	sys 0.003s
I20260709 13:08:38.184144 23624 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:38.259384 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 111021us
I20260709 13:08:38.194744 23743 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:38.262022 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:38.262146 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 67490.3us
I20260709 13:08:38.262694 23774 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.266942 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:38.267637 23625 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:38.266974 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:38.269047 23629 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:38.042021 25270 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:38.195693 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:38.274364 23622 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:38.197642 25353 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:38.199608 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 281215us
W20260709 13:08:38.280601 23593 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.558s (SENT)
W20260709 13:08:38.281872 23593 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.605s (SENT)
W20260709 13:08:38.282866 23593 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.615s (SENT)
I20260709 13:08:38.287107 23629 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:38.288780 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.289597 23698 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:38.290609 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.199700 25333 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.301210 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.211506 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:08:38.213104 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.307659 23701 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:38.214102 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:38.220468 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.222546 24993 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:38.241936 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.253700 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.271628 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:38.277088 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.293205 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:38.296029 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.297290 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.315531 23700 raft_consensus.cc:2368] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:38.315991 23697 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:38.316763 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.318722 23777 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:38.318995 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:38.252545 25212 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:38.321049 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.321923 23697 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:38.323029 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.324256 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:38.313438 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.327337 23703 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:38.329339 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.330165 23695 raft_consensus.cc:2368] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:38.326367 23697 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
W20260709 13:08:38.336727 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.201678 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.309815 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:38.293596 25291 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.340811 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.285953 25250 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:38.350677 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:38.351354 24393 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.342772 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.352365 23699 raft_consensus.cc:2410] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:38.273829 25270 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:38.344239 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.357286 23700 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 4: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:38.344198 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.351292 23770 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:38.358289 23770 pending_rounds.cc:85] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 1
I20260709 13:08:38.354344 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.353235 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:38.358556 23770 pending_rounds.cc:107] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:38.358530 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.359297 23770 raft_consensus.cc:2889] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:38.363703 23774 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:38.366678 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.369830 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.367678 23699 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:38.273212 25243 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:38.372960 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.373872 24393 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:38.374368 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:38.376945 23699 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:38.377143 23624 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 1.
I20260709 13:08:38.378088 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.375788 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.379195 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.379469 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:38.379884 23695 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:38.381318 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.382066 23696 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:38.383584 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.384306 23704 raft_consensus.cc:2368] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:38.387545 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:38.388095 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.388305 23625 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.317179 25074 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:08:38.389922 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.393266 23698 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:38.394771 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.390348 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.390765 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1058) took 1700 ms. Trace:
I20260709 13:08:38.390787 23703 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:38.355953 25277 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.331103 25075 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:08:38.395665 23698 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:38.402199 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.371837 25177 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:38.397423 23773 rpcz_store.cc:276] 0709 13:08:36.690799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.691825 (+  1026us) service_pool.cc:224] Handling call
0709 13:08:36.692283 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.692763 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.692791 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.693279 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.970097 (+276818us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:36.970139 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.970215 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.985830 (+1015615us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:08:38.390442 (+404612us) raft_consensus.cc:1685] finished
0709 13:08:38.390478 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.390701 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5952,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"spinlock_wait_cycles":47932288,"thread_start_us":276347,"threads_started":1,"wal-append.queue_time_us":463715}
I20260709 13:08:38.408320 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.408238 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:38.376586 25343 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:38.347416 25212 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.419565 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.421702 23696 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:38.406739 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.423179 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.349182 25293 consensus_queue.cc:1059] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:08:38.429625 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.372188 25250 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:38.424286 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.413545 25277 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.355195 25291 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.446611 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.448856 25291 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:38.442659 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:38.451489 25242 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.451972 25242 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.452335 25242 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:38.456532 25364 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:08:38.447584 23695 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:38.371574 25299 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:08:38.457862 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.402843 25356 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:38.462234 25243 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:38.462652 25356 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:38.463431 25293 raft_consensus.cc:3055] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:38.464139 25293 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:38.463788 25356 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:38.464617 25341 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.465130 25341 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.465443 25293 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.467039 25141 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:38.468042 25288 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:38.467440 25341 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:38.468670 25288 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:38.469331 25334 consensus_meta.cc:287] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
I20260709 13:08:38.469448 25288 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.428557 25343 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.470258 25343 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.474649 25353 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:38.475318 25353 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.476199 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:38.426290 25270 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.477605 25353 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:38.481531 24387 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:38.482412 24391 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:38.484463 25250 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.462579 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.487967 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:38.488404 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.488812 23620 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 2: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:38.467244 25293 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:38.414305 24358 leader_election.cc:336] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.655s (SENT)
I20260709 13:08:38.430301 23700 raft_consensus.cc:2376] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3. Re-sending same reply.
I20260709 13:08:38.430488 23703 raft_consensus.cc:2376] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4. Re-sending same reply.
I20260709 13:08:38.490881 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:38.493168 23624 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
W20260709 13:08:38.491242 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 76994.8us
I20260709 13:08:38.495143 23704 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:38.493800 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.494102 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.497792 23703 raft_consensus.cc:3055] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:38.412313 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.436379 23625 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:38.364964 25336 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:08:38.498194 23703 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:38.439579 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.504513 23701 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:38.427366 23696 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:38.499466 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:38.501123 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:38.462268 25212 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:38.499060 23699 raft_consensus.cc:2376] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3. Re-sending same reply.
I20260709 13:08:38.513651 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:38.511550 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.518455 23704 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:38.506681 23703 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:38.519361 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.519506 23703 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.525139 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.527716 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.529479 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.530438 23696 raft_consensus.cc:2376] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3. Re-sending same reply.
I20260709 13:08:38.531503 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.533200 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.540740 23701 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:38.510165 25336 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:38.536381 24358 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.542901 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.546996 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.548229 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.543645 23700 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:38.553735 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.558346 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.558694 23696 raft_consensus.cc:2376] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4. Re-sending same reply.
I20260709 13:08:38.559288 23704 raft_consensus.cc:2376] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4. Re-sending same reply.
I20260709 13:08:38.560690 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:08:38.563613 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 164168us
I20260709 13:08:38.564514 23704 raft_consensus.cc:2410] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:38.544271 25239 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.541407 24993 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.565763 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.545115 25336 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:38.572531 23696 raft_consensus.cc:2376] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3. Re-sending same reply.
I20260709 13:08:38.576298 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.579766 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.581003 23771 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:38.564134 25213 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:38.583637 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.572438 25239 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.566303 25075 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.585006 25336 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.566552 25186 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:38.586642 25277 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:38.574827 23593 leader_election.cc:400] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:38.618327 23593 leader_election.cc:403] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:08:38.619324 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 44722.1us
W20260709 13:08:38.587150 25366 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
I20260709 13:08:38.588590 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:38.622567 23774 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:38.588786 23696 raft_consensus.cc:2410] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:38.590943 23703 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:38.566658 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.594061 23701 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
W20260709 13:08:38.623812 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.612862 23695 raft_consensus.cc:2410] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:38.624286 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.625072 23703 raft_consensus.cc:2376] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3. Re-sending same reply.
I20260709 13:08:38.628153 23701 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:38.628551 23703 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:38.629302 23704 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:38.629709 23667 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:38.601572 25239 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:38.633129 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 84970.6us
W20260709 13:08:38.635718 23593 leader_election.cc:336] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.506s (SENT)
I20260709 13:08:38.637167 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.635246 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.636962 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:38.639216 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:38.640498 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:38.641515 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:38.641546 23593 leader_election.cc:336] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.695s (SENT)
I20260709 13:08:38.643888 23701 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 4: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:38.643527 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.645008 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.637187 25336 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.636933 25186 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:08:38.645664 23701 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.647480 25370 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.626020 25141 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
W20260709 13:08:38.656687 23593 leader_election.cc:336] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.719s (SENT)
I20260709 13:08:38.661761 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.665304 23628 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:38.637137 25033 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.600888 25213 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.665773 25370 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.649466 25075 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.629700 25238 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:08:38.670284 25033 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:38.677539 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.734671 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.683079 23593 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.782s (SENT)
I20260709 13:08:38.735842 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:08:38.736979 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 53948.3us
W20260709 13:08:38.737768 23593 leader_election.cc:336] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.803s (SENT)
I20260709 13:08:38.738210 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.686322 25141 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.670679 23701 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
W20260709 13:08:38.742024 23593 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.806s (SENT)
W20260709 13:08:38.720409 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.730494 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 90096.9us
I20260709 13:08:38.730883 23777 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:38.715505 23698 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
W20260709 13:08:38.798992 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.742039 23701 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:38.807155 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 119048us
I20260709 13:08:38.810662 25213 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:38.727265 25353 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.690760 25377 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:38.711534 25033 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.817147 23701 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:38.684963 25075 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:38.670924 25354 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.141s
I20260709 13:08:38.693380 25239 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.802677 25370 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:38.799785 25238 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:38.809890 25357 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.009s
I20260709 13:08:38.800496 25343 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.830518 25075 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:38.844538 23593 leader_election.cc:336] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.817s (SENT)
I20260709 13:08:38.845731 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.836119 25377 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:08:38.849558 23593 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.823s (SENT)
W20260709 13:08:38.852551 23593 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.892s (SENT)
W20260709 13:08:38.853449 23593 leader_election.cc:336] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.903s (SENT)
I20260709 13:08:38.853823 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:08:38.857630 23593 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.923s (SENT)
I20260709 13:08:38.859054 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:08:38.860762 23593 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.954s (SENT)
W20260709 13:08:38.864787 23593 leader_election.cc:336] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.999s (SENT)
W20260709 13:08:38.865548 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.865970 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.867594 25371 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.868494 25371 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.823573 25353 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.858155 25343 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:38.857836 25141 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:38.870483 23593 leader_election.cc:336] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.024s (SENT)
I20260709 13:08:38.883569 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:08:38.885089 23593 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.032s (SENT)
W20260709 13:08:38.886078 23593 leader_election.cc:336] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.055s (SENT)
I20260709 13:08:38.886797 23593 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:08:38.888577 23593 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.198s (SENT)
I20260709 13:08:38.848925 25238 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:38.894763 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 72650.1us
I20260709 13:08:38.892902 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.867194 25242 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:38.905611 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.906455 25141 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.906878 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:38.907773 25141 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.908263 25141 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:38.908716 25141 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.909490 23593 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.909955 23698 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:38.910398 25243 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.910712 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:38.911453 25243 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:38.912417 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:08:38.913169 25383 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:38.913486 25330 raft_consensus.cc:2764] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:08:38.911098 23698 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:38.892619 25371 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.892396 25370 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.920009 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:08:38.929042 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 115994us
W20260709 13:08:38.942348 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.976992 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 43629us
I20260709 13:08:38.903613 25343 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.893520 25212 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:08:38.992791 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.012176 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.013038 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.976671 25386 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.999279 23772 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:08:38.999258 25380 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:08:39.009759 25333 consensus_meta.cc:287] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.698s	user 0.008s	sys 0.006s
I20260709 13:08:38.989605 25238 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:39.027832 25388 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:08:39.030926 25378 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.215s	user 0.001s	sys 0.001s
W20260709 13:08:39.046113 25387 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:08:39.035643 25141 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.057372 25353 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:39.036541 25386 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:38.522987 25341 consensus_queue.cc:1175] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:39.063238 25386 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:39.064826 25394 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:39.025959 25239 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:39.089327 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:39.089915 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:39.090348 25141 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:39.090590 23701 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.038028 25238 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:39.091684 25075 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:39.092777 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:39.076288 25033 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.080457 23699 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:08:39.053596 25288 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 13:08:39.095691 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:39.095256 24390 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:39.108470 23699 raft_consensus.cc:2410] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:39.110157 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:39.112092 23701 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:39.113425 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:39.087304 23697 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:39.092180 25238 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.069947 25242 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:39.110868 23699 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:39.117733 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:39.119077 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:39.151219 23703 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 3. Ops: []
W20260709 13:08:39.093163 25360 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.016s	sys 0.030s
I20260709 13:08:39.155540 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:39.151269 25333 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:39.166288 25333 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:39.169091 25333 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:39.169327 25336 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.169967 25336 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:39.172411 25336 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:39.173532 25075 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:39.109561 25288 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.176465 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:39.177346 23628 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:39.177572 25288 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:39.115245 25293 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.154146 25342 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.180486 23699 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:39.180410 25342 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:39.181442 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.182085 23699 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:08:39.182500 23699 pending_rounds.cc:85] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 5
I20260709 13:08:39.182757 23699 pending_rounds.cc:107] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:08:39.183183 23699 raft_consensus.cc:2889] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:39.184739 23699 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:39.196125 23773 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:39.196604 23699 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:08:39.197124 23699 pending_rounds.cc:85] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 1
I20260709 13:08:39.197397 23699 pending_rounds.cc:107] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:08:39.197669 23699 raft_consensus.cc:2889] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:39.198935 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:39.160337 25360 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.017s	sys 0.030s
I20260709 13:08:39.183579 25342 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:39.206054 25277 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:39.211058 23592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.017s	sys 0.017s
W20260709 13:08:39.216063 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.221470 23592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.017s	sys 0.018s
W20260709 13:08:39.222975 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 929797us
W20260709 13:08:39.225633 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 145181us
W20260709 13:08:39.226084 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.228070 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:38.983814 25377 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:39.228624 23704 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:39.229022 23704 pending_rounds.cc:85] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 1
I20260709 13:08:39.229338 23704 pending_rounds.cc:107] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:39.229625 23704 raft_consensus.cc:2889] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:39.229475 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:08:39.230935 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 311201us
I20260709 13:08:39.179623 25293 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.216861 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:39.234352 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 308138us
I20260709 13:08:39.234002 24391 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:39.237373 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:39.209726 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:39.208134 25209 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:08:39.242313 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.227890 25212 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:08:39.245174 25250 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.250713 25250 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.231104 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:39.237166 25239 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.238627 25370 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:39.273383 25250 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:39.273661 25336 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:39.274246 25336 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:39.244464 25213 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.277138 25213 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.277165 25336 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:39.246328 23701 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:39.246672 25298 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:39.245616 23704 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:39.259096 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:39.259768 25356 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:39.260542 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:39.261686 23776 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:08:39.267457 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:39.267983 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:39.286825 23701 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:39.210152 25392 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:08:39.279136 25213 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:39.279991 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:39.228955 25277 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.268610 25342 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:39.282994 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:39.256498 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:39.273887 25033 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:39.321098 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 64680.7us
I20260709 13:08:39.253784 24387 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:39.325456 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:39.329101 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:39.270408 24390 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:39.354140 25277 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:39.355284 23695 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:39.355770 23695 pending_rounds.cc:85] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 1
I20260709 13:08:39.356027 23695 pending_rounds.cc:107] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:39.356326 23695 raft_consensus.cc:2889] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:39.356606 25369 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.907s	user 0.000s	sys 0.004s
I20260709 13:08:39.280555 25343 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:08:39.357072 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:39.288902 25370 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:39.359867 25370 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.362429 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1594) took 1010 ms. Trace:
I20260709 13:08:39.293143 25356 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.292663 23769 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:39.286509 25298 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.362826 23696 rpcz_store.cc:276] 0709 13:08:38.351716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.901500 (+549784us) service_pool.cc:224] Handling call
0709 13:08:38.901804 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.916845 (+ 15041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.916882 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.917414 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.116522 (+199108us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:39.161062 (+ 44540us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.161326 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.161421 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.362211 (+200790us) raft_consensus.cc:1685] finished
0709 13:08:39.362229 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.362366 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44330,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":23284,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":16078,"thread_start_us":198677,"threads_started":1,"wal-append.queue_time_us":327505}
I20260709 13:08:39.348956 23742 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:39.369809 23742 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:39.304508 25250 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.371177 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:39.288357 25141 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:08:39.374670 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:39.345959 25242 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.282331 25239 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.364310 25353 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:39.370404 25033 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:39.391791 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.370654 25298 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:39.386999 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.387403 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:39.385449 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.388695 23626 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:39.394342 23629 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:39.375521 25213 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.373234 25288 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.402165 23621 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:39.403292 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.404469 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.396346 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:39.405632 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:39.405887 23629 raft_consensus.cc:1217] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:08:39.406572 23629 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:39.398388 23626 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:39.408175 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.408828 23626 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:39.400301 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:39.409576 23624 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:39.403398 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:39.410312 23704 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:39.411898 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.413375 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.413838 25239 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:39.415114 23629 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:39.415181 25356 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:39.417635 23629 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:39.418628 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.419315 23625 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:39.420691 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.421288 23625 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:39.422389 23625 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:39.389071 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.423228 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:39.423815 23625 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.425735 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.426801 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.325004 25342 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:39.429618 23621 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:39.431849 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.381870 25336 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:39.437845 23776 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:39.439043 23770 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:39.442178 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:39.442780 23624 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:39.443018 23776 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:39.444023 23625 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:39.444274 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:39.445830 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:39.461704 23776 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.445772 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:39.464092 23770 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:39.465353 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:39.375428 25250 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:39.396415 25033 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:39.471841 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.472621 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.472813 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:39.473037 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.473471 23626 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:39.473650 23629 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:39.475061 23626 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:08:39.446995 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 164084us
I20260709 13:08:39.396198 25353 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:39.457479 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:39.476459 23624 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.439616 25336 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.470189 25342 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:39.477175 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:39.477468 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:39.477981 23621 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.486409 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.448060 25277 consensus_queue.cc:1059] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:08:39.482817 25033 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.506474 23624 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:39.486800 25336 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.511677 23776 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
W20260709 13:08:39.514921 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.528981 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:39.458554 25238 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.494951 25216 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:39.488166 25356 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:39.485322 25414 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:08:39.511282 25212 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:39.529978 25277 consensus_queue.cc:1243] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:08:39.537277 25356 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.537664 23621 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:39.546619 23629 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:39.532351 25370 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:39.546685 25238 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:39.541512 25250 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:39.566407 25288 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.568732 25370 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:39.541508 23769 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:39.544912 25216 raft_consensus.cc:697] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:39.573304 25336 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:39.574836 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.578483 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.576972 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 205870us
I20260709 13:08:39.578701 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:39.579782 25238 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.579955 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:39.582801 23775 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:39.551672 25213 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.563638 25353 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:39.585282 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:39.589489 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:39.577477 25242 raft_consensus.cc:2764] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:08:39.584684 25288 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.587580 25238 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:08:39.593179 25336 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:39.595575 25270 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.602295 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:39.602898 23774 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:39.603155 24391 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:39.604298 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.588892 25250 raft_consensus.cc:2764] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:39.613082 23625 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:39.605759 25288 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:39.621352 25370 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.624807 25216 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:39.572300 25033 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:39.639328 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 211360us
I20260709 13:08:39.610282 25238 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.644090 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:39.644708 23695 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:39.645694 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 220946us
I20260709 13:08:39.648401 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:39.645793 24391 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:39.650307 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:39.650974 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:39.651561 23703 raft_consensus.cc:2368] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:39.655452 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:39.658495 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1025) took 1481 ms. Trace:
I20260709 13:08:39.658926 23697 rpcz_store.cc:276] 0709 13:08:38.176789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.348526 (+171737us) service_pool.cc:224] Handling call
0709 13:08:39.658271 (+1309745us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400356e54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:39.658428 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1563150208}
I20260709 13:08:39.612131 25213 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:08:39.696503 25213 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:39.696957 25213 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:39.698096 25213 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.665302 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:39.700585 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:39.686630 25298 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:39.688390 25033 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:39.688565 25356 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:39.688804 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:39.712056 23704 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:39.689776 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:39.690428 25336 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:39.691612 23777 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:39.692842 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:39.695389 25426 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:39.705344 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:39.718917 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:39.722190 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:39.733974 23695 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
W20260709 13:08:39.736442 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 239861us
I20260709 13:08:39.649909 25288 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:08:39.782480 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:39.786671 24391 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:39.788684 25431 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.703977 25239 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.711699 25429 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:39.791509 25429 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:39.727448 25356 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.795658 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:39.801590 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:39.802268 25429 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:39.711153 25213 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.820477 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.821617 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:39.822172 24394 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:39.648535 25238 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:39.780484 25426 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:39.711913 25354 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.129s
I20260709 13:08:39.827662 25242 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:39.825702 25415 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.726150 25033 consensus_queue.cc:1059] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.121s
W20260709 13:08:39.865185 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 159134us
I20260709 13:08:39.872783 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:39.859652 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 203808us
I20260709 13:08:39.720232 25382 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 13:08:39.843189 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:39.834714 25425 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:08:39.837944 25429 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:08:39.878142 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:39.880807 25336 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:08:39.895751 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 74198.6us
I20260709 13:08:39.892190 23667 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:08:39.933092 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.872535 25242 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.023931 25430 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:40.024580 25430 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:40.025682 25430 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:40.026970 23628 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.028443 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:40.028949 25446 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.029563 25446 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:40.029886 25238 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.025750 25242 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:40.032317 25242 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.032908 25242 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.033442 25293 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.034675 25436 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.035246 25242 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:39.943810 25426 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.035679 25436 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:40.029084 24394 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:40.030043 23622 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:40.034716 25441 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.890708 25428 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:39.884727 24390 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:40.027431 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.053607 23703 raft_consensus.cc:2368] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:40.053974 24394 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:08:40.019254 25298 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:39.954353 25336 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:40.042151 25443 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:40.045733 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.053323 25436 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:40.038961 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:08:40.063764 25432 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.190s	user 0.000s	sys 0.009s
W20260709 13:08:40.064416 25434 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.155s	user 0.008s	sys 0.000s
W20260709 13:08:40.076762 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 204081us
I20260709 13:08:40.064241 25356 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:40.081051 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 188946us
I20260709 13:08:40.085508 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:40.071144 25446 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:40.091358 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:40.080359 25428 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:40.083846 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:40.090495 25033 consensus_queue.cc:1243] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:08:40.111832 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:40.115275 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.119784 24394 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:40.123202 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.108887 25444 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.080749 25443 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.114244 25428 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:08:40.136739 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.118360 25431 consensus_queue.cc:1059] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:08:40.140796 25445 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:40.142228 25428 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.127841 25444 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.141536 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:40.138769 25443 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.148718 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.164853 25250 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:40.165714 25250 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:40.184242 23622 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:40.188107 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:40.178041 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:40.190131 25445 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.191424 23743 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:08:40.200073 25270 consensus_meta.cc:287] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.009s
I20260709 13:08:40.212232 23702 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:40.212549 23702 pending_rounds.cc:85] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 1
I20260709 13:08:40.212767 23702 pending_rounds.cc:107] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:40.212981 23702 raft_consensus.cc:2889] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:40.203666 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1344) took 1742 ms. Trace:
I20260709 13:08:40.213958 23773 rpcz_store.cc:276] 0709 13:08:38.461617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.461786 (+   169us) service_pool.cc:224] Handling call
0709 13:08:38.462157 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.196609 (+734452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.203419 (+1006810us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b540016c454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:40.203612 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668153088}
I20260709 13:08:40.210342 25444 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.149354 25213 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:08:40.208328 25455 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:40.140344 25436 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.202756 25454 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:40.200454 25426 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.219717 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 150) took 1139 ms. Trace:
I20260709 13:08:40.220165 23627 rpcz_store.cc:276] 0709 13:08:39.080005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.080362 (+   357us) service_pool.cc:224] Handling call
0709 13:08:39.088368 (+  8006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.143314 (+1054946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.143350 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.143391 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:40.143421 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.219498 (+ 76077us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002b5554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:40.219539 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.219661 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2425701120}
I20260709 13:08:40.221277 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.167021 25250 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.232402 25333 raft_consensus.cc:3055] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:40.232858 25333 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:40.225381 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.234822 25333 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.244810 25333 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.285604 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:40.289577 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 78858.9us
I20260709 13:08:40.290601 23743 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:40.291908 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:40.297878 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:40.300189 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:40.293071 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.439136 23772 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:40.439994 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42298 (request call id 184) took 1203 ms. Trace:
I20260709 13:08:40.440519 23772 rpcz_store.cc:276] 0709 13:08:39.236393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.237320 (+   927us) service_pool.cc:224] Handling call
0709 13:08:40.289264 (+1051944us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800003c98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7eee 0000000000375939 00007f2b4625b1e0 00007f2b463240c4 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:08:40.439902 (+150638us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36793216}
I20260709 13:08:40.442566 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:40.291500 25445 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:40.477938 25445 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.478355 25445 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.479583 25298 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:40.479987 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 394540us
I20260709 13:08:40.480291 25442 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.480700 25298 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:40.466770 25386 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:40.460244 25462 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:08:40.481436 25438 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.482278 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:40.482396 25425 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.482937 25425 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:40.485033 25441 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.485635 25441 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.486255 25242 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:40.486835 25242 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:40.487643 25242 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:40.488163 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.489703 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1004) took 2673 ms. Trace:
I20260709 13:08:40.446966 25454 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:40.480784 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:40.479758 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 390246us
I20260709 13:08:40.481495 25386 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.482010 25438 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.491657 25386 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.490965 25454 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.492609 25454 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.493487 25438 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.485124 25336 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:40.494233 25336 raft_consensus.cc:697] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:40.477775 25216 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:40.495471 25468 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:40.495106 25336 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:40.476922 25460 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:08:40.491806 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:40.490087 23702 rpcz_store.cc:276] 0709 13:08:37.816139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.816442 (+   303us) service_pool.cc:224] Handling call
0709 13:08:38.148072 (+331630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.213323 (+2065251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.489441 (+276118us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b540040e054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:40.489619 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4746340736}
I20260709 13:08:40.472663 25213 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:40.462687 25250 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:40.504269 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:40.532235 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:40.506826 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:40.533778 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.505897 25428 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.511349 25468 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.512192 25333 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:40.514493 25438 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.515991 25450 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.516481 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:40.518929 25425 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:40.491706 25431 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:40.524276 25441 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.524953 25216 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:40.524077 25386 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:40.557941 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 257821us
W20260709 13:08:40.568885 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 52524.3us
I20260709 13:08:40.597591 23669 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:40.598814 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:40.601099 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1273) took 1221 ms. Trace:
I20260709 13:08:40.602861 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:40.601672 23628 rpcz_store.cc:276] 0709 13:08:39.379282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.379428 (+   146us) service_pool.cc:224] Handling call
0709 13:08:39.379771 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.027418 (+647647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.600773 (+573355us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54000dacd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:40.601014 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342374784}
I20260709 13:08:40.563851 25033 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.606106 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:40.566040 25447 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.559280 25446 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.612654 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:40.578367 25298 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:40.578027 25443 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.570461 25333 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.596444 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:40.621420 23669 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:40.628824 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.610939 25342 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.601771 25450 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.600971 25451 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.623188 25446 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.638334 25270 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:40.639235 25463 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:08:40.640223 25425 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:40.642264 24393 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:40.648008 25216 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.649619 24387 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:40.623399 25419 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.629853 25430 raft_consensus.cc:2764] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:40.650631 25333 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.654368 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:40.654690 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:40.567023 25428 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:40.702488 25428 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:40.702986 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.703814 25242 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.705044 25270 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:40.705681 25270 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.706084 25446 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.706653 25446 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:40.678020 25343 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:08:40.707759 25270 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.692472 25419 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.709498 23623 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:40.704525 25386 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.710361 25419 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.658314 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.633872 25298 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.617233 25341 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:40.661300 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.604918 25441 consensus_queue.cc:1059] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:08:40.678171 23593 leader_election.cc:400] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:40.714607 23593 leader_election.cc:403] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:40.715286 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.715428 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.715920 23704 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:40.716286 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:40.717000 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.717417 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:40.717584 23699 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:40.616155 25033 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.623499 25277 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:08:40.618170 25447 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.693900 23628 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.686326 25450 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:08:40.707125 25446 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.711704 23622 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:40.727102 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.728121 23695 raft_consensus.cc:3055] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:40.712533 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:40.713042 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 58476.6us
I20260709 13:08:40.574358 25438 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.692991 25454 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.713251 23668 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:40.716419 23625 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:40.679136 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.677801 25238 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:08:40.723618 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:40.712548 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 116269us
I20260709 13:08:40.728590 23695 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:40.729197 23697 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:40.735715 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:40.750073 23699 raft_consensus.cc:2376] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2. Re-sending same reply.
I20260709 13:08:40.750324 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.731281 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:40.733309 25438 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.751588 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.731446 25450 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:40.731211 25397 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:08:40.750414 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.737843 25033 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.756531 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.725757 25382 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:40.752967 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 96668.7us
W20260709 13:08:40.752454 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 74429.7us
I20260709 13:08:40.759151 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.754731 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.765727 23699 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:40.768522 23700 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:08:40.768939 23700 pending_rounds.cc:85] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 2
I20260709 13:08:40.769160 23700 pending_rounds.cc:107] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:08:40.769402 23700 raft_consensus.cc:2889] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:40.757901 25080 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:40.753393 25450 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:40.770622 25080 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:40.771286 25080 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.773238 23703 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:40.761987 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:40.732870 25446 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.731515 25447 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:40.770769 25356 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:40.774431 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:40.774868 23699 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:40.781641 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.781713 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:40.782313 23699 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:40.782999 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.784818 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.757619 25468 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:40.776768 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.785553 23701 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:40.791160 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:39.853087 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:40.788254 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:40.792975 25213 consensus_queue.cc:1059] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.779986 25419 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.794224 25454 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:40.789441 25429 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.772620 25382 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:40.788763 25343 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.780524 25356 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:40.797235 25356 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:40.798445 25356 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.791286 25426 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:08:40.773514 25471 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:08:40.771342 25450 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:40.800518 25442 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.800829 25450 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.800905 25442 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:40.802085 25442 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:40.803339 25442 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.788789 25483 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:40.804543 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1352) took 1365 ms. Trace:
I20260709 13:08:40.809013 23774 rpcz_store.cc:276] 0709 13:08:39.438657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.440440 (+  1783us) service_pool.cc:224] Handling call
0709 13:08:39.440758 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.603350 (+162592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.804300 (+1200950us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540014f854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:40.804483 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372377856}
I20260709 13:08:40.809417 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.758455 25438 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:40.783663 23699 raft_consensus.cc:2410] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:40.754441 23628 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:40.772959 23695 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.817211 23695 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.818286 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.804406 25483 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:40.804612 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:40.790784 25474 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:08:40.805691 25213 raft_consensus.cc:3055] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:40.826094 25354 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:40.826485 25213 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:40.795658 25382 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:40.827489 25213 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.828891 25213 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.806859 25353 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.777436 23697 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:40.830982 25353 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:40.831532 23704 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:40.831866 25353 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.832409 25474 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:40.832546 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:40.832903 25474 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:40.833002 25353 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.833210 23697 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:40.833848 25474 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:40.810142 23625 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:40.835310 25446 consensus_queue.cc:1059] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.835840 25238 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.836231 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.837338 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:08:40.838198 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.753095 25445 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:40.957198 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 140095us
I20260709 13:08:40.813318 23627 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:40.813766 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:40.958487 23593 leader_election.cc:400] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:40.814240 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.819919 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:40.830288 25447 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.811966 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:40.872403 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.841666 23695 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:40.964191 23695 pending_rounds.cc:85] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 1
I20260709 13:08:40.964448 23695 pending_rounds.cc:107] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:40.964701 23695 raft_consensus.cc:2889] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:40.835234 25474 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:40.962428 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.972023 25343 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:40.974501 25445 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:40.975371 25293 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:08:40.827425 25483 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:40.966655 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:08:40.967252 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 153608us
I20260709 13:08:40.989032 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:40.990274 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:40.991887 25445 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:40.992079 23769 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:40.816159 25438 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.992655 25438 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.993168 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.994277 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:40.995067 23772 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:40.994953 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.995618 23773 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:40.996098 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.996474 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.997155 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.997531 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.998615 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.998762 24393 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:40.819941 25415 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:41.000460 25441 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:41.002269 25438 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:41.004602 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.004653 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:41.006819 23772 raft_consensus.cc:2410] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:40.979635 23776 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:40.979786 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.980589 23777 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:40.981427 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:41.008513 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.982627 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:40.970825 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 151066us
I20260709 13:08:41.008630 23771 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:41.008566 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.999593 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:40.961663 25277 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.014463 23698 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:41.016119 23773 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:40.958930 23593 leader_election.cc:403] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:40.965065 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:41.082511 23777 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:08:41.082993 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 78416.6us
I20260709 13:08:41.084079 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:40.987991 25473 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:41.099979 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 89823.2us
I20260709 13:08:41.095160 25438 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:41.100719 23770 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:08:41.100893 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.102171 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:41.086344 25277 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.013109 25397 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:41.094674 25479 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:41.101037 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 143091us
I20260709 13:08:41.110013 23770 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.143829 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:41.144542 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.110152 23777 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:41.102217 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:41.147071 23776 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:41.142318 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:41.090193 25483 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:41.083369 25423 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:41.097029 25250 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:41.181079 23771 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:08:41.187357 23770 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:41.097884 25473 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:41.149758 25343 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:41.106194 25277 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:41.144497 25438 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:41.193010 25342 consensus_queue.cc:1059] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:08:41.105686 25397 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.198083 25336 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.181761 25444 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:41.189963 25250 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:41.159915 25033 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:08:41.197743 25473 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.206308 25479 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.205068 25438 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.194095 25423 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.200047 25425 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:08:41.216045 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:41.234948 25438 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.223658 25250 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:41.207216 25080 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.290519 23702 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:41.221258 25336 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.235423 25479 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.284286 25343 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:41.283700 25419 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:41.358858 25336 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:41.361259 25442 consensus_meta.cc:287] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.000s
I20260709 13:08:41.363477 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:41.368628 25397 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:41.370352 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.384267 23702 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:41.402645 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 248417us
I20260709 13:08:41.404212 23593 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:41.427255 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:41.371133 24390 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:41.435823 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:41.438071 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:41.415135 25442 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.426163 23623 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:41.430521 25330 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:41.461604 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 306942us
I20260709 13:08:41.429153 25080 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:41.444793 25353 consensus_meta.cc:287] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.611s	user 0.008s	sys 0.004s
W20260709 13:08:41.440502 25486 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:08:41.452942 25450 consensus_meta.cc:287] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.651s	user 0.005s	sys 0.005s
I20260709 13:08:41.472380 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:41.371770 25343 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.485543 25343 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.371577 25419 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.426192 25428 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:08:41.451229 25425 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.465860 25330 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.446483 25444 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:41.488855 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.490727 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:41.491850 23701 raft_consensus.cc:2410] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:41.439330 25336 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:41.498262 23592 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:41.480494 25441 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.497426 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:41.495925 25495 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:08:41.514604 25451 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:41.503542 25330 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:41.516289 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:41.517683 25450 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:41.520946 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:41.522276 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:41.524935 23777 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:41.527642 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:41.528395 23703 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.465517 25442 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.531822 25473 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.534219 25473 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:41.473995 25445 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:08:41.494401 25033 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.507531 25336 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.543262 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:41.543936 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:41.496248 25419 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.579787 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:41.544953 25141 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:41.594507 25141 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.595166 25141 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:41.598963 25489 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:08:41.508615 25343 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:08:41.524127 25444 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:41.546782 25356 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.748s	user 0.013s	sys 0.000s
I20260709 13:08:41.520391 25417 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:08:41.591722 25419 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:41.545275 25336 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.529953 25441 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:08:41.627367 25446 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:41.627957 25441 consensus_queue.cc:1243] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:41.628087 25446 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.628667 25446 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.630067 25417 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.629940 25419 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.548215 25499 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:41.546664 25451 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:41.581889 25447 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.546926 25450 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:41.539410 25330 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.617669 23703 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:41.626210 23771 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:08:41.641064 23771 pending_rounds.cc:85] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 4
I20260709 13:08:41.641396 23771 pending_rounds.cc:107] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:08:41.641672 23771 raft_consensus.cc:2889] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.581059 25445 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:41.633364 23777 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.634099 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:41.600184 25423 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.645092 23776 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:41.646713 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:41.630797 25446 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.612154 25353 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:41.630613 25417 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:41.652205 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 72511.9us
I20260709 13:08:41.635397 25499 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:41.655375 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:41.656044 23627 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:41.669739 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:41.672107 23621 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:41.670665 23628 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:41.643414 25479 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:41.651007 25447 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:41.674680 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:41.655587 25213 consensus_meta.cc:287] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.004s
I20260709 13:08:41.671204 23593 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:41.679199 23628 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:41.680213 23621 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:41.680639 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:41.641659 25451 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.642877 25450 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.683410 23775 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:41.684502 25506 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:41.684993 25506 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.685495 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:41.686501 25474 consensus_meta.cc:287] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.000s
I20260709 13:08:41.686865 25441 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:41.686749 25450 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.687701 25450 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:41.688218 25450 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.690738 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:41.691226 25450 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:41.691478 25441 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:41.670437 25425 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:08:41.670740 25448 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:41.692410 25448 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.692813 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:41.693740 25441 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:41.694094 25441 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:41.694445 25441 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:41.694657 25448 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:41.695865 25498 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:08:41.695860 25507 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:41.652403 25445 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.698431 25445 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:41.698506 23622 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:41.699796 25451 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.702992 25141 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.687089 23769 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:41.714705 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:41.704082 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:41.715266 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:41.715870 23777 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.704449 25502 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:41.707516 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:41.708437 24393 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:41.676656 25505 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:41.678373 25468 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.711447 25250 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.681346 25343 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:08:41.720150 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:41.656729 25446 consensus_queue.cc:1059] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:08:41.678988 25447 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.712327 25336 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.656687 25353 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.724749 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:41.726636 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:41.730060 23777 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:41.737140 23773 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:41.717450 25502 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.744757 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:41.732810 25141 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.723565 24390 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:41.761193 23703 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:41.736654 25496 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:41.762573 25336 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.702992 25441 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.763092 25496 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:41.767225 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 97432.7us
I20260709 13:08:41.734899 25382 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:41.768864 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:41.738415 25447 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.748301 25446 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:41.725677 25451 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:08:41.772153 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:41.772819 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:41.772902 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:41.721331 25438 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.749595 25502 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.725929 25468 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.778656 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:41.778694 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:41.779029 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:41.768471 25353 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:41.769429 25442 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.771741 25474 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:08:41.782462 25507 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:41.782666 25141 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.783334 25330 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.777002 25446 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.783829 25438 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.773856 25396 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.785919 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:41.788743 25250 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:41.790702 25496 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:41.803202 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:41.791139 25419 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.723465 25505 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.773674 25033 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:41.780210 25382 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:41.779186 25213 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.735793 25499 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.815929 23629 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 1.
I20260709 13:08:41.783337 25445 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:41.799154 25396 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.795496 25075 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:41.796615 25373 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:41.797245 25343 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:08:41.781818 25336 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:41.800817 25446 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.819213 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:41.817622 25445 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.822551 25505 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.822832 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:41.824100 25417 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.824374 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 126) took 1035 ms. Trace:
I20260709 13:08:41.852289 23701 rpcz_store.cc:276] 0709 13:08:40.788588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.821811 (+ 33223us) service_pool.cc:224] Handling call
0709 13:08:41.824224 (+1002413us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400088ed4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:41.824327 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156373376}
I20260709 13:08:41.803145 25353 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:41.835162 23697 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:41.837026 23773 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:41.839989 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 61348.5us
I20260709 13:08:41.825981 25468 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:41.854341 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:41.859248 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:41.830775 25373 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:41.860982 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:41.798180 25507 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.834731 25336 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.864950 25382 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.868083 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:41.870445 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:41.873266 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1085) took 1096 ms. Trace:
I20260709 13:08:41.876009 25213 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.875494 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:41.859499 25353 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.840240 25445 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:41.906531 23704 rpcz_store.cc:276] 0709 13:08:40.776660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.776781 (+   121us) service_pool.cc:224] Handling call
0709 13:08:40.831222 (+ 54441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.831866 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.873069 (+1041203us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b540026a7d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:41.873209 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124471552}
I20260709 13:08:41.913476 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:41.914321 23704 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:41.885926 23773 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:41.916712 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:41.907670 23701 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.906646 23621 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:41.909547 25444 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.917794 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:41.919816 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:41.922106 23704 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:41.922272 23696 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:41.922889 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:41.920486 25438 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:41.923695 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:41.899570 25373 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.928171 23742 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:41.925101 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:41.926748 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:41.929260 23704 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:41.930255 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:41.931128 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1631) took 2504 ms. Trace:
I20260709 13:08:41.931139 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:41.931644 23620 rpcz_store.cc:276] 0709 13:08:39.421996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.436171 (+ 14175us) service_pool.cc:224] Handling call
0709 13:08:40.600971 (+1164800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.613564 (+ 12593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.613584 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.631363 (+ 17779us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.747955 (+116592us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:40.752742 (+  4787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.752829 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.767295 (+ 14466us) raft_consensus.cc:1685] finished
0709 13:08:40.767315 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.909670 (+1142355us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000dacd0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:41.926511 (+ 16841us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12205,"raft.queue_time_us":12319,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":15451,"spinlock_wait_cycles":2678167680,"thread_start_us":110004,"threads_started":1,"wal-append.queue_time_us":127976,"wal-append.run_cpu_time_us":1704,"wal-append.run_wall_time_us":1003661}
I20260709 13:08:41.932857 23701 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:41.933383 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:41.931643 23704 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:41.934515 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:41.935600 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:41.936496 23621 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:41.930800 25213 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.940024 25213 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:41.943071 25213 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:41.943883 25454 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:41.944530 25454 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:41.944664 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:41.945035 25454 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.921535 25075 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:41.925315 25343 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:41.962555 25343 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:41.963061 25343 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:41.885288 25474 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:08:41.951304 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42286 (request call id 10) took 1110 ms. Trace:
I20260709 13:08:41.960292 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:41.961329 25353 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:41.924536 25417 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:08:41.965806 23774 rpcz_store.cc:276] 0709 13:08:40.839175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.840450 (+  1275us) service_pool.cc:224] Handling call
0709 13:08:41.949611 (+1109161us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54004312d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41312735 00007f2b462d2d29 00007f2b3f8511d4 00007f2b3f851162 00007f2b3f851091 00007f2b3f85100c 00007f2b3f8502c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:41.949812 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936255232}
I20260709 13:08:41.968703 25075 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.969707 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:41.971033 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:41.971388 25212 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:41.972285 25441 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.977746 25212 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.974261 25507 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:41.976663 25444 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:41.979344 25446 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:41.988303 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet 9e3b7e5b938d488e915e4b83c40e6e1d: Illegal state: Replica 4466bf6d6cf84ee89e84ea074e3964c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:41.988695 25444 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:41.989207 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:41.990414 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:41.991621 25353 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.977095 25336 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:41.992156 25353 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.978153 25396 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:41.973263 23774 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:41.993995 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:41.994589 25212 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:41.994832 23699 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:41.991955 25444 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:41.995226 25213 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:41.995932 25341 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:41.994285 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:41.995841 25213 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.996385 25341 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:41.997313 25341 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.985399 23704 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:41.999621 23593 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:42.000136 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.001370 23774 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.997680 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:42.000134 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:42.002954 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.003861 23774 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:42.004173 23621 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:42.005089 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.005920 23774 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:41.998222 25213 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:42.007333 25213 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:41.963543 25502 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.929260 25438 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.009184 23620 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 4: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:42.010376 23704 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:42.007236 25341 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:42.013697 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 83543.4us
I20260709 13:08:42.015219 23592 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.015581 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:42.012064 23774 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:42.008260 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.019546 23592 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.008108 25213 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.023857 25505 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.024319 25502 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.024587 25505 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:42.025103 25505 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.994645 25353 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:42.027256 25491 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.601s	user 0.001s	sys 0.001s
I20260709 13:08:42.029228 25445 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:41.997983 25447 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.021597 25417 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.012820 25212 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:42.032279 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.032779 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.038065 23696 raft_consensus.cc:2368] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:42.035426 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.053508 23778 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:08:42.054838 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:42.055719 23778 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.066517 23592 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.005897 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.069967 23621 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:42.022605 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:42.071544 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 56051.7us
I20260709 13:08:42.074460 23773 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:42.075647 24357 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.077389 23773 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:42.072620 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:42.095289 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:42.080065 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.107231 25141 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.108027 25216 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:42.108882 25216 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:42.111336 25216 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.114986 25141 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:42.115803 25141 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:42.117594 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45117.4us
I20260709 13:08:42.118804 25141 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.119506 25353 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:42.121021 25472 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:42.121419 25472 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:42.122381 25472 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.122534 25353 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:42.123883 25472 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:42.126828 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 46878.2us
I20260709 13:08:42.128217 25141 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:42.129596 25330 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:42.130084 25330 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:42.131201 25330 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:42.136471 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 85501.4us
W20260709 13:08:42.138041 25515 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:08:42.140599 25520 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:42.141098 25520 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.141515 25520 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:42.040653 25510 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:42.144752 23621 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:42.031688 25445 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:42.145715 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.032373 25513 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:42.149930 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:42.094012 25502 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:42.037895 25212 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:42.160513 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.160820 25212 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.037331 25417 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:42.037788 25447 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.058207 25342 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:42.153726 23772 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:42.146171 23778 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:42.150503 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1092) took 1370 ms. Trace:
I20260709 13:08:42.136600 25474 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:42.092559 25426 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.168076 23695 rpcz_store.cc:276] 0709 13:08:40.780661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.966444 (+185783us) service_pool.cc:224] Handling call
0709 13:08:40.966746 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.987251 (+ 20505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.987288 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.987785 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.235821 (+248036us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:41.508899 (+273078us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.514096 (+  5197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.514185 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.026707 (+512522us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:08:42.142754 (+116047us) raft_consensus.cc:1685] finished
0709 13:08:42.150224 (+  7470us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.150410 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67630,"prepare.queue_time_us":110094,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":26499,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":334,"spinlock_wait_cycles":4033920,"thread_start_us":459993,"threads_started":2,"wal-append.queue_time_us":437711}
I20260709 13:08:42.175635 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:42.068529 25444 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:08:42.176558 23695 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:42.147397 25510 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:42.180842 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:42.182885 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:42.183903 23695 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:42.149942 25493 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:42.170897 25474 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.192667 25474 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:42.200079 23667 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.3:45959 timed out after 1.548s (SENT) [suppressed 23 similar messages]
I20260709 13:08:42.158278 25445 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:42.202133 23695 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:08:42.167100 25243 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:42.171830 25417 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.172159 25342 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:42.207321 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:42.211503 25243 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.213810 25342 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.214905 25342 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.216059 25243 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.217950 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.218547 25298 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.219938 25510 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.218103 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:42.227769 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:42.230366 25468 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:42.230880 25468 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:42.231700 25468 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.188862 25496 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.238925 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.240063 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:42.241845 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.185845 25426 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.243288 25430 raft_consensus.cc:3055] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:42.258152 25430 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:42.239151 25496 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:42.243317 25353 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:42.222885 25493 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.222321 25445 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.266315 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.176406 25513 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.273334 25373 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.262476 25496 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.270090 25520 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:42.279340 25523 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:08:42.281042 25520 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.264366 25446 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.269101 25438 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.260149 25454 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.288781 25474 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.294075 25513 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.296959 25474 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:42.300616 25496 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.301347 25454 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.293514 25493 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:42.303030 25496 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.305017 25505 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.340049 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.338891 23526 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 2 to 3, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.344373 23526 catalog_manager.cc:5697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:42.358255 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.358151 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:42.361289 23622 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.364358 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1666) took 1256 ms. Trace:
I20260709 13:08:42.364888 23626 rpcz_store.cc:276] 0709 13:08:41.108086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.368432 (+260346us) service_pool.cc:224] Handling call
0709 13:08:41.368769 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.486100 (+117331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.486132 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.486172 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:41.486201 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.363686 (+877485us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400098b54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:42.363762 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.364126 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269475584}
I20260709 13:08:42.375931 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 125) took 1587 ms. Trace:
W20260709 13:08:42.376199 23698 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1641) took 1625 ms (client timeout 1674 ms). Trace:
I20260709 13:08:42.376502 23702 rpcz_store.cc:276] 0709 13:08:40.788328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.291750 (+503422us) service_pool.cc:224] Handling call
0709 13:08:41.345523 (+ 53773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.384945 (+ 39422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.375202 (+990257us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b5400405954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:42.375676 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87875840}
W20260709 13:08:42.377002 23698 rpcz_store.cc:269] 0709 13:08:40.750085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.750187 (+   102us) service_pool.cc:224] Handling call
0709 13:08:42.375335 (+1625148us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b540026b6d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:42.375717 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575914240}
I20260709 13:08:42.378955 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:42.380769 23700 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:42.381945 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:42.383085 23703 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:42.383232 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1651) took 1609 ms. Trace:
I20260709 13:08:42.379348 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:42.388108 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:42.386652 23700 rpcz_store.cc:276] 0709 13:08:40.773423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.773541 (+   118us) service_pool.cc:224] Handling call
0709 13:08:42.380049 (+1606508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.381508 (+  1459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.382910 (+  1402us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540026b6d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:42.383146 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3658265856}
I20260709 13:08:42.389765 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:42.391788 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:42.393718 23625 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:42.394536 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1657) took 1570 ms. Trace:
I20260709 13:08:42.394590 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.392719 23698 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:42.397446 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:42.404114 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.398070 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:08:42.409870 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.400185 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1661) took 1563 ms. Trace:
I20260709 13:08:42.402665 23704 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:42.412995 23627 rpcz_store.cc:276] 0709 13:08:40.836912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.963953 (+127041us) service_pool.cc:224] Handling call
0709 13:08:41.486756 (+522803us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:08:41.486954 (+   198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:41.668640 (+181686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.399512 (+730872us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54003255d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:42.399963 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392656896}
W20260709 13:08:42.412144 23769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1370) took 1428 ms (client timeout 1548 ms). Trace:
W20260709 13:08:42.416448 23769 rpcz_store.cc:269] 0709 13:08:40.983359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.992917 (+  9558us) service_pool.cc:224] Handling call
0709 13:08:42.411577 (+1418660us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b540032fd54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:42.411863 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1594217344}
I20260709 13:08:42.417351 23702 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:42.398288 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:42.394996 23625 rpcz_store.cc:276] 0709 13:08:40.823947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.892219 (+ 68272us) service_pool.cc:224] Handling call
0709 13:08:42.392831 (+1500612us) spinlock_profiling.cc:243] Waited 73.9 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:08:42.393191 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:42.394159 (+   968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.394446 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170005376}
I20260709 13:08:42.404098 23700 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:42.421391 23703 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.429020 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:42.443369 25538 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.446770 25538 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:42.453329 23622 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:42.292217 25426 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:42.469835 24387 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:42.470746 24385 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:42.472213 25468 consensus_queue.cc:1059] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:42.473323 25373 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.473632 25250 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:42.467468 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1372) took 1483 ms. Trace:
I20260709 13:08:42.479440 23703 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
W20260709 13:08:42.483631 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.484247 23770 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:42.308068 25510 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.490710 25444 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.492488 25213 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:42.493201 23773 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:08:42.495642 25441 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.484686 25033 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:42.497030 25441 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.498095 25033 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.492353 25293 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:42.500077 25496 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.500607 25293 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.503671 25451 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:42.504408 25451 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.505467 23593 leader_election.cc:400] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:42.505892 23593 leader_election.cc:403] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:42.498519 25448 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:42.486630 23775 rpcz_store.cc:276] 0709 13:08:40.983973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.008298 (+ 24325us) service_pool.cc:224] Handling call
0709 13:08:42.466986 (+1458688us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54004312d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:42.467224 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550355840}
I20260709 13:08:42.501107 25243 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:42.506549 23704 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:42.509485 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.499478 25277 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:42.274462 25430 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.522500 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:08:42.484700 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 55928.2us
I20260709 13:08:42.523808 25430 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.514533 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.525688 23742 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:42.492465 25444 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.527938 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:42.493232 25298 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.515115 25538 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:42.515475 25415 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:42.516891 25454 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:42.517238 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:42.513851 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:42.521324 25505 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.522183 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:42.526508 25448 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.528079 25277 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.528514 25428 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.513947 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.486573 25250 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.547410 25250 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.547832 25277 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.550300 25448 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.551137 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.552431 25075 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:42.553030 25538 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.554590 23776 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:42.527444 23701 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:08:42.517093 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.545640 25426 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.514158 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.555972 23701 pending_rounds.cc:85] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 1
I20260709 13:08:42.529196 25444 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.561662 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.566215 25505 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:42.563974 25441 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.567021 25293 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.567587 25505 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:42.568634 25415 consensus_queue.cc:1243] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:08:42.556944 25426 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.581526 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:42.581856 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.581856 25426 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.583573 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1381) took 1393 ms. Trace:
I20260709 13:08:42.584000 23771 rpcz_store.cc:276] 0709 13:08:41.190172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.190434 (+   262us) service_pool.cc:224] Handling call
0709 13:08:41.190845 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.642497 (+451652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.583129 (+940632us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b5400059bd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:42.583401 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000344960}
I20260709 13:08:42.585851 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:42.588133 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 364303us
W20260709 13:08:42.589650 25343 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.009s
I20260709 13:08:42.590332 25343 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.591909 23621 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:42.593349 25238 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:42.593730 25033 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.594064 24387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 377) took 1790 ms. Trace:
I20260709 13:08:42.598766 23702 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:42.600487 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:42.601318 23698 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:42.605772 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:42.606449 25499 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.606825 24392 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:42.614193 25428 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:42.614880 25506 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.620981 25445 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.552130 25298 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.644878 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.645571 25298 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.571971 25538 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.572576 25330 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:42.648195 25415 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:42.648262 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.648928 25415 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.650112 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:42.574854 25419 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:42.564857 25243 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.621775 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:42.622560 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:42.623080 25429 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.501150 25496 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:42.624686 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.624815 23668 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:42.625587 25293 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.688393 25293 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.628155 25212 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:42.691360 25212 raft_consensus.cc:3055] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:42.691893 25212 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:42.693120 25212 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.694953 25212 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.629779 23770 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:42.630129 25451 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.614420 25505 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.632170 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.632601 25441 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.697335 25441 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.634651 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:42.698907 23702 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:42.699616 23778 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:42.703176 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.705018 23526 catalog_manager.cc:5697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.708905 25496 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:42.710479 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:42.634784 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:42.635417 25033 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:42.636225 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:42.637506 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.713757 23775 raft_consensus.cc:2368] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:42.715152 25423 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:42.639078 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:42.639168 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.642484 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:42.561264 23701 pending_rounds.cc:107] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:08:42.558503 25454 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:42.654336 25419 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:42.663445 25243 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.664284 25429 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.665539 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.669605 25415 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.594712 24387 rpcz_store.cc:276] 0709 13:08:40.803365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.804290 (+   925us) service_pool.cc:224] Handling call
0709 13:08:41.820937 (+1016647us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b5800010e98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7eee 0000000000375939 00007f2b4625b1e0 00007f2b463240c4 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:08:41.821111 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.519854 (+698743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.593749 (+ 73895us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b5400602cd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:42.593984 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1457274112}
I20260709 13:08:42.673679 25250 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.680332 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.734586 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:42.711977 23770 raft_consensus.cc:2410] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:42.716248 23701 raft_consensus.cc:2889] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:42.719033 23774 raft_consensus.cc:2410] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:42.714705 25033 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.716787 23696 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:42.724187 23700 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:42.737815 23703 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.728279 23776 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:08:42.707392 23526 catalog_manager.cc:5697] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 3, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.741027 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.740825 25454 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.742833 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.743780 23622 raft_consensus.cc:2410] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:42.719280 25423 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:42.742312 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.671069 25428 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:42.750505 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.750813 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.740828 25419 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:42.753207 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 128597us
I20260709 13:08:42.753427 25441 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:42.756753 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 122106us
I20260709 13:08:42.758731 25451 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:42.758831 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.759415 23527 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 177) took 7291 ms. Trace:
I20260709 13:08:42.759642 23628 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:42.760028 25341 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:42.760807 25341 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:42.761430 25429 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.761749 25507 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:42.761833 25341 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.764273 23700 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:42.764333 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 122094us
I20260709 13:08:42.765081 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.765842 23667 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:42.766776 23700 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:42.748886 25373 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:08:42.767851 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1097) took 1200 ms. Trace:
I20260709 13:08:42.768725 25353 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:42.769395 25353 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.760100 25033 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.769398 25277 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:42.745754 23526 catalog_manager.cc:5697] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.780678 23622 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:42.743299 25293 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.784027 23698 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:08:42.788388 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:42.790616 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.793092 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.793572 23695 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:08:42.795472 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.793499 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:42.804457 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:08:42.805029 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.808547 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:42.808676 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.811076 23702 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:08:42.796480 23526 catalog_manager.cc:5697] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.816183 23698 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:08:42.789712 25445 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.820811 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:42.818949 23698 pending_rounds.cc:85] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 5
I20260709 13:08:42.829457 23698 pending_rounds.cc:107] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:08:42.830008 23698 raft_consensus.cc:2889] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:42.831079 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.768270 23697 rpcz_store.cc:276] 0709 13:08:41.542543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.405731 (+863188us) service_pool.cc:224] Handling call
0709 13:08:42.406114 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.406556 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:42.437446 (+ 30890us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.734198 (+296752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.734257 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:42.742299 (+  8042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.742374 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.742498 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17230,"prepare.queue_time_us":30074,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":43,"raft.queue_time_us":25296,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":5348,"thread_start_us":313018,"threads_started":2}
I20260709 13:08:42.833276 23627 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:42.840925 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:42.832077 25441 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:42.847254 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1659) took 1327 ms. Trace:
I20260709 13:08:42.847584 24386 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:42.849676 25423 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:42.851958 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 97609.1us
I20260709 13:08:42.855886 25520 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:42.856038 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.856685 25293 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:42.843392 23620 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:42.821460 25428 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.856261 25510 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.857766 25343 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.855983 23770 raft_consensus.cc:3055] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:42.823133 25451 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:08:42.871409 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 77528.3us
I20260709 13:08:42.865345 23526 catalog_manager.cc:5697] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.824266 25417 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:42.867827 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.869243 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:42.869481 23668 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:42.860219 23701 rpcz_store.cc:276] 0709 13:08:41.521933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.020779 (+498846us) service_pool.cc:224] Handling call
0709 13:08:42.032094 (+ 11315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.740560 (+708466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.827702 (+ 87142us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400026054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:42.847157 (+ 19455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017737600}
W20260709 13:08:42.870455 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 226259us
W20260709 13:08:42.871060 25342 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.648s	user 0.014s	sys 0.003s
W20260709 13:08:42.865578 25543 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:08:42.876045 25526 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:42.877511 25419 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:42.869486 23770 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:42.874190 25423 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.880499 23770 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.881577 23770 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:42.884094 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:42.884188 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 79846.4us
I20260709 13:08:42.886520 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.888584 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:42.891651 25373 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:42.892206 23699 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:42.892818 25526 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:42.893103 23625 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:42.893342 25526 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:42.894898 25428 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.894501 25526 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.759940 23527 rpcz_store.cc:276] 0709 13:08:35.493370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.504516 (+ 11146us) service_pool.cc:224] Handling call
0709 13:08:42.759139 (+7254623us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:37.324927 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:37.325677 (+   750us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:37.325713 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:08:37.325736 (+    23us) tablet.cc:662] Decoding operations
0709 13:08:37.472339 (+146603us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:37.476257 (+  3918us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:37.478303 (+  2046us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:08:37.573875 (+ 95572us) tablet.cc:701] Row locks acquired
0709 13:08:37.573909 (+    34us) write_op.cc:260] PREPARE: finished
0709 13:08:37.574124 (+   215us) write_op.cc:270] Start()
0709 13:08:37.574298 (+   174us) write_op.cc:276] Timestamp: P: 1783602517574063 usec, L: 0
0709 13:08:37.574327 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:08:37.575206 (+   879us) log.cc:844] Serialized 4004 byte log entry
0709 13:08:38.330157 (+754951us) op_driver.cc:464] REPLICATION: finished
0709 13:08:38.917287 (+587130us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b3e2020ac 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b44d42ef0
0709 13:08:39.240144 (+322857us) write_op.cc:301] APPLY: starting
0709 13:08:39.247962 (+  7818us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:39.328216 (+ 80254us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:39.344930 (+ 16714us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:39.512611 (+167681us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:39.545560 (+ 32949us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:08:39.545618 (+    58us) write_op.cc:312] APPLY: finished
0709 13:08:39.545940 (+   322us) log.cc:844] Serialized 77 byte log entry
0709 13:08:39.780674 (+234734us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:39.824757 (+ 44083us) write_op.cc:454] Released schema lock
0709 13:08:39.835411 (+ 10654us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:39.874475 (+ 39064us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:39.877603 (+  3128us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9343,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":887303,"apply.run_cpu_time_us":30297,"apply.run_wall_time_us":622809,"num_ops":10,"prepare.queue_time_us":218888,"prepare.run_cpu_time_us":38728,"prepare.run_wall_time_us":316813,"raft.queue_time_us":335905,"raft.run_cpu_time_us":48940,"raft.run_wall_time_us":1005860,"replication_time_us":697654,"spinlock_wait_cycles":35259264,"thread_start_us":1569411,"threads_started":5,"wal-append.queue_time_us":390723,"wal-append.run_cpu_time_us":41312,"wal-append.run_wall_time_us":2763144}]]}
I20260709 13:08:42.869046 25510 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.887784 25445 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.888540 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:42.888808 25293 raft_consensus.cc:697] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:42.889129 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:42.889353 25520 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:42.896422 25526 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:42.911842 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:42.912469 23526 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.915238 23626 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:08:42.917199 25293 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.919828 25451 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:42.920512 25451 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:42.921670 25451 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:42.924727 25417 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.928009 25510 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:42.930830 23592 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.932230 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:42.935880 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:42.936789 25342 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.937232 25342 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:42.937629 25342 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.937831 23592 leader_election.cc:400] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3.
I20260709 13:08:42.939920 25428 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:42.930915 25445 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:42.939428 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.940985 23620 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:42.933615 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:42.941479 25353 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:42.941702 23592 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.941952 25441 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:42.942526 25428 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:42.943039 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.943177 25428 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:42.933982 25213 raft_consensus.cc:3055] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:42.943320 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:42.943682 25213 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:42.944259 23626 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:42.944640 25213 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:42.941493 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:08:42.945878 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55997.8us
I20260709 13:08:42.934865 25250 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:42.934458 25510 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:42.935056 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.947203 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:42.932894 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1110) took 1065 ms. Trace:
I20260709 13:08:42.948966 23778 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:42.969679 23622 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:42.949714 23592 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:42.899912 25426 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
W20260709 13:08:42.951319 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.901957 25430 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:42.946014 25213 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.948439 24357 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:42.954650 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:42.933761 25417 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:42.964182 23695 rpcz_store.cc:276] 0709 13:08:41.867620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.663362 (+795742us) service_pool.cc:224] Handling call
0709 13:08:42.787604 (+124242us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:42.800916 (+ 13312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.932719 (+131803us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540015e850. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:42.932836 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277946624}
I20260709 13:08:43.012964 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:42.985283 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 187911us
I20260709 13:08:43.013783 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.014010 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.014832 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.015167 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.985805 25373 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:43.017295 25373 raft_consensus.cc:697] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:43.014386 23771 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:43.018399 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.018630 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.019114 23773 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:43.019212 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.979187 25423 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.019846 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.020044 25423 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.017518 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:42.981360 23774 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:42.992769 23703 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:43.003638 25446 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:42.964942 25441 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:43.005548 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 58430.2us
I20260709 13:08:43.007994 23770 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:08:43.013162 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.016083 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:42.997185 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 53941us
I20260709 13:08:43.023798 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1666) took 1271 ms. Trace:
I20260709 13:08:43.028298 23770 pending_rounds.cc:85] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 2
I20260709 13:08:43.028801 23770 pending_rounds.cc:107] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:08:43.025188 23778 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:08:43.029379 23770 raft_consensus.cc:2889] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:43.028445 23703 rpcz_store.cc:276] 0709 13:08:41.752694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.542177 (+789483us) service_pool.cc:224] Handling call
0709 13:08:42.661061 (+118884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.023491 (+362430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.023718 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:42.947576 25342 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:43.048431 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 98780.1us
I20260709 13:08:43.045081 23743 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:43.055080 23628 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:43.024611 25277 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:43.059964 23622 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 13:08:43.040076 25510 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.061524 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:43.065169 23769 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:43.058727 25423 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:43.018337 25373 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:43.054495 25341 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 13:08:43.087677 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.096433 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:43.106536 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:43.107506 25277 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:43.108628 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 86023.8us
I20260709 13:08:43.109419 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:43.110257 25250 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.110756 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:43.117058 25529 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:43.132491 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:43.080861 25417 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:43.133196 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 80982.7us
W20260709 13:08:43.135092 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.136808 23703 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:08:43.139822 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.138779 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:43.141592 23696 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.144096 23695 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:08:43.111619 25250 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.122438 25468 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.132539 25529 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:43.130899 25277 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:43.115700 25426 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:43.109664 25293 consensus_queue.cc:1059] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:08:43.157764 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.166554 23696 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:43.169174 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.167052 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.168206 23592 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:43.171550 23592 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:43.173810 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:43.174446 23703 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.161078 25454 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.175155 25075 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.179162 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:43.175402 25505 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:43.182534 25342 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:43.191704 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.191536 25212 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:08:43.197399 25419 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:43.201336 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.183948 25382 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:08:43.185309 25505 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.202721 23696 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:43.203269 23743 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:43.205217 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.205789 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.208987 25382 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:43.209211 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.209481 25382 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:43.210038 23770 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:43.210556 25382 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:43.210754 25277 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:43.211621 23772 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:08:43.208139 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.222132 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:43.223153 23776 raft_consensus.cc:2368] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:43.224351 25382 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.227070 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.230611 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.231410 23699 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:43.212006 25505 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.237519 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.237636 23769 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:43.212594 25419 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:43.243228 25419 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.234246 25529 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.228120 25454 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.251870 25529 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:43.257121 25559 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:08:43.262665 25033 raft_consensus.cc:3055] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:43.263171 25033 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:08:43.264343 25558 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.148s	user 0.000s	sys 0.002s
I20260709 13:08:43.264357 25033 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:43.270490 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.274187 23775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:43.278251 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:43.280130 25468 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:43.284199 23703 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
W20260709 13:08:43.300379 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.301096 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.305154 23592 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:08:43.307832 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.312556 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:43.289274 25250 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.313694 25510 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.288100 23775 raft_consensus.cc:606] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:43.309957 25505 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:43.316648 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.319159 23743 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:43.323760 23771 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:43.305855 25417 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.324313 23771 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:43.328207 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.329092 23701 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:43.312554 25341 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.316148 25212 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:43.338920 23743 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:43.342243 25033 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:43.342386 23771 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.344322 23771 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.336053 25250 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:43.336221 25213 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.351679 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:43.348649 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:43.336720 25212 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.332717 23592 leader_election.cc:400] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:43.331504 25417 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.352519 23703 raft_consensus.cc:2368] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:43.353896 23592 leader_election.cc:403] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.342965 25341 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.365046 23629 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:43.365752 23704 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:43.351858 25250 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.366809 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.351748 25454 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:43.356896 25212 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.371984 25250 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.380882 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.383999 23695 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:43.386469 25426 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:43.387814 25341 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:43.388151 25426 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:43.372599 25510 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.368163 24386 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:43.372876 25454 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:43.400599 23701 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:43.366453 25213 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.397120 23704 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:43.410795 23772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:43.411445 23772 raft_consensus.cc:606] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.411881 23772 raft_consensus.cc:614] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:43.404230 25454 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.421389 25141 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.422045 25141 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.423825 25562 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:43.427976 23696 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:43.389134 25479 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:08:43.440394 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54878.5us
I20260709 13:08:43.442487 23771 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:43.446972 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:43.460381 25499 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:43.438704 25505 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:43.455612 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.469257 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:43.470137 23771 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.471701 25213 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:43.474212 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.475879 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.476075 23772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:43.476771 23772 raft_consensus.cc:606] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.477859 25353 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:43.478396 25353 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:43.474232 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:43.487957 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.489132 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.475515 25417 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:43.496347 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49519.3us
I20260709 13:08:43.506829 24358 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:43.507826 25177 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:43.510272 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50931us
W20260709 13:08:43.511312 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 48999.6us
I20260709 13:08:43.494119 25419 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:43.513620 25141 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:43.513803 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:43.514212 25353 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.521153 25075 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:43.523718 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.500263 25428 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.532194 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.532485 23772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:43.545460 23772 raft_consensus.cc:606] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:43.533671 23629 raft_consensus.cc:2368] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4.
I20260709 13:08:43.546429 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:43.540949 25212 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.548128 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.548882 23698 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:08:43.549752 25212 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:43.550279 23628 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:43.554445 23625 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:43.545372 25428 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:43.555689 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.534240 23771 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:43.534396 23622 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:43.524847 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:43.538599 25075 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:43.578780 25423 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:43.538625 25353 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.579263 25423 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.579344 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.579778 25423 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.539885 25419 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:43.581223 25419 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:43.541699 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:43.583600 23704 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.501183 25213 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:43.585788 25213 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:43.544543 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.588217 23695 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
W20260709 13:08:43.595769 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 70976.2us
I20260709 13:08:43.596688 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:43.598009 23593 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:43.598517 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.599875 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:43.600531 23771 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.603127 23628 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:08:43.603353 25033 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:43.606056 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:43.606061 23592 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:43.607564 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:43.603613 23628 pending_rounds.cc:85] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 2
I20260709 13:08:43.608480 23628 pending_rounds.cc:107] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:08:43.604975 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.608930 23628 raft_consensus.cc:2889] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:43.610474 23669 leader_election.cc:400] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4.
I20260709 13:08:43.610991 23669 leader_election.cc:403] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.611061 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:43.612145 23629 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.587015 25213 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:43.613528 25428 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:43.614341 25428 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.614436 25141 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:43.614684 25033 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:43.615993 25441 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:43.617066 25033 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:43.619370 25572 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:43.619908 25572 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:43.620012 25141 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:43.620189 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:43.621176 24387 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:43.621062 25141 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.625033 23772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:43.625694 23772 raft_consensus.cc:606] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:43.625916 25510 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:43.604338 25529 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:43.628089 25529 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:43.628521 25529 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.629174 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.630730 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:43.631266 25430 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.608560 25212 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.633136 23667 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:43.651110 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 106948us
W20260709 13:08:43.652068 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44601.6us
I20260709 13:08:43.654266 23772 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:43.631932 25341 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.657325 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.662919 23771 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
W20260709 13:08:43.666009 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55755.9us
I20260709 13:08:43.667171 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:43.668820 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:43.670415 23593 leader_election.cc:400] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:43.672143 23771 raft_consensus.cc:2368] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4.
I20260709 13:08:43.675153 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:43.620369 25572 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.623170 25454 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:43.685864 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.687793 23775 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:43.672959 25446 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.678906 25451 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:43.691378 25033 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.691747 23667 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.692018 23773 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:43.695762 25033 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.680423 25342 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:43.697885 25033 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:43.678035 25510 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:43.702602 25033 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:43.704870 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:43.689311 25445 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:43.705617 25445 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.706780 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:43.680133 25293 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:08:43.720116 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.679993 25526 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:43.707957 25250 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.698699 25451 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:43.718106 25505 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:43.708413 25510 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.680750 25141 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:08:43.697818 25448 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:43.701619 25342 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.726218 25451 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.727867 23622 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:43.744542 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.745572 23627 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
W20260709 13:08:43.740729 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 65798.8us
I20260709 13:08:43.756083 25419 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:43.756780 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:43.757678 25419 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:43.758088 25419 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.758441 25419 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:43.764325 23704 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:43.765357 25430 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:43.767354 25430 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:43.744506 23622 pending_rounds.cc:85] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 1
I20260709 13:08:43.769662 23622 pending_rounds.cc:107] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:43.769977 23622 raft_consensus.cc:2889] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:43.743911 25342 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:43.767925 25441 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4.
I20260709 13:08:43.734006 25505 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:43.777303 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 68479.3us
I20260709 13:08:43.774749 25570 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:43.769291 25430 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:43.786415 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 130680us
I20260709 13:08:43.779357 25505 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:43.789608 25577 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:43.793377 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.794047 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:43.768023 25448 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:43.799572 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.800462 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.805343 25445 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:43.807137 25419 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.788228 25213 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 13:08:43.789690 25581 log.cc:927] Time spent T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:08:43.809576 25419 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:43.810541 25423 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.811997 23625 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:08:43.812707 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.815068 25454 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:43.815985 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:43.817597 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:43.819783 25250 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:43.820781 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.821075 23775 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:43.822302 25580 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:08:43.823040 25510 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:43.790230 25570 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:43.824817 25570 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.825742 25277 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.790649 25529 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:43.827085 25454 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:43.829267 25529 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:43.829533 25033 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.829995 25582 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.830789 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:43.830050 25033 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.833333 25426 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:43.833698 25448 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:43.833820 25479 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:43.834348 25468 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:43.835353 25479 raft_consensus.cc:993] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:43.835788 25479 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:43.836134 25479 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:43.836678 25213 raft_consensus.cc:1081] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:43.837054 25588 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:43.837554 25588 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.837940 25588 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.839627 25423 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:43.858608 25451 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:43.860554 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:43.863574 23592 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:43.849800 23629 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:43.867254 23620 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:43.871379 23704 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.863498 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:43.878201 23625 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
W20260709 13:08:43.883436 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 66259.2us
I20260709 13:08:43.884565 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.883647 23704 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:43.886658 23667 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:43.898536 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:43.899523 23770 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:43.905273 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:43.906474 25373 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:43.907049 25373 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:43.907553 25373 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.833755 25426 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.856909 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:44.023738 25341 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:43.924654 25446 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:43.875773 25277 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:43.877882 25499 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:44.070484 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 228962us
I20260709 13:08:44.071653 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:44.022109 25426 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:43.875270 25454 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.171s
I20260709 13:08:44.021852 23769 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:43.878566 25445 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.169s
I20260709 13:08:43.881472 25177 consensus_queue.cc:1059] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.191s
I20260709 13:08:44.113677 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:44.115302 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:43.837056 25479 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.128265 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:08:44.134110 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 245543us
I20260709 13:08:44.128939 23629 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.149539 23667 leader_election.cc:400] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4.
I20260709 13:08:44.150307 23622 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 13:08:44.162894 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.128886 25586 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:44.159502 23625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
I20260709 13:08:44.184489 23625 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:44.185056 23625 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.134281 25430 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:44.224351 25587 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:08:44.162699 25446 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:08:44.225618 25505 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.228314 25597 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.228655 25585 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:08:44.228899 25597 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.166785 25250 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:08:44.230093 25591 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:08:44.230753 25592 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:44.231247 25597 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.232059 25604 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.232348 25445 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:44.235585 25445 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:44.230079 23629 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:44.236589 25445 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.237728 25451 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.242631 25505 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:44.247408 25572 consensus_meta.cc:287] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.001s
I20260709 13:08:44.176239 25584 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 13:08:44.254781 23625 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.208998 25586 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:44.280419 25572 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:44.298666 25579 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.579s	user 0.002s	sys 0.000s
I20260709 13:08:44.320863 25599 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.330327 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 466854us
W20260709 13:08:44.342917 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 227773us
I20260709 13:08:44.328022 25293 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:44.352188 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:44.319566 25588 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.340229 25277 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.363653 23742 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:44.323410 25599 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.369726 23626 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.373840 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:44.359540 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:44.379323 23772 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 4: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:44.381853 23627 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:44.377665 25373 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:44.385885 23624 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:44.385556 25213 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:44.386606 25598 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:44.386719 25213 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:44.360396 25293 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.395996 25293 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.400362 25588 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.402467 25430 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:44.402776 25599 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:44.372511 25586 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.363463 25277 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.408564 25277 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.390506 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:44.380056 25342 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.603s	user 0.004s	sys 0.007s
I20260709 13:08:44.392154 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:44.412797 25342 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.393335 25213 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:44.419883 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:44.419382 25213 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.421336 25213 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.400254 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:44.435194 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:44.435971 23743 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:44.387682 25373 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.440021 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:44.438952 23772 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:44.444478 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:44.442191 23622 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:44.445852 23704 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:44.447443 25451 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:44.448118 23698 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:08:44.448302 25610 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:44.448650 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:44.448118 25451 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.449828 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:44.443630 25615 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:44.450769 25615 raft_consensus.cc:697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:44.451112 25451 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.451926 25615 consensus_queue.cc:237] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.448086 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:44.453236 23699 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:44.391759 25353 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.454440 25353 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.452454 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:44.456292 23773 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:44.433467 25426 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.448026 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:44.449648 25618 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:44.471829 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:44.467315 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:44.466656 25033 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.471222 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:44.465194 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:44.475327 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:44.475665 23776 raft_consensus.cc:2368] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4.
I20260709 13:08:44.476061 23703 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.448163 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:44.376771 25445 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:44.478106 23772 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:44.478565 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:44.478623 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:44.479944 23778 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:44.476732 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:44.481124 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:44.481287 25033 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:44.481782 25033 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.482127 25033 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.482429 23667 leader_election.cc:400] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4.
I20260709 13:08:44.482750 23667 leader_election.cc:403] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.482007 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:44.488171 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44901.1us
I20260709 13:08:44.493067 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:44.493593 24386 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:08:44.494030 24386 pending_rounds.cc:85] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Aborting all ops after (but not including) 5
I20260709 13:08:44.494350 24386 pending_rounds.cc:107] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:08:44.494213 25625 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4.
I20260709 13:08:44.494761 24386 raft_consensus.cc:2889] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.440981 25430 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:44.464720 25526 raft_consensus.cc:3055] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:44.475173 25342 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.511837 25033 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.496378 25293 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.519055 25033 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.523900 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:44.533238 23627 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.535959 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:44.513281 25526 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:44.500111 25445 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:08:44.546191 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:44.614319 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 76181.1us
I20260709 13:08:44.614391 25033 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:08:44.619234 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:08:44.627352 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 91476.5us
I20260709 13:08:44.627377 23703 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:44.628464 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:44.533161 25605 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.532945 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:44.512899 25430 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:44.632915 23770 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:44.618175 25441 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.674696 25382 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.700378 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 163564us
I20260709 13:08:44.613808 25620 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:44.613895 25342 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.633412 25417 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.629917 25562 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:44.698055 23774 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:44.675977 25419 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:44.682680 25212 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.712294 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 83928.8us
I20260709 13:08:44.713482 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:44.734908 23703 raft_consensus.cc:2368] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5.
I20260709 13:08:44.738430 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:44.677238 25451 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:08:44.741542 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:44.737447 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:44.737888 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:44.742368 23700 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.709131 25620 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:08:44.746531 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.736404 25212 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:44.748450 25617 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.752100 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:44.754719 23702 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:44.736879 23628 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:44.757233 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:44.757956 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:44.758078 23703 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:44.684878 25605 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:44.770614 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:44.771504 23695 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.746220 25446 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.782927 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:44.783712 23704 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.785344 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:44.711352 25382 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:44.758786 23699 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:44.722090 25417 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.781503 23592 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:44.757716 24386 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:44.793658 23702 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:44.754740 25526 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:44.795374 25526 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.796482 23703 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:44.796686 25510 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.763759 25445 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:44.798384 25625 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.798938 25625 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:44.799369 25605 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:44.790369 25604 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:08:44.806720 25588 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.806985 25604 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:44.808013 25620 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.800366 25423 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:44.809106 25423 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.809208 25620 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.802625 25417 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.809440 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:44.809517 25423 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:44.724313 25562 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:44.812546 25212 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:44.814206 25382 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:44.814307 25562 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.751595 25419 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:44.804486 25213 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.808539 25430 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:44.803961 25426 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:44.832929 25419 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.841702 23701 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:08:44.842278 23701 pending_rounds.cc:85] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 5
I20260709 13:08:44.842551 23701 pending_rounds.cc:107] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:08:44.842835 23701 raft_consensus.cc:2889] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.843219 23701 pending_rounds.cc:107] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:08:44.843498 23701 raft_consensus.cc:2889] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.848140 23700 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:44.807642 25604 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:44.789947 25611 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 13:08:44.867384 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 84793.4us
I20260709 13:08:44.870754 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:44.882591 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:44.883535 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.884783 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:44.885555 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:44.891196 25606 raft_consensus.cc:993] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:08:44.891050 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:44.896993 25572 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:44.889976 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:44.898201 24389 raft_consensus.cc:2410] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:44.889951 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:44.892343 25599 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.900525 25632 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.901590 25599 raft_consensus.cc:1081] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:08:44.904294 23704 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:44.914665 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:44.747552 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:44.919494 25468 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:44.920221 25468 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:44.866578 25426 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:44.923506 25353 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:44.926411 25479 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.874253 25596 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:44.900466 23625 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:44.934507 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:44.937013 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:44.938153 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:44.937757 23621 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:44.959076 23628 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:08:44.962394 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.879251 25604 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:44.968321 25610 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.976357 23778 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:44.982056 23743 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:44.982021 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:44.930670 25596 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:44.989338 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:44.992666 23621 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:44.994580 25353 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:08:44.990111 25604 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:08:44.991366 25454 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.997206 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:44.998142 23778 raft_consensus.cc:2410] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:44.966531 25426 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:45.000278 25625 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:45.000618 25426 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:45.002497 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:44.988197 25610 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.006390 25610 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:45.006953 25353 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:45.007432 25353 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:45.008271 25353 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.009466 25353 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.011890 25417 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.014031 23526 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 216) took 8490 ms. Trace:
W20260709 13:08:45.014436 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.017714 25468 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:45.014424 23526 rpcz_store.cc:276] 0709 13:08:36.524119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.524305 (+   186us) service_pool.cc:224] Handling call
0709 13:08:45.013949 (+8489644us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:43.084053 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:43.162554 (+ 78501us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:43.162644 (+    90us) write_op.cc:435] Acquired schema lock
0709 13:08:43.162671 (+    27us) tablet.cc:662] Decoding operations
0709 13:08:43.224424 (+ 61753us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:43.224543 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:43.224573 (+    30us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:08:43.225642 (+  1069us) tablet.cc:701] Row locks acquired
0709 13:08:43.225694 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:08:43.225880 (+   186us) write_op.cc:270] Start()
0709 13:08:43.226045 (+   165us) write_op.cc:276] Timestamp: P: 1783602523225814 usec, L: 0
0709 13:08:43.226085 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:08:43.229889 (+  3804us) log.cc:844] Serialized 3224 byte log entry
0709 13:08:43.548152 (+318263us) op_driver.cc:464] REPLICATION: finished
0709 13:08:43.786080 (+237928us) write_op.cc:301] APPLY: starting
0709 13:08:43.787778 (+  1698us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:43.815847 (+ 28069us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:43.819019 (+  3172us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:43.820296 (+  1277us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:43.820608 (+   312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:08:43.820678 (+    70us) write_op.cc:312] APPLY: finished
0709 13:08:43.821004 (+   326us) log.cc:844] Serialized 65 byte log entry
0709 13:08:43.821210 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.821334 (+   124us) write_op.cc:454] Released schema lock
0709 13:08:43.821398 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:43.821796 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.821826 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":948382,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":227029,"apply.run_cpu_time_us":3876,"apply.run_wall_time_us":37090,"num_ops":8,"prepare.queue_time_us":109440,"prepare.run_cpu_time_us":32541,"prepare.run_wall_time_us":325285,"raft.queue_time_us":42159,"raft.run_cpu_time_us":57624,"raft.run_wall_time_us":148137,"replication_time_us":321907,"thread_start_us":386250,"threads_started":4,"wal-append.queue_time_us":188380,"wal-append.run_cpu_time_us":7405,"wal-append.run_wall_time_us":1407839}]]}
I20260709 13:08:45.018662 25419 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:45.024256 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:45.024958 23625 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.024448 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:45.029922 23695 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:45.032645 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:45.032656 23628 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:08:45.035823 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:45.037283 23622 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:45.040261 25596 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.041030 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:45.041280 25596 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.052495 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:45.051378 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:45.056838 23625 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:45.057538 23621 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:45.055624 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:45.043422 25293 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.515s	user 0.003s	sys 0.007s
I20260709 13:08:45.072688 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:45.036690 25419 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:45.057953 25277 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:45.066437 25526 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.071406 25430 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.073895 25293 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.112041 25423 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.096412 23627 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:45.100479 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.104765 23620 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:45.123953 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.126843 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.127344 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.108287 25419 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.114205 23775 raft_consensus.cc:2410] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:45.080106 23524 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 2, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:45.121433 23778 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:45.122758 23624 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:08:45.143090 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 260224us
I20260709 13:08:45.145890 23524 catalog_manager.cc:5697] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 4, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 4 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.152477 23629 raft_consensus.cc:2368] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6.
I20260709 13:08:45.160457 23524 catalog_manager.cc:5697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 4, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 4 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.144541 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:45.095274 25526 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:45.175685 23524 catalog_manager.cc:5697] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 3, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 3 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:45.183495 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 106825us
I20260709 13:08:45.180907 25650 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:45.146049 25616 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:08:45.168605 25419 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.220957 23627 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:45.221513 23623 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:08:45.221922 23623 pending_rounds.cc:85] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 2
I20260709 13:08:45.222172 23623 pending_rounds.cc:107] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:08:45.222397 23623 raft_consensus.cc:2889] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.222687 23623 pending_rounds.cc:107] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:08:45.222914 23623 raft_consensus.cc:2889] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.232134 23777 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:45.243770 23593 leader_election.cc:400] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5.
W20260709 13:08:45.244989 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 53144.7us
I20260709 13:08:45.246387 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:45.245031 23593 leader_election.cc:403] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.248667 23770 raft_consensus.cc:2955] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:45.236757 25428 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.254171 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:45.254942 25653 log.cc:927] Time spent T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:08:45.255098 25423 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:45.255921 25428 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.256402 25526 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:45.227634 25417 raft_consensus.cc:2955] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:45.242645 25632 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.258090 25428 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:45.258186 25632 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:45.254977 24386 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:45.260676 25632 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:45.261653 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:45.244737 25611 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:08:45.262251 25423 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5.
I20260709 13:08:45.262444 25588 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:45.263360 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.263664 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:45.264444 25609 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.273729 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:45.275650 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:45.276953 25213 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:45.277627 25213 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:45.278784 25213 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.280982 25664 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:45.281430 25664 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:45.282514 23621 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:45.282311 25664 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:45.284356 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:45.284495 25622 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:45.285212 25661 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:45.285758 25661 raft_consensus.cc:697] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:45.286618 25661 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:45.291015 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44730.9us
I20260709 13:08:45.292953 25417 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:45.295887 25609 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:45.301503 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49713.8us
W20260709 13:08:45.301409 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 207822us
I20260709 13:08:45.298928 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:45.307651 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:45.308606 23695 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:08:45.313038 23704 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:45.315618 24391 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:45.317759 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:45.318631 23629 raft_consensus.cc:2410] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:45.318964 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:45.325486 23700 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:08:45.317274 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:45.325691 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:45.329890 23593 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:45.334645 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:45.338582 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:45.339536 23696 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:45.334699 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:45.342151 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:45.343350 25612 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:45.327718 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:45.345569 23704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:08:45.359416 23667 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:45.363240 23696 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:08:45.364607 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:45.360634 25033 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:45.360728 23703 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:45.350756 23697 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:45.371366 23704 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:45.372112 23704 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.358137 25618 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:45.376977 25618 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:45.377861 25428 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:45.378476 25428 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:45.338277 25617 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:45.379541 25428 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.380010 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:45.338685 25250 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:08:45.336802 25586 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:08:45.383260 25423 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:45.386983 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:45.387698 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:45.387681 23622 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:45.397753 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:45.340346 25341 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:45.341557 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:45.421383 25033 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:45.423345 23701 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:45.427901 23700 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:45.428447 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:45.429045 23695 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.344028 25612 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:45.363986 25562 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:45.433384 23704 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:45.442332 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 77132.3us
I20260709 13:08:45.379612 25618 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:45.439213 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 50098.1us
I20260709 13:08:45.449002 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:45.435040 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:45.413136 25342 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:45.447366 25033 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.415367 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:45.385229 25632 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:08:45.396682 25596 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:08:45.482869 23669 leader_election.cc:400] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6.
I20260709 13:08:45.412653 25620 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:08:45.442848 25612 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.485615 23669 leader_election.cc:403] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.442425 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:45.415546 25642 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:08:45.445624 25562 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:45.489424 23695 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:45.456393 25601 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.497473 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:45.502930 23699 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:45.446805 25341 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.483747 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:45.472147 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:45.511853 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 169786us
I20260709 13:08:45.444957 25615 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:08:45.502394 25562 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.502565 23769 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.510795 25342 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.531495 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:45.539559 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:45.528115 25617 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:45.525777 25213 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:45.551283 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 69774.6us
I20260709 13:08:45.536975 25595 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:08:45.545176 25417 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:45.525182 25423 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:45.553213 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:45.514897 25601 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:45.564525 25663 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:08:45.588493 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:45.561684 25419 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:45.557619 25417 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.576040 25570 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.544862 25426 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:08:45.599092 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:45.607388 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:45.561744 25609 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:45.566807 25213 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.612457 23695 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:45.575654 25250 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:08:45.591449 25277 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.600226 25417 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:45.595753 25446 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:45.614519 25624 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.629894 25624 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.630321 25624 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.632990 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:45.597097 23593 consensus_peers.cc:597] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5fa82982f53411c84a07a2fb3918888. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.624941 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:45.633787 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 55612.2us
I20260709 13:08:45.562371 25423 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.636271 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:45.572022 25617 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.622488 23770 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:45.609733 25570 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.618474 25526 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:45.640416 25419 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:45.699365 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 58134.9us
I20260709 13:08:45.675002 25419 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:45.707943 25419 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.710840 23769 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:08:45.723249 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:45.724092 25601 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:45.725123 25679 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:08:45.720669 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 82493.5us
I20260709 13:08:45.704769 25572 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.742026 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:45.744444 23699 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
W20260709 13:08:45.760663 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.742885 25572 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.809993 25572 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:45.838639 25419 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:45.856782 23704 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:45.804133 25213 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:45.770180 25612 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:45.873782 25624 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
W20260709 13:08:45.953127 25687 log.cc:927] Time spent T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:08:45.968780 25277 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:45.971148 25342 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6.
I20260709 13:08:45.970985 25277 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:45.973675 25277 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:45.985991 23697 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:08:45.991984 24386 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:45.993949 25612 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:45.997042 25341 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:46.000736 24389 consensus_meta.cc:287] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.003s
I20260709 13:08:46.000980 25664 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.001186 24389 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:46.001470 25341 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:46.003064 25341 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.006570 25341 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:46.013026 25624 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:46.014219 25562 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.016791 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.018204 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.019510 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.020308 23621 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:08:46.021885 25353 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:46.022491 25353 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.026546 23626 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:46.032948 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:46.037250 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:46.045178 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:46.045743 23774 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:46.046015 23774 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:46.039707 25595 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:08:46.048669 25353 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:46.039180 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:46.056747 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:46.039915 25468 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:46.065461 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:46.065889 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:46.066972 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:46.068339 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.060321 23774 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.041201 25562 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:46.060984 25419 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:46.058861 24386 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:46.067867 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:46.042426 25417 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:46.165378 25696 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.206s	user 0.004s	sys 0.000s
I20260709 13:08:46.165741 23776 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:46.160882 23778 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:46.173262 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.168551 23774 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:46.089551 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:46.169150 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:46.173096 25661 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:46.068400 25612 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:46.180104 23627 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:46.180964 23622 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 13:08:46.173689 25694 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:46.087610 25468 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:46.188037 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.188906 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:46.085480 25691 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:08:46.072357 25570 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:46.095999 25373 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.202350 25582 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:46.203508 25570 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:46.194628 25293 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.215054 25293 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.218735 25293 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:46.211516 25572 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:46.224428 25572 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.196573 25177 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.234289 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:46.235014 23777 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:46.191408 25468 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:46.236081 23776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:46.237082 23776 raft_consensus.cc:606] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:46.235790 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:46.237820 23774 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:08:46.237730 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:46.239493 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:46.244168 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:46.249935 25682 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.252449 25610 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:46.253077 25610 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:46.254086 25610 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.242576 25277 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:46.263141 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:46.271977 24358 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:08:46.279992 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 72545.2us
I20260709 13:08:46.187708 25612 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.280938 23592 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:46.288525 23695 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:46.292897 23700 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:46.300623 23776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:46.278762 25562 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:46.301330 23776 raft_consensus.cc:606] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:46.309340 23776 raft_consensus.cc:614] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:46.279855 25277 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.328116 23593 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:46.313968 25419 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:46.313308 25699 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.126s	user 0.000s	sys 0.002s
W20260709 13:08:46.329022 23699 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.022s	sys 0.040s
W20260709 13:08:46.333560 23699 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.022s	sys 0.040s
I20260709 13:08:46.319164 25277 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.313601 25562 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:46.347412 23776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:46.348241 23776 raft_consensus.cc:606] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:46.348676 23776 raft_consensus.cc:614] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:46.350622 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.314083 25661 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:46.354663 25677 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:08:46.355538 25631 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:46.356005 25430 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:46.356817 25572 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:46.340384 25609 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:46.371469 25686 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:08:46.340539 25562 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:46.346396 25419 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:46.367614 25417 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:46.398300 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:46.399130 23778 raft_consensus.cc:606] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:46.369987 25430 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.326730 25617 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:08:46.379827 25625 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:46.387871 25680 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:46.426645 25633 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:46.367976 25631 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.429230 25419 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:46.435207 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.436810 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:46.479302 23742 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:46.433297 25633 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:46.433040 25625 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.431661 25680 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:46.481141 23776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:46.484632 23776 raft_consensus.cc:606] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:46.470818 25612 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:46.486821 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:46.439513 25423 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:08:46.510820 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:46.475811 25693 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.483441 25615 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.517974 25693 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.521770 25430 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:46.523187 25693 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:46.523806 25625 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:46.524533 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:46.525257 25633 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.527117 25633 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.528025 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:46.528555 25701 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:08:46.528045 25680 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.530069 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1742) took 1033 ms. Trace:
I20260709 13:08:46.530447 23629 rpcz_store.cc:276] 0709 13:08:45.496681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.496820 (+   139us) service_pool.cc:224] Handling call
0709 13:08:45.497251 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:45.504167 (+  6916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:45.504421 (+   254us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:45.982735 (+478314us) spinlock_profiling.cc:243] Waited 975 us on lock 0x7b2c00058238. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:08:45.983188 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:08:46.188501 (+205313us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:46.188547 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.189674 (+  1127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:46.529752 (+340078us) raft_consensus.cc:1685] finished
0709 13:08:46.529776 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:46.530009 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4074,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5884,"spinlock_wait_cycles":2241920,"thread_start_us":204907,"threads_started":1,"wal-append.queue_time_us":383129}
I20260709 13:08:46.511034 25570 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.533560 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:46.533375 25570 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:46.534842 25570 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:46.535346 25570 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:46.537349 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:46.539638 23629 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:46.515626 25426 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.556545 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 163) took 1127 ms. Trace:
W20260709 13:08:46.555424 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 227417us
I20260709 13:08:46.559775 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:46.560374 23629 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:46.560460 25572 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:08:46.583146 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:46.556529 25479 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:46.582590 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:46.595227 23697 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:08:46.596235 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:46.597273 24391 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:46.597529 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:46.588562 23702 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:46.589113 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:46.601002 23704 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:46.598737 23668 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:46.601464 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:46.602483 25033 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:46.602577 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:46.602972 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.603216 25033 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:46.603899 25033 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.560719 25606 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.610008 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.611023 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:46.564585 25353 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.613360 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:46.585112 25631 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:46.573376 25430 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:46.619665 23702 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:46.612205 25633 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.582237 25582 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:46.630558 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.627786 23629 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:08:46.618789 25693 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.625885 23704 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:46.631585 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:46.638794 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:46.639484 25582 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.640885 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.586344 25570 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.648707 25430 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.609038 25479 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:46.588325 25277 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.625507 25353 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.663172 23628 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:46.617182 25562 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.666281 25693 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.666468 25382 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:46.675129 23696 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:46.681645 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:46.663492 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:46.656428 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:46.697144 25621 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:46.697700 25621 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.698136 25621 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.697831 25033 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.702282 23695 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:46.704741 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:46.657301 25633 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.710467 23704 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:08:46.691582 25341 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.720465 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:46.738116 24391 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:46.717458 25572 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.709000 25445 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:08:46.754187 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:46.755023 23778 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.724251 25277 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:46.720945 25582 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:46.760744 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1744) took 1187 ms. Trace:
I20260709 13:08:46.726408 25586 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:46.763526 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.735294 25631 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.769225 23622 rpcz_store.cc:276] 0709 13:08:45.572980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.577664 (+  4684us) service_pool.cc:224] Handling call
0709 13:08:45.578075 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.181404 (+603329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.760483 (+579079us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54003af554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:46.760680 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385938176}
W20260709 13:08:46.779628 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 62424.6us
I20260709 13:08:46.781090 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:46.781816 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:46.782675 23629 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 4: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:08:46.781992 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.783628 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:46.784917 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.785118 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.785949 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.787995 23622 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:46.734486 25595 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:08:46.733626 25341 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.789474 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:46.778861 25468 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.000s
I20260709 13:08:46.784945 25615 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.855350 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:46.791321 25419 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 13:08:46.791952 25706 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
W20260709 13:08:46.867702 25716 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:46.874076 25693 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:46.778399 25479 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:46.875342 25714 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:46.860873 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:46.781553 23702 raft_consensus.cc:2955] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:46.858320 23778 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:08:46.861797 25445 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.892524 25718 ts_tablet_manager.cc:933] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:46.861194 25631 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:46.898895 25715 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:08:46.900382 25353 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:46.901187 25606 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.905177 25633 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:46.857038 25615 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:46.906540 25615 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:46.907866 25250 raft_consensus.cc:3055] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:46.908601 25250 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:46.852645 25468 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.909736 25250 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.875157 25621 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.912500 23775 raft_consensus.cc:2368] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8.
I20260709 13:08:46.908038 25615 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.914539 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:46.915241 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:46.917822 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 170933us
I20260709 13:08:46.918545 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:46.779876 25586 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.921262 23778 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.921124 23669 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:46.932710 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:46.932710 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:46.934862 23776 raft_consensus.cc:2410] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:46.934039 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:46.936640 25625 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:46.939276 25693 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.938988 25727 raft_consensus.cc:2955] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:46.922214 25606 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:08:46.941753 25606 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:46.941964 25586 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:46.942212 25606 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:46.924930 25633 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:46.943449 25633 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:46.936874 25588 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:08:46.926052 25698 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:46.946101 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:46.947925 25212 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.948422 23769 raft_consensus.cc:2410] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:46.948688 25621 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:46.943204 25606 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.949443 25423 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:46.949993 25423 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:46.933139 25631 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.956317 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:08:46.958026 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.964903 25033 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:46.959525 25075 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.979151 23626 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:46.990027 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:46.991263 25033 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.991820 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:46.997538 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 51078.8us
I20260709 13:08:46.998808 23778 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:47.001035 25033 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.989500 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:46.944567 25633 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.003701 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1711) took 1679 ms. Trace:
I20260709 13:08:47.004125 23698 rpcz_store.cc:276] 0709 13:08:45.324333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.339648 (+ 15315us) service_pool.cc:224] Handling call
0709 13:08:47.003514 (+1663866us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400195854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:47.003649 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2737686912}
I20260709 13:08:46.977736 23623 raft_consensus.cc:2955] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:47.007556 25625 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:47.008905 23770 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:08:47.009338 23770 pending_rounds.cc:85] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 1
I20260709 13:08:46.960638 25610 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:47.009896 25610 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:47.012594 25610 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:47.009562 23770 pending_rounds.cc:107] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:08:47.013906 23770 raft_consensus.cc:2889] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.969837 25562 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:47.019191 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.023341 25729 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.025594 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:47.028348 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:47.028484 23771 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:47.030910 23695 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:47.037026 23626 raft_consensus.cc:2410] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:47.035326 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:47.038256 23628 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:47.000679 25606 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:47.069718 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.000069 25353 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:47.013052 25677 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:08:47.074822 23696 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:46.997166 25212 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:46.557278 23701 rpcz_store.cc:276] 0709 13:08:45.429244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.436347 (+  7103us) service_pool.cc:224] Handling call
0709 13:08:45.459434 (+ 23087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.459718 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:45.486594 (+ 26876us) log.cc:844] Serialized 14 byte log entry
0709 13:08:46.175346 (+688752us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18003abbe0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac23a 00007f2b41316a2a
0709 13:08:46.556119 (+380773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:46.556189 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:46.556234 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.556303 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:46.556465 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26492,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":4697,"raft.queue_time_us":3478,"spinlock_wait_cycles":6048000,"thread_start_us":378348,"threads_started":1}
I20260709 13:08:47.069510 25610 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.078315 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:47.091151 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 59399.1us
I20260709 13:08:47.013038 25727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42286 (request call id 11) took 1430 ms. Trace:
I20260709 13:08:47.027024 25733 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.070960 25631 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.123692 23622 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
W20260709 13:08:47.125671 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 94034.8us
I20260709 13:08:47.126039 23628 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:08:47.154417 25277 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:47.070580 25729 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.124244 25468 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:47.156474 25714 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:08:47.096196 25610 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.087303 25353 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.136245 25744 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:08:47.105134 25718 tablet_copy_client.cc:323] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.1:37537
W20260709 13:08:47.193151 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 66398.5us
I20260709 13:08:47.129243 25631 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:47.122668 25733 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.179003 25277 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:47.205140 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:47.258914 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 53890us
I20260709 13:08:47.260396 25277 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:47.262147 25740 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.206224 25673 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.265825 25673 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:47.209194 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.207486 25631 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:47.219189 25680 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.220839 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:47.222893 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:47.192420 25423 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:47.105036 25727 rpcz_store.cc:276] 0709 13:08:45.582771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.586626 (+  3855us) service_pool.cc:224] Handling call
0709 13:08:46.147118 (+560492us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4c00446300. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3f5d8a20 00007f2b3f5e9a29 00007f2b3f5af644 00007f2b3f5d6f2d 00007f2b3f5d6b93 00007f2b412651af 00007f2b41264f3e 00007f2b412ea888 00007f2b4130775c 00007f2b4130876a 00007f2b4130791b
0709 13:08:46.148703 (+  1585us) log.cc:844] Serialized 499 byte log entry
0709 13:08:47.012932 (+864229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3448,"raft.queue_time_us":5957,"raft.run_cpu_time_us":1927,"raft.run_wall_time_us":1924,"spinlock_wait_cycles":3729280,"thread_start_us":219598,"threads_started":1,"wal-append.queue_time_us":338849}
I20260709 13:08:47.273921 25727 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.233175 25212 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:47.274518 25727 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.234933 25729 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:47.237826 25610 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:47.246268 25353 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:47.249732 25733 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:47.252784 25714 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:47.253161 25633 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:47.285267 25633 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.256884 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.270776 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:47.288527 23742 consensus_peers.cc:597] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d67625249f734ae3b71d554b7a2ba33b. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.289213 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 493825us
I20260709 13:08:47.290071 25633 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:47.270813 25673 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:47.294533 25676 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:47.294701 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.295166 25676 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:47.303874 23639 tablet_copy_service.cc:140] P 9ab488f10c434878a749f261e99a8065: Received BeginTabletCopySession request for tablet d5fa82982f53411c84a07a2fb3918888 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:58448)
I20260709 13:08:47.304644 23639 tablet_copy_service.cc:161] P 9ab488f10c434878a749f261e99a8065: Beginning new tablet copy session on tablet d5fa82982f53411c84a07a2fb3918888 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:58448: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-d5fa82982f53411c84a07a2fb3918888
I20260709 13:08:47.285645 25727 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:47.312062 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:47.315119 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:47.315202 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:47.316388 23639 tablet_copy_source_session.cc:215] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:47.316531 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:47.317176 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:47.317814 24385 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:08:47.311903 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.320027 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:47.320621 23776 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:47.303982 25640 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:08:47.328233 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.328930 23771 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:47.329511 23668 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:47.330441 25033 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.330863 25033 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:47.330905 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:47.332456 23776 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:47.337015 23771 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:47.348644 23776 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:47.354135 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:47.357013 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:47.353912 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:47.375545 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1452) took 1315 ms. Trace:
I20260709 13:08:47.376017 23775 rpcz_store.cc:276] 0709 13:08:46.059865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.059984 (+   119us) service_pool.cc:224] Handling call
0709 13:08:47.367529 (+1307545us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b540014ee54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:47.375458 (+  7929us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696241536}
I20260709 13:08:47.377147 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:47.343082 25341 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:47.379498 23592 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:47.352025 25293 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:47.344167 25277 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:47.389557 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:47.393077 25033 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:47.393832 25033 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:47.394227 25033 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.394610 25033 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.366291 25693 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:47.402470 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 280428us
I20260709 13:08:47.396200 25623 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:47.405861 25588 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.406148 25586 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:47.406314 25623 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.408294 25674 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:47.408651 25623 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:47.408751 25674 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:47.381039 25341 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:47.410460 25341 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.410828 25341 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.406672 25588 consensus_queue.cc:1243] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:47.379899 25640 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.408376 25250 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.409757 25674 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.430635 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:47.430881 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:47.414111 24389 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:47.396893 24386 raft_consensus.cc:2393] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:47.401610 25277 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.417855 25604 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:47.435210 25033 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:47.419126 25212 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.381829 25743 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 13:08:47.413028 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.390945 25727 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.429491 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:47.477167 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 123794us
I20260709 13:08:47.403861 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:47.435333 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:47.436117 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet 4a97c483343c425ea75f1f6632924819: Illegal state: Replica 9ab488f10c434878a749f261e99a8065 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
W20260709 13:08:47.487025 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 83286.6us
W20260709 13:08:47.489033 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.445355 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:47.550953 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 197127us
I20260709 13:08:47.557511 25033 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:47.411808 25728 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:08:47.436439 25674 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.559809 23667 leader_election.cc:400] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8.
I20260709 13:08:47.578784 23667 leader_election.cc:403] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:47.579418 25033 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:08:47.580067 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 135887us
W20260709 13:08:47.582710 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 137480us
I20260709 13:08:47.552925 25604 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:47.552824 25745 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.593482 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.596868 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:47.597431 23775 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.598578 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:47.450438 25212 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.391971 25676 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:47.602751 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:47.591173 25673 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.606805 23701 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:08:47.611208 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:47.589170 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:47.605762 23704 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:47.614279 23629 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:47.604655 25607 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:47.616997 25341 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.617434 25607 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:47.618172 23697 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:47.619170 25341 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:47.620836 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:47.621532 23776 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.619474 25607 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:47.623365 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:47.627516 23776 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
W20260709 13:08:47.627856 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.629766 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:47.631659 25277 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:47.632488 25718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5fa82982f53411c84a07a2fb3918888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:47.611806 23703 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:47.613561 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:47.594987 25747 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:47.641752 25033 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8.
I20260709 13:08:47.641247 25739 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.646245 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.646868 25033 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:47.647323 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:47.651245 25033 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.645219 25604 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.656665 23778 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:47.643399 25747 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.643244 23696 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:47.652077 25277 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:47.664376 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:47.669133 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1382) took 1107 ms. Trace:
I20260709 13:08:47.659425 25747 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.654309 25739 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:47.669709 23625 rpcz_store.cc:276] 0709 13:08:46.561927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.562056 (+   129us) service_pool.cc:224] Handling call
0709 13:08:46.562493 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.960191 (+397698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.960235 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:46.960766 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:08:47.079196 (+118430us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:47.118241 (+ 39045us) log.cc:844] Serialized 14 byte log entry
0709 13:08:47.318057 (+199816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.666785 (+348728us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400324bd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:47.666856 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:47.666918 (+    62us) raft_consensus.cc:1685] finished
0709 13:08:47.668835 (+  1917us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.669026 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2289,"prepare.queue_time_us":44086,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":23771,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":12018,"spinlock_wait_cycles":913562496,"thread_start_us":317453,"threads_started":2,"wal-append.queue_time_us":152181}
I20260709 13:08:47.676370 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:47.680002 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:47.682374 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:47.684051 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:47.669418 25277 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:47.675210 25693 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:47.692167 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:47.693200 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:47.690093 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:47.678851 25212 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:47.674826 25728 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:08:47.701506 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:47.702494 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:47.703261 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:47.704826 23698 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.702667 23702 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:08:47.691052 25693 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:47.705683 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:47.706077 25693 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.706207 25277 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:47.708761 25754 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:08:47.698323 25740 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:47.695796 25752 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:47.710747 25740 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.711174 25740 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.711018 25752 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:47.711772 25570 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.713788 25752 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:47.691556 25611 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:08:47.716650 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:47.717296 23701 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:47.717424 24386 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:47.689846 25417 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:47.718206 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:47.720709 25430 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:47.721225 23701 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:08:47.720764 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:47.727155 23698 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:47.728916 23775 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:08:47.729379 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:47.731402 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:47.731848 23700 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 6. Ops: []
I20260709 13:08:47.739686 25586 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:47.754659 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:47.758185 25739 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:47.758642 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:47.755561 23700 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:47.731029 25468 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:47.748054 25586 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:47.776389 23700 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:08:47.779584 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:47.780783 25445 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.784428 25673 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:47.786861 25693 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.787562 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.788398 25586 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.802214 25747 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:47.803838 23624 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:47.819572 23699 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:47.823144 23628 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:08:47.823778 23628 pending_rounds.cc:85] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 2
I20260709 13:08:47.824060 23628 pending_rounds.cc:107] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:08:47.824343 23628 raft_consensus.cc:2889] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:47.833124 23742 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:47.837075 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:47.818514 25586 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.834132 25615 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:47.851650 24358 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:47.852689 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:47.858227 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:47.866408 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:47.868032 23775 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:47.868937 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.865751 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:47.877677 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:47.893401 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:47.851439 25604 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:47.849388 25747 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:47.895959 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.928429 23769 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:47.927919 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:47.935796 25610 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:08:47.923178 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:47.926858 25277 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:47.877178 25674 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:47.871078 25570 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.853413 25615 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.896829 25607 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:08:47.987187 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 59350.4us
I20260709 13:08:47.988034 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:47.990006 23773 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:47.893501 25621 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:47.975875 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:48.000041 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:47.948814 25604 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.939635 25582 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:47.871174 25612 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:47.924786 25633 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:08:47.926991 25430 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:47.951023 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:48.010171 23668 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:47.951483 25674 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:48.025481 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 127254us
I20260709 13:08:47.982191 25615 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.004437 25353 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.007997 25640 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.994901 25445 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:48.057392 23669 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:48.014531 25604 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:48.015202 25742 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:48.056639 24389 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.064792 25744 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:48.149564 25760 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:08:48.124150 25757 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:08:48.013554 25621 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:48.058343 25426 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.141320 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:48.176596 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:48.196884 23778 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.064704 25293 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:48.033234 25718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46566 (request call id 404) took 1404 ms. Trace:
I20260709 13:08:48.069360 25674 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.040453 23623 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
W20260709 13:08:48.150539 25761 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:08:48.175571 25751 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.739s	user 0.003s	sys 0.001s
I20260709 13:08:48.098454 25673 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:48.203634 25426 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:48.196988 25617 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:48.197142 25277 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:48.153383 25445 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:48.274430 25426 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:48.274930 25277 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:48.275111 25617 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:48.277526 25617 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:48.190562 25430 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:48.279639 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 302143us
I20260709 13:08:48.245522 25621 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:48.196244 25428 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:08:48.196211 25373 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.197116 25693 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:48.357888 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 457712us
I20260709 13:08:48.042809 25740 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:48.334518 25373 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:48.188983 25744 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:48.373158 25607 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:48.451812 25373 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:48.304980 25673 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:48.454862 25761 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:08:48.567085 25763 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.558s	user 0.002s	sys 0.000s
I20260709 13:08:48.617380 23778 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:48.735105 25740 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:48.739495 25761 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:08:48.740887 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1749) took 1046 ms. Trace:
I20260709 13:08:48.741496 23701 rpcz_store.cc:276] 0709 13:08:47.694857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.721927 (+ 27070us) service_pool.cc:224] Handling call
0709 13:08:47.722254 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:47.728629 (+  6375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.728666 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:47.729158 (+   492us) log.cc:844] Serialized 52 byte log entry
0709 13:08:47.832928 (+103770us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:47.839192 (+  6264us) log.cc:844] Serialized 14 byte log entry
0709 13:08:47.840114 (+   922us) log.cc:844] Serialized 14 byte log entry
0709 13:08:47.840310 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.840404 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.740577 (+900173us) raft_consensus.cc:1685] finished
0709 13:08:48.740607 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.740804 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6120,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":70,"raft.queue_time_us":8360,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":5527,"thread_start_us":77478,"threads_started":1,"wal-append.queue_time_us":191213}
W20260709 13:08:48.776624 24359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.019s	sys 0.011s
W20260709 13:08:48.780376 23742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.023s	sys 0.026s
W20260709 13:08:48.872138 23742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.025s	sys 0.027s
I20260709 13:08:48.872911 25676 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:48.777099 24360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.003s	sys 0.025s
W20260709 13:08:48.875239 24360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.004s	sys 0.026s
W20260709 13:08:48.875840 24359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.021s	sys 0.013s
W20260709 13:08:48.876309 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 891070us
I20260709 13:08:48.877614 25673 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:48.821403 25607 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:48.202409 25718 rpcz_store.cc:276] 0709 13:08:46.582102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.582419 (+   317us) service_pool.cc:224] Handling call
0709 13:08:46.893001 (+310582us) ts_tablet_manager.cc:934] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
0709 13:08:47.366430 (+473429us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:47.805923 (+439493us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:47.806089 (+   166us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:47.934600 (+128511us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:47.935082 (+   482us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:47.976113 (+ 41031us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:47.986040 (+  9927us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":68142,"tablet-copy.queue_time_us":207776,"thread_start_us":277808,"threads_started":2}
I20260709 13:08:48.882072 25718 tablet_copy_client.cc:806] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:48.882846 25718 tablet_copy_client.cc:670] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:48.886348 25773 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:48.887022 25773 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:48.887902 25775 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.850548 25615 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.733s	user 0.007s	sys 0.003s
W20260709 13:08:48.891330 25674 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.001s
I20260709 13:08:48.892382 25428 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:48.893455 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:48.907438 25604 consensus_meta.cc:287] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.000s
W20260709 13:08:48.908372 24389 consensus_meta.cc:287] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 13:08:48.908824 24389 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:08:48.905565 25677 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:08:48.870600 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.907960 25604 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:48.871182 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 813881us
I20260709 13:08:48.868995 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 181) took 1169 ms. Trace:
I20260709 13:08:48.922485 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:48.923694 25677 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:48.925774 25586 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.064s	user 0.011s	sys 0.000s
I20260709 13:08:48.926769 25677 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:48.927335 23668 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:48.898057 25778 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:48.903647 25673 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:48.909461 24389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46594 (request call id 347) took 1023 ms. Trace:
I20260709 13:08:48.903429 25353 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.903878 25623 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.920884 23702 rpcz_store.cc:276] 0709 13:08:47.700087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.730989 (+ 30902us) service_pool.cc:224] Handling call
0709 13:08:47.731304 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:47.735417 (+  4113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.735443 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:47.735958 (+   515us) log.cc:844] Serialized 52 byte log entry
0709 13:08:47.882698 (+146740us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:47.930928 (+ 48230us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.868622 (+937694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.868711 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.868758 (+    47us) raft_consensus.cc:1685] finished
0709 13:08:48.868773 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.868928 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27165,"prepare.queue_time_us":40891,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":123,"raft.queue_time_us":116593,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":29166,"thread_start_us":376918,"threads_started":2,"wal-append.queue_time_us":252879}
I20260709 13:08:48.898295 25779 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:48.916160 25293 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:48.910709 25428 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:48.936256 23775 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:48.928009 25677 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:48.938277 25623 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:48.938532 25293 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:48.904121 25615 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:48.904284 25775 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:48.909904 25674 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:48.933480 24389 rpcz_store.cc:276] 0709 13:08:47.885978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.893198 (+  7220us) service_pool.cc:224] Handling call
0709 13:08:48.909391 (+1016193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:48.934019 25771 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:48.937381 25744 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:48.993247 23772 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:08:48.991426 23776 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:48.937443 25341 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:48.969027 25445 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:48.974313 25177 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.970526 25767 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.011049 25430 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:48.940289 25779 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.011205 25341 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:49.013947 25733 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.017807 23524 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 118) took 10628 ms. Trace:
I20260709 13:08:47.551438 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:49.018718 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1228) took 1030 ms. Trace:
I20260709 13:08:48.936210 25673 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:48.940853 25353 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:48.977741 25601 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:49.024564 25604 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:48.934289 25778 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:48.982998 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:49.031446 23770 rpcz_store.cc:276] 0709 13:08:47.987842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.987980 (+   138us) service_pool.cc:224] Handling call
0709 13:08:47.995294 (+  7314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.278669 (+283375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.278703 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:48.278751 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:48.278789 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.018471 (+739682us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540014e454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:49.018520 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.018654 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651136896}
I20260709 13:08:48.981024 25753 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:48.981251 25770 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.977108 25677 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.023983 25616 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:49.005613 25771 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.043488 23769 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:49.045011 23774 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:08:49.029814 25430 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:48.983152 25631 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:08:49.025780 25177 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:49.030270 23524 rpcz_store.cc:276] 0709 13:08:38.409497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.429363 (+ 19866us) service_pool.cc:224] Handling call
0709 13:08:39.421438 (+992075us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54000b90d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41276090 00007f2b41314f3a 00007f2b470cb1cc 00007f2b471c937e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc 00007f2b45689392 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:49.017745 (+9596307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:45.504614 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:45.612972 (+108358us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:45.614809 (+  1837us) write_op.cc:435] Acquired schema lock
0709 13:08:45.614839 (+    30us) tablet.cc:662] Decoding operations
0709 13:08:45.672100 (+ 57261us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:45.672173 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:45.672207 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:45.672666 (+   459us) tablet.cc:701] Row locks acquired
0709 13:08:45.672688 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:45.672848 (+   160us) write_op.cc:270] Start()
0709 13:08:45.672987 (+   139us) write_op.cc:276] Timestamp: P: 1783602525672799 usec, L: 0
0709 13:08:45.673012 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:08:45.673739 (+   727us) log.cc:844] Serialized 1674 byte log entry
0709 13:08:46.164276 (+490537us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:08:46.655388 (+491112us) op_driver.cc:464] REPLICATION: finished
0709 13:08:46.953384 (+297996us) write_op.cc:301] APPLY: starting
0709 13:08:46.953490 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:46.958280 (+  4790us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:46.958321 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:46.959360 (+  1039us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:46.959673 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:08:46.959768 (+    95us) write_op.cc:312] APPLY: finished
0709 13:08:46.960064 (+   296us) log.cc:844] Serialized 41 byte log entry
0709 13:08:47.000944 (+ 40880us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:47.030022 (+ 29078us) write_op.cc:454] Released schema lock
0709 13:08:47.039262 (+  9240us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:47.128582 (+ 89320us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:47.132349 (+  3767us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1055886,"reported_tablets":10,"spinlock_wait_cycles":1745295744,"child_traces":[["op",{"apply.queue_time_us":293743,"apply.run_cpu_time_us":2965,"apply.run_wall_time_us":140236,"num_ops":4,"prepare.queue_time_us":152654,"prepare.run_cpu_time_us":33352,"prepare.run_wall_time_us":470006,"raft.queue_time_us":361059,"raft.run_cpu_time_us":23384,"raft.run_wall_time_us":257422,"replication_time_us":942932,"spinlock_wait_cycles":2674432,"thread_start_us":832129,"threads_started":4,"wal-append.queue_time_us":285402,"wal-append.run_cpu_time_us":26708,"wal-append.run_wall_time_us":2017403}]]}
I20260709 13:08:49.020184 25428 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.045660 25781 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:49.036239 25733 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:49.057960 25775 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:49.042899 25604 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.058290 25673 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:49.062374 25353 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:49.064893 25341 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:49.065955 25430 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:49.048544 25773 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:49.067885 25781 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:49.045744 25753 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.074321 25779 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:49.041081 25601 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:49.049701 25616 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:49.075708 25428 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.092912 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1229) took 1104 ms. Trace:
I20260709 13:08:49.093559 23775 rpcz_store.cc:276] 0709 13:08:47.988139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.989366 (+  1227us) service_pool.cc:224] Handling call
0709 13:08:47.989667 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.941920 (+952253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.092546 (+150626us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54002cabd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:49.092831 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176339328}
I20260709 13:08:49.047384 25770 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:49.088737 25615 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:49.081034 25604 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.096329 25674 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:49.137372 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.138839 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1234) took 1139 ms. Trace:
I20260709 13:08:49.142288 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:49.143018 23628 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:49.139252 23776 rpcz_store.cc:276] 0709 13:08:47.999532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.999772 (+   240us) service_pool.cc:224] Handling call
0709 13:08:49.137735 (+1137963us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b540016c454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:49.137913 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2262139264}
W20260709 13:08:49.162675 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 184210us
I20260709 13:08:49.163790 25767 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:49.164269 25674 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:49.164427 25767 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.165035 25674 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.165591 25713 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.166222 25713 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.167163 25767 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:49.167886 25783 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:49.168483 25783 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.175688 23592 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:49.145208 25673 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.148013 25631 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:49.152267 25784 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:49.152930 25430 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:49.159797 25769 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:49.156227 25341 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:49.186985 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:49.179653 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:49.196286 25033 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:49.197028 23699 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:08:49.201923 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.200253 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.195968 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.201687 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.184834 25677 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:49.201231 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:49.236251 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 60655.8us
I20260709 13:08:49.211525 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.198135 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:49.202982 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:49.240010 23778 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:49.248473 24359 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:49.249034 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:49.252946 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:49.190554 25782 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:08:49.422338 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 175995us
I20260709 13:08:49.213737 25601 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:49.190680 25781 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:49.192282 25277 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:49.186089 25770 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:49.221289 23525 catalog_manager.cc:5697] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:49.876403 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 696799us
I20260709 13:08:49.877246 23704 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:49.877681 23695 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:49.869333 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1231) took 1880 ms. Trace:
W20260709 13:08:49.729081 23741 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.029s	sys 0.058s
I20260709 13:08:49.878470 23703 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
W20260709 13:08:49.878818 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 630395us
I20260709 13:08:49.879060 25033 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.865841 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:49.876679 23770 raft_consensus.cc:2368] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4.
I20260709 13:08:49.880683 23700 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:49.883708 23741 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.029s	sys 0.068s
I20260709 13:08:49.865854 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:49.877233 23624 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:49.889482 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:49.568246 23595 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.014s	sys 0.104s
W20260709 13:08:49.892576 23595 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.014s	sys 0.128s
I20260709 13:08:49.191781 25733 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:49.191079 25713 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:49.212981 25674 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:49.188568 25616 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:49.192520 25753 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:49.222332 25676 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:49.187292 25604 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:49.185040 25353 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:49.887454 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.885186 23622 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 1.
W20260709 13:08:49.889561 24357 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.035s	sys 0.053s
I20260709 13:08:49.925367 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:08:49.928176 24357 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.035s	sys 0.053s
I20260709 13:08:49.201449 25177 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:49.883317 23771 rpcz_store.cc:276] 0709 13:08:47.988681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.990717 (+  2036us) service_pool.cc:224] Handling call
0709 13:08:47.991026 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.130393 (+139367us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b18003e0260. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b451e058f 00007f2b3e21f571 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd
0709 13:08:48.910983 (+780590us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b18003e0260. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b41304060 00007f2b41304bfb 00007f2b4130f64b
0709 13:08:48.911143 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.911172 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:48.914145 (+  2973us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.225868 (+311723us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:49.225928 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.226038 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.869085 (+643047us) raft_consensus.cc:1685] finished
0709 13:08:49.869104 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.869263 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12987,"raft.queue_time_us":42600,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":20276,"spinlock_wait_cycles":25761536,"thread_start_us":403738,"threads_started":2,"wal-append.queue_time_us":817008}
I20260709 13:08:49.928738 25794 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:49.929276 25794 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.929698 25794 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:49.253461 25586 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:49.932075 25586 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:49.932379 25718 tablet_copy_client.cc:538] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:49.933235 25586 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.188728 25693 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.890723 25033 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:49.936909 25693 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:49.939128 25794 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:49.210214 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:49.940788 24389 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.880013 23701 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:08:49.942960 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:49.943140 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.944104 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.945209 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.945779 23701 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:49.244624 25774 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:49.948887 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.946558 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:49.195844 25728 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.882555 25426 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:49.888650 25769 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.192621 25766 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:08:49.737838 24392 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.011s	sys 0.018s
I20260709 13:08:49.897624 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:49.969913 23668 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 334c9018414947cabb4405ef47b8018e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.897825 23628 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:08:49.732059 25768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.077s	sys 0.156s
W20260709 13:08:49.878173 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 691254us
I20260709 13:08:49.885771 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:49.191355 25778 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:49.213196 25783 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:49.605093 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.886952 25277 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.870941 25775 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:49.535812 25788 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:49.535823 25790 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:49.731947 25423 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.539265 25785 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:49.535650 25791 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:49.765657 25727 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:49.854805 25793 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:49.869854 25445 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:49.202327 25771 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:50.063090 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 185120us
I20260709 13:08:49.557643 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:49.912799 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.886847 25781 raft_consensus.cc:2764] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:08:49.905292 23525 catalog_manager.cc:5697] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 2 to 3, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 3 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.887055 25789 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:49.383813 25673 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.418860 25631 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:49.947050 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 965796us
W20260709 13:08:49.908512 25293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.047s	sys 0.121s
I20260709 13:08:49.535238 25430 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.243680 25744 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:49.950117 23695 raft_consensus.cc:2410] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:49.204810 25623 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:50.011998 25770 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:49.910254 25733 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:49.887794 25341 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:50.093958 25293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.047s	sys 0.121s
I20260709 13:08:49.973026 23696 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.927549 25676 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.975138 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:49.924427 25753 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:49.977598 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:49.977623 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:49.980964 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:49.981320 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:50.129129 23628 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:50.082707 25789 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:49.964159 23700 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:08:49.535491 25784 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:49.949676 25693 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:49.994153 25718 tablet_bootstrap.cc:492] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:49.967746 25728 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:49.967921 24392 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.014s	sys 0.025s
I20260709 13:08:49.967585 25426 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.000609 25277 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.004227 25775 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:49.976696 25768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.078s	sys 0.157s
I20260709 13:08:49.963464 25798 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:49.949342 25353 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:49.555953 25611 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:50.065721 23698 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:08:50.088152 25804 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:50.077237 25801 ts_tablet_manager.cc:933] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:49.949627 23699 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
W20260709 13:08:50.182192 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 201346us
I20260709 13:08:50.182906 24359 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:08:50.120262 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 231973us
I20260709 13:08:50.100070 24386 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:50.081470 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:50.151510 25615 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.131675 23701 raft_consensus.cc:2410] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:08:50.190330 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 92004.5us
I20260709 13:08:50.192126 23696 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:50.012918 25423 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.134271 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:50.194454 23771 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:50.118116 25733 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:50.135746 23629 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:50.138641 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:50.139787 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:50.096657 25794 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.140762 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:49.976502 25766 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.064633 25727 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.081512 25445 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.060750 25791 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.172809 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:50.044207 25785 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.180856 23525 catalog_manager.cc:5697] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.207962 23667 leader_election.cc:400] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4.
I20260709 13:08:49.963624 25774 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:50.115974 25744 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.134239 25789 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:50.139874 25778 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:50.180130 25293 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.236219 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:50.236869 23776 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:50.237038 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:50.237921 23625 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:08:50.200760 25177 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:50.189018 25772 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:50.079054 25793 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.195560 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:50.011763 25788 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:50.125839 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 136924us
I20260709 13:08:50.170686 25783 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.031041 25790 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:50.171685 25277 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.273101 23770 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:50.120910 25770 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:50.169474 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:50.278970 23622 raft_consensus.cc:2410] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:50.200528 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:50.202754 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:50.204861 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:50.281190 23777 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:08:50.228868 23667 leader_election.cc:403] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:50.177345 25808 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:50.231364 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:50.232311 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:50.244151 25293 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.284037 23620 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:50.283120 25808 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:50.271422 25733 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:50.241117 23593 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.955s (SENT)
I20260709 13:08:50.250685 23697 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:50.248188 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:50.254122 23776 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
W20260709 13:08:50.256776 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 61314.5us
I20260709 13:08:50.242954 24385 raft_consensus.cc:2368] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:08:50.259055 23525 catalog_manager.cc:5697] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.308928 23704 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:50.187412 23628 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
W20260709 13:08:50.253170 25797 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.274s	user 0.001s	sys 0.001s
I20260709 13:08:50.267948 25774 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:50.268110 25805 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:50.269157 25800 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:50.256266 25772 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:50.240011 25813 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:50.273294 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:50.241981 25617 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.275125 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:50.282374 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:50.260076 25812 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:50.234870 25753 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:08:50.244385 25778 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:50.198822 25615 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:50.184715 25611 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.338726 25772 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.317689 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:50.360332 25775 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:50.180356 25798 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:50.335491 25807 log.cc:927] Time spent T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:08:50.320102 23525 catalog_manager.cc:5697] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 1 to 3, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 3 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.362656 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1492) took 1124 ms. Trace:
I20260709 13:08:50.334722 25430 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.257544 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:50.363117 23772 rpcz_store.cc:276] 0709 13:08:49.238224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.238506 (+   282us) service_pool.cc:224] Handling call
0709 13:08:49.418843 (+180337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.427957 (+  9114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.428007 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.538535 (+110528us) log.cc:844] Serialized 26 byte log entry
0709 13:08:50.091761 (+553226us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:50.091830 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.091930 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.362416 (+270486us) raft_consensus.cc:1685] finished
0709 13:08:50.362439 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.362579 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8615,"raft.queue_time_us":9360,"spinlock_wait_cycles":25755008,"thread_start_us":225405,"threads_started":1,"wal-append.queue_time_us":591510}
I20260709 13:08:50.184492 25804 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.288857 25277 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.333115 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:50.334933 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 127190us
I20260709 13:08:50.356168 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:50.369828 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 94816.1us
I20260709 13:08:50.343880 25033 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:50.372136 25033 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.374425 23771 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:50.376089 23777 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:50.317209 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:50.378826 23776 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
W20260709 13:08:50.340301 25803 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:08:50.370743 23742 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:08:50.436105 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 65467.3us
I20260709 13:08:50.437336 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:50.438692 23742 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:08:50.446496 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 212739us
I20260709 13:08:50.274014 25783 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:50.345266 25293 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.359153 25423 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.332687 25805 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:50.338167 24389 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:50.455169 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 198) took 1231 ms. Trace:
I20260709 13:08:50.357287 25673 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.337303 25793 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.402868 25775 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:50.335542 24385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46566 (request call id 416) took 1101 ms. Trace:
I20260709 13:08:50.350299 25784 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:50.373272 25744 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.317644 25674 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 13:08:50.397022 25770 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.335325 25768 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4.
I20260709 13:08:50.394601 25790 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:50.332435 25733 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 13:08:50.401733 25617 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:50.404161 25813 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:50.457238 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 213497us
I20260709 13:08:50.925025 25033 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.637956 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1211) took 1434 ms. Trace:
I20260709 13:08:50.926043 23695 rpcz_store.cc:276] 0709 13:08:49.203432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.113348 (+909916us) service_pool.cc:224] Handling call
0709 13:08:50.113661 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.243457 (+129796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.243488 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.243535 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:50.243572 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.637625 (+394053us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540008a2d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:50.637691 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.637878 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298045312}
I20260709 13:08:50.927716 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:50.465103 25804 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:50.740097 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 498985us
I20260709 13:08:50.629084 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1494) took 1388 ms. Trace:
I20260709 13:08:50.929733 23775 rpcz_store.cc:276] 0709 13:08:49.240805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.240944 (+   139us) service_pool.cc:224] Handling call
0709 13:08:49.241269 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.244767 (+  3498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.244805 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.384661 (+139856us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.984919 (+600258us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:49.985021 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.985096 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.628744 (+643648us) raft_consensus.cc:1685] finished
0709 13:08:50.628774 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.628969 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117597,"raft.queue_time_us":3641,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":166090,"thread_start_us":450791,"threads_started":1,"wal-append.queue_time_us":590684}
I20260709 13:08:50.930729 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:50.931602 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:50.931947 23698 rpcz_store.cc:276] 0709 13:08:49.223568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.181132 (+957564us) service_pool.cc:224] Handling call
0709 13:08:50.181387 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.181582 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:50.247438 (+ 65856us) log.cc:844] Serialized 14 byte log entry
0709 13:08:50.454723 (+207285us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.454856 (+   133us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:50.454902 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.454969 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.455105 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126300,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":309,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":8273,"thread_start_us":267606,"threads_started":2}
I20260709 13:08:50.933979 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:50.934684 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 643844us
I20260709 13:08:50.582981 23628 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:08:50.637034 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:50.939944 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:50.940971 23621 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:50.944888 25836 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:50.929100 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:50.949826 25801 tablet_copy_client.cc:323] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.3:45959
I20260709 13:08:50.942569 25775 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:50.952893 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:50.452278 25818 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:50.451879 25430 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:50.452169 25774 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:50.719409 25824 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:08:50.952893 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:50.974100 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:50.972594 25789 consensus_meta.cc:287] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.700s	user 0.000s	sys 0.012s
I20260709 13:08:50.455879 25817 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:50.987509 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:50.988610 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:51.005012 23622 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:50.539937 25676 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.012135 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:51.013710 25813 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:50.956948 25804 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:50.958391 25784 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:50.635077 25611 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.720929 25777 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:50.841707 25788 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:50.908164 25783 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:50.924531 25805 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:50.906229 25277 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:50.975594 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 530212us
I20260709 13:08:50.940366 24385 rpcz_store.cc:276] 0709 13:08:49.234293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.243612 (+  9319us) service_pool.cc:224] Handling call
0709 13:08:50.060160 (+816548us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b5800010e98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:08:50.335442 (+275282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74910976}
I20260709 13:08:50.901822 25778 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:50.951907 25793 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:51.040162 25817 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:51.040064 25793 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:51.041299 25772 consensus_meta.cc:287] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.681s	user 0.000s	sys 0.011s
I20260709 13:08:51.041065 25817 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.042232 25793 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.041824 25772 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.030215 25834 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.412515 25812 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:51.048592 25834 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.049811 25423 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:51.050261 25772 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:51.050593 25834 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:51.050823 25837 raft_consensus.cc:2764] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:51.032727 25789 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.057224 24386 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:51.057545 25617 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.057961 25789 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.058126 25788 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:51.058669 25788 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:50.972055 25775 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:50.964614 24389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46566 (request call id 414) took 1754 ms. Trace:
I20260709 13:08:51.007517 25818 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.088554 25818 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.088328 24389 rpcz_store.cc:276] 0709 13:08:49.209775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.209938 (+   163us) service_pool.cc:224] Handling call
0709 13:08:50.952179 (+1742241us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:51.031574 23525 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.014s	sys 0.015s
I20260709 13:08:51.032210 23621 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:51.015872 25774 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:51.092096 23525 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.015s	sys 0.015s
I20260709 13:08:51.092357 25774 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:51.033893 23695 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:51.099896 25818 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:51.100631 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:51.101673 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:51.102595 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:51.102811 25818 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:51.104141 23773 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:51.044189 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:51.105302 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:50.711081 25821 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:51.107232 25821 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.110222 25821 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.061141 25788 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.103530 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:51.115664 25788 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.116603 25774 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.035159 25784 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:51.033643 25733 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:50.953006 25836 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.020761 25430 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:51.050266 25423 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:51.068629 25778 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:51.068681 25813 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:08:51.186599 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 199178us
W20260709 13:08:51.191308 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 75152.7us
W20260709 13:08:51.187652 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 199128us
I20260709 13:08:51.036597 25804 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.177663 25784 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.177304 25617 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:51.205160 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 129081us
I20260709 13:08:51.207861 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:51.210485 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:51.211177 23621 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:51.182880 25611 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:51.205457 23701 raft_consensus.cc:2955] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:51.185535 25676 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:51.177639 25733 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.038766 25777 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.203176 25813 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.202970 25778 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.373839 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:51.376475 23621 raft_consensus.cc:2410] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:51.377315 25778 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:51.212014 25617 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.380926 25617 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.383213 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:51.384359 23621 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:51.374972 25813 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.367223 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:51.249511 25804 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.405674 25430 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.407230 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:51.183884 25423 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.426054 25836 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.433947 23621 raft_consensus.cc:2410] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:51.250540 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:51.207388 25774 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:51.248570 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:51.450151 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:51.594184 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 382184us
W20260709 13:08:51.526414 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 291256us
W20260709 13:08:51.532979 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 321654us
W20260709 13:08:51.506814 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 109372us
W20260709 13:08:51.822875 25817 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.007s	sys 0.006s
I20260709 13:08:51.831398 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:51.834748 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:51.835354 23593 leader_election.cc:400] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
W20260709 13:08:51.254189 25802 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.246s	user 0.011s	sys 0.021s
I20260709 13:08:51.836422 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:51.838718 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:51.633181 25805 consensus_meta.cc:287] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 13:08:51.415458 25617 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:51.489198 25840 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.433990 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:51.833742 25817 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.007s	sys 0.007s
I20260709 13:08:51.637128 25777 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.391286 25611 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.763598 25842 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:51.449551 25848 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:51.695564 25430 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:51.818807 25812 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.855759 23743 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:51.900970 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1209) took 2698 ms. Trace:
W20260709 13:08:51.901270 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45612.3us
I20260709 13:08:51.901901 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:08:51.843051 25586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.000s	sys 0.012s
I20260709 13:08:51.422565 25676 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.838533 25844 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:51.905093 25791 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.906256 25844 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.906984 25177 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.907105 25791 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:51.837687 24389 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:51.907570 25177 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:51.907675 25791 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.908707 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:51.909929 25791 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.911409 25844 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.912432 25850 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:51.912642 25808 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.854838 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:51.909982 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:51.851698 25805 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:51.904557 25430 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.914755 23625 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:51.856573 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:51.850081 25733 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:51.853546 25617 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.889921 23788 tablet_copy_service.cc:140] P 4466bf6d6cf84ee89e84ea074e3964c9: Received BeginTabletCopySession request for tablet d67625249f734ae3b71d554b7a2ba33b from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:42298)
I20260709 13:08:51.931815 23788 tablet_copy_service.cc:161] P 4466bf6d6cf84ee89e84ea074e3964c9: Beginning new tablet copy session on tablet d67625249f734ae3b71d554b7a2ba33b from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:42298: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-d67625249f734ae3b71d554b7a2ba33b
I20260709 13:08:51.855290 25840 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.856915 25853 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:51.933766 25853 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:51.934707 25853 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.935072 25426 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:51.905256 25848 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.936546 25611 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.854091 25813 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:51.890421 25858 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:51.937558 25813 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.937680 25858 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.938367 25848 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:51.941150 23773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1502) took 1693 ms (client timeout 2131 ms). Trace:
I20260709 13:08:51.850067 25769 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.856629 25843 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:51.774919 25423 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.842895 24385 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:51.893368 25842 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:51.894490 25784 consensus_meta.cc:287] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
W20260709 13:08:51.896938 25775 consensus_meta.cc:287] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.723s	user 0.008s	sys 0.004s
I20260709 13:08:51.900120 25766 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.842033 25822 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:51.904011 23701 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.004s
I20260709 13:08:51.967927 25840 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.968637 25805 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:51.969417 25858 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.970705 25423 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:51.970851 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:51.972568 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:51.972715 25842 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.901337 23703 rpcz_store.cc:276] 0709 13:08:49.202914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.048328 (+845414us) service_pool.cc:224] Handling call
0709 13:08:50.081911 (+ 33583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.153745 (+ 71834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.153793 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.153855 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:50.153912 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.900754 (+1746842us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b5400195354. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:51.900799 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.900919 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164575616}
I20260709 13:08:51.929384 23621 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:51.916210 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:51.930408 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:51.930577 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:51.930860 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 312) took 1729 ms. Trace:
I20260709 13:08:51.976280 23771 raft_consensus.cc:2368] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8.
I20260709 13:08:51.976248 23778 rpcz_store.cc:276] 0709 13:08:50.201881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.202790 (+   909us) service_pool.cc:224] Handling call
0709 13:08:50.203157 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.250983 (+ 47826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.251044 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.251107 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:50.251166 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.930637 (+1679471us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b54000a3cd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:51.930682 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.930801 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109349120}
I20260709 13:08:51.977169 25788 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:51.977680 25788 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:51.978307 25792 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:51.978109 25788 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.952235 25794 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:51.890650 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:51.975013 25784 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:51.980023 23770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1243) took 1845 ms (client timeout 1839 ms). Trace:
I20260709 13:08:51.978012 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:51.980494 23770 rpcz_store.cc:269] 0709 13:08:50.134198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.134315 (+   117us) service_pool.cc:224] Handling call
0709 13:08:51.979778 (+1845463us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b54003ff7d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:51.979895 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168633088}
I20260709 13:08:51.981088 25353 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:51.981493 25784 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.891953 25839 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:51.981957 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:51.982039 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:51.941627 23773 rpcz_store.cc:269] 0709 13:08:50.247293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.952675 (+705382us) service_pool.cc:224] Handling call
0709 13:08:51.940968 (+988293us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540016b054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:51.941093 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300366080}
I20260709 13:08:51.982748 23770 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:51.983078 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:51.983363 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:51.984421 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:51.984552 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:51.985035 23773 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:51.985873 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:51.986004 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:51.987095 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:51.987632 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:51.988507 23778 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:51.989635 23788 tablet_copy_source_session.cc:215] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:51.990483 23704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1219) took 2758 ms (client timeout 1805 ms). Trace:
W20260709 13:08:51.990926 23704 rpcz_store.cc:269] 0709 13:08:49.232090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.889258 (+657168us) service_pool.cc:224] Handling call
0709 13:08:51.990259 (+2101001us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54001324d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:51.990384 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957854592}
I20260709 13:08:51.991567 25826 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.992417 25713 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.992551 25822 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:51.977950 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:51.993081 25713 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.993808 23703 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:51.994349 23771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1505) took 1736 ms (client timeout 2231 ms). Trace:
W20260709 13:08:51.994745 23771 rpcz_store.cc:269] 0709 13:08:50.257502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.930151 (+1672649us) service_pool.cc:224] Handling call
0709 13:08:51.994288 (+ 64137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:51.983636 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:51.995366 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 79262.8us
I20260709 13:08:51.995739 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:51.996475 23770 raft_consensus.cc:2410] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:51.939502 25813 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:51.999059 23742 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:51.904527 25847 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:51.951759 25843 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:51.976806 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46285.6us
I20260709 13:08:51.852561 25836 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:51.992134 25826 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.996408 23771 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:08:52.027988 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.029548 23771 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:08:51.992509 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1772) took 1058 ms. Trace:
W20260709 13:08:51.904937 25586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.000s	sys 0.013s
I20260709 13:08:51.993860 23624 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:51.995498 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:52.033511 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1820) took 1312 ms. Trace:
I20260709 13:08:52.033911 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.034153 24357 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:52.002297 23743 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.003116 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:51.993729 25822 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.004202 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.004714 25617 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.041662 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.005420 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.005551 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.006135 25843 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.006774 25839 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:52.008919 25676 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.009495 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1774) took 1074 ms. Trace:
I20260709 13:08:52.009690 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.010799 25615 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:52.010846 23593 connection.cc:256] RPC call timeout handler was delayed by -1.0757150130000355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:08:52.014935 23625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1812) took 1767 ms (client timeout 2161 ms). Trace:
W20260709 13:08:52.052289 23625 rpcz_store.cc:269] 0709 13:08:50.247796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.247968 (+   172us) service_pool.cc:224] Handling call
0709 13:08:52.014721 (+1766753us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400298454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:52.014842 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3741003136}
I20260709 13:08:52.053839 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.016853 25713 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.018743 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.026012 25777 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.059048 25777 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:51.946067 25727 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.030740 23698 rpcz_store.cc:276] 0709 13:08:50.934491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.032816 (+ 98325us) service_pool.cc:224] Handling call
0709 13:08:51.990390 (+957574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.990614 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.990650 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:51.990691 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:51.990738 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.990794 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.992352 (+  1558us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54001324d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:51.992453 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2201648384}
I20260709 13:08:52.041721 25847 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:52.036983 23703 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:52.068831 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:51.997756 25775 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:51.950085 25430 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.037456 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.037442 23743 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.043111 23700 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:52.084259 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:52.084749 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 47387.6us
I20260709 13:08:52.084955 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.086205 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1821) took 1364 ms. Trace:
I20260709 13:08:52.086434 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.086678 25847 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:52.087023 23742 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:52.087123 25847 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:52.047988 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.087899 25727 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:52.088071 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1816) took 1732 ms. Trace:
I20260709 13:08:52.032742 25836 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.057787 23770 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:52.062045 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:52.044461 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 200062us
I20260709 13:08:52.044734 25774 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:52.034049 23624 rpcz_store.cc:276] 0709 13:08:50.721324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.722116 (+   792us) service_pool.cc:224] Handling call
0709 13:08:51.993376 (+1271260us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:08:51.993568 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.033179 (+ 39611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.033443 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40618240}
I20260709 13:08:52.065939 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:51.986091 25177 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.093077 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.093750 23625 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:52.094473 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.037353 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.073257 25866 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.074327 25867 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:52.047173 25839 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.076436 25631 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.076730 25777 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.077281 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.077585 25826 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.078311 23775 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 4: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:52.079300 25775 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.080466 25785 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.074994 25801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d67625249f734ae3b71d554b7a2ba33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.080873 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1218) took 2855 ms. Trace:
I20260709 13:08:52.111521 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.079326 25445 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.111603 23699 rpcz_store.cc:276] 0709 13:08:49.225053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.183373 (+958320us) service_pool.cc:224] Handling call
0709 13:08:50.183598 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.351404 (+167806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.351452 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.351513 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:50.351576 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.080657 (+1729081us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540026b1d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.080699 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.080817 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385204608}
W20260709 13:08:52.083994 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46655.4us
W20260709 13:08:52.087286 23622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1815) took 1732 ms (client timeout 2037 ms). Trace:
I20260709 13:08:52.113924 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:52.114272 23622 rpcz_store.cc:269] 0709 13:08:50.355362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.355831 (+   469us) service_pool.cc:224] Handling call
0709 13:08:52.087145 (+1731314us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54003246d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:52.087234 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461905280}
I20260709 13:08:52.088712 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.089274 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.063431 23773 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:08:52.115487 23700 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:52.089541 23629 rpcz_store.cc:276] 0709 13:08:50.721674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.721806 (+   132us) service_pool.cc:224] Handling call
0709 13:08:52.085550 (+1363744us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:08:52.085736 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.085911 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.085936 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.085975 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.086004 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.086055 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.086151 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24388480}
I20260709 13:08:52.116377 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.088531 23628 rpcz_store.cc:276] 0709 13:08:50.371655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.373461 (+  1806us) service_pool.cc:224] Handling call
0709 13:08:50.373809 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.936885 (+563076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.087853 (+1150968us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540001d6d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.088015 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479971200}
I20260709 13:08:52.098150 25604 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:52.098793 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.103842 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.088378 25851 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:52.105594 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:52.107159 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.125173 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.125362 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.125779 23628 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:52.114496 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.047647 23696 rpcz_store.cc:276] 0709 13:08:50.935138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.106374 (+171236us) service_pool.cc:224] Handling call
0709 13:08:51.106697 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.111885 (+  5188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.111923 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:51.111980 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:51.112045 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.009228 (+897183us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b540042b154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.009280 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.009428 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11210496}
I20260709 13:08:52.126663 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.126827 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.127156 23628 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:52.081755 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 245) took 2942 ms. Trace:
I20260709 13:08:52.125867 23698 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:52.116999 23773 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:52.129562 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.130115 23592 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.130263 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.127345 23743 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:52.118221 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.131193 23700 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:52.131466 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.118919 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.109966 25586 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:52.134112 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.134506 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.092718 25615 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:52.110570 25839 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.109370 25617 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:52.122326 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:52.117676 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:52.089761 25847 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.140393 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:52.127502 23696 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:52.127985 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.113041 24391 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:08:52.128870 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:52.142032 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.117873 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.132375 23704 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:52.142697 23696 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:52.142930 23743 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:52.143260 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.143646 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:52.133333 23592 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:52.098292 25713 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:52.146672 25744 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:52.147122 25744 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:52.147413 25837 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:52.138363 25727 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.147926 25837 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.148200 25727 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:52.148409 25837 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.148064 25744 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.148768 25727 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.150641 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:52.151068 23592 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.136974 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:52.141182 25586 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.129511 23623 rpcz_store.cc:276] 0709 13:08:49.139721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.144170 (+  4449us) service_pool.cc:224] Handling call
0709 13:08:49.180843 (+ 36673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.184026 (+1003183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.195868 (+ 11842us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.198303 (+  2435us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:50.205736 (+  7433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.081498 (+1875762us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b5400099554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.081544 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.081668 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2276898048}
I20260709 13:08:52.152786 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.137010 23703 raft_consensus.cc:2376] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4. Re-sending same reply.
I20260709 13:08:52.135929 25851 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.137966 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.138329 25843 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:52.172042 25744 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.130493 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.145448 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.146128 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.238319 23624 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:52.147003 25713 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.119431 25836 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.134706 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.240218 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.239382 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.147006 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.241268 23772 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:52.151368 23700 raft_consensus.cc:2368] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5.
I20260709 13:08:52.104754 25866 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:52.144686 25617 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.227797 23769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1498) took 1982 ms. Trace:
I20260709 13:08:52.242111 23769 rpcz_store.cc:276] 0709 13:08:50.245382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.245522 (+   140us) service_pool.cc:224] Handling call
0709 13:08:50.245852 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.254790 (+  8938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.254836 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.254886 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:50.254931 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.223572 (+1968641us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b540014e954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.227597 (+  4025us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.227719 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19998976}
I20260709 13:08:52.239874 25785 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:52.245666 25713 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.251973 23629 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:52.111315 25867 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.255275 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:52.257019 25867 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.258034 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.259363 23628 raft_consensus.cc:2410] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:52.260501 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:52.261330 23628 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.261870 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.262517 23703 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:52.263386 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:52.271092 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:52.271546 23703 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:52.141072 25445 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:52.224340 25674 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:52.227583 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 76608us
I20260709 13:08:52.228976 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.273303 23776 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:52.273454 25728 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.273658 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1496) took 3023 ms. Trace:
I20260709 13:08:52.225409 23698 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
W20260709 13:08:52.227922 23697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1760) took 3030 ms (client timeout 1546 ms). Trace:
I20260709 13:08:52.158041 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:52.136848 25775 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:52.224898 25846 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:52.273932 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.275239 25836 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:52.274329 23697 rpcz_store.cc:269] 0709 13:08:49.197075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.197183 (+   108us) service_pool.cc:224] Handling call
0709 13:08:52.161674 (+2964491us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400024c54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:52.227850 (+ 66176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852789504}
I20260709 13:08:52.274011 23774 rpcz_store.cc:276] 0709 13:08:49.249796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.249942 (+   146us) service_pool.cc:224] Handling call
0709 13:08:49.250210 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.197727 (+947517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.197756 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.197793 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:50.197829 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.273426 (+2075597us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b540014f354. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.273473 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.273581 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2178646784}
I20260709 13:08:52.276654 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:52.277251 23697 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.153175 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.149586 25615 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:52.280098 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.280406 25615 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:52.281855 25851 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.283653 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1831) took 1077 ms. Trace:
I20260709 13:08:52.284055 23621 rpcz_store.cc:276] 0709 13:08:51.206741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.837991 (+631250us) service_pool.cc:224] Handling call
0709 13:08:52.283493 (+445502us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x7b5400098154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:52.283596 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187987840}
I20260709 13:08:52.284934 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1784) took 1253 ms. Trace:
I20260709 13:08:52.285077 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:52.285344 23698 rpcz_store.cc:276] 0709 13:08:51.031906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.284128 (+1252222us) service_pool.cc:224] Handling call
0709 13:08:52.284417 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.284595 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.284621 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.284662 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:52.284698 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.284752 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.284876 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.286201 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.286876 23621 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:52.287130 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1785) took 1249 ms. Trace:
I20260709 13:08:52.153630 25774 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:52.229703 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 52824.2us
I20260709 13:08:52.157565 25794 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:52.226567 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1818) took 1613 ms. Trace:
W20260709 13:08:52.176671 23775 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1500) took 1930 ms (client timeout 1813 ms). Trace:
I20260709 13:08:52.236225 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.134068 25862 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:08:52.238592 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 92509.1us
I20260709 13:08:52.204658 25822 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:52.247205 25866 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.257870 25177 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.268205 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 189) took 3104 ms. Trace:
I20260709 13:08:52.236654 25788 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:52.341591 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 116736us
I20260709 13:08:52.160703 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.240690 25718 tablet_bootstrap.cc:492] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:52.275000 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.375679 23626 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:52.375862 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:52.376219 23626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1822) took 1654 ms (client timeout 1607 ms). Trace:
I20260709 13:08:52.275746 25836 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:52.280794 23772 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:08:52.142206 23699 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:08:52.265411 25852 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.442s	user 0.002s	sys 0.001s
I20260709 13:08:52.235178 23696 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:52.287596 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:52.293092 23668 connection.cc:256] RPC call timeout handler was delayed by -1.3978803950000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 13:08:52.274933 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 124697us
I20260709 13:08:52.290091 23697 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:52.292625 25631 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:52.269953 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1768) took 1821 ms. Trace:
I20260709 13:08:52.378435 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:52.432711 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:52.376570 23626 rpcz_store.cc:269] 0709 13:08:50.722054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.722158 (+   104us) service_pool.cc:224] Handling call
0709 13:08:52.274864 (+1552706us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:08:52.376147 (+101283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40884992}
I20260709 13:08:52.461853 23701 rpcz_store.cc:276] 0709 13:08:50.448824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.976269 (+527445us) service_pool.cc:224] Handling call
0709 13:08:50.976563 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.205346 (+228783us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:51.967536 (+762190us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.067083 (+ 99547us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.067143 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.067246 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.269735 (+202489us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400131fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.269779 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.269896 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":140,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":1030,"spinlock_wait_cycles":525618944,"thread_start_us":99051,"threads_started":1,"wal-append.queue_time_us":182051}
I20260709 13:08:52.390138 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 205) took 1182 ms. Trace:
W20260709 13:08:52.463212 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 189338us
I20260709 13:08:52.463510 23696 rpcz_store.cc:276] 0709 13:08:51.207411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.389259 (+1181848us) service_pool.cc:224] Handling call
0709 13:08:52.389621 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.389803 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.389829 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.389876 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:52.389908 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.389965 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.390079 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.464114 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.403323 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.407676 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:52.458792 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 93720.7us
I20260709 13:08:52.473076 23624 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:52.272929 23628 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
W20260709 13:08:52.467435 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 89018.7us
I20260709 13:08:52.474530 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.474730 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:52.475502 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.475659 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:52.365801 23775 rpcz_store.cc:269] 0709 13:08:50.246711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.931375 (+684664us) service_pool.cc:224] Handling call
0709 13:08:52.159341 (+1227966us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001cb954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:52.176564 (+ 17223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2635213696}
I20260709 13:08:52.365844 23702 rpcz_store.cc:276] 0709 13:08:49.163848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.163988 (+   140us) service_pool.cc:224] Handling call
0709 13:08:49.164344 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.120336 (+955992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.120382 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.120438 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:50.120487 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.267931 (+2147444us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b540015d954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.267980 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.268111 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198055808}
I20260709 13:08:52.366209 23627 rpcz_store.cc:276] 0709 13:08:50.613334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.613541 (+   207us) service_pool.cc:224] Handling call
0709 13:08:52.161161 (+1547620us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:08:52.226048 (+ 64887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.226237 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.226263 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.226306 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.226335 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.226394 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.226507 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9349376}
I20260709 13:08:52.287534 23698 rpcz_store.cc:276] 0709 13:08:51.039179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.286312 (+1247133us) service_pool.cc:224] Handling call
0709 13:08:52.286614 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.286781 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.286809 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.286851 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.286886 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.286940 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.287076 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.368161 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1830) took 1178 ms. Trace:
I20260709 13:08:52.477762 23743 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:52.478554 23625 rpcz_store.cc:276] 0709 13:08:51.189911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.160395 (+970484us) service_pool.cc:224] Handling call
0709 13:08:52.368076 (+207681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.376866 23773 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:52.481055 23592 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.481398 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1247) took 1272 ms. Trace:
I20260709 13:08:52.481806 23775 rpcz_store.cc:276] 0709 13:08:51.209287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.480597 (+1271310us) service_pool.cc:224] Handling call
0709 13:08:52.480882 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.481073 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.481102 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.481152 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:52.481187 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.481247 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.481346 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.483368 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1249) took 1269 ms. Trace:
I20260709 13:08:52.465277 23622 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:08:52.483605 23775 rpcz_store.cc:276] 0709 13:08:51.213717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.482788 (+1269071us) service_pool.cc:224] Handling call
0709 13:08:52.483029 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.483157 (+   128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.483172 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.483199 (+    27us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:52.483220 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.483255 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.483328 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.464143 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 206) took 1256 ms. Trace:
I20260709 13:08:52.485601 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1253) took 1241 ms. Trace:
I20260709 13:08:52.485035 23621 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:08:52.490619 23698 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:52.486150 23775 rpcz_store.cc:276] 0709 13:08:51.244265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.484829 (+1240564us) service_pool.cc:224] Handling call
0709 13:08:52.485125 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.485298 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.485325 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.485363 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.485395 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.485448 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.485548 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.498438 23592 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:08:52.519071 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.519011 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.519436 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1254) took 1274 ms. Trace:
I20260709 13:08:52.519878 23775 rpcz_store.cc:276] 0709 13:08:51.244563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.518579 (+1274016us) service_pool.cc:224] Handling call
0709 13:08:52.518895 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.519106 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.519136 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.519180 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.519216 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.519275 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.519381 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.485663 23701 rpcz_store.cc:276] 0709 13:08:51.208769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.463376 (+1254607us) service_pool.cc:224] Handling call
0709 13:08:52.463764 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.463926 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.463943 (+    17us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.463970 (+    27us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:52.463993 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.464026 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.464102 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.521597 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1255) took 1276 ms. Trace:
I20260709 13:08:52.521981 23775 rpcz_store.cc:276] 0709 13:08:51.244836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.520850 (+1276014us) service_pool.cc:224] Handling call
0709 13:08:52.521140 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.521308 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.521332 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.521372 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.521402 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.521454 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.521545 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.522629 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:52.272989 25674 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:52.525656 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1256) took 1280 ms. Trace:
I20260709 13:08:52.526196 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.527415 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.374130 25822 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.366686 25341 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.349467 25846 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.528921 23702 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:52.289186 24386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 334) took 2045 ms. Trace:
I20260709 13:08:52.501004 25744 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:52.491096 25631 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.540082 25744 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:52.539878 24386 rpcz_store.cc:276] 0709 13:08:50.243380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.249552 (+  6172us) service_pool.cc:224] Handling call
0709 13:08:50.276926 (+ 27374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.057896 (+780970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.288938 (+1231042us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54004218d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.289116 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771485568}
I20260709 13:08:52.540712 25744 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.288091 25586 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.541705 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.432245 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.542397 24386 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:08:52.365607 25775 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:52.546716 25775 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:52.429839 25847 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.548957 25617 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.550127 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1783) took 1519 ms. Trace:
I20260709 13:08:52.551954 25586 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:52.491153 25818 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:08:52.528473 25798 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.491014 25813 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:52.557334 25775 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.556535 25813 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:52.559645 25775 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.530032 23775 rpcz_store.cc:276] 0709 13:08:51.245076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.523293 (+1278217us) service_pool.cc:224] Handling call
0709 13:08:52.523529 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.525282 (+  1753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.525310 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.525376 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:52.525425 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.525490 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.525600 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.366285 25794 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.560719 23777 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:52.528204 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 50553.6us
I20260709 13:08:52.349359 23623 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:08:52.377820 25862 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.365242 25774 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:52.466055 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.560921 25813 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.534111 25822 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.536671 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.532924 25842 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:52.430662 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.389299 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.531193 25718 tablet_bootstrap.cc:492] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:52.543141 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.486742 25445 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:08:52.487094 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.533733 25674 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.390396 25836 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.609553 25866 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.565052 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:52.628046 23621 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:52.546077 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47775.1us
I20260709 13:08:52.567093 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.550544 23695 rpcz_store.cc:276] 0709 13:08:51.030312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.118129 (+ 87817us) service_pool.cc:224] Handling call
0709 13:08:51.118478 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.126371 (+  7893us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:51.126406 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.127041 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.821182 (+694141us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:51.821246 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.821358 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.264746 (+443388us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:08:52.549824 (+285078us) raft_consensus.cc:1685] finished
0709 13:08:52.549846 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.550066 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7476,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":29122,"spinlock_wait_cycles":24599936,"thread_start_us":260709,"threads_started":1,"wal-append.queue_time_us":695643}
I20260709 13:08:52.561733 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.630888 23592 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:52.630959 23629 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:08:52.632218 23592 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:08:52.574231 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.486876 25604 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.523859 25853 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:52.575563 23699 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:08:52.527683 25728 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:52.537545 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.637482 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.458191 25727 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.590420 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.638399 23620 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:52.599946 23628 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:52.638839 23620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1819) took 1918 ms (client timeout 1876 ms). Trace:
I20260709 13:08:52.607981 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.608419 25847 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:52.639365 23620 rpcz_store.cc:269] 0709 13:08:50.720943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.722025 (+  1082us) service_pool.cc:224] Handling call
0709 13:08:52.637323 (+1915298us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:08:52.638772 (+  1449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15759616}
I20260709 13:08:52.648356 23624 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:52.615163 25862 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.567983 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.654228 23626 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:08:52.654834 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1450) took 1012 ms. Trace:
I20260709 13:08:52.655260 23626 rpcz_store.cc:276] 0709 13:08:51.642254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.527547 (+885293us) service_pool.cc:224] Handling call
0709 13:08:52.654741 (+127194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.617278 25837 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.658322 25794 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.659487 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.660195 25631 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.620487 25445 consensus_queue.cc:1243] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:52.660840 25794 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.661185 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.619374 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1421) took 1225 ms. Trace:
I20260709 13:08:52.662212 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.658340 24386 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:52.664146 25788 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.661803 23625 rpcz_store.cc:276] 0709 13:08:51.393779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.615385 (+1221606us) service_pool.cc:224] Handling call
0709 13:08:52.618871 (+  3486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.619075 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.619091 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.619120 (+    29us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:52.619146 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.619186 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.619302 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.666266 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:52.667591 25855 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.844s	user 0.002s	sys 0.000s
I20260709 13:08:52.660463 25837 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.626500 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:52.687911 25847 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.688658 25847 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.635427 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1503) took 2383 ms. Trace:
I20260709 13:08:52.691491 23777 rpcz_store.cc:276] 0709 13:08:50.252237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.367142 (+2114905us) service_pool.cc:224] Handling call
0709 13:08:52.367463 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.561201 (+193738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.635120 (+ 73919us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54003ff7d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.635348 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443970304}
I20260709 13:08:52.580405 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1437) took 1046 ms. Trace:
I20260709 13:08:52.692932 23623 rpcz_store.cc:276] 0709 13:08:51.532633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.152917 (+620284us) service_pool.cc:224] Handling call
0709 13:08:52.578506 (+425589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.694320 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:52.695106 23623 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:52.640190 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.697613 23774 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:52.698772 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.700209 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:52.654003 25783 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:52.706501 25783 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:52.707047 25783 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.707615 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.709251 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.609066 25718 ts_tablet_manager.cc:1403] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 2.615s	user 0.046s	sys 0.014s
I20260709 13:08:52.649881 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:52.649061 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1420) took 1255 ms. Trace:
I20260709 13:08:52.733369 23624 rpcz_store.cc:276] 0709 13:08:51.393462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.591668 (+1198206us) service_pool.cc:224] Handling call
0709 13:08:52.648022 (+ 56354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.648799 (+   777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.648993 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.650708 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1449) took 1008 ms. Trace:
I20260709 13:08:52.734668 23622 rpcz_store.cc:276] 0709 13:08:51.641968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.534715 (+892747us) service_pool.cc:224] Handling call
0709 13:08:52.650639 (+115924us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.649015 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.736100 23620 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:52.649102 25713 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:52.580577 25774 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:52.662318 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:52.667444 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:52.750113 23626 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.592942 25842 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:52.543995 25846 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:52.755362 25846 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.755610 25858 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:52.755998 24390 raft_consensus.cc:2368] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:08:52.756152 25858 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.763046 25631 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.744228 25713 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:08:52.764891 25839 consensus_meta.cc:287] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.003s
I20260709 13:08:52.763449 25801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46580 (request call id 331) took 3787 ms. Trace:
I20260709 13:08:52.770902 25713 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.763792 25631 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.715466 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1499) took 2469 ms. Trace:
I20260709 13:08:52.721148 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.792599 23774 rpcz_store.cc:276] 0709 13:08:50.246442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.276965 (+2030523us) service_pool.cc:224] Handling call
0709 13:08:52.277249 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.698230 (+420981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.699468 (+  1238us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400346a54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.699706 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966152448}
I20260709 13:08:52.793533 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.722064 23777 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:52.794127 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.794926 23774 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:08:52.795109 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.751174 24391 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:52.637604 25604 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:52.752188 25788 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.754532 24387 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:52.754936 25842 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:52.778178 25858 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.765849 25822 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.770175 25674 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.779609 25801 rpcz_store.cc:276] 0709 13:08:48.975828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.977654 (+  1826us) service_pool.cc:224] Handling call
0709 13:08:50.189766 (+1212112us) ts_tablet_manager.cc:934] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
0709 13:08:52.021021 (+1831255us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:52.563071 (+542050us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:52.563220 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:52.762728 (+199508us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:52.762996 (+   268us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:52.763286 (+   290us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:52.763355 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":438,"tablet-copy.queue_time_us":985813,"thread_start_us":1690043,"threads_started":2}
I20260709 13:08:52.810432 25813 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.801419 25788 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:52.801162 25604 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.816250 25836 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.779533 25839 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.836129 25847 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.828409 25788 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.832049 25801 tablet_copy_client.cc:806] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:52.847102 25813 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.849397 25839 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.851387 25836 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:52.852247 25846 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.839951 25866 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.855453 25822 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.855466 25846 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.662315 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.642112 23592 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.890251 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:52.890947 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 248746us
I20260709 13:08:52.633529 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:08:52.904522 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 270933us
I20260709 13:08:52.893235 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.906935 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:08:52.744390 23667 connection.cc:256] RPC call timeout handler was delayed by -1.2538003029999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 13:08:52.745616 23628 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:08:52.646808 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 208) took 1156 ms. Trace:
I20260709 13:08:52.898126 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1422) took 1503 ms. Trace:
I20260709 13:08:52.899253 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1790) took 1694 ms. Trace:
W20260709 13:08:52.732628 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 82841.9us
I20260709 13:08:52.899408 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:52.737692 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:52.910343 23769 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:52.911022 23771 raft_consensus.cc:606] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:52.801569 23777 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:52.912335 23776 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:52.912335 23775 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:52.893181 23625 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:52.799297 23774 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:52.976670 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:52.977443 23743 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.977651 23628 raft_consensus.cc:2376] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4. Re-sending same reply.
W20260709 13:08:52.934268 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 461829us
I20260709 13:08:52.915027 25677 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:52.978008 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 319) took 1141 ms. Trace:
I20260709 13:08:52.830448 25727 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:52.978937 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:52.975555 23697 rpcz_store.cc:276] 0709 13:08:51.490353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.464479 (+974126us) service_pool.cc:224] Handling call
0709 13:08:52.464787 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.576703 (+111916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.576733 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.576790 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:52.576828 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.641170 (+ 64342us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400404f54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.641236 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.646720 (+  5484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256529792}
I20260709 13:08:52.981465 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:52.964594 25728 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:52.983004 23629 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:52.983240 25728 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.966802 23771 raft_consensus.cc:614] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:52.983943 25728 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.984241 25836 consensus_queue.cc:1059] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:52.985805 25631 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.986545 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47404 (request call id 28) took 2016 ms. Trace:
I20260709 13:08:52.988484 23770 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:52.990003 23778 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:52.990449 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1265) took 1618 ms. Trace:
I20260709 13:08:52.978569 23775 rpcz_store.cc:276] 0709 13:08:51.836327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.575020 (+738693us) service_pool.cc:224] Handling call
0709 13:08:52.575324 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.975863 (+400539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.977645 (+  1782us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54000591d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:52.977932 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773243776}
I20260709 13:08:52.992904 25674 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:52.952003 23622 rpcz_store.cc:276] 0709 13:08:51.394072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.744411 (+1350339us) service_pool.cc:224] Handling call
0709 13:08:52.896735 (+152324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.897300 (+   565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.897342 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.897450 (+   108us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:52.897509 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.897625 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.897824 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.965142 25341 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:52.994590 25341 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:52.995971 25843 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.996181 25839 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:52.996878 25843 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:52.998962 25341 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:52.999867 23667 connection.cc:256] RPC call timeout handler was delayed by -1.2205003029999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 13:08:53.000542 23667 connection.cc:256] RPC call timeout handler was delayed by -1.0819003029999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
W20260709 13:08:53.000936 23667 connection.cc:256] RPC call timeout handler was delayed by -1.0639003029999685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 13:08:53.003347 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.004587 25880 ts_tablet_manager.cc:933] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:53.004856 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:52.990963 23770 rpcz_store.cc:276] 0709 13:08:51.372288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.093085 (+720797us) service_pool.cc:224] Handling call
0709 13:08:52.990094 (+897009us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54003fedd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:52.990373 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986064640}
I20260709 13:08:52.985713 25836 raft_consensus.cc:3055] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:52.999866 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:52.987087 23771 rpcz_store.cc:276] 0709 13:08:50.970612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.105427 (+1134815us) service_pool.cc:224] Handling call
0709 13:08:52.986264 (+880837us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54003fedd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41306853 00007f2b462d460a 00007f2b3f85a7d4 00007f2b3f85a762 00007f2b3f85a691 00007f2b3f85a60c 00007f2b3f8598c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:52.986427 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807871744}
I20260709 13:08:53.017220 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.017971 25873 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.018863 25873 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:53.007441 23629 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:08:53.009204 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:53.029112 25430 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:53.030166 25430 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:53.030833 25430 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.020327 23629 pending_rounds.cc:85] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 2
I20260709 13:08:53.032135 23629 pending_rounds.cc:107] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:08:53.032557 23629 raft_consensus.cc:2889] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:53.033438 25813 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:53.033885 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1429) took 1627 ms. Trace:
I20260709 13:08:53.034356 23629 rpcz_store.cc:276] 0709 13:08:51.406527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.004589 (+1598062us) service_pool.cc:224] Handling call
0709 13:08:53.005174 (+   585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.033576 (+ 28402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.033816 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.036209 23592 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.040457 23667 leader_election.cc:400] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8.
I20260709 13:08:53.040979 23667 leader_election.cc:403] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:53.042855 23621 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:08:53.046393 25341 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.047305 25341 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:53.047861 25341 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.049845 23627 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:53.050616 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1434) took 1623 ms. Trace:
I20260709 13:08:53.021634 23624 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:52.832748 25718 raft_consensus.cc:359] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:53.050992 23627 rpcz_store.cc:276] 0709 13:08:51.427058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.048983 (+1621925us) service_pool.cc:224] Handling call
0709 13:08:53.049525 (+   542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.050327 (+   802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.050546 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.055374 25718 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:53.055896 23621 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:53.032434 25801 tablet_copy_client.cc:670] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:53.056828 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1435) took 1629 ms. Trace:
I20260709 13:08:53.057333 23621 rpcz_store.cc:276] 0709 13:08:51.427360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.053625 (+1626265us) service_pool.cc:224] Handling call
0709 13:08:53.055518 (+  1893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.056448 (+   930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.056727 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.061079 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1431) took 1635 ms. Trace:
I20260709 13:08:52.952332 23703 rpcz_store.cc:276] 0709 13:08:51.204298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.389721 (+1185423us) service_pool.cc:224] Handling call
0709 13:08:52.443319 (+ 53598us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:52.479720 (+ 36401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.479777 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:52.524612 (+ 44835us) log.cc:844] Serialized 52 byte log entry
0709 13:08:52.759612 (+235000us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:52.760078 (+   466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.760176 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.898556 (+138380us) raft_consensus.cc:1685] finished
0709 13:08:52.898600 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.898960 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14658,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":190994,"threads_started":1,"wal-append.queue_time_us":296510}
I20260709 13:08:53.061622 23629 rpcz_store.cc:276] 0709 13:08:51.426087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.035337 (+1609250us) service_pool.cc:224] Handling call
0709 13:08:53.060028 (+ 24691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.060629 (+   601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.060670 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.060722 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:53.060766 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.060852 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.061006 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.063834 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:53.064320 23777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:53.065289 23777 raft_consensus.cc:606] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.065737 23777 raft_consensus.cc:614] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:53.067693 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 60921.1us
I20260709 13:08:53.009464 25836 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:53.069554 25674 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:53.071255 25836 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.022891 25843 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:53.077198 23621 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:53.019523 25873 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.073832 23770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:53.030767 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:08:53.085822 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55504.6us
I20260709 13:08:53.088315 24387 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:53.088248 25879 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:53.089059 25879 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.089394 25879 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:53.068457 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:53.095046 23628 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:53.096042 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1430) took 1670 ms. Trace:
I20260709 13:08:53.090106 23770 raft_consensus.cc:606] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.073482 25836 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.081522 25631 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8.
I20260709 13:08:53.078568 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 258) took 1056 ms. Trace:
I20260709 13:08:53.096184 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1438) took 1509 ms. Trace:
I20260709 13:08:53.109910 23625 rpcz_store.cc:276] 0709 13:08:52.022242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.077310 (+1055068us) service_pool.cc:224] Handling call
0709 13:08:53.077812 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.078225 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.078256 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.078314 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:53.078342 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.078397 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.078503 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.110474 23621 rpcz_store.cc:276] 0709 13:08:51.586682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.058379 (+1471697us) service_pool.cc:224] Handling call
0709 13:08:53.076985 (+ 18606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.080670 (+  3685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.094592 (+ 13922us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b54000645d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:53.095767 (+  1175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41895680}
W20260709 13:08:53.107941 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 461392us
I20260709 13:08:53.134783 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:53.135360 23770 raft_consensus.cc:614] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:53.096431 23628 rpcz_store.cc:276] 0709 13:08:51.425739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.052114 (+1626375us) service_pool.cc:224] Handling call
0709 13:08:53.094784 (+ 42670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.095752 (+   968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.095955 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.072296 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.079957 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.083609 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:53.149690 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1266) took 1505 ms. Trace:
I20260709 13:08:53.075212 25813 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.157532 25813 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:53.158401 25775 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:53.159467 23777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:53.159614 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 260) took 1123 ms. Trace:
I20260709 13:08:53.156966 23773 rpcz_store.cc:276] 0709 13:08:51.644045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.563961 (+919916us) service_pool.cc:224] Handling call
0709 13:08:52.578951 (+ 14990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.579171 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:52.770652 (+191481us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.148947 (+378295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.149064 (+   117us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:53.149178 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.149277 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.149471 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23791,"prepare.queue_time_us":265065,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":36834,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":242,"thread_start_us":429002,"threads_started":2,"wal-append.queue_time_us":338359}
I20260709 13:08:53.160264 23628 rpcz_store.cc:276] 0709 13:08:52.036563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.149443 (+1112880us) service_pool.cc:224] Handling call
0709 13:08:53.149884 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.159118 (+  9234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.159162 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.159251 (+    89us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:53.159307 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.159385 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.159519 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.160751 23626 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:53.160332 23777 raft_consensus.cc:606] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.182126 23777 raft_consensus.cc:614] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:53.172669 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:53.190367 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:53.192473 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:53.195361 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 262) took 1145 ms. Trace:
W20260709 13:08:53.190372 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 317768us
I20260709 13:08:53.202211 25867 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:53.202458 25177 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:53.195878 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 265) took 1120 ms. Trace:
I20260709 13:08:53.205928 23626 rpcz_store.cc:276] 0709 13:08:52.075828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.194703 (+1118875us) service_pool.cc:224] Handling call
0709 13:08:53.195138 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.195461 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.195494 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.195564 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:53.195618 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.195702 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.195820 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.206866 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:53.208217 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:53.208573 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:53.209043 23773 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:53.209338 23771 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:53.210317 25866 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:53.210794 25866 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:53.071825 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:53.212278 23629 raft_consensus.cc:2376] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2. Re-sending same reply.
I20260709 13:08:53.211509 23526 catalog_manager.cc:5697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 4, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 4 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:53.212098 25866 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.208122 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:53.209331 23626 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:08:53.215384 23525 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52058 (request call id 187) took 14028 ms (client timeout 15000 ms). Trace:
I20260709 13:08:53.111028 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.213855 23629 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:53.236078 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.239800 23777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:53.195878 23624 rpcz_store.cc:276] 0709 13:08:52.049789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.193970 (+1144181us) service_pool.cc:224] Handling call
0709 13:08:53.194455 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.194966 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.194996 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.195070 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:53.195108 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.195168 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.195295 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.242105 23777 raft_consensus.cc:606] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:53.242601 23777 raft_consensus.cc:614] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:53.245270 24391 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:53.246490 25713 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:53.247974 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 176333us
W20260709 13:08:53.234663 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 226524us
I20260709 13:08:53.251432 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:53.253638 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:53.255406 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 261) took 1210 ms. Trace:
I20260709 13:08:53.255884 23628 rpcz_store.cc:276] 0709 13:08:52.045019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.204315 (+1159296us) service_pool.cc:224] Handling call
0709 13:08:53.237102 (+ 32787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.255032 (+ 17930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.255063 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.255108 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:53.255139 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.255206 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.255343 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.259186 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:53.260290 25843 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:53.255453 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:53.234531 25866 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.258729 23778 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
W20260709 13:08:53.247587 25744 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.020s
I20260709 13:08:53.213938 23526 catalog_manager.cc:5697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 5, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 5 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:53.266559 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:53.267398 25774 consensus_meta.cc:287] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.012s
W20260709 13:08:53.269039 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 196335us
I20260709 13:08:53.271116 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1426) took 1862 ms. Trace:
I20260709 13:08:53.257026 25713 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:53.271606 23622 rpcz_store.cc:276] 0709 13:08:51.405397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.000008 (+1594611us) service_pool.cc:224] Handling call
0709 13:08:53.000729 (+   721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.001643 (+   914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.001705 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:53.002879 (+  1174us) log.cc:844] Serialized 26 byte log entry
0709 13:08:53.239038 (+236159us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:53.239078 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.239144 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.267835 (+ 28691us) raft_consensus.cc:1685] finished
0709 13:08:53.267860 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.267989 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2442,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":238,"thread_start_us":235262,"threads_started":1,"wal-append.queue_time_us":257193}
W20260709 13:08:53.281337 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 241275us
I20260709 13:08:53.208097 25718 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:53.298373 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:53.296944 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:53.295857 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:53.306824 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.310060 23593 leader_election.cc:400] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5.
I20260709 13:08:53.310673 23593 leader_election.cc:403] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:08:53.311916 25794 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:53.312212 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45872.5us
I20260709 13:08:53.313647 24359 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:53.282286 25744 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.297961 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:53.316644 23621 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:53.315510 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:53.320343 24391 raft_consensus.cc:2393] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 2: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:53.321094 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 259) took 1287 ms. Trace:
I20260709 13:08:53.321362 23621 rpcz_store.cc:276] 0709 13:08:52.033446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.140161 (+1106715us) service_pool.cc:224] Handling call
0709 13:08:53.158400 (+ 18239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.317082 (+158682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.320918 (+  3836us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54002459d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:53.321050 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363480320}
I20260709 13:08:53.323829 23622 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:53.279661 25842 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.282776 25774 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.339857 25794 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:53.341758 23621 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:08:53.339965 25846 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5.
I20260709 13:08:53.343735 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:53.344769 23698 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
W20260709 13:08:53.348397 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.359305 23697 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:53.335958 25775 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.380581 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:53.328080 25799 consensus_queue.cc:1059] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:08:53.351657 25880 tablet_copy_client.cc:323] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.2:44167
I20260709 13:08:53.380005 23526 catalog_manager.cc:5697] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 3, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 3 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:08:53.240567 23525 rpcz_store.cc:269] 0709 13:08:39.187136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.187325 (+   189us) service_pool.cc:224] Handling call
0709 13:08:39.408980 (+221655us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b54000b90d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41276090 00007f2b41314f3a 00007f2b470cb1cc 00007f2b471c937e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc 00007f2b45689392 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:53.215054 (+13806074us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:51.204244 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:51.584441 (+380197us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:51.586887 (+  2446us) write_op.cc:435] Acquired schema lock
0709 13:08:51.595751 (+  8864us) tablet.cc:662] Decoding operations
0709 13:08:51.630105 (+ 34354us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:51.630206 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:51.630248 (+    42us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:08:51.630911 (+   663us) tablet.cc:701] Row locks acquired
0709 13:08:51.630936 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:08:51.631113 (+   177us) write_op.cc:270] Start()
0709 13:08:51.631248 (+   135us) write_op.cc:276] Timestamp: P: 1783602531631056 usec, L: 0
0709 13:08:51.631279 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:08:51.719133 (+ 87854us) log.cc:844] Serialized 2079 byte log entry
0709 13:08:52.081696 (+362563us) op_driver.cc:464] REPLICATION: finished
0709 13:08:52.258350 (+176654us) write_op.cc:301] APPLY: starting
0709 13:08:52.292690 (+ 34340us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:52.292866 (+   176us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:52.293006 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:52.375067 (+ 82061us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:52.453900 (+ 78833us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:08:52.453969 (+    69us) write_op.cc:312] APPLY: finished
0709 13:08:52.454280 (+   311us) log.cc:844] Serialized 47 byte log entry
0709 13:08:52.454509 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:52.454632 (+   123us) write_op.cc:454] Released schema lock
0709 13:08:52.454683 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:52.455109 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:52.455140 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":270428,"reported_tablets":20,"spinlock_wait_cycles":47208192,"child_traces":[["op",{"apply.queue_time_us":157711,"apply.run_cpu_time_us":3643,"apply.run_wall_time_us":207307,"num_ops":5,"prepare.queue_time_us":758228,"prepare.run_cpu_time_us":12432,"prepare.run_wall_time_us":661258,"raft.queue_time_us":127685,"raft.run_cpu_time_us":21047,"raft.run_wall_time_us":52831,"replication_time_us":450241,"thread_start_us":961457,"threads_started":4,"wal-append.queue_time_us":134050}]]}
W20260709 13:08:53.392112 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 87907.4us
I20260709 13:08:53.364697 25794 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:08:53.395699 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 114157us
I20260709 13:08:53.382987 25775 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:08:53.400688 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 117965us
I20260709 13:08:53.404937 25775 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.423858 25884 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:08:53.417968 25788 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.429960 23774 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:53.431051 25788 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:53.419873 25801 tablet_copy_client.cc:538] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:53.432586 23697 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:53.433041 23697 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:53.433907 23697 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.435016 23697 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.420195 23593 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:08:53.420504 23623 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.725s	user 0.015s	sys 0.005s
I20260709 13:08:53.435850 25822 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:53.436113 23623 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:08:53.436497 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.436713 25713 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:53.437501 23592 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.437737 25674 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:53.420902 23772 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:53.420970 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.438135 25674 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:53.440119 25674 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.440150 25846 raft_consensus.cc:2764] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:08:53.442940 25843 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.436508 25822 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:53.444986 25822 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.443439 25843 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:53.411278 25744 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:53.449645 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47670.9us
W20260709 13:08:53.458482 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 65988.6us
W20260709 13:08:53.463040 25783 consensus_meta.cc:287] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.013s
I20260709 13:08:53.463563 25783 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.464334 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.465404 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.465436 25341 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.466419 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.466439 25783 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:53.467564 23620 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:53.463017 25879 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.459640 25430 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.468031 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:53.452977 25843 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.458412 23526 catalog_manager.cc:5697] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 3, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:53.473795 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:53.475714 25879 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:53.476153 25727 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:53.476639 25727 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:53.477043 25727 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:53.477334 25604 consensus_meta.cc:287] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.004s
I20260709 13:08:53.477499 25788 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:53.477747 25604 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.478147 25788 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:53.478703 25788 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.479387 25785 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:53.479871 25785 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:53.480064 23623 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:53.480240 25785 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.482977 25794 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.484629 25728 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.486759 25836 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.487550 25836 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:53.487830 25774 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:53.488207 25836 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.491583 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:53.494678 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:53.500455 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.500872 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:53.507225 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:53.468962 25842 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:53.507879 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47655.2us
I20260709 13:08:53.467653 25341 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:53.516462 23697 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:08:53.517745 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:53.518591 23701 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:08:53.486887 25728 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:53.517135 23697 pending_rounds.cc:85] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 5
I20260709 13:08:53.521324 23697 pending_rounds.cc:107] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:08:53.521692 23697 raft_consensus.cc:2889] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:53.522773 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:53.523684 23702 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.526991 23526 catalog_manager.cc:5697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 4, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.529852 23526 catalog_manager.cc:5697] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 3, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 3 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:08:53.531960 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44807.7us
I20260709 13:08:53.532290 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:53.487768 25430 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:53.453519 25813 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:53.522116 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 83976.6us
W20260709 13:08:53.538434 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 65613.1us
I20260709 13:08:53.531445 23526 catalog_manager.cc:5697] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 2, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:53.541976 25842 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.542443 25842 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:53.542793 25842 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.546026 25813 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:53.549191 23776 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:53.550205 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:53.550434 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:53.550931 23624 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.551136 23623 raft_consensus.cc:2393] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:53.553086 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:53.553937 23696 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:08:53.508371 25674 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.553237 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:53.557015 25873 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.557760 25674 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:53.560225 25775 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.561617 25801 tablet_bootstrap.cc:492] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:08:53.564255 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:53.563740 23778 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:53.565222 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.563967 25775 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:53.571193 23702 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:08:53.571933 25794 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:53.559579 25873 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:53.577111 23624 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
W20260709 13:08:53.581781 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 73576.9us
W20260709 13:08:53.579219 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 141810us
I20260709 13:08:53.579219 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:53.549176 25604 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:53.592473 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:53.607851 25873 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:53.611398 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 70961.7us
I20260709 13:08:53.615197 25884 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.616016 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.616513 25884 consensus_queue.cc:1059] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.618227 25774 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:53.618677 23526 catalog_manager.cc:5697] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 4, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 4 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:53.584892 25177 raft_consensus.cc:3055] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:53.627485 25341 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:53.634120 25774 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:53.635217 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:53.618286 25430 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:53.628795 25341 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:53.638327 25430 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:08:53.639922 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.639330 25430 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.625933 25177 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:53.640856 25785 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.642249 25177 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.639403 25843 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.649968 25718 ts_tablet_manager.cc:1434] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.900s	user 0.022s	sys 0.027s
W20260709 13:08:53.650455 25718 ts_tablet_manager.cc:1467] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Tablet startup took 921ms
I20260709 13:08:53.650826 25843 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:53.641157 24359 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.655447 25788 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.657069 25836 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.658649 25788 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:53.658587 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.660107 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:53.660923 23625 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:53.660982 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 318) took 2454 ms. Trace:
I20260709 13:08:53.659477 25836 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:53.661520 23772 rpcz_store.cc:276] 0709 13:08:51.206487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.483876 (+1277389us) service_pool.cc:224] Handling call
0709 13:08:52.533156 (+ 49280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.443854 (+910698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.660711 (+216857us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54003403d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:53.660902 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958519680}
I20260709 13:08:53.662705 23667 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.662006 25892 raft_consensus.cc:3055] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.664533 25892 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:53.660025 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1423) took 2258 ms. Trace:
I20260709 13:08:53.665603 25892 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.666301 23620 rpcz_store.cc:276] 0709 13:08:51.394347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.892032 (+1497685us) service_pool.cc:224] Handling call
0709 13:08:52.892942 (+   910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.468074 (+575132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.652772 (+184698us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400202bd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:53.652896 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320771840}
I20260709 13:08:53.667224 25885 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.667483 25873 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:53.667709 25885 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:53.667964 25873 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.668043 25858 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:53.668452 25873 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:53.670394 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 72404.7us
I20260709 13:08:53.643087 25785 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:53.666746 25892 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.640883 25430 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:53.671800 25885 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.658806 25896 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.674299 25674 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:53.682531 25879 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:08:53.685451 25879 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:53.685860 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.687342 25674 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:53.688050 25674 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:53.685896 25879 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:53.690953 25879 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.692198 25879 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.693697 25881 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:53.694192 25897 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:08:53.694629 25631 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:53.695053 25631 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:53.695194 25677 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:53.695508 25897 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:53.695962 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.696467 25896 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:53.696043 25631 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.696708 25799 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:53.697585 25631 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:53.695987 25897 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:53.697480 25896 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.698846 25897 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.697965 25799 raft_consensus.cc:3055] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:53.700075 25799 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:53.700418 25897 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:53.697609 25728 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:53.701452 25728 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:53.701156 25799 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.701855 25728 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.702694 25890 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:08:53.703787 25890 raft_consensus.cc:3055] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:53.704131 25890 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:53.705025 25890 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.706249 25890 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.639043 25341 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.708429 25341 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.711928 25898 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:08:53.713418 25898 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:53.713829 25898 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:53.711920 25728 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.715893 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.662983 25842 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.718331 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:53.719184 25842 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:53.719990 25677 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.720458 25677 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:53.720850 25677 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.722707 25783 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:53.724036 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46004.4us
I20260709 13:08:53.717236 25744 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:53.719264 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:53.702175 23526 catalog_manager.cc:5697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 3, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.726876 23526 catalog_manager.cc:5697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 3, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:53.728330 23526 catalog_manager.cc:5697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:53.728870 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 59534.6us
I20260709 13:08:53.729867 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:53.734905 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:53.739905 23625 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:53.740005 25177 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.740583 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.741731 23620 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:53.742491 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.742944 25744 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.743356 25744 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:53.744015 25744 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.744364 25794 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:53.744812 25794 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.745352 25794 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.748299 25891 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:53.749017 25891 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:53.715057 25898 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.757392 25902 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:53.751833 25799 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.760071 25674 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:53.762238 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.762439 25674 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:53.751600 25774 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.765645 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:53.767285 25858 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.678617 25727 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.772485 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:53.773332 25794 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.777729 25873 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.773758 25727 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:08:53.785503 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.780722 23526 catalog_manager.cc:5697] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 3, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 3 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
W20260709 13:08:53.782332 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 63150.9us
I20260709 13:08:53.757306 25677 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.789527 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.793422 25430 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:53.797166 25728 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:53.797246 23620 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:53.797616 24389 raft_consensus.cc:1217] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:08:53.798357 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:53.798835 25631 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:53.799443 25794 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:53.799921 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:53.800661 25908 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:53.803714 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:53.805823 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:53.822072 24394 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.805882 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:53.809121 25677 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:53.809420 23592 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.814177 23526 catalog_manager.cc:5697] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.824280 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:08:53.651110 25718 ts_tablet_manager.cc:1469] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Trace:
0709 13:08:46.582102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.582419 (+   317us) service_pool.cc:224] Handling call
0709 13:08:46.893001 (+310582us) ts_tablet_manager.cc:934] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
0709 13:08:47.366430 (+473429us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:47.805923 (+439493us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:47.806089 (+   166us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:47.934600 (+128511us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:47.935082 (+   482us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:47.976113 (+ 41031us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:47.986040 (+  9927us) inbound_call.cc:177] Queueing success response
0709 13:08:49.993650 (+2007610us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:08:52.749781 (+2756131us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:08:52.814357 (+ 64576us) tablet_replica.cc:261] Starting instrumentation
0709 13:08:52.815248 (+   891us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":68142,"mutex_wait_us":8184,"raft.queue_time_us":53866,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":7276,"tablet-copy.queue_time_us":207776,"tablet-download-pool.queue_time_us":122,"tablet-download-pool.run_cpu_time_us":1625,"tablet-download-pool.run_wall_time_us":1048807,"thread_start_us":328990,"threads_started":3}
I20260709 13:08:53.828543 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.827611 25908 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:53.830065 23526 catalog_manager.cc:5697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 4, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.836915 25908 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:53.837867 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:53.840382 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:53.841202 24393 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:53.831941 25631 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:53.845407 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.825253 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:53.848146 25674 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:53.854310 25866 consensus_queue.cc:1059] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:08:53.856097 25430 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:53.857659 25884 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:53.858071 25884 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:53.858673 23639 tablet_copy_service.cc:342] P 9ab488f10c434878a749f261e99a8065: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-d5fa82982f53411c84a07a2fb3918888 received from {username='slave'} at 127.0.0.1:58448
I20260709 13:08:53.859277 23639 tablet_copy_service.cc:434] P 9ab488f10c434878a749f261e99a8065: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-d5fa82982f53411c84a07a2fb3918888 on tablet d5fa82982f53411c84a07a2fb3918888 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:53.859103 25884 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.860599 25884 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.859975 23526 catalog_manager.cc:5697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.861701 23526 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:53.863076 23526 catalog_manager.cc:5697] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 3, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.852509 24393 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:53.852751 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:53.853953 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:53.851752 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:53.851384 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:53.850077 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:53.875365 24392 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
W20260709 13:08:53.874030 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 51072.8us
I20260709 13:08:53.872085 24394 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:08:53.876613 24390 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:53.877218 25631 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:53.877851 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:53.878752 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.878958 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.877923 23743 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.880509 24391 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:53.846015 25728 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:53.885941 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:53.883473 23526 catalog_manager.cc:5697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.877264 25866 raft_consensus.cc:3055] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:53.894809 24387 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:53.882282 25674 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:53.884475 25728 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.883867 25898 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:53.899633 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.901890 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.886145 25774 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.904870 23620 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:53.905400 25858 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:53.895861 25866 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:08:53.909696 25728 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.905294 23526 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 4, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 4 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:53.911966 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:53.914413 23669 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.522s (SENT)
I20260709 13:08:53.914608 23742 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:53.911453 25631 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.913933 25774 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:53.918006 25631 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:53.918231 25774 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.918627 25631 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:53.923110 23669 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.533s (SENT)
I20260709 13:08:53.923763 25873 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:53.932013 25885 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.925834 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.926852 25177 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:53.936570 25885 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:53.938416 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:53.939162 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.939541 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:53.939937 23624 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:53.940721 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.928858 24389 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:53.928876 25866 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:53.941944 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.942097 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.942818 23624 raft_consensus.cc:2368] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8.
I20260709 13:08:53.942749 25866 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.943694 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.945842 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.946190 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.946573 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.926366 23526 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 4, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 4 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:53.949892 23623 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:53.951475 25177 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:53.947995 23526 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 6, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 6 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.953552 23526 catalog_manager.cc:5697] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:53.957789 23526 catalog_manager.cc:5697] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 3, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 3 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:08:53.961494 25873 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:53.962654 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:53.959985 25909 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:53.960813 25907 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:53.963798 25909 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:53.964962 25909 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:53.962791 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50890.3us
W20260709 13:08:53.955190 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 69646.6us
W20260709 13:08:53.968425 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45354.1us
W20260709 13:08:53.969144 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 72013.7us
I20260709 13:08:53.967911 25858 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:53.973888 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:53.980119 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:53.980746 23593 leader_election.cc:400] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:08:53.981030 24390 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:53.982095 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.982420 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:08:53.982260 25674 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:08:53.986289 23669 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.541s (SENT)
I20260709 13:08:53.987039 23669 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:53.990054 23526 catalog_manager.cc:5697] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:08:53.992609 23742 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:53.989401 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:53.995481 25907 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.986347 25846 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:53.994122 25677 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:54.002362 25677 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:54.003301 25677 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.004778 25677 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.007951 25813 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:54.008864 25813 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:54.016163 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:54.018748 25907 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:54.020613 25604 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:54.021981 25604 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.022435 25604 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:53.983960 25908 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:54.024642 25788 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:54.025036 25908 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:54.023442 25604 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:54.026504 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.026998 25873 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:54.027137 23669 leader_election.cc:336] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.559s (SENT)
I20260709 13:08:54.027803 25341 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:54.028708 25604 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.028988 25430 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:54.029361 25813 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:54.029651 25430 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.025643 25908 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.027884 25873 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:54.031811 25728 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.032362 25873 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.033924 25728 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:54.034637 25873 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:54.028756 23669 leader_election.cc:336] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.733s (SENT)
I20260709 13:08:54.035573 25430 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:54.035933 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:54.028579 25341 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:54.037176 23669 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.813s (SENT)
I20260709 13:08:54.037644 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:54.038250 25341 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:54.038859 25341 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:54.039594 25341 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.042800 25631 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:54.039594 23669 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 2.031s (SENT)
W20260709 13:08:54.045161 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 55858.9us
I20260709 13:08:54.045542 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:54.053804 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:54.052122 25788 consensus_queue.cc:1243] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:53.990576 25842 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:54.051748 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:08:54.061547 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 69041.2us
I20260709 13:08:54.064556 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:54.065295 25842 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:54.065778 25631 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:54.066861 23669 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 2.131s (SENT)
I20260709 13:08:54.067358 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:54.069360 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.069635 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.069761 25884 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:54.070295 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:54.066404 25842 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.070979 25727 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:54.071667 25727 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:54.053239 25674 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:54.072718 25727 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.073292 25674 raft_consensus.cc:697] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:54.071049 23702 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:54.075098 25674 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.075914 23697 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:08:54.015489 25744 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.064069 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:54.081159 25744 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:54.062477 25873 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.082376 24385 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:54.083190 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:54.083876 25836 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:54.082556 23773 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:54.086778 25897 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:54.087360 24389 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:54.088130 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.088585 25907 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:54.089046 25785 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:54.089131 25907 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.089864 25785 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.091462 23695 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:08:54.092908 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.095194 23697 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:54.109186 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.110040 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.110888 23698 raft_consensus.cc:2410] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:08:54.112023 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.112903 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:53.985529 25774 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:53.997053 25858 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.118304 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:54.121140 25775 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:54.121585 25775 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:54.123427 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:54.124003 23701 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:54.124198 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:54.124431 25909 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:54.125561 25785 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:54.125713 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.122440 25775 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.126730 25775 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.127107 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:54.136235 24389 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:54.137315 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:54.140657 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.143494 23702 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:54.138473 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:54.137802 25908 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.153326 24390 raft_consensus.cc:2393] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 4: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:54.146279 24388 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:54.146456 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.146901 25858 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:54.147740 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.164311 23701 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.147835 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.148268 23697 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.117797 23593 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:08:54.166906 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 49179.6us
I20260709 13:08:54.154980 23703 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:54.168479 23699 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:54.131906 25907 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:54.155265 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.151117 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.174839 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.184559 23695 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.188851 23697 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:54.171496 25677 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:54.193461 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.194154 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:54.196324 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 83477us
I20260709 13:08:54.193141 25801 tablet_bootstrap.cc:492] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:54.186978 25908 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:54.209952 23626 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:54.220389 25774 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:54.209918 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:54.221369 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.222219 25744 raft_consensus.cc:1064] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:08:54.211338 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:54.216032 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:54.220597 25801 tablet_bootstrap.cc:492] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:08:54.210423 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:54.234357 24386 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:54.210671 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:54.235443 23620 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
W20260709 13:08:54.207105 25921 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:08:54.237749 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.238500 23699 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:08:54.240262 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.241446 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.242758 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.245534 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:54.232975 25801 ts_tablet_manager.cc:1403] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.672s	user 0.032s	sys 0.008s
I20260709 13:08:54.199402 25677 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:54.254341 25677 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.257750 23695 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:54.241531 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.246958 23703 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.247643 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.230988 23701 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:08:54.248818 23696 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:54.252758 23623 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:54.264168 23703 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.265391 25896 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:54.267805 25909 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:54.268352 23695 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.276523 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:08:54.302063 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.327872 23699 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:08:54.333623 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:54.225160 25744 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.336167 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.336351 23697 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:54.335623 25836 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:54.342768 25836 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.325584 25898 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:54.348182 25898 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:54.349320 25898 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.351491 25842 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:54.325014 25909 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:54.354667 25909 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.358866 23695 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.360097 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:08:54.363286 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.364720 23620 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:54.366766 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:54.368005 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.368676 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:54.368991 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.368825 23625 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.370579 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.368084 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.367367 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.371892 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.372766 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.376741 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.377278 23695 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.378723 23627 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:54.397831 23774 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.397550 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:54.406325 23695 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.489549 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:54.447309 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.495678 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.496631 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:54.421512 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.498718 23629 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:54.506493 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:54.364245 25801 raft_consensus.cc:359] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:54.508642 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:54.513707 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.516145 23778 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:54.495196 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:54.526115 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.526265 23776 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:54.524339 23623 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:54.544713 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:54.545514 23771 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 4: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:54.546413 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:54.547206 23771 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:54.548210 23714 tablet_copy_service.cc:140] P c885217113574e7489e6c3afb6950f76: Received BeginTabletCopySession request for tablet 334c9018414947cabb4405ef47b8018e from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:54670)
I20260709 13:08:54.548791 23714 tablet_copy_service.cc:161] P c885217113574e7489e6c3afb6950f76: Beginning new tablet copy session on tablet 334c9018414947cabb4405ef47b8018e from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:54670: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-334c9018414947cabb4405ef47b8018e
I20260709 13:08:54.524817 25801 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:08:54.557701 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:54.562841 23625 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:54.564951 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:54.565757 23624 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:54.567051 23773 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:54.568706 23776 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.571333 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:54.578176 23778 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:54.592141 23626 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:54.593305 25801 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:54.564592 24388 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEARNER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:54.596035 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.596807 23704 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:54.602070 23695 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:54.604689 23696 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:54.604998 23622 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:08:54.605520 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:54.606673 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:54.607463 25890 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:54.607775 23714 tablet_copy_source_session.cc:215] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:54.608135 25890 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.595496 25801 ts_tablet_manager.cc:1434] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.349s	user 0.007s	sys 0.002s
I20260709 13:08:54.610486 23771 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:08:54.635456 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:54.710753 23771 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:54.712100 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:54.694190 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:54.709029 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:54.714138 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:54.635411 25899 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:08:54.738210 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.706596 25928 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:08:54.642760 25921 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:08:54.740960 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:54.745857 23667 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:54.756021 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:54.757519 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:54.707319 25890 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:54.759881 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:54.761001 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:54.760303 23773 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:08:54.732718 25892 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.766008 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:54.767252 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:54.769624 23778 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:08:54.772159 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.770936 24358 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:54.759475 25926 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:08:54.774648 23788 tablet_copy_service.cc:342] P 4466bf6d6cf84ee89e84ea074e3964c9: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-d67625249f734ae3b71d554b7a2ba33b received from {username='slave'} at 127.0.0.1:42298
I20260709 13:08:54.775197 23788 tablet_copy_service.cc:434] P 4466bf6d6cf84ee89e84ea074e3964c9: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-d67625249f734ae3b71d554b7a2ba33b on tablet d67625249f734ae3b71d554b7a2ba33b with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:54.776821 23772 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:54.783206 23625 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:54.784716 23774 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.743139 25604 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:08:54.787417 23627 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.765241 25858 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:54.793782 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:54.778721 25890 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:54.798252 23626 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:54.778582 25744 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:54.776561 25884 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:08:54.790467 25925 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.805913 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:54.806088 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:54.793268 25892 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.792201 25858 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:54.794713 25908 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:08:54.817059 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49888.3us
W20260709 13:08:54.818339 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46974.4us
I20260709 13:08:54.833459 23667 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:08:54.833802 23669 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.713s (SENT)
W20260709 13:08:54.822446 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.832381 25909 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:54.838106 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:54.839627 25842 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:54.839922 25727 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:54.840524 25727 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:54.841536 25898 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:54.841460 25727 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.842684 25898 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:54.843676 25898 consensus_queue.cc:1059] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:54.844744 25674 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:54.844787 25909 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:54.845253 25674 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:54.845808 25783 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:54.845903 25909 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.846186 25674 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.848459 25604 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.848694 25775 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:54.846324 25783 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:54.839504 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:54.855962 23776 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:54.812014 25788 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:54.858536 25943 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:54.862083 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:54.863193 25677 raft_consensus.cc:3055] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:54.866832 25677 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:54.864037 25788 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:54.867638 25788 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.804780 25744 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.815569 25858 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.847580 25674 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.813730 25785 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
W20260709 13:08:54.872422 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 93429.6us
I20260709 13:08:54.864452 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:54.865799 23777 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:54.869043 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:54.875428 23667 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:54.879328 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:08:54.879504 23669 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 2.190s (SENT)
I20260709 13:08:54.872326 25604 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:54.876470 25949 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:54.878898 25884 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:54.887638 25884 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:54.888156 25884 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:54.888682 25940 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:08:54.887784 25939 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:08:54.893265 25785 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:54.898007 25604 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:54.879210 25842 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:54.899091 25604 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:54.875362 25783 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.874161 25813 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:08:54.893339 25631 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:54.888720 25744 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:54.872678 25677 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:54.924535 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49187.9us
I20260709 13:08:54.924417 25783 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.916822 25943 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:54.924338 25631 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:54.931559 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 57209.4us
W20260709 13:08:54.932577 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.947575 23669 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 2.231s (SENT)
I20260709 13:08:54.934834 25873 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:08:54.940500 25677 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.935842 25631 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.931746 25744 consensus_queue.cc:1059] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 13:08:54.951220 25946 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:08:54.959313 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 80048.1us
I20260709 13:08:54.933642 25948 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 13:08:54.962308 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.961423 25813 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:08:54.967839 25885 raft_consensus.cc:2955] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:08:54.955438 25873 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:54.973954 25873 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:54.974854 25873 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:54.956506 25898 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:08:54.975191 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.017984 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:55.021329 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:55.027076 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:54.993335 25775 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:55.025780 25907 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:55.029032 25907 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:55.030143 25907 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.031286 25788 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.033288 25909 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.033736 25788 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:55.035759 25775 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:55.036996 25775 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:55.037628 25936 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.404s	user 0.004s	sys 0.008s
I20260709 13:08:55.040808 25892 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:55.041296 25892 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:55.042236 25892 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.044368 25858 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.045627 23701 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:55.046689 25858 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.043680 25892 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.013892 25674 raft_consensus.cc:3055] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:55.049353 25674 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:55.038185 25943 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.050284 25674 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.031380 25907 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:55.058730 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.061419 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.068384 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.069429 23771 raft_consensus.cc:2410] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:08:55.074132 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.076085 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:55.069542 25674 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.057474 25949 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:55.067413 25785 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.075232 25836 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:55.092236 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 123231us
W20260709 13:08:55.096330 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 219832us
I20260709 13:08:55.068292 25631 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.098611 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:08:55.101999 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.132812 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 258944us
I20260709 13:08:55.132069 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.131776 25858 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.138898 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:55.138392 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:55.141999 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.142807 23775 raft_consensus.cc:2393] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:55.092442 25884 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.131201 25836 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:55.145561 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:55.152415 23629 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.145882 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.150682 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.147162 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.153714 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:55.144856 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.138185 25785 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.102941 25948 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:08:55.156190 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.143278 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.156702 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.157382 23627 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 2: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:55.156059 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.159248 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.161082 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:55.159861 25908 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:08:55.165529 24385 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:55.165642 24390 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:55.165875 25963 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:08:55.160112 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.175906 25964 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:55.228897 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.183422 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.184192 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.235176 23621 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:08:55.235539 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 74535.4us
W20260709 13:08:55.153544 25955 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:08:55.216982 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.236984 23771 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:55.166850 25958 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:08:55.160679 25949 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.167606 25744 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:08:55.177554 25962 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:55.185405 25836 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.167443 25788 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.179288 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:55.233340 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.249914 24386 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:55.233232 25909 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:55.157639 25677 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:08:55.242434 23775 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.259447 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:08:55.258308 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 96628.5us
I20260709 13:08:55.233750 25866 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.150220 25858 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.231487 23623 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
W20260709 13:08:55.261288 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.229619 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.266503 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.282956 23629 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:08:55.263900 25909 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:55.320449 25785 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.320943 23627 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:55.326850 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.266129 25866 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.339251 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.255177 25964 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:55.344854 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 175305us
W20260709 13:08:55.345337 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 53648us
I20260709 13:08:55.285727 25631 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:55.327932 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.327786 23778 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 4: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:55.251322 25962 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.351040 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:55.317780 25884 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.362380 24387 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:08:55.357034 25954 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
W20260709 13:08:55.356884 25952 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.213s	user 0.002s	sys 0.001s
I20260709 13:08:55.388849 23769 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.339104 25785 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:55.428134 23777 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:08:55.390810 25744 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.424067 25956 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:55.427395 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46461us
I20260709 13:08:55.433257 25951 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:55.438766 25911 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.456931 25911 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.457666 23627 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:55.387393 25966 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:55.460263 23622 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:55.441203 24388 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:08:55.467778 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 121923us
I20260709 13:08:55.391199 25958 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:08:55.465077 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.471868 23777 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:55.476255 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.476504 25884 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:55.477600 25884 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:55.477944 25884 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:55.478706 25884 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:55.479774 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.480695 25967 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:08:55.457538 25971 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.126s
I20260709 13:08:55.482873 23773 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:08:55.483068 25967 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:08:55.484280 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.485118 25941 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.618s	user 0.007s	sys 0.002s
I20260709 13:08:55.486557 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1276) took 1247 ms. Trace:
I20260709 13:08:55.487635 25973 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:55.488200 25973 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:55.488759 25965 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:08:55.490520 25973 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.458999 25892 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.493304 25892 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.456955 24389 raft_consensus.cc:1217] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:08:55.458371 25956 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:08:55.505000 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 228273us
I20260709 13:08:55.487017 23703 rpcz_store.cc:276] 0709 13:08:54.238828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.265030 (+ 26202us) service_pool.cc:224] Handling call
0709 13:08:54.510245 (+245215us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b580000ff98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:08:54.510446 (+   201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.529155 (+ 18709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.529208 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.531762 (+  2554us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.784760 (+252998us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:54.784798 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.785114 (+   316us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.384384 (+599270us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:08:55.486283 (+101899us) raft_consensus.cc:1685] finished
0709 13:08:55.486309 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.486472 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30079,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":14365,"spinlock_wait_cycles":14412416,"thread_start_us":217894,"threads_started":1,"wal-append.queue_time_us":293454}
W20260709 13:08:55.518271 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.463886 24390 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:55.547412 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 230366us
W20260709 13:08:55.550539 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.556048 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:55.557106 24387 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:55.557590 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.563151 23769 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:55.474215 25966 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:55.495715 25892 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:55.495859 25884 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.565743 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:55.483646 25967 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:55.497181 25962 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:55.569547 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:55.574357 23769 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:55.577931 23777 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:08:55.538590 25964 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.619479 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.499974 25908 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:08:55.458202 25909 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:55.623687 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 46310us
W20260709 13:08:55.560515 25945 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.008s	sys 0.017s
I20260709 13:08:55.566690 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:55.620466 25892 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.562088 25677 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 13:08:55.626253 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 46203.2us
I20260709 13:08:55.580231 25788 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.642918 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:55.634292 23773 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
W20260709 13:08:55.632153 25945 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.009s	sys 0.018s
I20260709 13:08:55.633884 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.625079 25177 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.621248 25858 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:55.636509 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 97167.5us
I20260709 13:08:55.643613 24394 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:08:55.619572 25674 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.558877 25948 consensus_queue.cc:1059] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:08:55.648990 23627 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:08:55.629734 25897 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.654539 23773 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:55.659776 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.666441 25966 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.667888 25890 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.668493 25890 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.658283 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:55.649679 25866 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.687815 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.670948 25890 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.636024 25970 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:08:55.662801 25858 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.642298 25892 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.658272 25177 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.656561 25788 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:55.652084 25956 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.698222 23773 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:55.662144 25674 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.738301 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:55.729643 25911 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.692782 25948 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.729581 25978 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:55.735386 25775 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:55.675964 25897 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.736554 24390 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:55.754472 23776 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:55.764590 24391 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:55.764665 25744 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:55.751935 25978 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.765404 25897 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.765558 25783 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:55.729012 25990 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:08:55.767189 25177 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.773172 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.773957 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.760936 25775 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.777207 23778 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:08:55.741828 25858 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.782198 25788 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:55.783138 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:08:55.672451 25967 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.793274 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:55.800405 23773 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:55.791356 25978 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.794546 25783 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:55.791700 25948 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:08:55.813079 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 125403us
I20260709 13:08:55.814477 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:55.816725 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 130715us
I20260709 13:08:55.820642 25892 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.811882 25967 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.807924 25897 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:55.834319 23769 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:55.835398 25892 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:55.832216 25959 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.750s	user 0.006s	sys 0.000s
I20260709 13:08:55.837661 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.838699 25996 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.840004 25775 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:55.840243 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.832031 25897 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.829895 25948 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:55.853075 25884 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.853371 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:55.854987 25948 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.855191 25957 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:55.855674 25957 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:55.856530 25957 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.857980 25950 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.858616 25950 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.852288 25978 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.853391 25783 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.862484 25783 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.862717 25873 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.864153 25953 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:55.863987 25974 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:08:55.864831 25953 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:55.865247 23592 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:55.865798 25953 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.866427 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:55.866740 25674 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.858929 23773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:55.867151 24388 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.846211 25897 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.867715 23773 raft_consensus.cc:606] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.870340 25972 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:55.870824 25972 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:08:55.872015 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.871764 25972 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.872985 25972 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.874701 25978 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:55.877210 25890 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.877858 25890 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.879678 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:55.880002 23742 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.635s (SENT) [suppressed 35 similar messages]
I20260709 13:08:55.880501 23773 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:08:55.881708 23776 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.879400 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:55.883055 23778 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:08:55.847483 23669 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.885285 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:55.897518 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 50148.7us
I20260709 13:08:55.898912 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:55.899837 25958 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.900266 25982 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.901095 23592 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:55.896657 25990 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.901785 23776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:55.902408 23776 raft_consensus.cc:606] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.902820 23776 raft_consensus.cc:614] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:55.883837 25890 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:55.904290 25960 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.908131 25962 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.908620 23776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce71536613184c6d869077ae232876cc"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:55.908736 25962 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:55.909693 23776 raft_consensus.cc:606] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.910182 23776 raft_consensus.cc:614] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:55.910229 24386 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:55.915000 25969 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:55.915496 25969 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:55.917624 25775 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:55.918419 25775 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:55.920046 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.921178 23625 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:55.922510 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:55.922785 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:55.923362 23773 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:55.917527 25713 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:55.932809 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:55.934268 23667 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:55.929198 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:55.936388 23592 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:55.938060 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:55.867220 25953 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.938764 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:55.920974 23626 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:55.939610 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:55.944214 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:55.946265 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 66291.2us
I20260709 13:08:55.944383 23592 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:55.937522 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.945088 23777 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:55.945101 23667 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:55.916491 25969 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:55.942906 25885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.001s	sys 0.025s
I20260709 13:08:55.950359 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:55.950359 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:55.953627 23771 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.930269 25713 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:55.940936 25962 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:55.955001 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:55.941988 25990 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:55.953075 24387 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
W20260709 13:08:56.001746 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 64293.9us
I20260709 13:08:56.004944 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
W20260709 13:08:55.966252 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.021147 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:55.940644 24388 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
W20260709 13:08:56.022990 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 140729us
I20260709 13:08:55.949002 25950 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:56.023916 23778 raft_consensus.cc:606] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
W20260709 13:08:55.952862 25885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.002s	sys 0.025s
I20260709 13:08:55.948539 25958 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.950878 25971 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.940763 25982 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.940318 25978 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:55.952703 25836 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:55.952418 25964 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:56.018565 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 73431.3us
W20260709 13:08:56.038544 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.025604 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 70705.7us
W20260709 13:08:56.026420 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 69263.4us
I20260709 13:08:56.042900 23592 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:56.044046 23592 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:56.028653 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:56.034183 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:56.021430 25951 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:56.035858 23771 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:08:56.046802 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:56.047713 25974 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:56.026340 25788 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:56.050881 24387 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.051445 25996 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:56.051966 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.052874 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:56.027341 25969 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.026672 25948 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:56.075915 25964 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:56.075631 25983 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.057727 25978 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:56.058112 25997 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:56.055014 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:56.030012 25884 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:56.093889 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54233.7us
I20260709 13:08:56.097823 23592 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:56.043807 25990 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:56.113435 24387 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:56.109302 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:56.070645 23623 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:56.115489 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:56.118942 23778 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:56.074754 25775 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:56.111011 25892 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:56.122380 25892 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:56.123968 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 88652.9us
I20260709 13:08:56.124749 25892 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:56.124928 25897 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:56.125921 25842 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:08:56.128706 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.128412 25907 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:56.130491 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:56.134833 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:56.084695 25962 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:08:56.137743 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 82896.5us
I20260709 13:08:56.138602 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:56.142740 23669 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:56.099094 25836 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:56.111860 25674 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:56.114238 25997 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.145262 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:56.044175 25971 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:56.096915 25948 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:56.115036 25951 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:56.193835 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:56.096568 25926 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:08:56.200815 25962 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:56.193934 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:56.211187 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:56.201246 24385 raft_consensus.cc:2368] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5.
I20260709 13:08:56.149350 25885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54660 (request call id 8) took 8537 ms. Trace:
W20260709 13:08:56.202570 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 59914.1us
I20260709 13:08:56.144342 25982 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:56.144980 25996 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:56.053630 25713 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:56.219816 25713 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.084029 25788 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:56.224609 25925 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:56.225364 25788 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:56.197430 25873 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:56.195659 25997 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.197099 23778 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
W20260709 13:08:56.201146 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 60982.1us
I20260709 13:08:56.207657 25892 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.215056 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:56.195998 25631 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:56.234807 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:08:56.208981 24392 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:08:56.217280 26004 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:08:56.209517 25890 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.140497 25842 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:08:56.217816 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.204339 25948 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:56.247303 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 121907us
W20260709 13:08:56.265751 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.261786 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:56.274694 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 141085us
I20260709 13:08:56.116212 25983 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:56.277217 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:56.277864 24391 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:08:56.263712 25873 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:56.213711 25885 rpcz_store.cc:276] 0709 13:08:47.604927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.609348 (+  4421us) service_pool.cc:224] Handling call
0709 13:08:47.769654 (+160306us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b4c000febc0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3f5d8a20 00007f2b3f5e9a29 00007f2b3f5af644 00007f2b3f5d6f2d 00007f2b3f5d6b93 00007f2b412651af 00007f2b41264f3e 00007f2b412ea888 00007f2b4130775c 00007f2b4130876a 00007f2b4130791b
0709 13:08:47.771666 (+  2012us) log.cc:844] Serialized 499 byte log entry
0709 13:08:48.148039 (+376373us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b54001d2520. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41285142 00007f2b41265eaa 00007f2b4126cd53 00007f2b4126ccd9 00007f2b4126cc69 00007f2b4126cc31 00007f2b4126bdfd 000000000038f354 000000000038f199 00007f2b3e21f475
0709 13:08:48.499295 (+351256us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b54001d2520. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41285142 00007f2b41265eaa 00007f2b4126cd53 00007f2b4126ccd9 00007f2b4126cc69 00007f2b4126cc31 00007f2b4126bdfd 000000000038f354 000000000038f199 00007f2b3e21f475
0709 13:08:56.117612 (+7618317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":479320,"raft.queue_time_us":62405,"raft.run_cpu_time_us":6254,"raft.run_wall_time_us":1003001,"spinlock_wait_cycles":90419584,"thread_start_us":76547,"threads_started":1,"wal-append.queue_time_us":161999,"wal-append.run_cpu_time_us":2377,"wal-append.run_wall_time_us":1002348}
I20260709 13:08:56.285799 25996 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.289162 25885 raft_consensus.cc:3055] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:56.288743 25996 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:56.289638 25885 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:56.290120 25963 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:56.290659 25885 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:56.279927 25982 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:56.279930 25836 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:56.291486 25996 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:56.292892 25982 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:56.278334 23743 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:56.295467 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:56.285346 25884 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:56.283483 25677 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:56.304733 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 65671.8us
I20260709 13:08:56.305155 25677 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:56.305661 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:56.239183 25978 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:56.306548 25884 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:56.306253 25677 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:56.307138 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:56.229867 25990 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:56.276333 25890 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:56.316303 26017 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:56.316830 26017 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.317251 26017 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.317358 25890 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:56.276995 25788 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:08:56.319839 25788 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:56.322762 25962 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:56.324704 25971 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:56.305694 25983 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:56.326020 25788 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:56.294463 25898 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:56.311339 25744 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:08:56.231933 25951 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:56.334224 25951 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:56.334995 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:56.241786 25892 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:56.339123 23625 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:56.343357 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:56.332947 26017 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:56.356523 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:56.299181 25885 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.357723 23778 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:56.358340 23626 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:56.362337 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:56.364591 23627 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:56.368669 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:56.344198 25631 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:56.309367 25783 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:08:56.372102 23769 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 5. Ops: []
W20260709 13:08:56.386180 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.405747 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 98744.3us
I20260709 13:08:56.438761 23669 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:08:56.487929 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.504179 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.542177 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 134449us
I20260709 13:08:56.544452 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:56.546022 23702 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:56.547679 23696 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:08:56.490877 25969 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.548625 25971 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:56.593686 23699 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:08:56.606873 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 310744us
I20260709 13:08:56.618507 23696 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:56.605624 25987 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 13:08:56.604743 25971 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:56.631227 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:56.617929 25974 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.631981 25971 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.635047 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:56.597849 25969 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:56.634270 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:56.633675 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:56.636655 23699 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:56.638382 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:56.619886 25898 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 13:08:56.640101 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.642485 23696 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
W20260709 13:08:56.777802 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.779920 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:56.627017 26018 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:08:56.782938 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:56.783152 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:56.788615 23620 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:56.786177 23699 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:56.793102 23775 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:56.777998 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 417167us
I20260709 13:08:56.794238 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:56.802938 23624 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:56.643081 26020 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:56.751509 25951 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.806756 23696 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:56.807899 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:56.810871 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:56.820931 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.634859 25974 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:56.824740 23699 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:56.772083 26011 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:56.826316 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:56.792237 25783 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:08:56.809638 25953 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.863s	user 0.008s	sys 0.004s
I20260709 13:08:56.859525 23624 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:08:56.924270 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.808867 26020 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.859030 23743 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:56.875870 23696 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:56.874747 23700 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:08:56.973126 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 141885us
I20260709 13:08:56.805773 25973 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:56.909587 25783 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:56.977734 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:56.831171 25892 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:56.873355 26017 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:57.000936 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.001895 23624 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:08:56.976410 25898 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:56.828673 25951 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:56.983882 25953 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.971192 26020 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.030426 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.039347 23626 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:57.003118 25713 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:57.022038 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 386094us
I20260709 13:08:56.859712 26011 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:57.037405 26015 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.433s	user 0.002s	sys 0.000s
W20260709 13:08:57.039688 25775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.020s	sys 0.021s
I20260709 13:08:56.992805 25973 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.040812 26022 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:57.081452 26022 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
W20260709 13:08:57.086293 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.064863 25775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.021s	sys 0.022s
I20260709 13:08:57.038688 25898 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.100759 23620 raft_consensus.cc:2410] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:08:57.044468 25953 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:57.088044 26024 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 13:08:57.074625 25969 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.053056 25713 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.105365 25631 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:57.129051 25972 consensus_meta.cc:287] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.256s	user 0.008s	sys 0.007s
I20260709 13:08:57.166087 25783 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.166582 23622 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:57.168431 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:57.169579 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:57.172276 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.175320 25953 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.175822 25897 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:57.176621 25948 consensus_meta.cc:287] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.897s	user 0.012s	sys 0.000s
I20260709 13:08:57.177101 25948 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:57.131924 25775 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:57.180730 25978 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:57.180492 25775 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.181207 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1911) took 1233 ms. Trace:
I20260709 13:08:57.181339 25962 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:57.182089 25962 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.182907 25775 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.181802 23629 rpcz_store.cc:276] 0709 13:08:55.915569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.918269 (+  2700us) service_pool.cc:224] Handling call
0709 13:08:55.918587 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:55.918971 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:55.918999 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:55.919495 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:08:56.275636 (+356141us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:56.275680 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.277652 (+  1972us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.149080 (+871428us) raft_consensus.cc:1685] finished
0709 13:08:57.149109 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.149322 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106,"raft.queue_time_us":1492,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10703,"thread_start_us":355682,"threads_started":1,"wal-append.queue_time_us":447921}
I20260709 13:08:57.183903 25974 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.181346 25978 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:57.186259 25997 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.925s	user 0.011s	sys 0.000s
I20260709 13:08:57.186617 25978 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.187362 25953 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:57.187443 25892 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.188052 25953 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.188551 25892 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.189769 25973 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.190557 25953 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:57.190891 26013 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:08:57.191848 25892 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.192301 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1562) took 1254 ms. Trace:
I20260709 13:08:57.192631 25892 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.192798 23773 rpcz_store.cc:276] 0709 13:08:55.938044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.938205 (+   161us) service_pool.cc:224] Handling call
0709 13:08:55.938622 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:55.948601 (+  9979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:55.948642 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:55.953495 (+  4853us) log.cc:844] Serialized 52 byte log entry
0709 13:08:56.371652 (+418157us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:56.371759 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.371853 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.192038 (+820185us) raft_consensus.cc:1685] finished
0709 13:08:57.192059 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.192232 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62819,"raft.queue_time_us":3124,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5328,"thread_start_us":346986,"threads_started":1,"wal-append.queue_time_us":800919}
I20260709 13:08:57.156630 23621 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:57.193499 25892 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:08:57.136919 26028 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:08:57.159622 26023 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 13:08:57.160216 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:57.162514 26025 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:08:57.105578 26036 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:57.198294 25892 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.198681 26036 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:08:57.198788 24385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46580 (request call id 364) took 1861 ms (client timeout 1984 ms). Trace:
I20260709 13:08:57.198889 25892 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:57.199342 24385 rpcz_store.cc:269] 0709 13:08:55.337534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.340335 (+  2801us) service_pool.cc:224] Handling call
0709 13:08:55.853179 (+512844us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b5800010e98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:08:57.198543 (+1345364us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400463554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:57.198696 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655718016}
I20260709 13:08:57.165046 26011 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.199678 25892 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.149761 26029 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.200924 26029 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:57.201735 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.203194 26029 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:57.203258 25892 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.136039 26044 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:57.206032 25631 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.186745 25997 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.196635 25962 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.179527 25948 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.199246 26036 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.193187 25951 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.248700 23702 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:57.203524 25971 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
W20260709 13:08:57.256215 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 281877us
I20260709 13:08:57.270641 26029 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:57.257660 23667 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:57.246337 25962 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:57.279850 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.224378 26044 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.254772 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:57.253194 26017 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:08:57.297355 23773 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:57.286105 23703 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:57.318943 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:57.277695 25951 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:57.323143 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:57.325405 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:57.335914 23769 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.336040 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:57.336292 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:57.284626 25885 consensus_meta.cc:287] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.923s	user 0.008s	sys 0.005s
W20260709 13:08:57.275573 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.284375 26031 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:57.284543 25909 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.353367 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:57.297273 25677 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:57.358925 26031 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.360177 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:57.360831 23778 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:08:57.280961 25962 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.325609 25951 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.334944 26021 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:57.371564 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:57.376406 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:57.377022 23622 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.347846 26012 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.347550 26018 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:57.382123 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.386019 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.381287 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 163705us
I20260709 13:08:57.384291 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:57.356437 26011 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.350991 26038 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:57.357106 26035 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:57.395128 23625 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:57.392359 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:57.405107 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.408634 23622 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:57.373660 25951 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.414161 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:57.381670 25974 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.368377 25677 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.430354 23701 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:57.368413 25909 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.412503 25892 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:57.392474 25978 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:57.385777 26021 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.393203 26012 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.620965 25971 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.621111 25951 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.622092 26012 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:57.622649 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.623235 23624 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
W20260709 13:08:57.623821 26046 log.cc:927] Time spent T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.185s	user 0.000s	sys 0.011s
I20260709 13:08:57.623920 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.624590 23625 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
W20260709 13:08:57.455440 26043 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:08:57.396917 26018 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.626609 25677 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.627185 25677 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:57.627247 26018 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.628130 26044 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.419093 26011 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.443171 25997 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.428398 25974 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.630147 26011 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:57.630273 26021 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:57.630594 25974 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.444018 25892 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.631351 25892 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:57.633054 26031 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:57.633635 23772 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:08:57.431313 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:57.562947 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.637835 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 206594us
I20260709 13:08:57.638645 24357 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:08:57.642560 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:57.573549 25813 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.378s	user 0.027s	sys 0.032s
I20260709 13:08:57.385347 26040 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 13:08:57.650116 25813 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.574s	user 0.029s	sys 0.033s
I20260709 13:08:57.421545 25783 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:57.616722 25744 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.617093 24390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 452) took 1590 ms. Trace:
I20260709 13:08:57.617202 26017 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.672421 26017 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.648801 25677 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.675613 25677 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:57.650997 26039 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.228s	user 0.000s	sys 0.007s
I20260709 13:08:57.679184 26040 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:57.618098 26036 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.619786 23769 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:08:57.687494 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.687817 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:57.688719 23769 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:08:57.689783 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:57.690899 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:57.691068 23627 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:08:57.620265 26020 consensus_meta.cc:287] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.005s
W20260709 13:08:57.692052 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.692299 26020 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.693219 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.694259 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.694586 26020 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.694766 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.695274 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:57.695499 23773 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:08:57.650796 26031 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:57.700368 23628 raft_consensus.cc:2368] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3.
W20260709 13:08:57.648352 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.648669 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.615638 25945 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:57.652036 23699 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:57.653203 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.675523 26017 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:57.660892 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.636188 25909 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:57.668272 25783 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.670140 26058 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:57.696332 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.652990 25908 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.414170 26038 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.697065 26011 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.697054 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.684377 23743 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:57.698302 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:57.720008 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.720913 23629 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:08:57.691434 23769 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:08:57.702047 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.705322 23696 raft_consensus.cc:2368] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:57.660164 23695 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:57.722507 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:57.723520 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:08:57.724049 23769 raft_consensus.cc:606] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:08:57.724376 23769 raft_consensus.cc:614] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:57.699638 23592 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:57.660173 25971 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:57.681073 26021 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:57.708329 23700 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:08:57.710116 23624 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:08:57.695698 23627 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:08:57.717335 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:57.722312 23697 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:08:57.703699 25948 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.679914 25744 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.697121 26012 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:08:57.734397 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 94654.4us
I20260709 13:08:57.736747 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:08:57.737967 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:57.738669 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.739295 23697 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:57.739661 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:57.684268 26040 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.740191 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.743259 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:57.742187 23697 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:57.744915 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.734237 26042 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:57.744515 26054 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.735316 25971 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.747988 26054 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.740867 25948 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.750079 25971 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.745628 23696 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:08:57.752347 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.752558 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.753225 23695 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:08:57.753752 25953 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:57.734126 26021 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:57.754366 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.754616 23696 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:57.754707 26021 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:57.757045 23696 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:57.760658 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:57.761420 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:57.763019 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.732203 26020 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:57.751507 25948 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.763521 26050 raft_consensus.cc:993] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:57.755625 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:08:57.707126 26031 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.763150 26054 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:57.717402 25908 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.792784 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:08:57.802963 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 63387us
I20260709 13:08:57.774343 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:57.729411 26011 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:57.808032 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 88852.8us
I20260709 13:08:57.809439 23700 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:57.768286 25962 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.810470 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:57.807515 23697 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:57.795311 26020 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.792781 25677 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.820374 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:57.822623 23696 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:57.822623 23697 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:57.798930 26042 raft_consensus.cc:697] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:57.834462 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:57.829664 23668 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:57.838578 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:57.806998 25951 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.840284 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.846995 23629 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:08:57.887763 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 60562.3us
I20260709 13:08:57.921834 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:57.664630 24390 rpcz_store.cc:276] 0709 13:08:56.026456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.029130 (+  2674us) service_pool.cc:224] Handling call
0709 13:08:56.229780 (+200650us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b5800010e98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:08:56.230019 (+   239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:56.749664 (+519645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:56.776099 (+ 26435us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:56.977227 (+201128us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.254221 (+276994us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:57.281423 (+ 27202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.295347 (+ 13924us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.616733 (+321386us) raft_consensus.cc:1685] finished
0709 13:08:57.616755 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.617001 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89379,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":16108928,"thread_start_us":614464,"threads_started":2,"wal-append.queue_time_us":379825}
I20260709 13:08:57.822566 26020 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:57.905006 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.857074 25971 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.833596 25962 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:57.839596 26017 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.879871 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.864347 25997 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:57.919008 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:57.856073 25813 raft_consensus.cc:1081] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:08:57.868101 23697 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:57.922147 26066 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:57.839277 25885 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:57.882390 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.869333 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:57.857456 26054 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:57.917644 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:57.837435 25948 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:08:57.876830 25972 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:57.837013 25677 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.877346 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:57.863935 25953 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:08:57.923646 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.865473 23627 raft_consensus.cc:2410] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:57.930819 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:57.963887 23625 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.947715 26066 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:57.950623 26068 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:57.924556 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:57.953421 24394 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:08:57.953842 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:57.945542 26030 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 13:08:57.957067 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:57.943635 25885 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.974030 23621 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.959199 25783 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:57.969432 23626 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
W20260709 13:08:57.975347 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44626.1us
I20260709 13:08:57.970328 24388 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:57.978793 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:57.980113 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:57.942267 26017 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:57.942493 25971 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:57.984119 26062 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:08:57.984386 24392 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:57.975454 25885 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.970830 25744 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.993377 23621 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
W20260709 13:08:57.996627 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 182077us
W20260709 13:08:57.999290 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.974638 25962 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:58.015065 25962 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:58.015635 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:08:57.980599 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 57641.5us
I20260709 13:08:57.963902 25972 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.013202 25908 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:58.018571 25972 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:57.978555 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:58.020275 25836 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:08:58.039671 25892 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.041347 23695 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:08:58.026841 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.042969 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 131461us
I20260709 13:08:58.045130 23625 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:08:57.954102 26042 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:58.047987 25908 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.048481 25908 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:58.048892 25908 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:58.049593 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:58.049979 25948 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:58.050563 25948 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.050779 26074 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:57.990175 26012 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:58.057876 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:58.060928 23777 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:08:58.070237 25631 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.070750 25892 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.070870 25948 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.070266 24359 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:58.039620 25885 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.051520 25836 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:08:58.079159 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.079912 26030 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.080394 26030 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.080775 26030 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:58.019942 26040 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:58.020009 25727 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:08:58.089752 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:58.117686 23622 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.042351 26011 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:58.019924 26075 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:08:58.020967 26031 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:58.056493 25972 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:58.130918 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 81383.7us
W20260709 13:08:58.084321 25999 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 2.062s	user 0.000s	sys 0.029s
W20260709 13:08:58.140421 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 70272.8us
W20260709 13:08:58.145730 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.143592 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:08:58.148660 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.149410 23593 connection.cc:256] RPC call timeout handler was delayed by -1.3759847659999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 13:08:58.150063 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:58.150002 23593 connection.cc:256] RPC call timeout handler was delayed by -1.0792226109999774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 13:08:58.116248 25744 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.140141 25967 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:58.153292 23668 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:58.060322 26012 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:58.156701 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:58.041952 26066 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.056640 26021 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:58.135246 25948 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:58.180637 26054 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:58.157291 25744 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.182626 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:58.160480 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.135615 26069 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:58.146243 23622 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:08:58.152290 25892 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:58.157331 25967 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.147449 25972 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.212538 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:58.265537 24359 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:08:58.268034 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 85531.2us
I20260709 13:08:58.270224 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:58.186967 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:58.174875 25953 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:58.120090 25962 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.179780 26012 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:58.299593 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 113625us
I20260709 13:08:58.204710 25971 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.215059 25744 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.188510 26011 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:58.188838 24389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 449) took 2452 ms. Trace:
I20260709 13:08:58.307114 23625 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:08:58.205641 25677 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:58.188918 25674 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.204124 25960 consensus_queue.cc:1059] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
W20260709 13:08:58.309607 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.276119 26054 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:58.187031 25948 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.211455 26017 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:58.278040 25945 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.304433 26075 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:58.276281 26038 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:58.310570 26011 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.300118 26070 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.306283 25892 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:58.301163 25953 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:58.237139 26036 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:58.306206 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:58.203619 26022 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.315435 25744 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.355225 25953 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.297915 25997 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:08:58.335783 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:58.328153 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 270944us
W20260709 13:08:58.336853 23620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1500) took 1517 ms (client timeout 1504 ms). Trace:
I20260709 13:08:58.317548 26092 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.355087 25744 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.350562 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1848) took 1771 ms. Trace:
I20260709 13:08:58.351627 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1837) took 1808 ms. Trace:
I20260709 13:08:58.317929 25674 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.326776 25971 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:58.353856 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1306) took 2621 ms. Trace:
I20260709 13:08:58.360809 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:08:58.360993 23620 rpcz_store.cc:269] 0709 13:08:56.809610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.810553 (+   943us) service_pool.cc:224] Handling call
0709 13:08:58.324647 (+1514094us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54003af554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:58.327110 (+  2463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663718784}
I20260709 13:08:58.335358 26075 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:58.339262 26089 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:58.389494 26089 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:58.393528 25948 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.393630 23769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1316) took 1024 ms. Trace:
I20260709 13:08:58.344916 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:58.377533 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:58.368542 23703 rpcz_store.cc:276] 0709 13:08:56.543659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.546341 (+  2682us) service_pool.cc:224] Handling call
0709 13:08:56.546656 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.321820 (+775164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.351365 (+1029545us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400131fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:58.351563 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699988352}
I20260709 13:08:58.341966 26011 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.397064 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:58.398272 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 53414.8us
I20260709 13:08:58.393831 26021 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.368468 23702 rpcz_store.cc:276] 0709 13:08:56.579018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.579143 (+   125us) service_pool.cc:224] Handling call
0709 13:08:56.600513 (+ 21370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.249313 (+648800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.350237 (+1100924us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400357fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:58.350489 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490053888}
I20260709 13:08:58.388551 25972 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.394243 23769 rpcz_store.cc:276] 0709 13:08:57.369020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.814265 (+445245us) service_pool.cc:224] Handling call
0709 13:08:57.821409 (+  7144us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.863398 (+ 41989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.864748 (+  1350us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.872192 (+  7444us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.144257 (+272065us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:58.144300 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.144370 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.393417 (+249047us) raft_consensus.cc:1685] finished
0709 13:08:58.393434 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.393570 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17315,"raft.queue_time_us":65384,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":222774,"threads_started":1,"wal-append.queue_time_us":338917}
I20260709 13:08:58.323074 25908 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:58.360401 26070 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.383816 23775 rpcz_store.cc:276] 0709 13:08:55.732522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.733632 (+  1110us) service_pool.cc:224] Handling call
0709 13:08:55.740598 (+  6966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.793705 (+1053107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.353573 (+1559868us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000023d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:58.353757 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419976064}
I20260709 13:08:58.403014 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:58.386889 25892 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.409456 25892 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:58.410607 26089 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.368898 26038 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.400316 25963 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:58.427091 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1318) took 1057 ms. Trace:
I20260709 13:08:58.427815 23772 rpcz_store.cc:276] 0709 13:08:57.369658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.413869 (+ 44211us) service_pool.cc:224] Handling call
0709 13:08:58.426817 (+1012948us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54002c9cd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:58.426984 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502919936}
I20260709 13:08:58.429819 23592 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:08:58.429942 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 56434.8us
I20260709 13:08:58.425809 26030 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.431115 25972 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:58.431531 25972 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.427460 25963 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.431931 25972 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.432192 25963 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.432530 26030 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:58.434993 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.436110 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.436503 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.437127 23629 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:08:58.312044 24389 rpcz_store.cc:276] 0709 13:08:55.736694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.738426 (+  1732us) service_pool.cc:224] Handling call
0709 13:08:55.753075 (+ 14649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:55.768215 (+ 15140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:55.768259 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:55.768851 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.830997 (+ 62146us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:55.833549 (+  2552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.130803 (+1297254us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b5400654854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:57.133190 (+  2387us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.056081 (+922891us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:08:58.188560 (+132479us) raft_consensus.cc:1685] finished
0709 13:08:58.188590 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.188750 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12637,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":18402048,"thread_start_us":43374,"threads_started":1,"wal-append.queue_time_us":173530}
I20260709 13:08:58.426748 26022 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.437952 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.411583 25892 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:58.417567 25744 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.443037 25908 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:58.413910 25956 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:08:58.379814 26092 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.423862 26038 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.404367 25788 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:58.417984 25885 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.401857 25974 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:08:58.395313 25971 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:58.417235 25674 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.422163 23593 leader_election.cc:400] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:58.394424 26075 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.423110 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:58.403580 25967 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.415776 25948 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:58.415541 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.610170 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.598414 23701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1838) took 2054 ms (client timeout 1635 ms). Trace:
I20260709 13:08:58.545691 23775 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:58.537159 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.467306 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.472060 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:58.517768 23769 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:58.472553 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:58.618184 23593 leader_election.cc:403] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:58.468719 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:08:58.632339 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 210294us
I20260709 13:08:58.633159 24391 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:08:58.633687 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:58.554961 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:58.448518 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.669358 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:08:58.619561 23701 rpcz_store.cc:269] 0709 13:08:56.543984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.544130 (+   146us) service_pool.cc:224] Handling call
0709 13:08:58.598156 (+2054026us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b5400356e54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:58.598296 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853385472}
I20260709 13:08:58.448405 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:58.446740 26059 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.627s	user 0.001s	sys 0.001s
W20260709 13:08:58.456408 26020 consensus_meta.cc:287] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.001s
I20260709 13:08:58.624440 23667 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:58.457139 25677 raft_consensus.cc:3055] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:58.686565 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 595970us
I20260709 13:08:58.579185 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:58.703033 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 78218.5us
I20260709 13:08:58.595461 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:58.707871 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.624887 25978 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:58.595304 25898 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:58.596045 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:58.465795 25971 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:58.673123 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.733912 23627 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:08:58.456669 25974 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:58.709384 24391 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:58.451542 26070 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.449034 25972 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.718936 25677 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:08:58.710758 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.624887 26035 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.447996 26038 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:58.720858 23622 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:08:58.682255 25982 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:58.676834 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 50034.4us
I20260709 13:08:58.725713 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:58.593629 25963 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.545182 26078 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:58.669119 26022 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:58.735605 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:58.590672 24386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 376) took 1373 ms. Trace:
I20260709 13:08:58.448717 25788 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.683141 26054 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:58.817109 26054 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.817590 26054 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.803587 24385 raft_consensus.cc:2368] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5.
I20260709 13:08:58.821722 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:58.822932 26022 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:58.823429 26022 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.824977 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1292) took 1180 ms. Trace:
I20260709 13:08:58.825502 23696 rpcz_store.cc:276] 0709 13:08:57.644799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.800586 (+155787us) service_pool.cc:224] Handling call
0709 13:08:57.803538 (+  2952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.832223 (+ 28685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.824628 (+992405us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b540042b654. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:08:58.824892 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43155840}
I20260709 13:08:58.732314 25967 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:58.828527 25967 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:08:58.830430 26080 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:58.831164 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:58.832679 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:58.833875 23771 raft_consensus.cc:2410] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:58.718261 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:58.545923 26011 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.670485 25744 consensus_queue.cc:1059] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:08:58.460354 25953 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:58.787292 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.447508 26092 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.744729 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.708452 26020 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.720103 25885 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:58.675896 26096 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:08:58.787647 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 374) took 1574 ms. Trace:
I20260709 13:08:58.736799 25978 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.727569 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:58.831327 25908 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:58.903887 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:58.848816 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 130636us
I20260709 13:08:58.905215 23620 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:58.905437 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:58.850455 23742 leader_election.cc:400] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5.
W20260709 13:08:58.907797 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 57509.3us
I20260709 13:08:58.674132 26012 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:58.720281 25949 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:08:58.917433 23743 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:08:58.736963 25974 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:58.672096 25948 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.869565 23629 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:58.872697 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.832407 25788 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.892510 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.853027 25967 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:08:58.873769 25892 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.914543 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:58.929728 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:08:58.809659 26035 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:58.921271 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:08:58.848300 26054 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:58.931062 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:08:58.937992 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 132561us
I20260709 13:08:58.923023 23627 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
W20260709 13:08:58.925158 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 197717us
I20260709 13:08:58.787039 25958 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.848233 26080 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:08:58.939941 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:08:58.903182 25885 raft_consensus.cc:697] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:58.809993 25982 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:58.942586 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:08:58.939703 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.914139 25842 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:58.948300 23774 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:58.919443 26101 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:08:58.902480 24393 rpcz_store.cc:276] 0709 13:08:57.213112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.213250 (+   138us) service_pool.cc:224] Handling call
0709 13:08:57.224503 (+ 11253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.248984 (+ 24481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.249017 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.252213 (+  3196us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.647408 (+395195us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:57.647499 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.647643 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.446144 (+798501us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:08:58.787274 (+341130us) raft_consensus.cc:1685] finished
0709 13:08:58.787305 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.787569 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":856,"raft.queue_time_us":21622,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3172,"spinlock_wait_cycles":7755136,"thread_start_us":365952,"threads_started":1,"wal-append.queue_time_us":472080}
I20260709 13:08:58.869511 26088 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:08:58.902871 25908 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:58.893011 25898 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:08:58.919090 26070 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:08:59.002693 24358 connection.cc:256] RPC call timeout handler was delayed by -2.5433232309999312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 13:08:58.928627 25892 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.923475 26107 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:58.931998 25631 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:58.895067 26092 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:08:58.954233 23669 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:58.929349 26096 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:58.929194 25971 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:58.959378 25775 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.952316 25967 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.097s
W20260709 13:08:59.094904 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 140730us
I20260709 13:08:58.944976 25926 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:59.011693 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:59.096581 23627 raft_consensus.cc:2410] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:59.005693 25990 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.033507 26027 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.106742 25775 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:59.020282 26097 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:08:59.072423 26106 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:08:59.019979 26085 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.033238 25982 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:59.145617 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1520) took 1099 ms. Trace:
I20260709 13:08:59.115842 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:08:59.115757 25967 consensus_queue.cc:1243] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:08:59.054831 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.168951 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.955713 25958 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:59.124639 25926 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.146070 23626 rpcz_store.cc:276] 0709 13:08:58.046007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.046191 (+   184us) service_pool.cc:224] Handling call
0709 13:08:58.046564 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:58.056831 (+ 10267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.056883 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.084859 (+ 27976us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.312787 (+227928us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:58.336579 (+ 23792us) log.cc:844] Serialized 14 byte log entry
0709 13:08:58.893224 (+556645us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b180035cfe0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287 00007f2b41327208
0709 13:08:59.133000 (+239776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.133084 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:59.133127 (+    43us) raft_consensus.cc:1685] finished
0709 13:08:59.145037 (+ 11910us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.145518 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21755,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":11284,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":23069,"spinlock_wait_cycles":12825088,"thread_start_us":385340,"threads_started":2,"wal-append.queue_time_us":205488}
W20260709 13:08:59.170531 24358 connection.cc:256] RPC call timeout handler was delayed by -1.6672730159999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
I20260709 13:08:59.124256 25892 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:59.171979 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 56206.8us
I20260709 13:08:59.175288 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:08:59.173269 24358 connection.cc:256] RPC call timeout handler was delayed by -1.1957397420000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23370000000000002s for a response
I20260709 13:08:59.177220 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:59.147743 25775 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:59.142380 25963 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:59.167982 25990 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:59.103029 25971 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:59.175781 25926 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.103183 26096 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:59.172672 25972 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:58.832157 24386 rpcz_store.cc:276] 0709 13:08:57.216815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.222205 (+  5390us) service_pool.cc:224] Handling call
0709 13:08:58.033934 (+811729us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b5800010e98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:08:58.034162 (+   228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:58.034673 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.034709 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.035645 (+   936us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.181220 (+145575us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:58.340690 (+159470us) log.cc:844] Serialized 14 byte log entry
0709 13:08:58.386329 (+ 45639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.545356 (+159027us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.571117 (+ 25761us) raft_consensus.cc:1685] finished
0709 13:08:58.590387 (+ 19270us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.590588 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11263,"prepare.queue_time_us":205311,"prepare.run_wall_time_us":42,"raft.queue_time_us":4445,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":18915,"spinlock_wait_cycles":19132160,"thread_start_us":270255,"threads_started":2,"wal-append.queue_time_us":257837}
I20260709 13:08:59.208487 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:59.197206 26098 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.195s	user 0.000s	sys 0.002s
I20260709 13:08:59.131340 25885 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:08:59.197582 26108 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.109s
W20260709 13:08:59.199429 25945 consensus_meta.cc:287] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.859s	user 0.010s	sys 0.000s
W20260709 13:08:59.182829 26102 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:08:59.174674 25982 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:59.047587 25974 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:59.203060 23622 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:08:59.115525 26107 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:59.183425 25953 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:59.180338 26011 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:59.200263 25990 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:59.220409 26100 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:08:59.216125 23626 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.217549 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:59.184688 26085 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:08:59.231915 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 56711.6us
I20260709 13:08:59.270931 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:59.235191 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:59.242103 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1865) took 1528 ms. Trace:
I20260709 13:08:59.219445 25945 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.245697 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:59.246591 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.222281 26054 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:08:59.252038 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.209259 26012 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:59.176057 25908 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:59.219641 25982 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:08:59.301707 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:59.266081 25990 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:59.216150 26035 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:59.271981 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:59.216538 25978 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:59.243222 23770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42298 (request call id 369) took 3209 ms (client timeout 1721 ms). Trace:
I20260709 13:08:59.273069 23695 rpcz_store.cc:276] 0709 13:08:57.714183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.755363 (+ 41180us) service_pool.cc:224] Handling call
0709 13:08:59.241820 (+1486457us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540026acd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:59.242014 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557422336}
W20260709 13:08:59.321597 23770 rpcz_store.cc:269] 0709 13:08:56.034319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.034499 (+   180us) service_pool.cc:224] Handling call
0709 13:08:59.242905 (+3208406us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400141754. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:59.243085 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4156064640}
W20260709 13:08:59.249385 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.307976 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:08:59.214951 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 206226us
I20260709 13:08:59.265632 25974 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.311529 24393 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:59.330783 26112 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:08:59.322939 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:08:59.331681 26109 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:08:59.332561 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:59.333411 24386 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:08:59.334235 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:08:59.334805 24386 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:59.335980 25982 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:59.336800 26036 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:59.337239 25982 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:59.337265 26036 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:08:59.338449 26036 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:59.318840 26027 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:59.299494 26105 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:08:59.265789 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:59.264490 25997 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:59.326323 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49113.9us
I20260709 13:08:59.415217 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:59.416976 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:59.330518 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:59.267239 25879 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:59.275022 25953 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:59.263922 25631 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:08:59.312322 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:59.339962 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 68063.3us
I20260709 13:08:59.262997 26114 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:59.333412 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:08:59.352876 26036 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.342233 26085 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:08:59.360369 25949 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:59.360327 25898 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:59.364285 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.319110 26054 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.428251 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:08:59.470096 25949 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:59.470786 26054 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:59.473228 26054 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:59.473922 25898 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:59.319650 25908 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.340260 25978 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:59.480285 25978 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:08:59.481485 25978 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:59.527307 23623 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:59.274411 26078 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.166s
I20260709 13:08:59.649370 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:59.684870 25997 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:59.449638 25897 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:59.427249 25953 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.427207 26089 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:59.462842 26119 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:08:59.721211 26022 consensus_meta.cc:287] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.897s	user 0.007s	sys 0.003s
I20260709 13:08:59.726416 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:59.824782 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1582) took 1152 ms. Trace:
I20260709 13:08:59.729182 25674 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:59.730829 24387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 385) took 1367 ms. Trace:
W20260709 13:08:59.744454 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 327556us
I20260709 13:08:59.747643 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:08:59.825142 23776 rpcz_store.cc:276] 0709 13:08:58.672822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.726008 (+1053186us) service_pool.cc:224] Handling call
0709 13:08:59.824713 (+ 98705us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:59.460263 26114 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:08:59.776993 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:59.712139 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1326) took 1107 ms. Trace:
I20260709 13:08:59.774760 25897 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:59.710520 26085 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:59.710731 26035 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:08:59.686674 25967 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:59.395532 23626 raft_consensus.cc:2410] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:59.831045 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:08:59.831110 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:08:59.832708 23770 rpcz_store.cc:276] 0709 13:08:58.604428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.454397 (+849969us) service_pool.cc:224] Handling call
0709 13:08:59.712049 (+257652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:59.717381 26054 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:08:59.829380 24387 rpcz_store.cc:276] 0709 13:08:58.363172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.363304 (+   132us) service_pool.cc:224] Handling call
0709 13:08:58.363630 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:58.365087 (+  1457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.365128 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:58.365694 (+   566us) log.cc:844] Serialized 52 byte log entry
0709 13:08:58.534172 (+168478us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:58.534229 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.534325 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:59.730481 (+1196156us) raft_consensus.cc:1685] finished
0709 13:08:59.730518 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.730754 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13148,"raft.queue_time_us":22653,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5127,"thread_start_us":141768,"threads_started":1,"wal-append.queue_time_us":333054}
I20260709 13:08:59.777206 26096 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:08:59.844776 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.845476 23623 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:08:59.778530 25953 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.851665 23769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42298 (request call id 388) took 1174 ms. Trace:
I20260709 13:08:59.852324 23769 rpcz_store.cc:276] 0709 13:08:58.676825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.773637 (+1096812us) service_pool.cc:224] Handling call
0709 13:08:59.851575 (+ 77938us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:59.834924 26114 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.823380 25997 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:08:59.836508 26075 consensus_meta.cc:287] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.197s	user 0.008s	sys 0.004s
I20260709 13:08:59.825004 25971 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:08:59.838301 25897 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.881557 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1591) took 1137 ms. Trace:
I20260709 13:08:59.888665 23776 rpcz_store.cc:276] 0709 13:08:58.744336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.830776 (+1086440us) service_pool.cc:224] Handling call
0709 13:08:59.881489 (+ 50713us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:59.889653 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:59.890164 23776 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:59.890443 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.874850 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.886209 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:08:59.891288 23769 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.840638 25631 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:59.817358 26092 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.030s	sys 0.077s
W20260709 13:08:59.942885 23628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1493) took 3111 ms (client timeout 2049 ms). Trace:
I20260709 13:08:59.893726 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:08:59.947916 23628 rpcz_store.cc:269] 0709 13:08:56.782413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.782598 (+   185us) service_pool.cc:224] Handling call
0709 13:08:59.893941 (+3111343us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b5400098b54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:08:59.894101 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092420992}
W20260709 13:08:59.939132 24359 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.028s	sys 0.062s
W20260709 13:08:59.950759 24359 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.029s	sys 0.062s
I20260709 13:08:59.894551 23624 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:59.951475 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 536908us
I20260709 13:08:59.834211 26022 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:59.848482 26035 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:59.835285 25674 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:08:59.977865 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1597) took 1029 ms. Trace:
I20260709 13:08:59.999032 23770 rpcz_store.cc:276] 0709 13:08:58.948074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.850869 (+902795us) service_pool.cc:224] Handling call
0709 13:08:59.977769 (+126900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:59.983685 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:08:59.982520 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:08:59.952214 26092 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.032s	sys 0.081s
I20260709 13:09:00.005265 25957 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.986063 26130 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:59.977027 25631 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:00.009019 24390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 388) took 1162 ms. Trace:
I20260709 13:08:59.982208 25713 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:00.011941 26089 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:00.009093 25892 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.824s	user 0.007s	sys 0.002s
W20260709 13:09:00.014600 26036 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.001s
I20260709 13:08:59.839115 26119 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:08:59.954716 26111 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.855362 26085 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:00.023160 26107 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:00.010555 25958 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:08:59.981297 25971 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:08:59.849864 25967 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:00.017477 26121 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
W20260709 13:09:00.027478 23625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1522) took 1950 ms (client timeout 1544 ms). Trace:
W20260709 13:09:00.260147 23625 rpcz_store.cc:269] 0709 13:08:58.076969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.078729 (+  1760us) service_pool.cc:224] Handling call
0709 13:09:00.027231 (+1948502us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54003250d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:00.027400 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521919360}
I20260709 13:09:00.067021 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1315) took 2703 ms. Trace:
I20260709 13:08:59.860378 26054 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:00.289990 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.893158 25880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334c9018414947cabb4405ef47b8018e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:00.067322 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 319821us
W20260709 13:09:00.089871 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:00.066187 25788 consensus_meta.cc:287] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.088s	user 0.006s	sys 0.006s
I20260709 13:08:59.986761 26118 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:00.064054 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:00.303622 23771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1327) took 1698 ms (client timeout 2110 ms). Trace:
W20260709 13:09:00.304037 23771 rpcz_store.cc:269] 0709 13:08:58.605637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.063645 (+1458008us) service_pool.cc:224] Handling call
0709 13:09:00.303554 (+239909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.024365 24390 rpcz_store.cc:276] 0709 13:08:58.846909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.848220 (+  1311us) service_pool.cc:224] Handling call
0709 13:08:58.900357 (+ 52137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.920561 (+ 20204us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:59.195000 (+274439us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.008386 (+813386us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b18003be9c0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac23a
0709 13:09:00.008605 (+   219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.008677 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:00.008733 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.008823 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.008953 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":281776,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":3867,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":9952128,"thread_start_us":225531,"threads_started":2,"wal-append.queue_time_us":124719}
I20260709 13:08:59.891690 26075 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:00.099771 26088 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:00.088579 26117 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:00.160774 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:00.311218 23770 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
W20260709 13:09:00.311859 23770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1338) took 1508 ms (client timeout 1929 ms). Trace:
W20260709 13:09:00.312331 23770 rpcz_store.cc:269] 0709 13:08:58.803867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.033921 (+1230054us) service_pool.cc:224] Handling call
0709 13:09:00.311783 (+277862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.163291 26022 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:00.104262 26127 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:00.323197 26127 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:00.325964 26127 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:00.104645 25997 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:00.024015 26130 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:00.060258 26096 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:00.329911 26130 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.330034 26096 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:00.332370 26096 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:00.177479 26038 consensus_meta.cc:287] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.363s	user 0.007s	sys 0.004s
I20260709 13:09:00.333060 26038 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:00.335364 26038 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:00.185693 26119 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:00.060523 25960 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:00.337785 25960 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:00.192032 25713 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.229964 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.261605 23778 rpcz_store.cc:276] 0709 13:08:57.364089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.365320 (+  1231us) service_pool.cc:224] Handling call
0709 13:08:57.380512 (+ 15192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.628235 (+247723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.628264 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.077444 (+449180us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b2c0012bcd8. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:08:58.077858 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.255974 (+178116us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:58.256038 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.066628 (+1810590us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400021054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:00.066703 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.066773 (+    70us) raft_consensus.cc:1685] finished
0709 13:09:00.066791 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.066962 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":456,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":587748480,"thread_start_us":107388,"threads_started":1,"wal-append.queue_time_us":227400,"wal-append.run_cpu_time_us":2266,"wal-append.run_wall_time_us":1110320}
I20260709 13:09:00.294001 23769 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
W20260709 13:09:00.344022 23769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42298 (request call id 387) took 1672 ms (client timeout 2011 ms). Trace:
W20260709 13:09:00.344445 23769 rpcz_store.cc:269] 0709 13:08:58.671807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.881704 (+1209897us) service_pool.cc:224] Handling call
0709 13:09:00.343967 (+462263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.345373 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:00.346306 23769 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:00.346787 23769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1581) took 1674 ms (client timeout 2214 ms). Trace:
I20260709 13:09:00.088703 26108 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:00.305867 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:00.305886 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:00.155215 25674 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:00.201857 25677 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:00.375288 25677 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.320762 23777 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:00.097824 23776 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
W20260709 13:09:00.351904 23771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1594) took 1549 ms (client timeout 1964 ms). Trace:
W20260709 13:09:00.379906 23771 rpcz_store.cc:269] 0709 13:08:58.802372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.305591 (+1503219us) service_pool.cc:224] Handling call
0709 13:09:00.351840 (+ 46249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.380940 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:00.381518 23771 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.322099 26075 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:00.098973 25892 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:00.385758 25892 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:00.386335 25892 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:00.386816 25892 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:00.369120 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:00.389604 25982 consensus_meta.cc:287] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.052s	user 0.006s	sys 0.007s
I20260709 13:09:00.390101 25892 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:00.390858 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.392664 23625 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:00.374854 25897 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:00.393400 26125 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:09:00.395123 25926 consensus_meta.cc:287] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.186s	user 0.010s	sys 0.000s
I20260709 13:09:00.396836 25631 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:00.260967 25971 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:00.395079 25897 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:00.347229 23769 rpcz_store.cc:269] 0709 13:08:58.672545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.345083 (+1672538us) service_pool.cc:224] Handling call
0709 13:09:00.346690 (+  1607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.387169 25953 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:00.124791 26111 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:00.730746 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:00.340454 24385 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:00.467862 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:00.379536 23776 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1588) took 1695 ms (client timeout 2010 ms). Trace:
W20260709 13:09:00.809018 23776 rpcz_store.cc:269] 0709 13:08:58.684225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.889413 (+1205188us) service_pool.cc:224] Handling call
0709 13:09:00.379466 (+490053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.810140 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:00.811023 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1598) took 1478 ms. Trace:
I20260709 13:09:00.811437 23776 rpcz_store.cc:276] 0709 13:08:59.332600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.809879 (+1477279us) service_pool.cc:224] Handling call
0709 13:09:00.810966 (+  1087us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:00.393430 23625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1962) took 1613 ms (client timeout 2099 ms). Trace:
W20260709 13:09:00.812964 23625 rpcz_store.cc:269] 0709 13:08:58.780117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.261181 (+1481064us) service_pool.cc:224] Handling call
0709 13:09:00.393373 (+132192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:00.403258 23742 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.053s	sys 0.065s
W20260709 13:09:00.814191 23742 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.061s	sys 0.075s
W20260709 13:09:00.814548 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 1.23705e+06us
W20260709 13:09:00.694046 23593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.010s	sys 0.023s
W20260709 13:09:00.816077 23593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.013s	sys 0.031s
I20260709 13:09:00.817555 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:00.724009 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.409067 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:00.768961 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 472154us
W20260709 13:09:00.770920 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 479641us
I20260709 13:09:00.374859 23772 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:00.598304 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 455) took 1421 ms. Trace:
I20260709 13:09:00.821209 24393 rpcz_store.cc:276] 0709 13:08:59.176841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.177085 (+   244us) service_pool.cc:224] Handling call
0709 13:08:59.195471 (+ 18386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.330074 (+134603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.598036 (+1267962us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54009849d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:00.598237 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266480384}
W20260709 13:09:00.606351 23629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1944) took 2170 ms (client timeout 1582 ms). Trace:
W20260709 13:09:00.822857 23629 rpcz_store.cc:269] 0709 13:08:58.435635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.437739 (+  2104us) service_pool.cc:224] Handling call
0709 13:09:00.606039 (+2168300us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54000dacd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:00.606243 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990760192}
I20260709 13:09:00.592265 23771 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
W20260709 13:09:00.803937 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 73337.3us
I20260709 13:09:00.821480 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:00.824728 23701 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:00.404953 23628 raft_consensus.cc:2410] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:09:00.825811 23771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1325) took 2223 ms (client timeout 2715 ms). Trace:
W20260709 13:09:00.826277 23771 rpcz_store.cc:269] 0709 13:08:58.602286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.380652 (+1778366us) service_pool.cc:224] Handling call
0709 13:09:00.825746 (+445094us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:00.596518 25990 consensus_meta.cc:287] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.267s	user 0.013s	sys 0.000s
W20260709 13:09:00.697680 26092 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.008s	sys 0.025s
I20260709 13:09:00.305234 25788 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:00.828418 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:00.911121 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:00.923252 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:01.010259 23769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1595) took 2201 ms (client timeout 2537 ms). Trace:
W20260709 13:09:00.361986 25775 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.161s	user 0.008s	sys 0.002s
W20260709 13:09:00.967165 23743 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.715s (SENT) [suppressed 12 similar messages]
W20260709 13:09:01.014688 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47601.6us
I20260709 13:09:00.402741 26085 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:00.871420 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:00.999217 23742 leader_election.cc:336] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.666s (SENT)
I20260709 13:09:00.563112 25982 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.939486 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.910674 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:00.341779 26088 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:00.902602 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 85019.6us
I20260709 13:09:00.604099 25949 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:00.870639 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:00.900775 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:00.903970 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:01.010771 23769 rpcz_store.cc:269] 0709 13:08:58.808934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.807544 (+1998610us) service_pool.cc:224] Handling call
0709 13:09:01.010187 (+202643us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:01.010406 23625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1975) took 1665 ms (client timeout 1715 ms). Trace:
I20260709 13:09:00.796988 26054 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:00.430380 25960 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:00.786466 26123 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:00.829007 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:00.901458 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:01.012333 26092 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.011s	sys 0.036s
I20260709 13:09:01.010836 23776 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:00.901175 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:00.343286 26117 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:00.733603 26133 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.799003 25885 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.922698 25962 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:01.036152 23625 rpcz_store.cc:269] 0709 13:08:59.345412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.813757 (+1468345us) service_pool.cc:224] Handling call
0709 13:09:01.010348 (+196591us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.698500 26058 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:00.601653 24389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 387) took 1755 ms. Trace:
I20260709 13:09:00.716902 26131 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:00.609403 26132 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.392664 24386 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 1.057s	user 0.012s	sys 0.000s
I20260709 13:09:01.033059 23629 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:09:00.343125 26118 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:01.205639 26118 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:01.039556 23773 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:00.998095 25909 raft_consensus.cc:1064] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:09:00.828707 26050 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.995100 25950 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.352828 25713 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.006747 25967 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:00.999718 26069 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:00.367563 26108 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.053431 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1585) took 2379 ms. Trace:
I20260709 13:09:01.225680 23776 rpcz_store.cc:276] 0709 13:08:58.673518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.922971 (+2249453us) service_pool.cc:224] Handling call
0709 13:09:01.053335 (+130364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.227422 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1331) took 2603 ms. Trace:
I20260709 13:09:01.227835 23776 rpcz_store.cc:276] 0709 13:08:58.624338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.226467 (+2602129us) service_pool.cc:224] Handling call
0709 13:09:01.226813 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.227033 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.227061 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.227127 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:01.227173 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.227239 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.227358 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.229256 23776 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:01.229830 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1333) took 2584 ms. Trace:
I20260709 13:09:01.230149 23776 rpcz_store.cc:276] 0709 13:08:58.645781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.228793 (+2583012us) service_pool.cc:224] Handling call
0709 13:09:01.229078 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.229590 (+   512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.229779 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.231354 23776 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:00.610620 25908 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.133s	user 0.009s	sys 0.007s
I20260709 13:09:01.066025 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:01.232657 23769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1586) took 2558 ms (client timeout 3354 ms). Trace:
W20260709 13:09:01.233054 23769 rpcz_store.cc:269] 0709 13:08:58.673782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.043027 (+2369245us) service_pool.cc:224] Handling call
0709 13:09:01.232581 (+189554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.234162 23769 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:01.234735 23769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1583) took 2561 ms. Trace:
I20260709 13:09:01.235041 23769 rpcz_store.cc:276] 0709 13:08:58.673061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.233709 (+2560648us) service_pool.cc:224] Handling call
0709 13:09:01.233995 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.234498 (+   503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.234679 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.236143 23770 raft_consensus.cc:2410] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:01.020615 25674 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:01.120568 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:01.237286 23704 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:01.238191 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:01.238766 23704 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.144878 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:01.240628 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:01.241371 23699 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:00.395671 25926 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.244565 25926 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:01.176064 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:01.178314 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 353105us
W20260709 13:09:01.200109 23629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1529) took 2474 ms (client timeout 2372 ms). Trace:
I20260709 13:09:00.994563 25990 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.246202 23778 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:01.189543 26130 consensus_meta.cc:287] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.859s	user 0.011s	sys 0.000s
W20260709 13:09:01.245982 23629 rpcz_store.cc:269] 0709 13:08:58.726012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.870325 (+2144313us) service_pool.cc:224] Handling call
0709 13:09:01.200024 (+329699us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.248941 26130 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.249408 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:01.250233 23629 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:09:01.250680 23629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1974) took 1930 ms (client timeout 2216 ms). Trace:
W20260709 13:09:01.251029 23629 rpcz_store.cc:269] 0709 13:08:59.320472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.249175 (+1928703us) service_pool.cc:224] Handling call
0709 13:09:01.250610 (+  1435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.202754 26132 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:09:01.253643 26132 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.203464 26138 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.203604 24386 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:01.254604 24386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46594 (request call id 389) took 1994 ms. Trace:
I20260709 13:09:01.254732 23695 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:01.254980 24386 rpcz_store.cc:276] 0709 13:08:59.259869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.333993 (+ 74124us) service_pool.cc:224] Handling call
0709 13:09:01.254535 (+1920542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.251531 26130 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.023149 25775 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:01.209872 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.248530 25990 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.144006 25960 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.144261 26085 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:01.257314 25775 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:01.256987 25960 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.257090 26085 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:01.258149 24387 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:01.259387 26085 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:01.039788 25982 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.260027 23771 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:01.259553 25960 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.261785 25982 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:01.224572 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.245729 23625 raft_consensus.cc:2410] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:01.262072 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:01.263049 23625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1528) took 2538 ms (client timeout 2537 ms). Trace:
W20260709 13:09:01.263499 23629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58448 (request call id 329) took 1203 ms (client timeout 1590 ms). Trace:
W20260709 13:09:01.263542 23625 rpcz_store.cc:269] 0709 13:08:58.724899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.175766 (+2450867us) service_pool.cc:224] Handling call
0709 13:09:01.262951 (+ 87185us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:01.264071 23629 rpcz_store.cc:269] 0709 13:09:00.060120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.251703 (+1191583us) service_pool.cc:224] Handling call
0709 13:09:01.263439 (+ 11736us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.264968 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:01.265753 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 324) took 2814 ms. Trace:
I20260709 13:09:01.265872 23625 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:01.155799 26123 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:01.171883 25885 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.144035 26133 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:01.188082 26058 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:01.206959 26050 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.200115 26131 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:01.266152 23629 rpcz_store.cc:276] 0709 13:08:58.451287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.264951 (+2813664us) service_pool.cc:224] Handling call
0709 13:09:01.265226 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.265413 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.265441 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.265484 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:01.265528 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.265582 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.265695 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.307299 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1335) took 2636 ms. Trace:
I20260709 13:09:01.342358 23776 rpcz_store.cc:276] 0709 13:08:58.671137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.230915 (+2559778us) service_pool.cc:224] Handling call
0709 13:09:01.231190 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.231694 (+   504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.307203 (+ 75509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.266444 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1978) took 1909 ms. Trace:
I20260709 13:09:01.346920 23625 rpcz_store.cc:276] 0709 13:08:59.357233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.264689 (+1907456us) service_pool.cc:224] Handling call
0709 13:09:01.266383 (+  1694us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:01.323632 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 242107us
W20260709 13:09:01.223601 25974 consensus_meta.cc:287] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.871s	user 0.010s	sys 0.002s
W20260709 13:09:01.223533 25677 consensus_meta.cc:287] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.848s	user 0.007s	sys 0.003s
W20260709 13:09:01.353247 26135 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:09:01.353379 25958 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.354278 25958 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:01.267168 26040 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.352039 26143 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:09:01.352065 23621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58448 (request call id 310) took 3523 ms (client timeout 1590 ms). Trace:
W20260709 13:09:01.356518 23621 rpcz_store.cc:269] 0709 13:08:57.828545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.830206 (+  1661us) service_pool.cc:224] Handling call
0709 13:09:01.351841 (+3521635us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54000dc0d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:01.351977 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314607360}
I20260709 13:09:01.357147 25788 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:01.358280 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1949) took 2826 ms. Trace:
I20260709 13:09:01.358799 23621 rpcz_store.cc:276] 0709 13:08:58.532816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.357431 (+2824615us) service_pool.cc:224] Handling call
0709 13:09:01.357770 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.357951 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.357976 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.358017 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:01.358055 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.358105 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.358222 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.360793 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1950) took 2814 ms. Trace:
I20260709 13:09:01.345582 25953 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.361266 23621 rpcz_store.cc:276] 0709 13:08:58.545970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.359701 (+2813731us) service_pool.cc:224] Handling call
0709 13:09:01.360154 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.360367 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.360410 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.360458 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:01.360500 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.360557 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.360684 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.362594 26040 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:01.365679 26020 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:01.366043 23778 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1336) took 2684 ms (client timeout 2243 ms). Trace:
W20260709 13:09:01.366896 23772 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1592) took 2606 ms (client timeout 1742 ms). Trace:
W20260709 13:09:01.386950 23772 rpcz_store.cc:269] 0709 13:08:58.760125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.312079 (+551954us) service_pool.cc:224] Handling call
0709 13:09:01.366660 (+2054581us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b5400430dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:01.366769 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2178284800}
I20260709 13:09:01.369867 26117 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:01.376891 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:01.397208 25951 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:01.221622 26069 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:01.367635 23770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1329) took 2744 ms (client timeout 2238 ms). Trace:
W20260709 13:09:01.403218 23770 rpcz_store.cc:269] 0709 13:08:58.623226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.344447 (+1721221us) service_pool.cc:224] Handling call
0709 13:09:01.367410 (+1022963us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b5400141754. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:01.367551 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946121088}
I20260709 13:09:01.369122 23775 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:01.405094 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 389) took 2695 ms. Trace:
I20260709 13:09:01.405560 23775 rpcz_store.cc:276] 0709 13:08:58.709439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.368489 (+2659050us) service_pool.cc:224] Handling call
0709 13:09:01.368906 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.404730 (+ 35824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.405017 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.371464 26035 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:01.380450 26137 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:09:01.376294 23627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1523) took 2657 ms (client timeout 1870 ms). Trace:
W20260709 13:09:01.407454 23627 rpcz_store.cc:269] 0709 13:08:58.718801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.940393 (+221592us) service_pool.cc:224] Handling call
0709 13:09:01.376050 (+2435657us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b54003241d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:01.376210 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217587456}
I20260709 13:09:01.408875 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1952) took 2830 ms. Trace:
I20260709 13:09:01.409117 23627 rpcz_store.cc:276] 0709 13:08:58.578524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.408202 (+2829678us) service_pool.cc:224] Handling call
0709 13:09:01.408428 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.408556 (+   128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.408570 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.408653 (+    83us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:01.408702 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.408757 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.408834 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:01.377374 23773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1589) took 2671 ms (client timeout 1697 ms). Trace:
W20260709 13:09:01.366485 23778 rpcz_store.cc:269] 0709 13:08:58.704412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.348408 (+1643996us) service_pool.cc:224] Handling call
0709 13:09:01.365805 (+1017397us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b540016ba54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:01.365959 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":982333184}
W20260709 13:09:01.381845 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.314740 23704 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
W20260709 13:09:01.410056 23773 rpcz_store.cc:269] 0709 13:08:58.705989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.953327 (+247338us) service_pool.cc:224] Handling call
0709 13:09:01.377146 (+2423819us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b54000a41d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:01.377294 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4400507776}
I20260709 13:09:01.411075 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:01.340605 26114 consensus_meta.cc:287] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.400s	user 0.008s	sys 0.004s
I20260709 13:09:01.392767 23776 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:01.325537 26149 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.398569 23696 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:09:01.372499 25713 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.321676 26111 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.312933 26085 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.338934 25971 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.412312 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1948) took 2911 ms. Trace:
I20260709 13:09:01.397635 25953 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:09:01.218447 25950 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.422731 26149 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.429592 25950 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:01.422212 23625 rpcz_store.cc:276] 0709 13:08:58.500802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.348754 (+2847952us) service_pool.cc:224] Handling call
0709 13:09:01.411815 (+ 63061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.412000 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.412024 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.412064 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:01.412101 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.412151 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.412257 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.409759 23627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
I20260709 13:09:01.431743 23627 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.432156 23627 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.432499 25885 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.434583 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1514) took 3591 ms. Trace:
I20260709 13:09:01.418277 26114 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:01.437422 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:01.435107 23624 rpcz_store.cc:276] 0709 13:08:57.843762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.845173 (+  1411us) service_pool.cc:224] Handling call
0709 13:08:59.894362 (+2049189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.975880 (+ 81518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.434304 (+1458424us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400098b50. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:01.434493 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4703935744}
I20260709 13:09:01.397817 25951 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:01.440882 23620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1939) took 3006 ms (client timeout 1807 ms). Trace:
W20260709 13:09:01.441306 23620 rpcz_store.cc:269] 0709 13:08:58.434342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.435854 (+  1512us) service_pool.cc:224] Handling call
0709 13:09:01.440678 (+3004824us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54000654d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:01.440805 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072641920}
I20260709 13:09:01.442307 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:01.443058 23620 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:01.430709 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:01.444798 23625 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:01.448156 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:01.449119 23624 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:01.430624 26149 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.461311 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:01.463693 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:01.463792 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:01.464875 23620 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.465608 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:01.466449 23697 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.176729 24389 rpcz_store.cc:276] 0709 13:08:58.846611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.848486 (+  1875us) service_pool.cc:224] Handling call
0709 13:09:00.600163 (+1751677us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b5800010e98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7eee 0000000000375939 00007f2b4625b1e0 00007f2b463240c4 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:09:00.600405 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.600694 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.600739 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.600792 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:00.600831 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.600906 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.601063 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15339392}
I20260709 13:09:01.439075 26085 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.467048 25971 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:01.532804 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:01.490339 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:01.620296 23625 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:09:01.610211 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.488937 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:01.450747 25951 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.611065 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:01.606855 26156 log.cc:927] Time spent T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:09:01.624598 23627 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.468245 26141 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:01.493628 26088 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:01.495918 26114 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:01.631748 26131 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:01.582111 25885 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.609489 26108 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.635784 23627 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.496816 26069 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:09:01.618852 25971 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:01.644274 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:01.660367 23699 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:01.644992 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:01.646914 23697 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
W20260709 13:09:01.650426 23669 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45072 dropped due to backpressure: service queue is full with 50 items
W20260709 13:09:01.640966 26153 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:09:01.657872 23620 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:01.670902 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:01.660792 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52042 (request call id 1953) took 3055 ms. Trace:
I20260709 13:09:01.671802 23620 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:01.663085 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:01.661495 23625 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:01.660445 25885 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:01.662719 24357 connection.cc:256] RPC call timeout handler was delayed by -1.4516904040000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
I20260709 13:09:01.668433 25971 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:01.662600 23669 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45072 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1915)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1909)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1916)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1311)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1908)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1315)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1303)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1917)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1910)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1924)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1918)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1313)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1919)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1920)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1900)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1921)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1923)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1922)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1911)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1310)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1306)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1314)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1926)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1312)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1906)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1890)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1893)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1895)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1896)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1897)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1898)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1899)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1904)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1905)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1907)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1301)
I20260709 13:09:01.671557 23627 rpcz_store.cc:276] 0709 13:08:58.631307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.409672 (+2778365us) service_pool.cc:224] Handling call
0709 13:09:01.656349 (+246677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.741983 23699 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:02.029351 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:01.685583 23622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1524) took 2964 ms (client timeout 1742 ms). Trace:
W20260709 13:09:01.822808 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.239611 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.113840 23623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1967) took 3299 ms (client timeout 1875 ms). Trace:
I20260709 13:09:01.961961 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 385) took 3625 ms. Trace:
I20260709 13:09:02.240624 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:01.777029 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:01.837942 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 381) took 3793 ms. Trace:
W20260709 13:09:02.113229 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.021957 24358 leader_election.cc:336] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.054s (SENT)
W20260709 13:09:01.957882 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.990890 23628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1964) took 3177 ms (client timeout 1907 ms). Trace:
I20260709 13:09:02.162513 24387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 465) took 2131 ms. Trace:
W20260709 13:09:02.241220 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 463840us
I20260709 13:09:01.722139 26085 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:02.062291 23626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1527) took 3338 ms (client timeout 1964 ms). Trace:
W20260709 13:09:02.230696 23629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.041s	sys 0.106s
I20260709 13:09:02.112535 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1882) took 1154 ms. Trace:
I20260709 13:09:02.140483 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.249881 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:02.251070 23624 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:02.256165 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:02.276196 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.898861 26161 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:09:01.899616 26163 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:09:02.140755 25962 consensus_meta.cc:287] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.962s	user 0.013s	sys 0.000s
W20260709 13:09:02.251796 23622 rpcz_store.cc:269] 0709 13:08:58.720908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.929462 (+208554us) service_pool.cc:224] Handling call
0709 13:09:01.685349 (+2755887us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54002b4654. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:01.685495 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593643776}
I20260709 13:09:02.293035 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:02.295059 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:02.253065 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.252182 24357 connection.cc:256] RPC call timeout handler was delayed by -1.377890404000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 13:09:02.298203 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 386) took 3489 ms. Trace:
I20260709 13:09:02.300683 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1956) took 3595 ms. Trace:
I20260709 13:09:02.301493 23622 rpcz_store.cc:276] 0709 13:08:58.705522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.299166 (+3593644us) service_pool.cc:224] Handling call
0709 13:09:02.299550 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.300173 (+   623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.300232 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.300293 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:02.300351 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.300432 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.300607 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.717876 26058 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:02.251216 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.306619 23622 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:02.307163 23699 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:02.276480 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:02.247681 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.307575 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1958) took 3580 ms. Trace:
W20260709 13:09:02.276547 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 254639us
I20260709 13:09:02.307672 23624 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:02.258118 23628 rpcz_store.cc:269] 0709 13:08:58.813472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.949698 (+1136226us) service_pool.cc:224] Handling call
0709 13:09:01.990546 (+2040848us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b5400244fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:01.990764 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927262592}
W20260709 13:09:02.265964 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.309886 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.310705 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.264176 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1880) took 1437 ms. Trace:
I20260709 13:09:02.313346 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.312028 23701 rpcz_store.cc:276] 0709 13:09:00.826898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.955268 (+128370us) service_pool.cc:224] Handling call
0709 13:09:00.955830 (+   562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.956240 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.956278 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.956845 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.899161 (+942316us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b18002dcb20. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1
0709 13:09:01.899354 (+   193us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:01.899392 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.899460 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.244546 (+345086us) raft_consensus.cc:1685] finished
0709 13:09:02.244564 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.264094 (+ 19530us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8976,"raft.queue_time_us":189910,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":12867,"spinlock_wait_cycles":22009216,"thread_start_us":235655,"threads_started":1,"wal-append.queue_time_us":352905}
I20260709 13:09:02.313961 23699 raft_consensus.cc:2376] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6. Re-sending same reply.
I20260709 13:09:02.315462 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.316270 23778 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
W20260709 13:09:02.267505 23629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.042s	sys 0.106s
I20260709 13:09:02.317310 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.317579 23697 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:02.254627 23620 raft_consensus.cc:2376] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4. Re-sending same reply.
I20260709 13:09:02.319260 23620 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:02.275503 23627 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.319976 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1959) took 3581 ms. Trace:
W20260709 13:09:02.267259 23626 rpcz_store.cc:269] 0709 13:08:58.724189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.176970 (+452781us) service_pool.cc:224] Handling call
0709 13:09:02.061913 (+2884943us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b54002b4b54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:02.062150 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87987968}
I20260709 13:09:01.703902 26139 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.698668 26069 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.685736 26123 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:02.324785 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.325754 23778 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:02.253875 23623 rpcz_store.cc:269] 0709 13:08:58.814516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.333152 (+518636us) service_pool.cc:224] Handling call
0709 13:09:02.113529 (+2780377us) spinlock_profiling.cc:243] Waited 77.7 ms on lock 0x7b5400064ad4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:02.113720 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178710784}
I20260709 13:09:02.329072 23623 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:02.329788 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1965) took 3516 ms. Trace:
I20260709 13:09:02.330112 23623 rpcz_store.cc:276] 0709 13:08:58.813863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.328591 (+3514728us) service_pool.cc:224] Handling call
0709 13:09:02.328896 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.329540 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.329728 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.255522 23774 rpcz_store.cc:276] 0709 13:08:58.044357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.045147 (+   790us) service_pool.cc:224] Handling call
0709 13:08:58.059802 (+ 14655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.101982 (+1042180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.837607 (+2735625us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54003417d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:01.837853 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012816256}
I20260709 13:09:01.789130 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:02.026095 26040 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:01.789654 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:01.731267 25948 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:01.869189 25898 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:02.346166 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.290767 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1587) took 3613 ms. Trace:
I20260709 13:09:02.347681 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.347486 23776 rpcz_store.cc:276] 0709 13:08:58.677197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.350376 (+2673179us) service_pool.cc:224] Handling call
0709 13:09:01.392625 (+ 42249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.415975 (+ 23350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.290553 (+874578us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b540016ba50. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:02.290702 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96187264}
I20260709 13:09:02.349273 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.350200 23776 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:01.960841 25880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46594 (request call id 361) took 9323 ms. Trace:
I20260709 13:09:01.754350 26133 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:02.351411 25880 rpcz_store.cc:276] 0709 13:08:52.618402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.635846 (+ 17444us) service_pool.cc:224] Handling call
0709 13:08:53.005059 (+369213us) ts_tablet_manager.cc:934] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
0709 13:08:59.420065 (+6415006us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:01.362417 (+1942352us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:01.362557 (+   140us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:01.722149 (+359592us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:01.798256 (+ 76107us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:01.865520 (+ 67264us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:01.928259 (+ 62739us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":30295,"tablet-copy.queue_time_us":345216,"thread_start_us":598011,"threads_started":2}
I20260709 13:09:02.354343 25880 tablet_copy_client.cc:806] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:02.355074 25880 tablet_copy_client.cc:670] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:02.358758 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:02.361130 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:02.298743 24394 rpcz_store.cc:276] 0709 13:08:58.808373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.808517 (+   144us) service_pool.cc:224] Handling call
0709 13:08:58.808857 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:58.831844 (+ 22987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.831878 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.854552 (+ 22674us) log.cc:844] Serialized 26 byte log entry
0709 13:08:59.140042 (+285490us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:01.971909 (+2831867us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b18000b37a0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b44d043c7 00007f2b413169a7 00007f2b413260bf
0709 13:09:01.972142 (+   233us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.285743 (+313601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.285820 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.285859 (+    39us) raft_consensus.cc:1685] finished
0709 13:09:02.297999 (+ 12140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.298137 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":130725,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1849,"raft.queue_time_us":2618,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":34438,"spinlock_wait_cycles":3545856,"thread_start_us":645453,"threads_started":3,"wal-append.queue_time_us":371150,"wal-append.run_cpu_time_us":2313,"wal-append.run_wall_time_us":1100868}
I20260709 13:09:02.257504 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:02.308043 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.310581 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.363116 25885 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:02.363687 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.364811 23770 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 3: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:02.367237 25971 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.372196 23622 rpcz_store.cc:276] 0709 13:08:58.727615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.303625 (+3576010us) service_pool.cc:224] Handling call
0709 13:09:02.306360 (+  2735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.307244 (+   884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.307503 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.258661 24387 rpcz_store.cc:276] 0709 13:09:00.031395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.032838 (+  1443us) service_pool.cc:224] Handling call
0709 13:09:01.257924 (+1225086us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.258552 (+   628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.162162 (+903610us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002f7450. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:02.162413 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816428800}
I20260709 13:09:02.321959 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.270394 26074 raft_consensus.cc:476] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:02.396535 26040 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.396884 26074 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.397101 26040 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:02.397580 26074 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:09:02.327797 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1961) took 3567 ms. Trace:
W20260709 13:09:02.400274 23771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1332) took 3775 ms (client timeout 2791 ms). Trace:
I20260709 13:09:02.401360 23699 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:09:02.403337 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.338927 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.406536 23775 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 4: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:02.339661 24388 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:09:02.407604 24388 pending_rounds.cc:85] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Aborting all ops after (but not including) 4
I20260709 13:09:02.408012 24388 pending_rounds.cc:107] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:09:02.408380 24388 raft_consensus.cc:2917] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:09:02.408914 24388 raft_consensus.cc:2889] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:02.340903 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.410930 23701 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:02.412117 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.412814 23701 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.343794 26139 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:02.345511 24389 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:02.351137 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.254895 24390 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:09:02.415995 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:02.417033 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:02.417531 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:02.418453 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:02.418943 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:02.421630 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:02.269784 23700 rpcz_store.cc:276] 0709 13:09:00.958124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.958255 (+   131us) service_pool.cc:224] Handling call
0709 13:09:00.958645 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.396164 (+437519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.396203 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.413659 (+ 17456us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.618834 (+205175us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:01.618875 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.064503 (+445628us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b5400405954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:02.064581 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.064693 (+   112us) raft_consensus.cc:1685] finished
0709 13:09:02.064708 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.112407 (+ 47699us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1256,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":1005100928,"thread_start_us":170625,"threads_started":1,"wal-append.queue_time_us":242315}
I20260709 13:09:02.422976 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.424032 23700 raft_consensus.cc:2410] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:02.424957 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.425670 23700 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:09:02.426663 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.430933 26139 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:02.432703 23699 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:02.434024 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.435086 23699 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:02.337723 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.436483 23774 raft_consensus.cc:2410] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:02.368572 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:02.271063 25744 consensus_queue.cc:1059] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:09:02.437898 25744 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:02.438519 25744 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:02.370182 25951 consensus_meta.cc:287] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.003s
I20260709 13:09:02.440264 25951 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:02.440907 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1883) took 1481 ms. Trace:
W20260709 13:09:02.364831 26158 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.599s	user 0.006s	sys 0.000s
I20260709 13:09:02.445405 25951 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:02.400096 23628 rpcz_store.cc:276] 0709 13:08:58.760517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.318864 (+3558347us) service_pool.cc:224] Handling call
0709 13:09:02.319256 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.319502 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.327281 (+  7779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.327358 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:02.327434 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.327526 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.327685 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.447688 25744 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:02.448944 25744 raft_consensus.cc:3055] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:02.449352 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:02.449977 24394 raft_consensus.cc:2410] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:02.371105 24386 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:02.451141 23628 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:02.393177 23623 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:02.452611 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:02.452852 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1966) took 3638 ms. Trace:
I20260709 13:09:02.453291 23628 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:02.453495 23623 rpcz_store.cc:276] 0709 13:08:58.814193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.330880 (+3516687us) service_pool.cc:224] Handling call
0709 13:09:02.392825 (+ 61945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.452463 (+ 59638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.452783 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.320382 23620 rpcz_store.cc:276] 0709 13:08:58.738953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.318778 (+3579825us) service_pool.cc:224] Handling call
0709 13:09:02.319068 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.319663 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.319913 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.456444 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:02.459033 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1968) took 3612 ms. Trace:
I20260709 13:09:02.459617 23620 rpcz_store.cc:276] 0709 13:08:58.846948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.458033 (+3611085us) service_pool.cc:224] Handling call
0709 13:09:02.458386 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.458615 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.458653 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.458709 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:02.458776 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.458845 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.458966 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.427615 23700 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:02.406563 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:02.368104 23695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1874) took 1548 ms (client timeout 1666 ms). Trace:
I20260709 13:09:02.464777 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1970) took 3517 ms. Trace:
W20260709 13:09:02.465122 23695 rpcz_store.cc:269] 0709 13:09:00.820060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.820231 (+   171us) service_pool.cc:224] Handling call
0709 13:09:02.367926 (+1547695us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400356e54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:02.368038 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505032960}
I20260709 13:09:02.401693 23769 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:02.400951 23771 rpcz_store.cc:269] 0709 13:08:58.624907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.871155 (+2246248us) service_pool.cc:224] Handling call
0709 13:09:02.400033 (+1528878us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54000596d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:02.400191 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544246528}
I20260709 13:09:02.404017 26119 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:02.467579 26119 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:02.468274 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1971) took 3520 ms. Trace:
I20260709 13:09:02.468638 26119 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:02.393970 23778 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:02.254249 23777 rpcz_store.cc:276] 0709 13:08:58.336118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.336380 (+   262us) service_pool.cc:224] Handling call
0709 13:08:58.336678 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.375964 (+2039286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.961666 (+1585702us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b5400347454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:01.961879 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4562323328}
I20260709 13:09:02.441787 23704 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:02.441394 23698 rpcz_store.cc:276] 0709 13:09:00.959289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.959436 (+   147us) service_pool.cc:224] Handling call
0709 13:09:00.959896 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.345379 (+385483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.345419 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.393971 (+ 48552us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.487446 (+ 93475us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:01.487508 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.487626 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.440674 (+953048us) raft_consensus.cc:1685] finished
0709 13:09:02.440695 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.440842 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":850,"raft.queue_time_us":251017,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":8707,"thread_start_us":445833,"threads_started":2,"wal-append.queue_time_us":264253}
W20260709 13:09:02.376482 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 119020us
I20260709 13:09:02.323779 25958 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:02.474954 25892 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:02.477798 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:02.479166 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.465296 23623 rpcz_store.cc:276] 0709 13:08:58.947289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.463606 (+3516317us) service_pool.cc:224] Handling call
0709 13:09:02.464009 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.464241 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.464279 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.464424 (+   145us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:02.464488 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.464566 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.464696 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.287883 26078 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:02.286439 25945 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:02.287642 25631 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:02.516526 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.518802 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.519287 23778 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:02.519656 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1910) took 1140 ms. Trace:
I20260709 13:09:02.520066 23700 rpcz_store.cc:276] 0709 13:09:01.379130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.518586 (+1139456us) service_pool.cc:224] Handling call
0709 13:09:02.519598 (+  1012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.520723 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.521550 23699 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:09:02.521960 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.522120 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1918) took 1080 ms. Trace:
I20260709 13:09:02.468755 23622 rpcz_store.cc:276] 0709 13:08:58.948035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.467223 (+3519188us) service_pool.cc:224] Handling call
0709 13:09:02.467562 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.467814 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.467851 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.467907 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:02.467971 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.468041 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.468210 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:59.267220 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:02.487674 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:02.489264 26078 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:02.490604 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1912) took 1111 ms. Trace:
I20260709 13:09:02.494069 26050 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:02.491652 23696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1875) took 1671 ms (client timeout 1944 ms). Trace:
I20260709 13:09:02.525111 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 326) took 3268 ms. Trace:
W20260709 13:09:02.525409 23696 rpcz_store.cc:269] 0709 13:09:00.820657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.820774 (+   117us) service_pool.cc:224] Handling call
0709 13:09:02.491472 (+1670698us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54003d22d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:02.491584 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819026176}
I20260709 13:09:02.525642 23622 rpcz_store.cc:276] 0709 13:08:59.256931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.524119 (+3267188us) service_pool.cc:224] Handling call
0709 13:09:02.524478 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.524692 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.524728 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.524795 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:02.524855 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.524928 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.525049 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.495560 23769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1584) took 3822 ms. Trace:
I20260709 13:09:02.527097 23769 rpcz_store.cc:276] 0709 13:08:58.673293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.255795 (+2582502us) service_pool.cc:224] Handling call
0709 13:09:02.401464 (+1145669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.466555 (+ 65091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.495371 (+ 28816us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000596d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:02.495503 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2620948352}
I20260709 13:09:02.497416 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.493952 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1972) took 3536 ms. Trace:
I20260709 13:09:02.506891 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:02.522604 23697 raft_consensus.cc:2376] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7. Re-sending same reply.
I20260709 13:09:02.530287 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1917) took 1105 ms. Trace:
I20260709 13:09:02.530697 23697 rpcz_store.cc:276] 0709 13:09:01.425256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.521739 (+1096483us) service_pool.cc:224] Handling call
0709 13:09:02.530217 (+  8478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.531559 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 325) took 3275 ms. Trace:
I20260709 13:09:02.531767 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.532622 23697 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:02.524377 23704 rpcz_store.cc:276] 0709 13:09:01.379669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.410827 (+ 31158us) service_pool.cc:224] Handling call
0709 13:09:02.490392 (+1079565us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400195354. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:02.490541 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2368293248}
W20260709 13:09:02.481182 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 66764.9us
I20260709 13:09:02.533783 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.534430 23696 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:02.534902 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1920) took 1072 ms. Trace:
I20260709 13:09:02.535197 23696 rpcz_store.cc:276] 0709 13:09:01.462956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.526743 (+1063787us) service_pool.cc:224] Handling call
0709 13:09:02.534850 (+  8107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.529553 23623 rpcz_store.cc:276] 0709 13:08:58.957799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.491829 (+3534030us) service_pool.cc:224] Handling call
0709 13:09:02.492217 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.493494 (+  1277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.493534 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.493598 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:02.493653 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.493748 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.493881 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.537889 23623 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:02.405433 26074 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:02.512635 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.516659 25631 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:02.517730 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:02.518100 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.540108 23698 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:02.532043 23628 rpcz_store.cc:276] 0709 13:08:59.256578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.511657 (+3255079us) service_pool.cc:224] Handling call
0709 13:09:02.530933 (+ 19276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.531184 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.531208 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.531320 (+   112us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:02.531365 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.531417 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.531510 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.522598 23699 rpcz_store.cc:276] 0709 13:09:01.441355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.520435 (+1079080us) service_pool.cc:224] Handling call
0709 13:09:02.522048 (+  1613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.544750 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.545631 23699 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:02.546792 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.548671 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:02.549754 24389 raft_consensus.cc:2410] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:09:02.520885 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.529007 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 327) took 3271 ms. Trace:
I20260709 13:09:02.481673 23701 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:09:02.550734 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1919) took 1091 ms. Trace:
I20260709 13:09:02.550827 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1908) took 1172 ms. Trace:
I20260709 13:09:02.551185 23700 rpcz_store.cc:276] 0709 13:09:01.458889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.520669 (+1061780us) service_pool.cc:224] Handling call
0709 13:09:02.550631 (+ 29962us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.551548 23701 rpcz_store.cc:276] 0709 13:09:01.378492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.411790 (+1033298us) service_pool.cc:224] Handling call
0709 13:09:02.550750 (+138960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.552218 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.552928 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1911) took 1173 ms. Trace:
I20260709 13:09:02.552736 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.553444 23700 rpcz_store.cc:276] 0709 13:09:01.379400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.551990 (+1172590us) service_pool.cc:224] Handling call
0709 13:09:02.552872 (+   882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.554500 23622 rpcz_store.cc:276] 0709 13:08:59.257243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.528039 (+3270796us) service_pool.cc:224] Handling call
0709 13:09:02.528385 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.528599 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.528638 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.528690 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:02.528745 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.528812 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.528945 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.557194 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.557961 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 328) took 3292 ms. Trace:
I20260709 13:09:02.558421 23696 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:02.558369 23623 rpcz_store.cc:276] 0709 13:08:59.265343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.537323 (+3271980us) service_pool.cc:224] Handling call
0709 13:09:02.537691 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.538462 (+   771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.557897 (+ 19435us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:02.559183 24392 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.031s	sys 0.068s
I20260709 13:09:02.560351 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1921) took 1096 ms. Trace:
I20260709 13:09:02.561250 23696 rpcz_store.cc:276] 0709 13:09:01.463678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.535897 (+1072219us) service_pool.cc:224] Handling call
0709 13:09:02.560276 (+ 24379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.399540 26040 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:02.563198 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.564164 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.570889 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1922) took 1094 ms. Trace:
I20260709 13:09:02.571259 23699 rpcz_store.cc:276] 0709 13:09:01.476368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.546479 (+1070111us) service_pool.cc:224] Handling call
0709 13:09:02.570830 (+ 24351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.571511 23697 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
W20260709 13:09:02.564705 23703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.045s	sys 0.054s
I20260709 13:09:02.572234 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:02.572539 23703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.045s	sys 0.054s
I20260709 13:09:02.573307 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.596362 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1973) took 3285 ms. Trace:
I20260709 13:09:02.596776 23625 rpcz_store.cc:276] 0709 13:08:59.311129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.581166 (+3270037us) service_pool.cc:224] Handling call
0709 13:09:02.595873 (+ 14707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.596050 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.596074 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.596115 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:02.596154 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.596203 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.596310 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.570457 24391 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
W20260709 13:09:02.559623 24392 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.031s	sys 0.069s
I20260709 13:09:02.457064 23669 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45086 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1917)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1910)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1924)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1918)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1313)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1919)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1920)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1900)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1921)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1923)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1922)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1911)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1310)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1306)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1314)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1926)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1323)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1330)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1317)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1312)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1906)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1328)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1325)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1890)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1893)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1895)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1896)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1897)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1898)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1899)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1904)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1905)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1907)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1318)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1320)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1326)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1327)
I20260709 13:09:02.573979 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.598953 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1976) took 3242 ms. Trace:
I20260709 13:09:02.599499 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1924) took 1122 ms. Trace:
I20260709 13:09:02.600037 23695 rpcz_store.cc:276] 0709 13:09:01.476980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.523250 (+1046270us) service_pool.cc:224] Handling call
0709 13:09:02.599444 (+ 76194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.567097 23624 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:02.601073 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1989) took 1145 ms. Trace:
I20260709 13:09:02.601383 23624 rpcz_store.cc:276] 0709 13:09:01.455393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.276199 (+820806us) service_pool.cc:224] Handling call
0709 13:09:02.601020 (+324821us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.602746 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1977) took 3246 ms. Trace:
I20260709 13:09:02.603109 23624 rpcz_store.cc:276] 0709 13:08:59.356824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.602031 (+3245207us) service_pool.cc:224] Handling call
0709 13:09:02.602295 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.602462 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.602484 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.602522 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.602562 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.602609 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.602698 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.575367 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.576673 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.604490 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1903) took 1227 ms. Trace:
I20260709 13:09:02.604781 23701 rpcz_store.cc:276] 0709 13:09:01.376861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.554398 (+1177537us) service_pool.cc:224] Handling call
0709 13:09:02.604438 (+ 50040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.577788 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.605295 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.605633 23778 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:02.606329 23771 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:02.584043 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.584352 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.607259 23697 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:09:02.608107 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.609126 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.609740 23697 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:02.585191 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.610289 23773 raft_consensus.cc:2368] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7.
I20260709 13:09:02.569762 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.586330 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.611230 23704 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.554709 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.590291 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1596) took 3777 ms. Trace:
W20260709 13:09:02.592991 24393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.047s	sys 0.064s
I20260709 13:09:02.569140 23627 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:02.614640 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 1990) took 1152 ms. Trace:
W20260709 13:09:02.615576 24393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.047s	sys 0.064s
I20260709 13:09:02.615185 23627 rpcz_store.cc:276] 0709 13:09:01.462416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.249596 (+787180us) service_pool.cc:224] Handling call
0709 13:09:02.614582 (+364986us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18176}
I20260709 13:09:02.599375 23625 rpcz_store.cc:276] 0709 13:08:59.356372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.597993 (+3241621us) service_pool.cc:224] Handling call
0709 13:09:02.598423 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.598604 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.598629 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.598669 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.598712 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.598765 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.598900 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.636929 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.637657 23697 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:02.638461 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.640197 23699 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:02.640861 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1926) took 1154 ms. Trace:
I20260709 13:09:02.641335 23699 rpcz_store.cc:276] 0709 13:09:01.486806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.573078 (+1086272us) service_pool.cc:224] Handling call
0709 13:09:02.640791 (+ 67713us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.614315 23772 rpcz_store.cc:276] 0709 13:08:58.812500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.387948 (+2575448us) service_pool.cc:224] Handling call
0709 13:09:01.388372 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:01.388822 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.388852 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:01.417076 (+ 28224us) log.cc:844] Serialized 52 byte log entry
0709 13:09:01.582533 (+165457us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:01.582572 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.582640 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.589969 (+1007329us) raft_consensus.cc:1685] finished
0709 13:09:02.590000 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.590195 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":464,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":11906,"thread_start_us":121696,"threads_started":1,"wal-append.queue_time_us":220688}
I20260709 13:09:02.644418 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.615697 23700 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:02.645948 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.646162 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.646713 23769 raft_consensus.cc:2376] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4. Re-sending same reply.
I20260709 13:09:02.636987 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1923) took 1160 ms. Trace:
I20260709 13:09:02.449380 25744 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:02.647330 23698 rpcz_store.cc:276] 0709 13:09:01.476655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.540948 (+1064293us) service_pool.cc:224] Handling call
0709 13:09:02.636922 (+ 95974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.639513 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.651449 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1906) took 1273 ms. Trace:
I20260709 13:09:02.651934 23697 rpcz_store.cc:276] 0709 13:09:01.377839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.639308 (+1261469us) service_pool.cc:224] Handling call
0709 13:09:02.651382 (+ 12074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.650077 23700 raft_consensus.cc:2368] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:09:02.652361 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.654618 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.652721 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.653532 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.655490 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:02.649278 23704 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:02.562672 26142 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:09:02.656713 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1900) took 1316 ms. Trace:
I20260709 13:09:02.660048 23704 rpcz_store.cc:276] 0709 13:09:01.340008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.562775 (+1222767us) service_pool.cc:224] Handling call
0709 13:09:02.656658 (+ 93883us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.657931 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.661553 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.656243 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1309) took 1008 ms. Trace:
I20260709 13:09:02.662628 23701 rpcz_store.cc:276] 0709 13:09:01.648080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.605341 (+957261us) service_pool.cc:224] Handling call
0709 13:09:02.656185 (+ 50844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.655954 23698 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:02.668869 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1897) took 1393 ms. Trace:
I20260709 13:09:02.669248 23699 rpcz_store.cc:276] 0709 13:09:01.275385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.668038 (+1392653us) service_pool.cc:224] Handling call
0709 13:09:02.668355 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.668535 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.668559 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.668603 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:02.668653 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.668707 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.668809 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.670855 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1898) took 1371 ms. Trace:
I20260709 13:09:02.661494 23695 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:02.661034 23696 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:02.671203 23699 rpcz_store.cc:276] 0709 13:09:01.299087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.670110 (+1371023us) service_pool.cc:224] Handling call
0709 13:09:02.670387 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.670542 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.670565 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.670608 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:02.670660 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.670711 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.670802 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.673281 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1896) took 1448 ms. Trace:
I20260709 13:09:02.673326 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1904) took 1296 ms. Trace:
I20260709 13:09:02.673700 23698 rpcz_store.cc:276] 0709 13:09:01.224580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.672503 (+1447923us) service_pool.cc:224] Handling call
0709 13:09:02.672823 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.672997 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.673021 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.673059 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:02.673098 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.673147 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.673231 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13696}
I20260709 13:09:02.673808 23699 rpcz_store.cc:276] 0709 13:09:01.377183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.672506 (+1295323us) service_pool.cc:224] Handling call
0709 13:09:02.672855 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.673025 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.673050 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.673088 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.673134 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.673183 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.673274 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25216}
I20260709 13:09:02.675323 23698 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:09:02.671571 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:02.676532 23696 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:02.676792 23699 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.677007 23704 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.677197 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1905) took 1299 ms. Trace:
I20260709 13:09:02.677505 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1907) took 1299 ms. Trace:
I20260709 13:09:02.677673 23698 rpcz_store.cc:276] 0709 13:09:01.377493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.674928 (+1297435us) service_pool.cc:224] Handling call
0709 13:09:02.675164 (+   236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.675653 (+   489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.677142 (+  1489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.678033 23699 rpcz_store.cc:276] 0709 13:09:01.378167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.675402 (+1297235us) service_pool.cc:224] Handling call
0709 13:09:02.675758 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.677245 (+  1487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.677452 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.679039 23698 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:02.587483 25879 consensus_queue.cc:1059] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:09:02.679668 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1300) took 1082 ms. Trace:
I20260709 13:09:02.680311 23698 rpcz_store.cc:276] 0709 13:09:01.596903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.678622 (+1081719us) service_pool.cc:224] Handling call
0709 13:09:02.678892 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.679449 (+   557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.679609 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.681128 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.679641 23699 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:02.681881 23769 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:02.682605 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1899) took 1356 ms. Trace:
I20260709 13:09:02.682960 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.592017 26058 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:09:02.710709 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.682969 23696 rpcz_store.cc:276] 0709 13:09:01.325968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.672176 (+1346208us) service_pool.cc:224] Handling call
0709 13:09:02.676366 (+  4190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.682375 (+  6009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.682550 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.697206 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.685376 23777 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:09:02.684049 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1301) took 1073 ms. Trace:
I20260709 13:09:02.720975 23774 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
W20260709 13:09:02.718808 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47295.2us
I20260709 13:09:02.719975 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.683269 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.722259 23772 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:02.722481 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:02.706490 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.724015 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.724186 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.721112 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.690044 23704 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:02.725761 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.725944 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.685403 23697 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:09:02.726739 23777 raft_consensus.cc:2368] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:09:02.723225 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1895) took 1515 ms. Trace:
I20260709 13:09:02.725069 23743 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:02.727346 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.727298 23701 rpcz_store.cc:276] 0709 13:09:01.207973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.676073 (+1468100us) service_pool.cc:224] Handling call
0709 13:09:02.722697 (+ 46624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.722897 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.722923 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.722964 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:02.723017 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.723070 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.723175 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.721134 23699 rpcz_store.cc:276] 0709 13:09:01.610952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.679153 (+1068201us) service_pool.cc:224] Handling call
0709 13:09:02.679447 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.683704 (+  4257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.683974 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.728433 23743 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:02.725013 23695 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:02.729609 23699 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:02.730300 23695 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:09:02.725926 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1893) took 1669 ms. Trace:
I20260709 13:09:02.734956 23773 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:02.733368 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.735929 23778 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:02.736342 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.735829 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:02.737452 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.738121 23778 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:02.735035 23704 rpcz_store.cc:276] 0709 13:09:01.056158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.671656 (+1615498us) service_pool.cc:224] Handling call
0709 13:09:02.676889 (+  5233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.725664 (+ 48775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.725866 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.738996 23701 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:02.727902 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.739207 23743 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:02.719408 26050 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:02.741537 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.740576 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.741354 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.742264 23776 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:02.741564 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1890) took 1777 ms. Trace:
I20260709 13:09:02.743485 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.743453 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:02.744077 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.744654 23704 raft_consensus.cc:2410] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:02.750792 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:02.748042 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.745122 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.744705 23771 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:02.731508 26085 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:02.743609 23697 rpcz_store.cc:276] 0709 13:09:00.964491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.668038 (+1703547us) service_pool.cc:224] Handling call
0709 13:09:02.685184 (+ 17146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.741278 (+ 56094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.741490 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.764364 23769 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:02.740396 26074 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:02.766106 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:02.742334 26027 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:02.767508 25879 raft_consensus.cc:3055] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:02.768165 25879 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:02.769371 25879 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:02.773684 26027 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:02.775143 26027 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:02.777561 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1881) took 1819 ms. Trace:
I20260709 13:09:02.729724 26123 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:09:02.773833 26078 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:02.781459 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.782608 23526 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 178) took 15325 ms (client timeout 15000 ms). Trace:
I20260709 13:09:02.778071 23703 rpcz_store.cc:276] 0709 13:09:00.957777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.957977 (+   200us) service_pool.cc:224] Handling call
0709 13:09:00.958444 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.972486 (+1014042us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b180042b800. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b41304060 00007f2b41304bfb 00007f2b4130f64b
0709 13:09:01.980462 (+  7976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.980513 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.981186 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.573140 (+591954us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:02.573184 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.573476 (+   292us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.777237 (+203761us) raft_consensus.cc:1685] finished
0709 13:09:02.777264 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.777490 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2468,"raft.queue_time_us":250864,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":13061,"spinlock_wait_cycles":3524352,"thread_start_us":820221,"threads_started":2,"wal-append.queue_time_us":722524}
I20260709 13:09:02.746374 26040 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:02.794348 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:02.800591 23771 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:02.782176 26172 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:02.849098 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.864176 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:02.766731 26074 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:02.786643 23526 rpcz_store.cc:269] 0709 13:08:47.439194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.441506 (+  2312us) service_pool.cc:224] Handling call
0709 13:09:02.764486 (+15322980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:54.608884 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:54.634621 (+ 25737us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:54.640939 (+  6318us) write_op.cc:435] Acquired schema lock
0709 13:08:54.640981 (+    42us) tablet.cc:662] Decoding operations
0709 13:08:54.774568 (+133587us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:54.774623 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:54.774657 (+    34us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:08:54.891438 (+116781us) tablet.cc:701] Row locks acquired
0709 13:08:54.891479 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:08:54.891657 (+   178us) write_op.cc:270] Start()
0709 13:08:54.923993 (+ 32336us) write_op.cc:276] Timestamp: P: 1783602534891583 usec, L: 0
0709 13:08:54.925819 (+  1826us) op_driver.cc:348] REPLICATION: starting
0709 13:08:54.950301 (+ 24482us) log.cc:844] Serialized 9412 byte log entry
0709 13:08:55.425492 (+475191us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:08:56.137195 (+711703us) op_driver.cc:464] REPLICATION: finished
0709 13:08:56.542035 (+404840us) write_op.cc:301] APPLY: starting
0709 13:08:56.542130 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:56.542595 (+   465us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:56.542639 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:57.064348 (+521709us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:57.160349 (+ 96001us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 13:08:57.160438 (+    89us) write_op.cc:312] APPLY: finished
0709 13:08:57.161359 (+   921us) log.cc:844] Serialized 164 byte log entry
0709 13:08:57.422951 (+261592us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.636435 (+213484us) write_op.cc:454] Released schema lock
0709 13:08:57.653163 (+ 16728us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:57.666319 (+ 13156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.666350 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1264852,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":400126,"apply.run_cpu_time_us":63365,"apply.run_wall_time_us":1124247,"num_ops":24,"prepare.queue_time_us":256547,"prepare.run_cpu_time_us":11090,"prepare.run_wall_time_us":419144,"raft.queue_time_us":216760,"raft.run_cpu_time_us":14176,"raft.run_wall_time_us":277816,"replication_time_us":1171449,"spinlock_wait_cycles":6156544,"thread_start_us":619530,"threads_started":5,"wal-append.queue_time_us":606582,"wal-append.run_cpu_time_us":31271,"wal-append.run_wall_time_us":3033151}]]}
W20260709 13:09:02.897018 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.898371 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 117944us
I20260709 13:09:02.899149 26085 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:02.736996 25744 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:03.078795 24357 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.012s
W20260709 13:09:03.075443 23593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.018s	sys 0.062s
W20260709 13:09:02.953231 23629 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.007s	sys 0.002s
W20260709 13:09:03.079926 23593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.019s	sys 0.062s
W20260709 13:09:03.080300 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 820616us
I20260709 13:09:03.074543 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:03.081419 24358 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.013s	sys 0.006s
W20260709 13:09:03.081933 24358 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.013s	sys 0.006s
I20260709 13:09:03.013296 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:02.780673 26050 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.232s
W20260709 13:09:03.078651 23742 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.007s	sys 0.006s
W20260709 13:09:03.082815 23742 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.007s	sys 0.006s
I20260709 13:09:03.083065 23774 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:03.078433 23667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.003s	sys 0.015s
W20260709 13:09:03.083801 23667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.004s	sys 0.015s
I20260709 13:09:03.051316 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:03.081068 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.082386 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 773798us
W20260709 13:09:03.093521 23629 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.007s	sys 0.005s
W20260709 13:09:02.953490 23621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.002s	sys 0.006s
W20260709 13:09:03.094453 23621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.004s	sys 0.008s
I20260709 13:09:03.083760 23774 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:03.092904 23701 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:03.084618 23696 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
W20260709 13:09:02.953020 23592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.000s	sys 0.008s
W20260709 13:09:03.096434 23592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.003s	sys 0.010s
I20260709 13:09:02.924432 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:03.097189 23592 connection.cc:256] RPC call timeout handler was delayed by -2.3579014680000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 13:09:03.051498 26040 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:03.097373 23697 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:03.079321 24357 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.012s
W20260709 13:09:03.083124 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 786854us
W20260709 13:09:03.100998 24358 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.514s (SENT)
I20260709 13:09:03.101477 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:03.102211 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.104256 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 394) took 1150 ms. Trace:
W20260709 13:09:03.099573 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 524043us
I20260709 13:09:03.109480 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:02.821683 26172 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:03.098418 23592 connection.cc:256] RPC call timeout handler was delayed by -2.32910146800009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 13:09:03.128772 23592 connection.cc:256] RPC call timeout handler was delayed by -2.2121014680000144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 13:09:03.074122 25879 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.889159 25631 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:03.012779 26074 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.095706 23774 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:03.149127 23774 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:03.136947 24359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.002s	sys 0.014s
W20260709 13:09:03.130237 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.150498 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.143453 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:03.150504 24359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.002s	sys 0.014s
I20260709 13:09:03.151351 23703 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
W20260709 13:09:03.151513 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 556680us
I20260709 13:09:03.015301 26011 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.215s
I20260709 13:09:03.140492 25744 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.163861 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.168587 23696 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:03.129813 26172 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.171191 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.157088 26123 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:03.192716 24393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.022s	sys 0.015s
W20260709 13:09:03.194903 24393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.022s	sys 0.015s
I20260709 13:09:03.182761 26078 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:03.200878 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 470) took 1418 ms. Trace:
I20260709 13:09:03.185477 26175 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.207505 24393 rpcz_store.cc:276] 0709 13:09:01.782928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.783058 (+   130us) service_pool.cc:224] Handling call
0709 13:09:01.783398 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.783693 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:02.078558 (+294865us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.195343 (+1116785us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.195418 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:03.195499 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.195590 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.200746 (+  5156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":555091,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":127193,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":19102,"thread_start_us":1380337,"threads_started":3,"wal-append.queue_time_us":574210}
I20260709 13:09:03.164528 26040 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:03.207468 26191 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:03.242666 26069 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.918s	user 0.011s	sys 0.000s
I20260709 13:09:03.194798 26085 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:03.234862 26191 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:03.262562 26191 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:03.295835 23593 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.518s (SENT)
I20260709 13:09:03.297775 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:09:03.129459 23592 connection.cc:256] RPC call timeout handler was delayed by -2.1914014680000946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:09:03.300874 23592 connection.cc:256] RPC call timeout handler was delayed by -2.0690014680000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 13:09:03.301302 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.301486 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1951) took 4728 ms. Trace:
W20260709 13:09:03.301996 23620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.003s	sys 0.021s
W20260709 13:09:03.302497 23620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.003s	sys 0.021s
W20260709 13:09:03.301456 23592 connection.cc:256] RPC call timeout handler was delayed by -2.0501014680000935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:09:03.314343 23592 connection.cc:256] RPC call timeout handler was delayed by -1.8872014680000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
W20260709 13:09:03.317762 23592 connection.cc:256] RPC call timeout handler was delayed by -1.7720014680000986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 13:09:03.318298 23592 connection.cc:256] RPC call timeout handler was delayed by -1.7675014680000913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
W20260709 13:09:03.321089 23592 connection.cc:256] RPC call timeout handler was delayed by -1.358940500000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 13:09:03.321626 23592 connection.cc:256] RPC call timeout handler was delayed by -1.3427014680000866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2715s for a response
W20260709 13:09:03.322103 23592 connection.cc:256] RPC call timeout handler was delayed by -1.2743014680000897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2791s for a response
W20260709 13:09:03.322566 23592 connection.cc:256] RPC call timeout handler was delayed by -1.0975869359999706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 13:09:03.324378 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 222011us
I20260709 13:09:03.328941 26181 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:03.330075 26181 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:03.332082 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 232524us
W20260709 13:09:03.329197 23626 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.008s	sys 0.025s
I20260709 13:09:03.335422 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1887) took 2371 ms. Trace:
W20260709 13:09:03.357183 23626 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.008s	sys 0.025s
W20260709 13:09:03.358654 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 204294us
I20260709 13:09:03.353977 23700 rpcz_store.cc:276] 0709 13:09:00.963628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.668201 (+1704573us) service_pool.cc:224] Handling call
0709 13:09:02.668445 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.668802 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.668827 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.669260 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.084305 (+415045us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:03.333416 (+249111us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.334303 (+   887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.334540 (+   237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.334655 (+   115us) raft_consensus.cc:1685] finished
0709 13:09:03.334686 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.335019 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8920,"thread_start_us":543731,"threads_started":2,"wal-append.queue_time_us":505044}
I20260709 13:09:03.363933 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.327157 26177 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:03.367046 26190 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.367549 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:03.302201 23621 rpcz_store.cc:276] 0709 13:08:58.572922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.363608 (+2790686us) service_pool.cc:224] Handling call
0709 13:09:01.363993 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.391691 (+ 27698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.391745 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.399617 (+  7872us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.304711 (+905094us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b18000b47c0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1 00007f2b412c7a0f
0709 13:09:03.095056 (+790345us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:03.095110 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.095215 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.300418 (+205203us) raft_consensus.cc:1685] finished
0709 13:09:03.300529 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.301187 (+   658us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3066,"raft.queue_time_us":29670,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":13920,"spinlock_wait_cycles":3586816,"thread_start_us":790056,"threads_started":1,"wal-append.queue_time_us":1752140}
W20260709 13:09:03.368340 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44822.2us
I20260709 13:09:03.243571 26069 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:03.373651 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.374066 26069 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:09:03.386073 26181 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:03.389772 23698 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:03.219851 26175 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:03.397735 23697 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:09:03.405048 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.408483 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.427485 26069 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:03.404649 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.430478 23696 raft_consensus.cc:2410] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:03.431244 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.401122 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.436458 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.435966 23524 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 5 to 6, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 6 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:09:03.440449 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1969) took 4586 ms. Trace:
I20260709 13:09:03.440608 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:03.441180 23620 rpcz_store.cc:276] 0709 13:08:58.853804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.461344 (+3607540us) service_pool.cc:224] Handling call
0709 13:09:02.461765 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.462027 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:02.723109 (+261082us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.386761 (+663652us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.430668 (+ 43907us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:03.439924 (+  9256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.440084 (+   160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.440336 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":550598,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":83922,"thread_start_us":868446,"threads_started":3,"wal-append.queue_time_us":473351}
I20260709 13:09:03.442587 26142 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:03.443051 26142 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:03.444103 23743 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:03.437469 23701 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:09:03.368150 26190 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:03.458027 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:03.458755 26190 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:03.460318 23703 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:09:03.460491 25909 raft_consensus.cc:1068] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Unable to promote non-voter b1e32a12daf44ebbbd71cc3ce41d7d8e: Illegal state: Replica 4466bf6d6cf84ee89e84ea074e3964c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:09:03.497951 26175 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:03.460156 26058 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:03.460697 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.411286 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:03.461283 23524 catalog_manager.cc:5697] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.462623 26142 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:03.464792 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1318) took 1138 ms. Trace:
I20260709 13:09:03.466150 26141 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:03.470130 24388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 392) took 1059 ms. Trace:
I20260709 13:09:03.473271 25962 raft_consensus.cc:1064] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
W20260709 13:09:03.474750 26174 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.283s	user 0.002s	sys 0.000s
I20260709 13:09:03.475324 23620 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:03.482630 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.514405 26141 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:03.104837 24392 rpcz_store.cc:276] 0709 13:09:01.953769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.954024 (+   255us) service_pool.cc:224] Handling call
0709 13:09:01.954507 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.954850 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:02.598875 (+644025us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.085791 (+486916us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.103503 (+ 17712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.103596 (+    93us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:03.103682 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.104027 (+   345us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.104179 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":384320,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":17802,"thread_start_us":1117648,"threads_started":2}
I20260709 13:09:03.483462 26200 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:03.486534 23704 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:03.487923 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 58609.1us
I20260709 13:09:03.489005 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:03.489886 26193 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:03.493625 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1947) took 5013 ms. Trace:
I20260709 13:09:03.512807 23698 rpcz_store.cc:276] 0709 13:09:02.326449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.702331 (+375882us) service_pool.cc:224] Handling call
0709 13:09:02.702818 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.390401 (+687583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.464258 (+ 73857us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540008a7d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:03.464693 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572628352}
I20260709 13:09:03.527979 26141 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:03.530405 23769 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:03.605439 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.524993 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:03.715096 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 304060us
I20260709 13:09:03.533895 26142 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.761910 23629 rpcz_store.cc:276] 0709 13:08:58.479593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.341270 (+2861677us) service_pool.cc:224] Handling call
0709 13:09:01.385674 (+ 44404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.385959 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:01.618290 (+232331us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.094221 (+1475931us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.094297 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:03.094355 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.094428 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.493060 (+398632us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b54003241d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:03.493355 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":283678,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":58,"raft.queue_time_us":131476,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":101307264,"thread_start_us":1681328,"threads_started":3,"wal-append.queue_time_us":670193,"wal-append.run_cpu_time_us":1534,"wal-append.run_wall_time_us":1073027}
I20260709 13:09:03.594441 23697 raft_consensus.cc:2410] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:03.720398 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.780328 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.781545 26123 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.599308 26184 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:03.602356 26212 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.003s
W20260709 13:09:03.784551 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 287638us
W20260709 13:09:03.532022 25962 raft_consensus.cc:1068] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Unable to promote non-voter b1e32a12daf44ebbbd71cc3ce41d7d8e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:03.788149 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.602517 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:03.793712 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.794262 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.794575 23696 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:03.795800 23778 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:03.795871 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.797077 23700 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:03.715049 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:03.797613 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.776607 26200 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.799674 26011 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:03.801846 25879 consensus_meta.cc:287] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.659s	user 0.005s	sys 0.012s
I20260709 13:09:03.803709 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:03.802467 26123 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:03.715299 26177 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:03.808414 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 89263us
I20260709 13:09:03.809413 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:03.809660 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.810897 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.811151 23777 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:03.810403 23772 raft_consensus.cc:2376] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6. Re-sending same reply.
I20260709 13:09:03.603482 23524 catalog_manager.cc:5697] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:09:03.775830 26193 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:03.807363 23703 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:03.821826 26011 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:03.807178 26200 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.822640 23773 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:03.822088 23701 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
W20260709 13:09:03.830086 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.829494 23524 catalog_manager.cc:5697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 3 to 4, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 4 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:09:03.831861 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.832515 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44504.4us
W20260709 13:09:03.833225 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.597744 26074 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:03.834342 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 58343.8us
W20260709 13:09:03.838599 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 543159us
I20260709 13:09:03.839706 26175 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:03.840548 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:03.825850 26011 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:03.848891 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:03.842119 26175 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.840379 23524 catalog_manager.cc:5697] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 4, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 4 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:03.850121 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1963) took 5043 ms. Trace:
I20260709 13:09:03.855020 26175 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.857460 23771 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:03.857622 24357 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:03.859082 24357 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:09:03.860217 25744 consensus_meta.cc:287] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.003s
I20260709 13:09:03.861173 26123 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:03.861789 25971 consensus_meta.cc:287] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.391s	user 0.012s	sys 0.008s
I20260709 13:09:03.864531 23702 raft_consensus.cc:2410] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:03.864583 25945 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:03.866650 26119 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.867156 26119 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:03.869259 24392 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:03.872669 26193 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:03.874125 25945 raft_consensus.cc:697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:03.874619 26193 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:03.876413 23702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1915) took 2458 ms (client timeout 1694 ms). Trace:
W20260709 13:09:03.876909 23702 rpcz_store.cc:269] 0709 13:09:01.417958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.090080 (+672122us) service_pool.cc:224] Handling call
0709 13:09:03.876113 (+1786033us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400089dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:03.876302 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3662015232}
I20260709 13:09:03.877661 23701 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:03.826964 26184 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:03.851092 26141 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.881848 26119 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:03.882108 26184 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:03.883392 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 62026.3us
I20260709 13:09:03.886953 26123 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:03.889035 26074 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:03.891649 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.893672 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.894493 23701 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:03.862399 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:03.875468 25945 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:03.897001 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47192.9us
I20260709 13:09:03.898861 26190 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:03.899572 26190 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:03.901016 26190 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:03.902772 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.903784 23702 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:03.887673 26123 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:03.916510 23704 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:03.915709 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:03.924113 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:03.854305 23626 rpcz_store.cc:276] 0709 13:08:58.806497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.320957 (+3514460us) service_pool.cc:224] Handling call
0709 13:09:02.324049 (+  3092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.326335 (+  2286us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:03.375757 (+1049422us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.790406 (+414649us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.798289 (+  7883us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:03.821535 (+ 23246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.829056 (+  7521us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.850063 (+ 21007us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":467191,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":4428,"raft.queue_time_us":8268,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":19300,"thread_start_us":1428483,"threads_started":2,"wal-append.queue_time_us":392943}
I20260709 13:09:03.924933 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.920591 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:03.923105 23667 leader_election.cc:336] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Timed out: RequestConsensusVote RPC to 127.21.244.3:45959 timed out after 1.697s (SENT)
W20260709 13:09:03.929816 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 81590.9us
I20260709 13:09:03.917531 26123 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:03.931025 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 65834.8us
I20260709 13:09:03.915887 26058 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:03.937134 23593 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.587s (SENT)
I20260709 13:09:03.937783 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:03.944613 26058 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:03.514611 24388 rpcz_store.cc:276] 0709 13:09:02.410854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.471841 (+ 60987us) service_pool.cc:224] Handling call
0709 13:09:02.472189 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.472452 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:02.473069 (+   617us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.467783 (+994714us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b1800389620. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287
0709 13:09:03.467986 (+   203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.468083 (+    97us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:03.469580 (+  1497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.469708 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.469934 (+   226us) inbound_call.cc:177] Queueing success response
0709 13:09:03.474068 (+  4134us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b2400258db8. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e0a59c4 00007f2b3e0a3acb 00007f2b3e25edc9 00007f2b3e25ea55 00007f2b3e25e09d 00007f2b40e9010e 00007f2b40ea788c 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221
Metrics: {"mutex_wait_us":16671,"prepare.queue_time_us":179,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":73762,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":52785,"spinlock_wait_cycles":303564288,"thread_start_us":397312,"threads_started":2,"wal-append.queue_time_us":306313}
I20260709 13:09:03.947767 25744 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:03.987783 25744 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:03.958226 25631 raft_consensus.cc:1064] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
W20260709 13:09:03.989559 25631 raft_consensus.cc:1068] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Unable to promote non-voter b1e32a12daf44ebbbd71cc3ce41d7d8e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:03.989033 25744 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:03.987787 23592 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:03.993309 23592 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:03.994022 26172 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.011s
I20260709 13:09:03.994405 26210 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:03.994562 26172 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:03.995350 26210 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:03.996008 26210 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.996434 26210 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:03.959870 26027 consensus_meta.cc:287] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.147s	user 0.006s	sys 0.015s
I20260709 13:09:03.999796 26027 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.002909 26027 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:03.960867 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 101881us
I20260709 13:09:04.012158 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:04.013646 25879 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:04.014127 25879 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:03.942906 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 1979) took 4469 ms. Trace:
I20260709 13:09:04.014582 25879 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:04.014671 26166 consensus_queue.cc:1059] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:09:03.963150 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44604.5us
W20260709 13:09:04.016441 23667 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Timed out: RequestConsensusVote RPC to 127.21.244.3:45959 timed out after 1.742s (SENT)
I20260709 13:09:04.015431 23624 rpcz_store.cc:276] 0709 13:08:59.368620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.606939 (+3238319us) service_pool.cc:224] Handling call
0709 13:09:02.669595 (+ 62656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.669798 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:03.084601 (+414803us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.767701 (+683100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.792568 (+ 24867us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:03.817070 (+ 24502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.826471 (+  9401us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.838191 (+ 11720us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17864,"prepare.queue_time_us":445391,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":7934,"raft.queue_time_us":171353,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":120405,"thread_start_us":704186,"threads_started":2,"wal-append.queue_time_us":371198}
I20260709 13:09:03.963634 26200 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:03.967446 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.019980 23626 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:03.969386 25962 raft_consensus.cc:1064] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:09:04.020623 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:03.977660 23524 catalog_manager.cc:5697] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:03.980461 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.022178 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:03.983966 26058 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:03.985256 23702 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:03.985850 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.986573 26207 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:03.960318 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 75363.7us
I20260709 13:09:04.006402 23592 leader_election.cc:400] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:09:04.044536 23592 leader_election.cc:403] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:04.006990 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:04.008248 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:03.931515 25971 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:09:03.973301 23774 consensus_meta.cc:287] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.692s	user 0.006s	sys 0.013s
W20260709 13:09:04.021265 25962 raft_consensus.cc:1068] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Unable to promote non-voter b1e32a12daf44ebbbd71cc3ce41d7d8e: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:09:04.021667 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 87650.4us
I20260709 13:09:04.025384 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:04.049124 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.025441 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:04.021281 26200 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:04.053244 23777 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:04.055140 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49144.4us
I20260709 13:09:04.055285 23774 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:04.044464 25631 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:04.067862 26177 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:09:04.068332 25631 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.068857 25631 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:04.063315 23593 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.614s (SENT)
I20260709 13:09:04.062490 23773 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
W20260709 13:09:04.074779 23593 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.619s (SENT)
I20260709 13:09:04.075300 23593 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.078734 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.079973 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.080231 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.081984 25879 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:04.060600 26058 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:04.095613 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1360) took 1322 ms. Trace:
I20260709 13:09:04.096261 23774 rpcz_store.cc:276] 0709 13:09:02.767307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.818841 (+ 51534us) service_pool.cc:224] Handling call
0709 13:09:04.086015 (+1267174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:04.094256 23626 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:04.091161 23524 catalog_manager.cc:5697] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 2 to 4, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 4 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.116827 23624 raft_consensus.cc:2410] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:09:04.117800 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 95708.2us
I20260709 13:09:04.094811 26058 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.122471 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:04.136443 23777 raft_consensus.cc:2410] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:09:04.138806 23803 heartbeater.cc:646] Failed to heartbeat to 127.21.244.62:36967 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.21.244.62:36967 timed out after 15.000s (SENT)
I20260709 13:09:04.139703 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:04.140403 23772 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:04.140951 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:04.141633 23771 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.142728 26175 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.126377 26207 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:04.099112 26177 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:09:04.145416 26177 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:04.145812 26177 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:04.147230 25879 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:04.148250 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.148838 23773 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:04.149376 23626 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:09:04.152488 26123 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:04.164619 23742 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.165171 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:04.166050 23769 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:09:04.166651 23742 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:04.167830 26027 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:04.168108 23773 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:04.169746 26058 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:04.173434 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 98700.2us
W20260709 13:09:04.174173 23593 leader_election.cc:336] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.628s (SENT)
I20260709 13:09:04.174618 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.118075 26172 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:04.175948 25744 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:04.154579 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:04.179626 23778 raft_consensus.cc:2376] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7. Re-sending same reply.
I20260709 13:09:04.152523 26210 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.182753 23629 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:04.182835 26210 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:04.148372 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:04.184307 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:04.189157 26175 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:04.146978 26177 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.195389 23629 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:04.169734 26123 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:04.199914 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 88854.9us
W20260709 13:09:04.200865 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 52606.6us
I20260709 13:09:04.200757 26179 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:04.202327 23771 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
W20260709 13:09:04.205698 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 172922us
W20260709 13:09:04.206270 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.216233 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:04.188416 23524 catalog_manager.cc:5697] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 4, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 4 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:04.219079 23742 connection.cc:256] RPC call timeout handler was delayed by -2.0545153130000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3093s for a response
I20260709 13:09:04.218930 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:04.219676 23742 connection.cc:256] RPC call timeout handler was delayed by -1.7990215299998908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 13:09:04.220084 23772 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:04.220232 23742 connection.cc:256] RPC call timeout handler was delayed by -1.6748215299999174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 13:09:04.220707 23742 connection.cc:256] RPC call timeout handler was delayed by -1.570421529999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 13:09:04.221040 23742 connection.cc:256] RPC call timeout handler was delayed by -1.5308078919999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:09:04.221374 23742 connection.cc:256] RPC call timeout handler was delayed by -1.5119078919999538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:09:04.222383 23742 connection.cc:256] RPC call timeout handler was delayed by -1.4750078919998941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 13:09:04.222687 23742 connection.cc:256] RPC call timeout handler was delayed by -1.4525078919999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 13:09:04.222991 23742 connection.cc:256] RPC call timeout handler was delayed by -1.4336078919999409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 13:09:04.223362 23742 connection.cc:256] RPC call timeout handler was delayed by -1.3455005490000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 13:09:04.223678 23742 connection.cc:256] RPC call timeout handler was delayed by -1.2608078919998889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:09:04.224013 23742 connection.cc:256] RPC call timeout handler was delayed by -1.2275078919999487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:09:04.224429 23742 connection.cc:256] RPC call timeout handler was delayed by -1.2068078919999152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
W20260709 13:09:04.224753 23742 connection.cc:256] RPC call timeout handler was delayed by -1.1915078919998905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 13:09:04.225066 23742 connection.cc:256] RPC call timeout handler was delayed by -1.1082642339998756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:09:04.225387 23742 connection.cc:256] RPC call timeout handler was delayed by -1.06796658199994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
I20260709 13:09:04.226902 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:04.227411 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:04.249307 23628 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:09:04.225699 23742 connection.cc:256] RPC call timeout handler was delayed by -1.0386277970000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
W20260709 13:09:04.250207 23742 connection.cc:256] RPC call timeout handler was delayed by -1.0154669069999045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
I20260709 13:09:04.251310 24392 raft_consensus.cc:2410] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:04.261605 26141 raft_consensus.cc:3055] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:04.262166 26141 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:04.249426 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:04.272033 23593 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.679s (SENT)
I20260709 13:09:04.272562 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.265197 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:04.273440 23771 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
W20260709 13:09:04.229593 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.204728 26177 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:04.263150 26141 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:04.278973 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44585us
I20260709 13:09:04.278155 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.268761 26175 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:04.280983 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 69015.7us
I20260709 13:09:04.287809 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:04.288667 24391 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:04.290336 26058 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:04.282083 26175 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.286026 26207 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:04.312057 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.296310 23524 catalog_manager.cc:5697] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 1 to 4, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 4 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:04.314950 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.297199 26119 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:04.318745 26119 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:04.319924 26119 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.321363 26119 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.313182 24392 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:04.300931 26175 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:04.325186 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 100445us
W20260709 13:09:04.325906 23593 leader_election.cc:336] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.688s (SENT)
W20260709 13:09:04.327042 23593 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.749s (SENT)
I20260709 13:09:04.327432 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.315434 23524 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:04.329454 23592 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:04.333173 26058 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:04.334800 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.335934 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.336552 23626 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:04.339380 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.340252 23620 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:04.335582 23621 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:04.347083 23742 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.607s (SENT)
I20260709 13:09:04.347640 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.354094 26027 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:04.301358 26210 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:04.356734 26210 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.357167 26210 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.359246 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:04.331049 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:04.364567 25971 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:04.365756 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 70455.2us
I20260709 13:09:04.366721 26207 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:04.367622 26207 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:04.368045 26207 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.368078 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:04.368530 26207 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.370994 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:04.371937 25744 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:04.373411 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:04.375051 23743 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:04.375337 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:04.375867 26027 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:04.375912 26193 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:04.376511 26027 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.377092 26027 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:04.376588 26193 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.378784 26193 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.378928 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:04.379912 23778 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:04.383015 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:04.360625 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:04.397576 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50524.7us
I20260709 13:09:04.401667 23620 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:04.409416 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:04.414253 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 87227.6us
I20260709 13:09:04.419387 23627 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:04.419288 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:04.421695 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.426330 24387 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:04.431175 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.435768 23626 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:04.425483 26141 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.440284 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:04.441671 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.448134 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:04.451354 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:04.451828 23624 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:04.442446 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.452740 25879 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:04.453420 25879 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:04.453960 25879 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.455902 26166 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:04.456564 26166 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:04.457762 26166 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:04.437045 25631 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.459486 23621 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:04.460764 26223 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.461429 26223 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:04.463626 25631 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:04.464890 23777 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:04.469285 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.437886 25744 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:04.466961 23772 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:04.477474 23771 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:04.477797 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.481287 24357 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:04.476954 26223 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:04.446830 25971 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:04.497566 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.498689 23626 raft_consensus.cc:2410] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:04.493259 25945 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:04.503158 25945 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:04.504135 25945 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:04.438764 26172 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:09:04.493990 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:04.516530 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:04.528102 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 142733us
I20260709 13:09:04.526386 26223 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:04.539642 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 103782us
W20260709 13:09:04.540457 23742 leader_election.cc:336] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.628s (SENT)
I20260709 13:09:04.544575 23624 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: [3.2-6.4]
I20260709 13:09:04.546011 23620 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:09:04.547122 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.548669 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.550639 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.551081 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:04.551970 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 73318us
I20260709 13:09:04.548705 26011 raft_consensus.cc:2955] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:09:04.553556 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.554375 23621 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:04.555990 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.556846 23626 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:04.556919 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:04.541558 23742 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.669s (SENT)
I20260709 13:09:04.558372 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.562073 23778 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:04.566608 23743 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:04.568665 26232 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:04.569159 26232 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:04.569964 26232 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.577098 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.549039 25744 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.560972 26229 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:09:04.594013 26229 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:04.594408 26229 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:04.596597 25631 raft_consensus.cc:1064] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
W20260709 13:09:04.597116 25631 raft_consensus.cc:1068] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Unable to promote non-voter b1e32a12daf44ebbbd71cc3ce41d7d8e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:04.597752 25879 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:04.571928 26190 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:09:04.599907 26190 consensus_queue.cc:1243] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:04.588775 26228 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:04.602264 26228 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:04.603538 26228 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.604758 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.606009 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.607015 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.607789 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.609119 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.610754 26172 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:04.605907 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.609064 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.620086 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.620545 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.621142 23628 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:04.621533 23627 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:04.621833 26141 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.622342 26141 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:04.632768 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:04.633533 23772 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:04.634074 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:04.634454 26177 consensus_queue.cc:1059] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:04.634860 23778 raft_consensus.cc:606] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.636097 23623 raft_consensus.cc:2410] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:04.637365 23622 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:04.638147 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:04.588514 25971 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:04.638880 23778 raft_consensus.cc:606] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.638724 23592 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:04.641256 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:04.642139 26222 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:04.642515 26141 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:04.642696 26222 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.650426 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.635520 26177 raft_consensus.cc:3055] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:04.653644 26177 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:04.654322 26236 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:04.654958 26236 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:04.654688 26177 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:04.656373 26177 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.656003 26236 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:04.652571 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 117290us
I20260709 13:09:04.663000 25971 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:04.664872 25631 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:04.665295 25631 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:04.666385 23622 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:04.666325 25631 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:04.667796 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.671095 25631 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:04.668246 26223 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:04.675153 26223 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:04.678699 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 137155us
I20260709 13:09:04.702946 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:04.709426 23628 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:09:04.712105 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 144669us
I20260709 13:09:04.712882 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:04.713749 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:04.595310 26229 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:04.679409 26222 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.584983 26207 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.724484 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:04.722645 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 165818us
I20260709 13:09:04.725989 23778 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:04.730165 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.715934 25879 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:04.745162 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.769469 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.724423 23742 leader_election.cc:336] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.694s (SENT)
I20260709 13:09:04.786206 23742 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.772976 23772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:04.787007 23772 raft_consensus.cc:606] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.791708 24393 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:04.733150 25945 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:09:04.795468 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 116582us
I20260709 13:09:04.796492 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:04.733459 26074 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:04.805226 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.805747 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.787967 25971 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:04.732439 26175 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.799602 23629 raft_consensus.cc:2955] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:09:04.833782 26233 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:04.836337 24388 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:04.815203 26229 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:04.840587 23620 raft_consensus.cc:2368] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 8.
I20260709 13:09:04.848202 23778 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:04.850000 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:04.839664 26119 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:04.873816 26175 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:04.868230 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 153261us
I20260709 13:09:04.863646 26223 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:04.878207 23627 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:09:04.882263 23742 leader_election.cc:336] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.715s (SENT)
I20260709 13:09:04.882952 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.884301 26223 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:04.885401 26223 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:04.893365 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:04.896219 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:04.897044 24387 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:04.849923 25971 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:09:04.897904 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.905054 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.907335 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:04.908023 24392 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:04.912309 26207 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:04.915429 26210 consensus_meta.cc:287] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 13:09:04.916013 26119 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:04.916211 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 119833us
W20260709 13:09:04.917186 26027 consensus_meta.cc:287] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.004s
I20260709 13:09:04.917943 26228 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:04.918772 26193 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.001s
W20260709 13:09:04.924888 23593 connection.cc:256] RPC call timeout handler was delayed by -1.5264624699999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
W20260709 13:09:04.931008 23593 connection.cc:256] RPC call timeout handler was delayed by -1.5174624699999413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
W20260709 13:09:04.931499 23593 connection.cc:256] RPC call timeout handler was delayed by -1.4187255729999606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 13:09:04.932130 23593 connection.cc:256] RPC call timeout handler was delayed by -1.411525572999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 13:09:04.934747 26232 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.936856 26232 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:04.934206 23593 leader_election.cc:336] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.772s (SENT)
I20260709 13:09:04.939953 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.945914 23625 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:04.927075 26119 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:04.950294 26074 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:04.957981 26074 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.960002 25971 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:04.960462 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:04.961609 25631 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:04.961987 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:04.963060 25631 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:04.964874 25631 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:04.935360 26193 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:09:04.967389 26193 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:04.968051 26175 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:04.953896 23593 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.839s (SENT)
I20260709 13:09:04.973474 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:04.981824 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:04.985962 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 107825us
I20260709 13:09:04.927510 26210 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:04.985868 23772 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:04.988579 26234 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:04.988623 23627 pending_rounds.cc:85] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 1
I20260709 13:09:04.993057 23777 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:04.954080 26254 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:09:04.993966 26232 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:04.994318 23742 leader_election.cc:336] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.907s (SENT)
I20260709 13:09:04.931372 26027 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:04.997298 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:04.997689 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:04.998332 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:04.962011 25971 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:04.998337 23628 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.000012 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:05.000801 23778 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.995761 23627 pending_rounds.cc:107] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:09:05.019421 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:05.025180 23629 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:05.024187 23627 raft_consensus.cc:2889] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:05.027823 26119 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:05.010718 25945 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:09:05.029151 26119 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:05.032971 26253 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 13:09:05.036145 23624 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:05.046512 26255 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:05.047446 26255 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:05.050948 23771 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:05.046579 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 92720.7us
I20260709 13:09:04.997774 25879 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:05.050217 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:05.053356 23778 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:05.060007 23592 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:05.061488 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:05.062240 23623 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:05.065470 26222 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:05.000131 25971 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.035888 26236 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:05.074962 23628 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:05.073282 25971 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.081467 26222 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:05.088235 23593 leader_election.cc:336] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.894s (SENT)
I20260709 13:09:05.092211 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.100687 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:05.103909 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:05.104537 23778 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.103399 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:05.105911 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:05.085106 26207 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:05.111203 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.113420 23769 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:09:05.116935 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.117733 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.129385 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:05.131035 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:05.102236 26210 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:05.070876 25879 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:05.136317 23771 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:05.137334 23772 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:05.108547 26179 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:05.048722 26255 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:05.108968 26236 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:05.144925 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.140870 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:05.128912 26207 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:05.154138 23771 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:09:05.156572 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 68369.8us
W20260709 13:09:05.165503 23593 connection.cc:256] RPC call timeout handler was delayed by -1.2611361240000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
I20260709 13:09:05.142992 26200 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.168674 23625 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:05.167392 23743 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:05.149093 26223 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:05.178737 23593 connection.cc:256] RPC call timeout handler was delayed by -1.150262469999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25179999999999997s for a response
I20260709 13:09:05.156023 26228 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:05.218765 23620 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:05.221369 23778 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
W20260709 13:09:05.190265 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 195950us
I20260709 13:09:05.156714 26179 raft_consensus.cc:697] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:05.172960 26172 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:05.231459 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:05.234660 23775 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:05.189064 26254 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:05.241545 23778 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:05.250605 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.255054 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:05.191035 26222 consensus_queue.cc:1059] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:09:05.238109 26172 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.220808 26237 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:09:05.233321 25744 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:09:05.272940 23742 leader_election.cc:336] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.944s (SENT)
I20260709 13:09:05.279000 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.188665 26223 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:05.282385 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 51013.3us
I20260709 13:09:05.258045 26027 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:05.304306 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 74819.5us
W20260709 13:09:05.302289 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.257159 26260 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:09:05.308440 23742 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.967s (SENT)
W20260709 13:09:05.309502 23742 leader_election.cc:336] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.984s (SENT)
I20260709 13:09:05.309906 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.310191 26223 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:05.310817 26223 raft_consensus.cc:3055] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:05.280723 26254 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:05.311185 26223 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:05.312125 26254 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:09:05.239379 26235 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:09:05.273963 26262 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.278959 26172 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:05.331171 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.317376 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:05.315356 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:05.338831 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.340276 23771 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:05.277838 26166 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:05.342839 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:05.344352 23771 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:09:05.342859 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:05.348556 26267 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:05.349542 26267 consensus_queue.cc:1243] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:05.350069 26267 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:05.323319 26265 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:05.306344 26207 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:05.498383 26210 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:05.516638 26266 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:09:05.528017 26210 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:05.451611 26243 log.cc:927] Time spent T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:09:05.451342 26119 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:05.530411 26119 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:05.524523 24357 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:05.348618 26270 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.183s
I20260709 13:09:05.416211 26179 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:05.533586 26270 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:05.534253 26270 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.452127 26240 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:05.363564 26027 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.343992 26262 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:05.521785 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 212271us
I20260709 13:09:05.420991 26223 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:05.403155 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 87877us
W20260709 13:09:05.525506 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 171182us
I20260709 13:09:05.523073 25879 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:05.568418 26223 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.541985 26269 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:05.546109 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 53932.7us
W20260709 13:09:05.454794 26229 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.604s	user 0.004s	sys 0.005s
I20260709 13:09:05.571300 26172 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:05.365032 26166 raft_consensus.cc:697] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:05.571923 26269 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:05.576539 23742 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.099s (SENT)
W20260709 13:09:05.579005 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.579485 24358 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.105s (SENT)
I20260709 13:09:05.549481 26270 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:05.581368 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 56939.7us
I20260709 13:09:05.582211 26236 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:05.581092 25744 consensus_queue.cc:1059] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:09:05.581326 26177 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
W20260709 13:09:05.584596 25971 consensus_meta.cc:287] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:09:05.585481 26269 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:05.531365 26119 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:05.572671 26240 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:09:05.596335 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 250380us
I20260709 13:09:05.599435 25744 raft_consensus.cc:3055] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:05.599210 26166 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:05.599915 25744 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:05.600854 25744 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:05.602617 24358 leader_election.cc:336] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.197s (SENT)
I20260709 13:09:05.609144 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.602201 25744 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.612485 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:05.616211 26262 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:05.612545 23742 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.216s (SENT)
I20260709 13:09:05.617471 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.596647 25971 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:05.620095 26262 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:05.622119 26240 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:05.622901 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.626124 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:05.626616 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50005.3us
I20260709 13:09:05.626890 24392 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:05.628456 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.628600 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:05.628971 26272 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:05.629195 26177 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:05.629810 23742 leader_election.cc:336] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.304s (SENT)
I20260709 13:09:05.631078 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:05.633152 23742 connection.cc:256] RPC call timeout handler was delayed by -1.1905395549999866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2596s for a response
I20260709 13:09:05.635504 26269 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:05.638334 26177 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.646311 26172 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:05.646524 24358 leader_election.cc:336] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.135s (SENT)
I20260709 13:09:05.647230 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.648366 26228 raft_consensus.cc:3055] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:05.648802 26228 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:05.649706 26228 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:05.650699 26228 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.651207 24387 raft_consensus.cc:2410] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:09:05.652565 26280 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.115s	user 0.000s	sys 0.003s
I20260709 13:09:05.654071 25971 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:05.646754 26245 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:05.665583 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:05.672524 26245 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:05.672741 23628 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.668051 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:05.670918 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:05.674510 23774 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:05.683202 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 52237.1us
I20260709 13:09:05.634825 26210 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:05.684983 23620 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
W20260709 13:09:05.685832 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.687816 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:05.673489 26245 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:05.683641 26255 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.658972 26270 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:05.701928 25879 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.726125 23593 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:05.730014 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 69962.2us
W20260709 13:09:05.732296 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.732514 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 86019.5us
W20260709 13:09:05.733101 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.737031 23628 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:05.732314 26210 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:05.743960 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.747874 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:05.748778 26281 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:05.749605 26281 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:05.752749 23626 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:05.763013 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.767055 23774 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:05.769848 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:05.770486 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:05.773200 26262 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:05.773671 26262 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:05.774116 26262 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.775942 26249 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:05.777314 26245 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.795473 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.796904 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:05.797762 26210 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:05.794368 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:05.799015 26210 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:05.799460 26210 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:05.799546 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.800005 26210 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.800522 25744 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:05.802198 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.805109 26027 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.806286 26190 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:05.806844 26190 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:05.807862 26190 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:05.725054 26255 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:05.807420 25631 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:05.816720 25744 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:05.840154 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.834996 25631 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:05.848222 25631 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:05.854681 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 69134.6us
I20260709 13:09:05.861639 26292 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.863768 25879 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:05.863619 26292 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:05.864580 25879 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:05.867390 26279 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:05.869737 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:05.868173 26279 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:05.878264 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:05.871829 26269 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.882301 23774 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:05.891162 26279 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:05.892055 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:05.872869 26292 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:05.894557 26179 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:05.899044 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.904685 23669 connection.cc:256] RPC call timeout handler was delayed by -4.5450805519999449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 13:09:05.903582 26281 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:05.913411 26119 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:05.920238 25879 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:05.929291 26269 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:05.938439 23669 connection.cc:256] RPC call timeout handler was delayed by -3.7202672339999481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 13:09:05.962977 23669 connection.cc:256] RPC call timeout handler was delayed by -3.6050672339999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:09:05.963317 23669 connection.cc:256] RPC call timeout handler was delayed by -3.5204672339999661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 13:09:05.963619 23669 connection.cc:256] RPC call timeout handler was delayed by -3.1532672339999408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2372s for a response
W20260709 13:09:05.963955 23669 connection.cc:256] RPC call timeout handler was delayed by -3.0047672339999281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2537s for a response
I20260709 13:09:05.951923 26233 raft_consensus.cc:993] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:09:05.967871 26233 raft_consensus.cc:1081] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:09:05.969797 23770 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:05.936618 26270 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:05.971581 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 61128.8us
I20260709 13:09:05.972553 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.973718 26260 raft_consensus.cc:993] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:09:05.973948 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:05.974364 26260 raft_consensus.cc:1081] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:09:05.974860 25744 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.975625 25744 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.910611 26179 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:05.981866 26179 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:05.986088 26193 consensus_queue.cc:1059] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:05.987572 26193 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:05.989082 26011 raft_consensus.cc:3055] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:05.975422 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:05.936465 26255 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:06.031913 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:06.037768 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:06.038679 23742 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.596s (SENT) [suppressed 78 similar messages]
I20260709 13:09:06.040581 24387 raft_consensus.cc:2410] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:06.041515 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.048804 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:06.049046 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.037905 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:06.049600 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.049067 23627 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:06.050232 23704 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:05.931689 26269 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:06.054526 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 79166.6us
I20260709 13:09:05.995832 26027 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:06.058864 23702 raft_consensus.cc:2410] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:05.989583 26011 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:06.061532 24392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:58744
I20260709 13:09:06.064531 24392 raft_consensus.cc:606] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:06.064914 24392 raft_consensus.cc:614] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:06.065659 26260 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.061105 23742 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:05.939949 26119 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:06.062855 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.067054 26119 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:06.067873 23697 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:06.068596 23696 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.068742 23777 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:06.069322 23701 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:06.037540 25744 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:06.066154 26260 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:06.075503 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.072480 23774 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:09:06.076166 23704 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:06.037813 26240 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:06.037505 26279 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:06.076839 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 145935us
I20260709 13:09:06.081683 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:06.096573 23770 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.076268 23774 pending_rounds.cc:85] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 5
I20260709 13:09:06.097290 23774 pending_rounds.cc:107] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:09:06.097553 23774 raft_consensus.cc:2889] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.082388 23703 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:06.082760 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:06.060022 26027 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:06.032019 26210 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:06.109998 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.126711 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:06.123679 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:06.127307 24392 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.122459 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:06.075032 25744 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:06.160247 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:06.164528 23777 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:06.164000 24387 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEARNER]: Advancing to term 4
I20260709 13:09:06.165342 23769 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:06.075186 26233 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.168500 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:06.170948 23592 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:06.189678 23699 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:06.088574 26262 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:06.166836 26193 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:06.172221 25744 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.196082 23593 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:06.178359 26236 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:06.165678 26291 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:06.178960 26074 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:06.106662 26279 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:06.242719 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:06.243527 24393 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:06.203164 26236 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.203473 26232 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:09:06.201334 26193 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.255445 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.194183 26222 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:09:06.203814 26119 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:06.286125 23699 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:06.288837 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.254568 26074 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:06.299742 26299 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:09:06.283079 26207 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:06.273670 26236 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.283411 25945 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.277446 26193 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.303536 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:06.303658 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.296609 26179 raft_consensus.cc:1064] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:09:06.246611 26291 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:06.294974 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:06.295838 26302 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:06.350116 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.351408 23699 raft_consensus.cc:2410] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:09:06.351868 24358 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.086s (SENT)
I20260709 13:09:06.203663 26027 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:06.354219 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.361501 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.356161 26245 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.358079 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:06.357703 26294 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.082s	user 0.006s	sys 0.002s
I20260709 13:09:06.352756 26255 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.355968 26302 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:06.395314 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 189796us
W20260709 13:09:06.356724 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.395323 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 213206us
I20260709 13:09:06.403127 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:06.434690 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 238848us
I20260709 13:09:06.515659 23699 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:06.516923 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:06.517555 23699 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.432619 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.520696 23697 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:06.521638 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:06.522043 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.522244 23697 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:06.523185 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.400424 26027 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.460925 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:06.528337 23703 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:06.529248 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.530419 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.530220 26236 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:06.531152 23703 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:06.432739 26260 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:06.463517 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 61571.7us
I20260709 13:09:06.465528 26318 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:06.531649 26262 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:06.420418 26210 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:06.400146 26245 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:06.532778 26318 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:06.470605 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:06.534968 26318 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:06.392367 26207 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:09:06.535337 23695 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:06.468132 26301 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:09:06.554342 23695 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:06.484915 26296 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:09:06.485200 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:06.556578 26291 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:06.488191 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2037) took 1369 ms. Trace:
I20260709 13:09:06.559966 23629 rpcz_store.cc:276] 0709 13:09:05.118895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.119459 (+   564us) service_pool.cc:224] Handling call
0709 13:09:05.143128 (+ 23669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.147566 (+  4438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.147601 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.798128 (+650527us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b2c00058238. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:09:05.798709 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.032808 (+234099us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:06.032870 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.032974 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:06.475225 (+442251us) raft_consensus.cc:1685] finished
0709 13:09:06.475247 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.488116 (+ 12869us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12094,"raft.queue_time_us":4752,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4794,"spinlock_wait_cycles":3640064,"thread_start_us":231804,"threads_started":1,"wal-append.queue_time_us":264297}
I20260709 13:09:06.561317 23696 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:06.561852 23697 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:06.489723 24392 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:06.564309 24387 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEARNER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:06.409684 26255 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:06.492908 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 141078us
W20260709 13:09:06.495412 26289 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.006s	sys 0.016s
W20260709 13:09:06.496052 26304 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:09:06.500587 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.502873 26240 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.502408 26179 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:06.504144 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:06.507820 26308 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:09:06.508198 26309 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.508926 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:06.435497 26074 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:06.509554 26279 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:06.491165 26302 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:06.466257 26307 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:09:06.538373 26207 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.539428 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:06.539669 23625 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:06.539876 23769 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:06.540194 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:06.542531 26305 log.cc:927] Time spent T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 13:09:06.471092 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:06.546758 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:06.549090 23624 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:06.490423 23770 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:06.566846 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:06.568523 23704 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
W20260709 13:09:06.725273 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.700287 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:06.600706 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:06.738057 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 191373us
W20260709 13:09:06.738663 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.599174 23742 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.385s (SENT)
I20260709 13:09:06.647190 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:06.589172 23628 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.563313 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:06.570469 23699 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:06.592448 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:06.638139 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:06.579450 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.689177 24387 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:06.742340 23626 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:06.741057 23771 raft_consensus.cc:2393] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:06.599892 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:06.744362 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 43586.1us
I20260709 13:09:06.744561 23627 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 4: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:06.737565 23701 raft_consensus.cc:2410] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:06.644640 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:06.739674 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:06.738338 23776 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
W20260709 13:09:06.739868 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.779233 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:09:06.777103 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.780193 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.752925 23702 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:06.752355 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:06.782991 24387 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:06.783700 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 264764us
W20260709 13:09:06.784379 23593 connection.cc:256] RPC call timeout handler was delayed by -1.4447655730000406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 13:09:06.785279 23770 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:09:06.736539 26289 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.007s	sys 0.024s
I20260709 13:09:06.863958 23625 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:06.637235 26270 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.758361 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:06.870698 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 112480us
I20260709 13:09:06.752763 26269 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.872663 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:06.792244 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:06.584949 26245 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:06.875483 23628 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:06.753191 26236 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:06.881934 23769 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:09:06.886543 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 377721us
I20260709 13:09:06.883858 23628 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:06.752959 26291 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:06.887850 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:06.888617 23774 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.792291 26302 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.841794 26267 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:06.811503 26321 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:06.682729 25744 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:06.873991 26172 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:06.876386 26222 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:06.583696 26011 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:06.909492 23775 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:06.811558 26240 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:06.790181 26312 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:09:06.879822 26175 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.880064 26166 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.905531 23773 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:06.864574 26223 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:09:06.753162 26207 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:06.913370 23774 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:06.880677 26270 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:06.905269 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 113098us
I20260709 13:09:06.891815 26291 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.942122 23777 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:06.905330 26267 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:06.956756 23592 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:06.910053 26236 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:09:06.942077 23669 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:06.955847 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.898344 24387 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:06.924216 26119 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:06.957998 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.907419 26321 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:06.974913 26321 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:06.975943 26297 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:06.967971 26119 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.976403 26297 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:06.976773 26119 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.976878 26297 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.977715 26270 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:06.978919 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.983356 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 384181us
I20260709 13:09:06.988384 25744 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:06.989138 24357 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:06.990029 26235 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:06.990550 26235 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:06.991011 26267 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:06.991626 26267 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:06.967834 26291 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.991436 26235 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:06.955507 26166 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:06.994113 26166 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:06.883924 26269 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:06.997056 26269 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:06.997267 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.997732 26267 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:06.998384 26267 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.956346 26331 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:06.975526 26321 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:06.998502 23775 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:06.998991 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:07.001358 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 96606.5us
I20260709 13:09:06.998819 26322 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:09:07.002264 26328 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:06.955710 26175 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:07.031670 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.034750 23623 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:07.039762 23775 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:07.041430 24357 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:07.045141 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.046186 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.053843 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.054770 23772 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:07.056671 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:07.062374 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.063532 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:07.065659 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.066605 23775 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:07.047513 26166 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:07.106709 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.046020 26321 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:07.112756 23775 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:07.045941 26270 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:09:07.062573 26312 raft_consensus.cc:2764] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:07.110723 26166 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:07.115216 26193 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.756s	user 0.003s	sys 0.007s
I20260709 13:09:07.123323 26255 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:07.344444 23593 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:07.358448 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.380491 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.345993 26321 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:07.119349 26223 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.269s
I20260709 13:09:07.117236 26289 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:07.132309 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 84011.1us
W20260709 13:09:07.170186 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.131361 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 246) took 1102 ms. Trace:
I20260709 13:09:07.387229 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:07.387547 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.390463 24358 leader_election.cc:336] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.626s (SENT)
I20260709 13:09:07.392815 24358 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:07.390827 23696 rpcz_store.cc:276] 0709 13:09:06.028626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.037511 (+  8885us) service_pool.cc:224] Handling call
0709 13:09:07.131181 (+1093670us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b54000893d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:07.131296 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40181632}
W20260709 13:09:07.396606 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.038945 26331 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:07.379786 26318 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:07.277215 23742 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.624s (SENT)
I20260709 13:09:07.325472 26207 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:07.397938 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:07.279716 26333 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.389436 26166 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:07.380131 26240 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:07.404197 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:07.278156 26329 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.279701 26332 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:07.451524 26329 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:07.453748 26329 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:07.454787 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 56970.5us
I20260709 13:09:07.456184 26318 raft_consensus.cc:2764] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:07.432327 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:07.389616 26193 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:07.485049 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:07.240226 26119 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:07.407361 26341 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:07.485893 23775 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:07.403003 26338 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:07.489859 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:07.463905 26240 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.494061 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.395259 26297 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:07.393664 26289 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:07.498716 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.484465 26235 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.488538 26255 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:07.503383 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 103328us
I20260709 13:09:07.447891 26333 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:07.490329 26291 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:07.512451 26317 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:09:07.513361 26119 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:07.491024 26166 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:07.515767 26329 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.516851 26175 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:07.517442 26193 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:07.503347 26270 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 13:09:07.519547 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 242361us
I20260709 13:09:07.553939 24392 raft_consensus.cc:2368] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:07.529074 26289 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:07.544518 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:07.492637 26338 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:07.558589 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 59537.8us
I20260709 13:09:07.562877 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:07.568490 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.532455 26235 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:07.563634 26119 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.557655 26338 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.501833 26240 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
W20260709 13:09:07.585438 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.597062 26255 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:07.597739 26255 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:07.599320 26175 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:07.600225 26175 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:07.603119 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:07.604624 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:07.606078 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:07.610173 26235 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:07.611038 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.612401 26332 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:07.613308 26333 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:07.616454 26324 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.729s	user 0.008s	sys 0.000s
I20260709 13:09:07.620383 26240 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:07.616351 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.561376 26345 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:07.613240 26332 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:07.630115 26332 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:07.630595 26332 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.594877 26179 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.635931 26179 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.636582 26166 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:07.638070 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:07.638913 23772 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:07.639089 26179 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.640090 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.603314 26175 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:07.642635 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 152092us
I20260709 13:09:07.678624 23772 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:07.876530 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:07.877607 23593 leader_election.cc:336] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.648s (SENT)
W20260709 13:09:07.650751 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 132364us
I20260709 13:09:07.723043 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1649) took 1085 ms. Trace:
I20260709 13:09:07.881199 23773 rpcz_store.cc:276] 0709 13:09:06.637376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.637524 (+   148us) service_pool.cc:224] Handling call
0709 13:09:07.722805 (+1085281us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000591d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:07.722970 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368536960}
W20260709 13:09:07.882359 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.882742 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.883028 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.883344 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.880128 23593 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.211s (SENT)
I20260709 13:09:07.725508 26222 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:07.884030 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:07.854132 24358 leader_election.cc:336] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.158s (SENT)
I20260709 13:09:07.680182 26339 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.771399 26318 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:07.811779 26267 consensus_meta.cc:287] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.775s	user 0.012s	sys 0.000s
I20260709 13:09:07.885085 24357 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:07.671180 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 116975us
W20260709 13:09:07.646323 26302 consensus_meta.cc:287] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.000s
W20260709 13:09:07.890290 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 84567.7us
W20260709 13:09:07.893723 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.895869 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.897956 26344 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:09:07.875065 26297 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:07.642050 26291 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:07.899863 26175 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:07.905205 26270 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:07.905819 26270 raft_consensus.cc:697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:07.645581 26345 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:07.906971 26345 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:07.645208 26179 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:07.911527 26322 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.912364 26322 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:07.912869 26179 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:07.913172 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:07.913599 26267 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:07.916199 26267 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:07.916023 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:07.917155 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.917064 23623 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:07.918346 26332 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:07.918812 23624 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:07.920363 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:07.914033 23626 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
W20260709 13:09:07.923834 23742 leader_election.cc:336] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.745s (SENT)
I20260709 13:09:07.925305 26119 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:07.906854 26270 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:07.929447 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 323470us
I20260709 13:09:07.930539 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:07.721632 26279 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:07.931980 26279 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:07.932422 23776 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:07.852862 26331 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:07.938915 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2075) took 1279 ms. Trace:
I20260709 13:09:07.699406 26255 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:07.929553 26119 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:07.939353 23620 rpcz_store.cc:276] 0709 13:09:06.659500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.791510 (+132010us) service_pool.cc:224] Handling call
0709 13:09:06.864674 (+ 73164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.982033 (+117359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.982062 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:06.982104 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:06.982139 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.938688 (+956549us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54003af554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:07.938741 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.938847 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269368064}
I20260709 13:09:07.888417 26222 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:07.963311 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:07.972679 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:07.973624 23743 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:07.974268 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:07.974356 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:07.975530 26297 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:07.893784 26339 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:07.976614 26332 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:09:07.976482 26267 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:07.979550 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:07.963692 23626 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:07.978053 26291 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:07.984069 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 103952us
W20260709 13:09:08.014729 23593 leader_election.cc:336] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.791s (SENT)
I20260709 13:09:08.015283 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:07.923539 26329 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.001428 23624 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:08.011819 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:07.963485 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.013514 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50311.7us
W20260709 13:09:08.017081 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 43523.1us
I20260709 13:09:08.024712 26345 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.025815 26222 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:08.026753 26249 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:08.027026 26222 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.984910 26240 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:09:08.033931 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:08.036319 26356 raft_consensus.cc:2764] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:09:08.037331 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:08.038061 26233 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:08.038518 26179 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.038682 26233 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.039374 26233 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.039506 26265 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:08.043795 26175 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.044395 26175 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:08.044589 23525 catalog_manager.cc:5697] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 4 to 6, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 6 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.046895 26175 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:07.903568 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:08.050608 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.052860 23776 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:08.050421 26339 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:08.055302 23742 leader_election.cc:336] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.609s (SENT)
W20260709 13:09:08.055523 23593 leader_election.cc:336] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.931s (SENT)
W20260709 13:09:08.055980 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 81793.1us
I20260709 13:09:08.056002 23593 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:07.725822 26350 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.286s
W20260709 13:09:08.082067 23742 leader_election.cc:336] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.883s (SENT)
W20260709 13:09:08.082268 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 61581.5us
I20260709 13:09:08.082615 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:08.082994 24359 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:07.989032 26338 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:08.079525 23593 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.024s (SENT)
I20260709 13:09:08.079246 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:08.088709 23593 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:08.089048 23777 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:08.090374 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:08.091709 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:08.092893 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:08.093957 23742 leader_election.cc:336] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.907s (SENT)
I20260709 13:09:07.932956 26279 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:07.974856 26318 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.096691 23773 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:08.091472 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:07.990406 26245 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:09:08.109800 23776 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:08.111557 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:08.100625 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:07.978549 26255 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:09:08.041769 26322 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:08.076930 26240 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.115558 23775 raft_consensus.cc:2410] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:08.119581 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:08.123070 23778 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.007480 26119 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:08.126068 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47028.7us
I20260709 13:09:08.126885 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:08.129856 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:08.091995 26358 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.132203 23622 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:08.140125 26323 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 1.277s	user 0.004s	sys 0.017s
I20260709 13:09:08.141567 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 372) took 1835 ms. Trace:
I20260709 13:09:08.141930 23621 rpcz_store.cc:276] 0709 13:09:06.306233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.307336 (+  1103us) service_pool.cc:224] Handling call
0709 13:09:06.307745 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:06.467626 (+159881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.467670 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:06.471554 (+  3884us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.668396 (+196842us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:06.668432 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.668504 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.942404 (+1273900us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:08.141244 (+198840us) raft_consensus.cc:1685] finished
0709 13:09:08.141264 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.141501 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117597,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":5758208,"thread_start_us":310903,"threads_started":2,"wal-append.queue_time_us":365632}
I20260709 13:09:08.143215 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:08.143479 24358 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.879s (SENT)
I20260709 13:09:08.143802 26175 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:08.144194 26175 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:08.144616 26350 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.145557 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:08.146838 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 67348us
I20260709 13:09:08.148870 23622 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:08.156208 23778 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:08.116945 26309 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:08.158828 23593 leader_election.cc:400] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:08.159284 23593 leader_election.cc:403] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:08.144982 26175 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.160770 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:08.161803 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:08.163385 26267 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:08.163883 26267 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.163932 26297 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.091516 26193 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:09:08.164410 26267 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:08.102588 26166 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:09:08.181581 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 87673.1us
W20260709 13:09:08.182500 23742 leader_election.cc:336] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.999s (SENT)
I20260709 13:09:08.154811 26262 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:08.178937 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:08.156132 26356 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.175028 26291 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:09:08.179430 26328 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.213538 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:08.215874 26210 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:08.216130 23769 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:09:08.163944 26331 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:09:08.220913 23742 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.673s (SENT)
I20260709 13:09:08.216603 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:08.222792 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:08.223950 23742 leader_election.cc:336] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.095s (SENT)
W20260709 13:09:08.225528 23742 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.136s (SENT)
W20260709 13:09:08.230139 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 76344.2us
I20260709 13:09:08.209579 26338 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:08.238749 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:08.244071 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:08.247903 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:08.214187 26356 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:08.255460 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.227833 26260 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.259447 24388 raft_consensus.cc:2410] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:09:08.282665 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 124068us
I20260709 13:09:08.283169 26372 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:08.283766 26372 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.284137 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:08.287304 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:08.288885 26372 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:08.289455 26372 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.228044 26358 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:09:08.229548 26210 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:08.294993 26365 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:09:08.270586 26356 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:08.303849 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.316943 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.304114 26358 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:08.310976 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:08.296943 26279 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:08.279539 26338 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:08.280296 26255 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.332119 26297 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:08.332578 23669 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:08.340024 26270 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.344225 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 430) took 1376 ms. Trace:
I20260709 13:09:08.345337 26356 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.347460 26318 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:08.348101 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:08.352238 26370 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.354229 26011 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.326049 26358 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:08.393643 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:08.394546 26358 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.396291 26358 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:08.357136 26210 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:08.397799 23775 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:09:08.398890 23742 leader_election.cc:336] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.766s (SENT)
I20260709 13:09:08.383620 24386 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEARNER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:08.381098 26370 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.376930 23774 rpcz_store.cc:276] 0709 13:09:06.967381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.969647 (+  2266us) service_pool.cc:224] Handling call
0709 13:09:07.026512 (+ 56865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.903905 (+877393us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b1800230ce0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b41304060 00007f2b41304bfb 00007f2b4130f64b
0709 13:09:07.904076 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:07.904421 (+   345us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.181268 (+276847us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.181483 (+   215us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:08.203519 (+ 22036us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.203677 (+   158us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:08.203716 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.203812 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.343945 (+140133us) raft_consensus.cc:1685] finished
0709 13:09:08.343978 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.344137 (+   159us) inbound_call.cc:177] Queueing success response
0709 13:09:08.364600 (+ 20463us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b4800280758. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
Metrics: {"mutex_wait_us":8567,"prepare.queue_time_us":670,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":87426,"raft.run_cpu_time_us":1258,"raft.run_wall_time_us":205085,"spinlock_wait_cycles":8659968,"thread_start_us":356625,"threads_started":2,"wal-append.queue_time_us":350451}
I20260709 13:09:08.387642 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:08.386744 26318 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:08.380081 26270 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:08.411497 26270 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:08.364073 26119 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:08.413283 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:08.413959 23625 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:08.415222 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:08.402587 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:08.402766 23742 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.805s (SENT)
I20260709 13:09:08.404364 23622 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
W20260709 13:09:08.406448 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 73952.2us
I20260709 13:09:08.409003 26318 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.407958 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:08.399777 26267 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.417178 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:08.419979 24358 leader_election.cc:336] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.680s (SENT)
I20260709 13:09:08.422150 23623 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:08.406872 26332 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:08.425513 23742 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.823s (SENT)
I20260709 13:09:08.403522 26297 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.429935 26374 raft_consensus.cc:476] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:08.432229 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:08.433151 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:08.433545 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.440991 26377 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:08.433845 24389 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:09:08.434173 26223 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:08.441674 26377 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.443755 26223 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.444013 26179 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.444218 26223 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:08.449540 26370 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:08.451333 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:08.452682 24388 raft_consensus.cc:2410] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEARNER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:09:08.453079 26362 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.362s	user 0.001s	sys 0.003s
I20260709 13:09:08.417985 26233 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.454581 23773 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:08.434906 26119 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.435999 24386 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:08.458539 24393 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:09:08.461812 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44768.7us
I20260709 13:09:08.467379 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:08.423619 26166 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:09:08.456060 26291 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:09:08.474359 26193 raft_consensus.cc:1064] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
W20260709 13:09:08.474879 26193 raft_consensus.cc:1068] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Unable to promote non-voter b1e32a12daf44ebbbd71cc3ce41d7d8e: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:09:08.473080 23593 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.875s (SENT)
I20260709 13:09:08.475922 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:08.455708 26233 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:08.484189 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:08.485364 26179 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:08.485471 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:08.486392 26179 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.486747 23669 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:08.487537 26179 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.482460 26119 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.490478 26300 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:08.491243 23743 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:08.491406 26300 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:08.492164 26300 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:08.493005 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:08.493505 26232 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:08.493943 26232 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.494302 26232 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:08.494858 26337 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:08.495468 26337 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:08.496410 26337 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.493058 26300 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.499910 26300 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.500828 23669 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:08.501739 26119 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.501981 23743 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:08.502859 26265 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:08.503255 26265 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.503640 26265 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.505249 26318 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:08.505854 26318 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:08.511937 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.513893 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.507160 23743 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:08.530227 23627 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:08.543332 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:08.539440 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:08.544456 23620 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.524231 26255 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.580453 24386 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:08.526547 26193 raft_consensus.cc:2764] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:09:08.561699 26347 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:09:08.559361 26309 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:08.596067 26309 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.604707 26267 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:08.559130 26254 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.605724 26254 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.540709 26119 consensus_queue.cc:1059] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:09:08.532502 26377 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:08.614028 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:08.612896 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:08.615353 23620 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:08.623114 26179 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:08.637953 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 77511.5us
I20260709 13:09:08.551291 26223 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:08.649507 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:08.778019 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.683274 23593 leader_election.cc:336] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.165s (SENT)
W20260709 13:09:08.780001 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 96795.9us
W20260709 13:09:08.780646 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.775028 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.719174 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.785018 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.778923 24358 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.797s (SENT)
I20260709 13:09:08.786412 23743 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:08.786947 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.776011 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 250185us
W20260709 13:09:08.792163 26381 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:09:08.793605 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:08.794327 23626 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:08.793407 26232 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.812664 23771 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:08.814080 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:08.805325 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:08.636992 26377 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:08.815845 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:08.733098 26367 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:09:08.820452 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.821394 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:08.740114 26332 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.732898 26302 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:08.823405 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.760560 26356 raft_consensus.cc:3055] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:08.815675 26175 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.825309 23743 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:08.759172 26254 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:08.829578 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:08.817077 26338 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:08.822206 26377 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.760274 26265 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:08.816360 26179 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:08.867209 26179 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:08.819202 26309 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:08.873562 26309 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:08.844556 26358 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.877482 23628 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:09:08.877730 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 52490.1us
I20260709 13:09:08.843675 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:08.845443 23524 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 217) took 19287 ms (client timeout 15000 ms). Trace:
I20260709 13:09:08.878961 23777 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:08.836941 24386 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:08.824910 26233 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:08.854394 26371 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:09:08.856310 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:08.834026 26318 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:08.834293 26356 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:08.851190 26377 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.865850 26265 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:08.848093 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:08.888435 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:08.891897 26254 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:08.893675 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:08.902387 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 46144.2us
I20260709 13:09:08.931692 23592 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:08.865062 26223 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:08.909708 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:08.940321 23624 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:08.919382 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 89860us
I20260709 13:09:08.942525 23669 leader_election.cc:400] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 8.
I20260709 13:09:08.943018 23669 leader_election.cc:403] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:08.943760 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.837723 26302 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:08.963943 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47202.9us
W20260709 13:09:08.969506 24358 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.902s (SENT)
I20260709 13:09:08.935886 26254 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.905509 26318 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:08.905908 26338 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.910687 26333 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:09:08.945326 26233 raft_consensus.cc:697] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:08.958113 26345 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:08.879130 23524 rpcz_store.cc:269] 0709 13:08:49.538006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.540992 (+  2986us) service_pool.cc:224] Handling call
0709 13:08:50.020911 (+479919us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b54000b90d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41276090 00007f2b41314f3a 00007f2b470cb1cc 00007f2b471c937e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc 00007f2b45689392 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:08.825006 (+18804095us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:04.833140 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:04.833874 (+   734us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:04.833920 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:09:04.833946 (+    26us) tablet.cc:662] Decoding operations
0709 13:09:04.835041 (+  1095us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:04.835108 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:04.835139 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:09:04.836902 (+  1763us) tablet.cc:701] Row locks acquired
0709 13:09:04.836944 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:09:04.837102 (+   158us) write_op.cc:270] Start()
0709 13:09:04.837261 (+   159us) write_op.cc:276] Timestamp: P: 1783602544837041 usec, L: 0
0709 13:09:04.837279 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:09:04.838017 (+   738us) log.cc:844] Serialized 3989 byte log entry
0709 13:09:05.517131 (+679114us) op_driver.cc:464] REPLICATION: finished
0709 13:09:05.552843 (+ 35712us) write_op.cc:301] APPLY: starting
0709 13:09:05.552973 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:05.553253 (+   280us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:05.553413 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:05.554949 (+  1536us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:05.555368 (+   419us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:09:05.555428 (+    60us) write_op.cc:312] APPLY: finished
0709 13:09:05.560371 (+  4943us) log.cc:844] Serialized 77 byte log entry
0709 13:09:05.580712 (+ 20341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:05.592489 (+ 11777us) write_op.cc:454] Released schema lock
0709 13:09:05.596110 (+  3621us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:05.625896 (+ 29786us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:05.625942 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23643,"reported_tablets":44,"spinlock_wait_cycles":14084864,"child_traces":[["op",{"apply.queue_time_us":35365,"apply.run_cpu_time_us":4482,"apply.run_wall_time_us":73006,"num_ops":10,"prepare.queue_time_us":179699,"prepare.run_cpu_time_us":6609,"prepare.run_wall_time_us":71476,"raft.queue_time_us":386292,"raft.run_cpu_time_us":23187,"raft.run_wall_time_us":115443,"replication_time_us":662650,"thread_start_us":389131,"threads_started":4,"wal-append.queue_time_us":65659,"wal-append.run_cpu_time_us":25344,"wal-append.run_wall_time_us":1679270}]]}
W20260709 13:09:09.002269 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 60080.9us
I20260709 13:09:09.008631 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:09.017396 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 170526us
I20260709 13:09:09.002612 26291 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:08.995402 26254 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.010241 26345 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:09.010531 26279 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:09:09.041790 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.029574 26358 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:09.032749 26232 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:09.059819 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:09.036305 26345 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:09.001814 26356 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:09.030108 26267 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:09:09.077803 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.079818 23698 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:09.082791 24389 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:09.047065 26358 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:09.096908 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:09.098805 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.100509 26390 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:09:09.101163 26389 log.cc:927] Time spent T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:09:09.102732 26392 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:09:09.106628 23624 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:09.108145 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.109187 23701 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:09.087842 26358 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:09.075992 26233 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:09.100546 26401 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.129042 26401 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:09.138631 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 160849us
I20260709 13:09:09.121552 26302 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:09.071102 26318 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:09.147150 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.153239 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:09.148118 23742 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.596s (SENT)
I20260709 13:09:09.160612 23704 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:09:09.161094 23704 pending_rounds.cc:85] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 3
I20260709 13:09:09.161360 23704 pending_rounds.cc:107] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:09:09.161630 23704 raft_consensus.cc:2889] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:09.165755 23701 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:09.168428 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.169085 23697 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:09.169553 23697 pending_rounds.cc:85] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 3
I20260709 13:09:09.169816 23697 pending_rounds.cc:107] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:09.169278 23695 raft_consensus.cc:2368] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7.
I20260709 13:09:09.170115 23697 raft_consensus.cc:2889] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:09.171511 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.172232 23702 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:09.173964 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:09.116746 26267 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:09.175000 26267 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:09.177547 26267 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:09.178475 26339 consensus_queue.cc:1059] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:09.178941 23703 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:09.179468 26339 raft_consensus.cc:3055] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:09.180714 26339 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:09.180925 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:09.181572 24394 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:09.181761 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.181677 26339 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:09.182497 23698 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:09:09.183274 26401 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:09.183300 26179 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:09.185300 26179 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:09.186664 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:09.187342 23624 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:09.186866 23699 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:09.190128 23622 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:09:09.180981 23742 leader_election.cc:336] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.867s (SENT)
I20260709 13:09:09.203553 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:09.199420 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:09.205124 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:09.207049 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:09.207962 23704 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.214208 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:09.216212 23702 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:09.221743 23703 raft_consensus.cc:2368] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4.
W20260709 13:09:09.231348 24358 leader_election.cc:336] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.251s (SENT)
I20260709 13:09:09.231896 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:09.239334 23777 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:09.239986 23700 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:09.242089 23624 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:09.247665 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:09.249037 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:09.201821 26396 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.250171 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 298910us
I20260709 13:09:09.250849 23699 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:09.261436 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:09.202031 26339 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.215320 26358 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:09.268085 23700 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:09.268110 23743 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:09.264060 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:09.274462 23703 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:09.276666 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:09.283946 23702 raft_consensus.cc:2368] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 10.
W20260709 13:09:09.276687 23593 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.788s (SENT)
I20260709 13:09:09.285006 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:09.286589 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.287598 23695 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:09.288821 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.289076 23704 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:09.250456 26309 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:09.291352 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 110396us
I20260709 13:09:09.293026 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:09.273207 26401 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:09.294108 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:09.259152 26328 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:09.296602 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:09.297706 23742 leader_election.cc:336] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 3.093s (SENT)
I20260709 13:09:09.289537 23697 raft_consensus.cc:2376] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9. Re-sending same reply.
I20260709 13:09:09.298362 23696 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:09.300318 23695 raft_consensus.cc:2368] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8.
I20260709 13:09:09.300228 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:09.302551 23699 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:09.304339 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:09.306602 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.308820 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.313522 23695 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:09.320082 23704 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
W20260709 13:09:09.320938 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.269434 26396 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:09.258880 26179 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:09.322105 26119 raft_consensus.cc:2955] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:09:09.472180 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.773361 23704 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:09.393513 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.576136 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.737848 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.336109 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.348276 23697 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:09.299664 26175 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:09.357774 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 90062.6us
I20260709 13:09:09.329442 24389 raft_consensus.cc:2955] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:09.370051 23698 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
W20260709 13:09:09.382311 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 90280.5us
I20260709 13:09:09.811329 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:09.352594 26405 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.096s	user 0.004s	sys 0.000s
W20260709 13:09:09.817682 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.511474 26222 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.824594 24358 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.895s (SENT)
I20260709 13:09:09.828255 26374 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.361017 23695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:09:09.843065 23695 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:09.843518 23695 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:09.485996 23696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:09:09.486693 26332 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.834147 26322 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.834558 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:09.385310 26190 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:09.570089 26291 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 8.
I20260709 13:09:09.835937 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:09.836894 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.838771 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.857352 23698 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:09.844322 23696 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:09.858143 23696 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.847862 23704 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
W20260709 13:09:09.549906 26408 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:09:09.595263 26254 consensus_meta.cc:287] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
I20260709 13:09:09.551182 26297 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:09.785857 26358 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:09.836444 23777 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:09.849635 23697 raft_consensus.cc:2376] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9. Re-sending same reply.
I20260709 13:09:09.785588 26401 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.482499 26255 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:09.861855 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.786527 26356 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:09.836460 26377 consensus_meta.cc:287] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.891s	user 0.013s	sys 0.001s
W20260709 13:09:09.927119 23593 leader_election.cc:336] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.510s (SENT)
I20260709 13:09:09.382628 26027 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:09.865558 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.870862 26223 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:09.816987 26407 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:09.874365 26179 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:09.976830 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 127622us
I20260709 13:09:09.850077 26222 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:09.856637 26374 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:09.879458 26406 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:09:09.861090 26322 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:09.856323 26338 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:09.888418 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.003391 23704 raft_consensus.cc:2376] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6. Re-sending same reply.
I20260709 13:09:09.886754 23696 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:09.395633 26345 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:09.892597 26254 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:09.947393 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:09.964721 23698 raft_consensus.cc:2376] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7. Re-sending same reply.
I20260709 13:09:09.925863 26255 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:09.934918 26339 consensus_meta.cc:287] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.661s	user 0.005s	sys 0.005s
I20260709 13:09:09.913763 26328 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:10.074471 26328 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:09.911440 26401 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.077298 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 458) took 1291 ms. Trace:
I20260709 13:09:10.077627 26401 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:09.973143 26371 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:09.976868 26297 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.100981 23743 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:10.102177 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.102775 23704 raft_consensus.cc:2376] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7. Re-sending same reply.
I20260709 13:09:10.103608 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.104139 23704 raft_consensus.cc:2376] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4. Re-sending same reply.
I20260709 13:09:10.105229 23696 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.109176 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.110260 23698 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:10.021381 26291 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.929620 26358 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:10.001901 26394 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:10.032423 23697 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:09.993881 26407 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.077405 26328 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:09.975471 26190 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:10.017843 26027 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:09:09.891311 26332 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.138604 26332 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.139122 26332 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.978773 26377 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.139951 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.140597 23698 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:10.141438 26377 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.141443 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.142277 23698 raft_consensus.cc:2376] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4. Re-sending same reply.
I20260709 13:09:10.139582 26332 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.077910 23778 rpcz_store.cc:276] 0709 13:09:08.786170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.823461 (+ 37291us) service_pool.cc:224] Handling call
0709 13:09:08.836350 (+ 12889us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:08.883549 (+ 47199us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:09.062767 (+179218us) log.cc:844] Serialized 14 byte log entry
0709 13:09:09.130020 (+ 67253us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b1800208600. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b451e058f 00007f2b3e21f571 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd
0709 13:09:09.358126 (+228106us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:09.773500 (+415374us) log.cc:844] Serialized 52 byte log entry
0709 13:09:09.773682 (+   182us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:09.774118 (+   436us) log.cc:844] Serialized 14 byte log entry
0709 13:09:09.836077 (+ 61959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.836147 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.878878 (+ 42731us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:10.077106 (+198228us) raft_consensus.cc:1685] finished
0709 13:09:10.077126 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.077240 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":244714,"prepare.queue_time_us":18504,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":8106,"raft.queue_time_us":201429,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":24069,"spinlock_wait_cycles":130626176,"thread_start_us":379145,"threads_started":2,"wal-append.queue_time_us":473682}
I20260709 13:09:10.124292 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.143296 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.143887 23704 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.144076 23698 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:10.141486 26339 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:10.145278 26339 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:10.146193 26339 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:09.965345 23593 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:10.148726 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 221639us
W20260709 13:09:10.149309 23593 leader_election.cc:336] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.514s (SENT)
I20260709 13:09:10.126396 26291 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.152055 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:10.152649 23593 leader_election.cc:336] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.670s (SENT)
I20260709 13:09:10.152801 24388 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:09:10.153090 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:10.022636 26338 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.155236 26338 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.155949 26318 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:10.156399 26415 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:09:10.156694 26318 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:10.157308 26416 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 13:09:10.158663 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:10.159065 23668 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:10.079644 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 237160us
I20260709 13:09:10.127305 26329 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:09:10.145092 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.101254 26386 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.175765 23593 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.768s (SENT)
I20260709 13:09:10.163834 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.176481 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:10.177081 23703 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:10.165050 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:10.165391 23698 raft_consensus.cc:2376] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6. Re-sending same reply.
I20260709 13:09:10.179536 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.168704 23773 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:10.178479 23775 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:10.186911 23621 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:10.190471 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.194502 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:09:10.164673 26413 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.330s	user 0.000s	sys 0.002s
W20260709 13:09:10.170699 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.202621 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.173586 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.096815 23695 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.204363 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.201207 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.205596 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.136456 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.206533 23701 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.204452 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:10.151641 26291 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.209157 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.169816 23704 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
W20260709 13:09:10.214536 23593 leader_election.cc:336] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.820s (SENT)
I20260709 13:09:10.215373 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:10.222133 23778 raft_consensus.cc:3055] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:10.222500 23778 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:10.216367 26377 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:10.200471 26166 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:10.120317 26371 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.218039 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.217371 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.219369 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.219820 23695 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.135805 26358 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.219069 23704 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:10.220608 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.215046 23703 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.240495 23626 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.225927 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:10.231503 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:10.223184 23778 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.248059 23778 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:10.225550 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 363471us
I20260709 13:09:10.191591 26386 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:10.249924 24358 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.198s (SENT)
W20260709 13:09:10.250751 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.252579 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.237943 23627 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:10.257769 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.258244 23695 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:10.263986 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:10.266034 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.268536 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.225868 26338 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.270838 24389 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:10.271649 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.281800 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.282351 23629 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:10.290846 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.288488 23697 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:10.227383 26166 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:10.283123 24358 leader_election.cc:336] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.749s (SENT)
I20260709 13:09:10.294826 23695 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:10.291884 23778 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:10.290983 23626 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:10.260782 26011 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.298693 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.280668 26424 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:10.294350 26338 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.280575 26396 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.302474 26422 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:10.216821 26190 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:10.303627 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.304864 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.306686 26300 raft_consensus.cc:1064] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:09:10.322947 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.332110 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:10.339480 23778 raft_consensus.cc:2410] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:10.340184 23621 raft_consensus.cc:2368] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 4.
I20260709 13:09:10.340768 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.335016 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:10.341663 23628 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.341866 23777 raft_consensus.cc:2368] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:10.340821 26422 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.344343 26332 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.345124 26358 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.345278 26422 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.325935 26166 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.351032 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.352530 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:10.353225 24388 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
W20260709 13:09:10.256600 26232 consensus_queue.cc:1175] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9ab488f10c434878a749f261e99a8065" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 2 } }
I20260709 13:09:10.308368 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.307624 26291 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:10.354211 23624 raft_consensus.cc:2368] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6.
I20260709 13:09:10.354496 26291 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.354857 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:10.355648 26435 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:10.356074 26435 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.356407 26435 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.356657 26291 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.323474 26424 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.357468 26424 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.328632 26011 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.326016 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.359622 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.360023 26011 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:10.360776 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.360909 26386 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.328161 26374 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:10.328151 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.356433 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42298 (request call id 463) took 1152 ms. Trace:
I20260709 13:09:10.355674 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.361739 26297 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.353403 26254 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:10.347630 26411 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.513s	user 0.000s	sys 0.011s
W20260709 13:09:10.325261 24358 leader_election.cc:336] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.069s (SENT)
W20260709 13:09:10.373050 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 47786.3us
W20260709 13:09:10.363751 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.364142 23592 leader_election.cc:400] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:10.374897 23592 leader_election.cc:403] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:09:10.322702 23622 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:10.366379 23703 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:10.362689 23773 rpcz_store.cc:276] 0709 13:09:09.203651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.203865 (+   214us) service_pool.cc:224] Handling call
0709 13:09:10.356268 (+1152403us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b5400341cd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:10.356380 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908145920}
I20260709 13:09:10.376570 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.314385 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.363770 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:10.382720 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.384560 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.385115 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:10.385949 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.386631 23621 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.343629 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:10.387840 23629 raft_consensus.cc:2410] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:10.388155 24386 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.388674 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.390172 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.377131 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.392567 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.369957 23701 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:10.393558 23704 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:10.393661 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.394552 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.329734 26345 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.338898 26396 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.397158 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:10.398520 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 58071us
I20260709 13:09:10.408299 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.408550 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.422719 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.422719 23703 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:10.423887 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.329857 26222 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:10.406963 23628 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:10.425956 23698 raft_consensus.cc:2410] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:09:10.428776 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.430624 23695 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7.
I20260709 13:09:10.431246 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.432081 23696 raft_consensus.cc:2410] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:10.431708 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.424782 23621 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:10.435165 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.282079 26395 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.138s
W20260709 13:09:10.425143 23669 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54670 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
I20260709 13:09:10.429417 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.391960 26374 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:10.438879 23703 raft_consensus.cc:2368] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:10.440827 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.441411 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.442049 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.442452 23701 raft_consensus.cc:2368] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:10.398756 26401 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:10.442691 23696 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:10.396308 26403 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:10.446638 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 245357us
I20260709 13:09:10.446892 23622 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:10.449213 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.450130 23703 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:10.447505 23628 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:10.419510 26423 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:10.420603 26255 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.476821 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:10.451408 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 541053us
I20260709 13:09:10.479386 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:10.425136 26426 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:10.470484 23621 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:10.469933 23628 pending_rounds.cc:85] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 7
I20260709 13:09:10.481364 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.484167 23628 pending_rounds.cc:107] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:10.484398 23699 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:10.433760 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:10.481547 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.421447 26332 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:09:10.484504 23628 raft_consensus.cc:2889] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:10.485967 23695 raft_consensus.cc:2376] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9. Re-sending same reply.
W20260709 13:09:10.513283 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 231808us
I20260709 13:09:10.515031 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:10.509516 23742 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:10.480715 26337 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:10.523950 23627 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:10.427910 26396 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.483441 26426 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.526705 23627 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:10.532809 23627 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:10.443985 23669 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54670 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1418)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1382)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1411)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1378)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1381)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1401)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 275)
I20260709 13:09:10.514149 26011 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:10.471845 26403 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.477113 26401 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.508172 26255 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:10.530824 23742 leader_election.cc:336] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.533s (SENT)
I20260709 13:09:10.543891 26396 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:10.544601 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:10.524893 26422 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:10.544740 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:10.545594 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:10.553051 23773 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:10.553381 23773 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:10.546283 26420 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:10.546486 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:10.546891 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:10.525239 26337 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:10.546502 23743 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:10.547458 26436 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:09:10.548102 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:10.548444 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:10.589941 23771 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:10.550586 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:10.556352 23773 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.562934 26371 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.562765 26255 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.600791 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.601466 23704 raft_consensus.cc:2376] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4. Re-sending same reply.
I20260709 13:09:10.602471 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.564519 26337 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.572819 23697 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:10.537861 26426 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:10.548141 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:10.589998 26119 consensus_meta.cc:287] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.762s	user 0.003s	sys 0.007s
I20260709 13:09:10.592988 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:10.610766 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.611402 23625 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
W20260709 13:09:10.611835 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 135099us
W20260709 13:09:10.612540 23593 leader_election.cc:336] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.767s (SENT)
I20260709 13:09:10.595301 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.613611 23699 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:09:10.595597 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 64830.2us
I20260709 13:09:10.597956 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.614943 23698 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.603590 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.617580 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.618598 23704 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:10.605305 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:10.619709 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:10.605522 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.621024 23697 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:10.621480 26440 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:10.622045 26440 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.622017 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.622829 26440 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.604151 23773 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.483569 26423 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.630282 26423 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.630913 23629 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.633211 26440 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.541687 26011 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.636166 26011 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.636543 26440 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:10.549197 26254 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:10.637614 26254 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.549422 26297 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:10.639916 26297 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.640609 26254 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:10.623719 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.642589 23697 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:10.643688 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.644105 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:10.644346 23697 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.601116 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.645539 23623 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.619575 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.652387 26297 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.653362 26297 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:10.612109 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:10.659296 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.660475 23629 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:10.588094 26345 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.664503 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50118.9us
I20260709 13:09:10.591369 26190 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:10.609123 26395 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:10.660475 23773 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:10.668752 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:10.669052 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 57017.4us
I20260709 13:09:10.592025 26422 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:10.672056 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.684844 23625 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.603624 26386 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:10.677321 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:10.686556 23623 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:10.687160 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:10.691756 26297 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:10.697311 25880 tablet_copy_client.cc:538] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:10.698837 26442 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:10.656575 26291 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:10.696473 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:10.709686 23669 leader_election.cc:400] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 2. Current term is 4.
I20260709 13:09:10.710865 23698 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:10.712077 23669 leader_election.cc:400] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6.
I20260709 13:09:10.712410 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.712419 23669 leader_election.cc:403] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:09:10.713514 23698 raft_consensus.cc:2368] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:09:10.714892 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.715770 23699 raft_consensus.cc:2410] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:10.691298 23697 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:10.716719 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.717774 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.662364 26370 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:10.715410 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.697752 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.721908 23698 raft_consensus.cc:2376] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6. Re-sending same reply.
I20260709 13:09:10.607322 26166 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.698892 26297 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.704847 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 99612.2us
I20260709 13:09:10.720170 26291 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:10.713574 26011 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:10.731148 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 73151.2us
I20260709 13:09:10.723582 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.733389 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:10.736930 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:10.739862 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 44992.6us
I20260709 13:09:10.700631 26423 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.754051 23698 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:10.754837 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:10.754932 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.755556 23698 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.745635 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.745491 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:10.756024 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:10.706684 26318 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:10.745525 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 1963) took 1225 ms. Trace:
I20260709 13:09:10.708315 26190 raft_consensus.cc:697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:10.671067 26345 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.746536 26371 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:10.756794 24391 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:10.757447 23700 rpcz_store.cc:276] 0709 13:09:09.505662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.505931 (+   269us) service_pool.cc:224] Handling call
0709 13:09:09.510250 (+  4319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.510776 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.510819 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.511634 (+   815us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.912167 (+400533us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:10.434810 (+522643us) log.cc:844] Serialized 14 byte log entry
0709 13:09:10.435831 (+  1021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.435901 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.730115 (+294214us) raft_consensus.cc:1685] finished
0709 13:09:10.730136 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.730273 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85456,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":2201,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":34335,"thread_start_us":581289,"threads_started":2,"wal-append.queue_time_us":908993}
I20260709 13:09:10.759166 26027 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:10.759452 26254 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:10.783389 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.720510 26386 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.761382 23667 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:10.761240 26233 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:10.791294 26267 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:10.793541 26267 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:10.793840 26450 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:10.793954 26267 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.751808 26297 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.796054 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:10.743388 26358 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6.
I20260709 13:09:10.762503 23778 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:10.762705 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.767822 26119 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:10.796968 26297 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.797295 23699 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:10.798213 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.790102 26435 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.798790 23699 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.704883 26448 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:10.799543 26233 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:10.800103 26233 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:10.769591 26011 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.772550 26255 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.775838 26422 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.800922 26233 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:10.802300 26233 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.802906 26345 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.766952 26318 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:10.779208 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 86267.9us
I20260709 13:09:10.759786 26440 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:10.837642 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:10.838575 26440 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:10.838778 24387 raft_consensus.cc:2393] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:10.838965 26440 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:10.839900 26440 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.841063 26440 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.787999 23698 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:10.841161 24387 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:10.841888 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.843151 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.729250 26370 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.849507 26370 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.757719 26329 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:09:10.768625 26431 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:09:10.804140 23697 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:10.841228 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.856961 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.815760 25880 tablet_bootstrap.cc:492] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:09:10.812744 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:10.864741 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:10.864827 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 52183.6us
I20260709 13:09:10.866444 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:10.763597 26232 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:09:10.818221 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:10.878460 24391 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.783681 26371 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.813205 26358 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:10.816205 26435 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.821292 26318 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.821622 26424 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.825362 24386 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:10.827138 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.828579 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.809031 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.832540 26322 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:10.882153 26233 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:10.819337 23699 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:10.837352 26267 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.841986 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.893635 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.894544 23698 raft_consensus.cc:2368] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10.
I20260709 13:09:10.789671 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:10.829146 23593 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.159s (SENT)
W20260709 13:09:10.895810 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 66812.4us
I20260709 13:09:10.762733 26423 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.871888 23625 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:10.881968 26254 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:10.762512 26395 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:09:10.762219 26339 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:09:10.766700 26429 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:09:10.879674 23624 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:10.794070 26386 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.884163 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.835932 24394 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:10.889210 23629 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:10.890424 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.910377 23703 raft_consensus.cc:2376] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4. Re-sending same reply.
I20260709 13:09:10.910702 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.892378 23700 raft_consensus.cc:2376] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7. Re-sending same reply.
W20260709 13:09:10.897197 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 141257us
I20260709 13:09:10.898597 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.912037 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:10.900992 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:10.824853 26300 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:10.885608 26338 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:10.905676 23704 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:10.906010 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.906268 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.886996 26358 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:10.911254 23629 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.912787 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:10.913669 23698 raft_consensus.cc:2368] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10.
I20260709 13:09:10.930963 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.913862 23669 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:10.914652 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.911182 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.931612 23624 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:10.931771 23701 raft_consensus.cc:2376] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5. Re-sending same reply.
I20260709 13:09:10.916697 23625 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:10.929324 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.912364 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.932643 23700 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:10.932790 23699 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:10.904238 26254 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:10.938851 23629 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:10.933883 23699 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:10.940431 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.945832 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:10.952420 23624 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:10.955094 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:10.956007 23701 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:10.939139 23698 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:10.947055 23699 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:10.939935 26428 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:10.944788 26424 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:10.944231 26386 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:10.978116 23698 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:10.976644 23699 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:10.975504 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:10.984072 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:10.928422 26345 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:09:10.891220 26190 consensus_queue.cc:237] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:10.908094 26318 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:09:10.973016 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:10.988659 24394 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:10.989317 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:10.990912 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:10.995615 23698 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:10.935215 26254 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.997761 23698 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:10.995824 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:10.998838 23701 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:11.000874 23701 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:09:11.001317 23701 pending_rounds.cc:85] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 2
I20260709 13:09:10.987389 26027 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.001608 23701 pending_rounds.cc:107] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:09:11.033669 23701 raft_consensus.cc:2889] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:10.957669 26455 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:11.025022 26421 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:11.025283 26451 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:09:10.997843 26424 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:10.979002 26267 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:11.031925 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:11.057126 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:11.058086 23625 raft_consensus.cc:2368] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6.
I20260709 13:09:11.059108 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:10.940199 26453 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:11.029927 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:10.999491 26233 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:09:11.035825 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:11.036746 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:11.039186 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:11.040948 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:11.034853 26358 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:11.046151 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.054860 26456 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:10.996668 26386 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:11.032994 26119 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:11.059968 26421 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:11.080268 24391 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:10.940793 26422 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
W20260709 13:09:11.067826 23593 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 3.012s (SENT) [suppressed 48 similar messages]
I20260709 13:09:11.085152 23593 leader_election.cc:400] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10.
I20260709 13:09:11.070289 23701 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:11.074045 23624 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:11.076633 23703 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:11.073143 26270 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:11.051664 26455 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:11.078734 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:11.090721 23743 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:11.091132 23593 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:11.066366 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.070940 26374 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:11.083176 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:11.087985 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.108723 23701 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:11.074952 26339 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:11.089707 26270 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.093124 26011 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:11.093712 26452 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:11.096371 26456 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:11.096946 26345 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:11.100314 26426 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:11.100674 26421 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:11.101562 26179 consensus_meta.cc:287] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.104s	user 0.007s	sys 0.005s
I20260709 13:09:11.106542 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:11.107271 23698 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:11.119114 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.127581 26453 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:11.135437 23701 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:11.138599 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.138860 26193 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:11.139757 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:11.126834 26452 consensus_queue.cc:1243] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:11.118561 26270 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:11.118283 26190 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:11.102077 26318 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:09:11.137697 23743 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:11.135324 26456 consensus_queue.cc:1243] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:11.141311 23702 raft_consensus.cc:2368] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5.
I20260709 13:09:11.142243 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.124747 26374 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:11.154620 26374 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:11.156400 26450 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.157043 26450 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:11.145020 26190 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:11.158279 26190 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.141177 26370 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:09:11.160727 26337 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:11.083916 26119 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:09:11.163153 26119 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:11.128662 26011 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:11.134936 26279 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:09:11.164356 26011 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:11.145015 26460 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:11.166744 26027 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:11.167527 26432 raft_consensus.cc:1027] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: attempt to promote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:09:11.167941 26395 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:11.168437 26395 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.168852 26395 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:11.169134 26463 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:09:11.140497 26422 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.170792 26422 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:11.144728 26434 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:09:11.133428 26396 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:09:11.174945 26455 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:11.179121 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:11.143997 26453 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:11.179868 23701 raft_consensus.cc:2376] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5. Re-sending same reply.
I20260709 13:09:11.180905 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.150715 26458 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:11.146754 26267 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.182009 26267 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:11.182651 26426 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:11.184185 26267 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:11.180567 26453 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:11.185287 23701 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:11.188576 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:11.135618 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:11.192878 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44476.3us
I20260709 13:09:11.194365 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.195905 26422 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:11.202453 26464 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:11.202281 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:11.205646 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.207159 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.210728 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:11.212291 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:11.214442 23701 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
W20260709 13:09:11.216971 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 87871.4us
I20260709 13:09:11.218947 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:11.221540 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:11.225008 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:11.226001 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:11.228119 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:11.232059 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.234699 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.239933 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.240484 23701 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:11.241624 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.225822 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:11.244467 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:11.245591 26467 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:11.258513 23698 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:11.263669 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:11.265530 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:11.266705 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:11.268824 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.269658 23701 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 4: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:11.215198 26356 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:09:11.271502 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.275507 23698 raft_consensus.cc:2368] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:11.276376 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:11.277040 23698 raft_consensus.cc:2368] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:11.277809 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.278520 23698 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:11.220968 26446 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:11.221750 26426 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.279340 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:11.286454 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.281847 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:11.287623 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:11.223841 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:11.226769 26458 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:11.293854 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.239895 26179 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.240597 26452 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:11.295413 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54321.5us
I20260709 13:09:11.297156 23701 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:11.288446 23698 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:11.267831 26318 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:11.215416 26422 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:09:11.326387 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.330371 23701 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:11.323948 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:11.327091 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1378) took 1030 ms. Trace:
I20260709 13:09:11.332010 23700 rpcz_store.cc:276] 0709 13:09:10.296700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.934606 (+637906us) service_pool.cc:224] Handling call
0709 13:09:10.958061 (+ 23455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.989925 (+ 31864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.989956 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:10.990582 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.072064 (+ 81482us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:11.142239 (+ 70175us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.144339 (+  2100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.144427 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.326876 (+182449us) raft_consensus.cc:1685] finished
0709 13:09:11.326897 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.327035 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4452,"prepare.queue_time_us":78227,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":6769,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":9544,"thread_start_us":94423,"threads_started":2,"wal-append.queue_time_us":103038}
I20260709 13:09:11.282537 26291 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:11.283960 26424 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:11.280632 26339 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:11.239063 26267 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:09:11.240254 26119 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:09:11.296456 26458 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:11.291983 26297 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:11.321084 26478 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:11.360927 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:11.361593 23698 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:11.361956 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:11.345172 26291 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:11.345942 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 135535us
I20260709 13:09:11.291848 26255 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:11.355677 23669 leader_election.cc:400] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6.
I20260709 13:09:11.327099 26318 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:11.303117 26452 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:11.322744 26477 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:11.295477 26426 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:11.346552 26179 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.379055 26457 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:11.377521 26477 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:11.379627 26469 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:09:11.380483 26462 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 13:09:11.382573 26465 log.cc:927] Time spent T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:09:11.383036 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1408) took 1068 ms. Trace:
I20260709 13:09:11.383980 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:11.383416 26426 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:11.383453 23703 rpcz_store.cc:276] 0709 13:09:10.314481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.910962 (+596481us) service_pool.cc:224] Handling call
0709 13:09:11.382874 (+471912us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400405454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:11.382979 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332962048}
I20260709 13:09:11.367697 23669 leader_election.cc:403] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:09:11.370673 26193 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:11.361060 26458 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:11.374440 26254 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:11.425787 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 191531us
I20260709 13:09:11.357322 26267 consensus_queue.cc:1243] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:11.428581 24391 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:09:11.377552 26318 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.430032 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:11.430873 24391 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:11.377715 26302 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:11.378150 26452 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:11.356509 26339 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:11.361285 26190 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:11.384359 26434 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:11.363854 26297 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:11.433785 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 78445.2us
I20260709 13:09:11.432581 26302 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:11.433635 26267 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:11.435544 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:11.436110 26401 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:11.437316 26190 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:11.439940 26291 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:11.467442 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:11.492024 24391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36da9377816744739720cb01b6191368"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:58744
I20260709 13:09:11.492847 24391 raft_consensus.cc:606] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:11.493335 24391 raft_consensus.cc:614] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:11.495283 26302 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:11.496404 26302 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:11.465725 26434 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:11.503804 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:11.473188 26254 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:11.507508 26119 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:11.508069 26467 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:11.519146 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:11.516629 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 162574us
I20260709 13:09:11.522320 23620 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:11.524204 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:11.530182 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:11.532096 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:11.532708 23628 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.536937 23777 raft_consensus.cc:2393] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:11.532697 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:11.541608 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:11.542351 23775 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:11.543963 24359 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:11.544893 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:11.546084 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:11.551944 23628 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:11.555210 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:11.556500 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:11.552901 23620 pending_rounds.cc:85] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 4
I20260709 13:09:11.557204 23620 pending_rounds.cc:107] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:09:11.553428 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:11.557509 23620 raft_consensus.cc:2917] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:09:11.559046 23626 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:11.559269 23620 raft_consensus.cc:2889] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:11.562983 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:11.559700 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:11.564049 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:11.519991 26467 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:11.569742 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:11.597000 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:11.595575 23776 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:11.558539 26309 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.603515 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:11.568698 26377 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:11.562405 26456 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:11.614019 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 80820.2us
W20260709 13:09:11.741080 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 115980us
I20260709 13:09:11.593734 26467 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:11.605386 23771 raft_consensus.cc:2376] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6. Re-sending same reply.
I20260709 13:09:11.595467 26235 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:11.597658 26345 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:11.738608 23626 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:11.589244 26426 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:11.543279 26329 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 13:09:11.619669 26443 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:09:11.739523 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:11.767693 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 174116us
W20260709 13:09:11.786345 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.614025 26339 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:11.609628 26377 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:11.793547 23628 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:09:11.614346 26119 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.184s
I20260709 13:09:11.765763 26401 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:11.614531 26270 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:11.817972 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 258321us
I20260709 13:09:11.619210 26309 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:11.765435 26166 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:11.858809 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:11.790673 26429 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:11.850204 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 293737us
I20260709 13:09:11.864732 23593 leader_election.cc:400] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:11.866046 23593 leader_election.cc:400] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:11.802964 26377 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:11.766732 26337 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:11.859256 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:09:11.824518 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 82297.8us
I20260709 13:09:11.881954 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:11.882203 24357 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:11.817840 26345 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:11.868741 26482 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 13:09:11.855443 26119 consensus_queue.cc:1243] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:11.873479 26444 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.292s
I20260709 13:09:11.867206 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:11.809001 26434 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:11.797278 26235 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:11.861089 26338 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:11.862818 26297 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:11.863325 26475 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:11.915293 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.918141 23743 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:11.933873 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 370933us
I20260709 13:09:11.944872 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1408) took 2684 ms. Trace:
I20260709 13:09:11.945495 23772 rpcz_store.cc:276] 0709 13:09:09.260868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.272636 (+ 11768us) service_pool.cc:224] Handling call
0709 13:09:09.908374 (+635738us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.978021 (+ 69647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.978052 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:10.081416 (+103364us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b2c0012bcd8. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:09:10.081911 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.420387 (+338476us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:10.420450 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.420549 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.851714 (+431165us) raft_consensus.cc:1685] finished
0709 13:09:10.851766 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.944602 (+1092836us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54003403d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:11.944779 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69250,"raft.queue_time_us":85041,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6950,"spinlock_wait_cycles":1453121536,"thread_start_us":282870,"threads_started":1,"wal-append.queue_time_us":389161,"wal-append.run_cpu_time_us":2881,"wal-append.run_wall_time_us":1348592}
W20260709 13:09:11.958281 23698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.004s	sys 0.002s
W20260709 13:09:11.959014 23698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.004s	sys 0.002s
W20260709 13:09:11.918773 26421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.002s	sys 0.005s
I20260709 13:09:11.907796 26338 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:11.873507 26429 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:11.974088 24359 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:11.971050 26421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.002s	sys 0.005s
I20260709 13:09:11.981834 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:11.897176 26345 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:11.972893 26498 raft_consensus.cc:2764] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:09:11.986568 23700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.017s	sys 0.006s
I20260709 13:09:11.902567 26458 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:11.988075 23696 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
W20260709 13:09:12.009775 23700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.018s	sys 0.006s
I20260709 13:09:12.010456 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:12.009946 23696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1414) took 1685 ms (client timeout 1963 ms). Trace:
W20260709 13:09:12.014391 23696 rpcz_store.cc:269] 0709 13:09:10.324077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.981471 (+1657394us) service_pool.cc:224] Handling call
0709 13:09:12.009880 (+ 28409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.987138 26500 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:11.999753 26267 consensus_meta.cc:287] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.001s
I20260709 13:09:11.930423 26475 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:11.994308 26401 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:12.159113 26302 consensus_meta.cc:287] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.004s
I20260709 13:09:12.161691 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:12.047324 26458 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.160089 26429 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:12.157685 26452 consensus_meta.cc:287] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.700s	user 0.008s	sys 0.004s
W20260709 13:09:12.158494 26502 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.149s	user 0.003s	sys 0.000s
I20260709 13:09:12.047350 26454 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:12.048030 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48002.7us
I20260709 13:09:12.159060 26508 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:12.156858 26506 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:09:11.980868 26505 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:12.035775 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 51195.6us
I20260709 13:09:12.175784 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:12.210656 23696 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:09:12.018674 26489 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.397s	user 0.000s	sys 0.001s
W20260709 13:09:12.193670 26318 consensus_meta.cc:287] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.764s	user 0.005s	sys 0.008s
W20260709 13:09:12.139107 26501 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:09:12.047056 26484 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 13:09:12.065511 26395 consensus_meta.cc:287] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.896s	user 0.014s	sys 0.000s
I20260709 13:09:12.000505 26329 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:12.158602 26345 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:12.047209 26479 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.344s
I20260709 13:09:12.038581 26267 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6.
I20260709 13:09:12.051096 26498 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.205389 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.017997 26407 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:12.228260 23776 raft_consensus.cc:2410] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:12.196758 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:12.057030 26456 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:12.161520 26496 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.219444 23622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:09:12.235919 23622 raft_consensus.cc:606] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Received request to transfer leadership to TS 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:12.236382 23622 raft_consensus.cc:614] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:12.229022 23775 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:12.232102 26493 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:12.232692 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:12.234586 26456 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:12.000470 26396 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.219s
I20260709 13:09:12.239670 24391 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:12.216441 26454 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:12.017869 26500 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.008466 26235 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:12.255661 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:12.199503 26452 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.257514 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:12.257889 23696 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
W20260709 13:09:12.247603 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 380502us
I20260709 13:09:12.040005 26338 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:12.269017 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:12.223632 26318 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.277817 23622 raft_consensus.cc:2410] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:12.279088 26452 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.248994 26329 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:12.140424 26495 consensus_queue.cc:1059] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.206s
I20260709 13:09:12.251039 26496 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.281603 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:12.282032 26403 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.284016 23775 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:12.266302 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:12.308200 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:12.206717 26508 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:12.290859 26456 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:12.291268 26475 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:12.277462 26332 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:12.296010 25880 tablet_bootstrap.cc:492] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:09:12.297148 26329 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.228132 26395 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.327916 26428 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:12.287081 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:12.344141 23773 raft_consensus.cc:2368] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
W20260709 13:09:12.344811 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 57793.8us
I20260709 13:09:12.310420 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:12.325186 26190 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.329095 23629 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:12.303396 26318 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.289032 26338 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.336205 26494 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:12.336874 25880 tablet_bootstrap.cc:492] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
W20260709 13:09:12.339823 26513 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.127s	user 0.003s	sys 0.010s
I20260709 13:09:12.245837 26454 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:12.303942 23624 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:12.342255 26471 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.357824 26499 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:12.358044 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:12.343986 26428 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:12.331146 26332 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:12.307547 26452 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:12.347470 23695 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.315120 26345 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:12.316593 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:12.366135 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49608.3us
I20260709 13:09:12.272725 26493 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:12.359584 26428 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:12.356873 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:12.362129 25880 ts_tablet_manager.cc:1403] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 1.547s	user 0.028s	sys 0.020s
I20260709 13:09:12.368278 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2010) took 1239 ms. Trace:
I20260709 13:09:12.369102 23622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:09:12.372893 23622 raft_consensus.cc:606] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:12.373473 23622 raft_consensus.cc:614] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:12.374500 23696 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:12.372545 23698 rpcz_store.cc:276] 0709 13:09:11.128531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.368553 (+240022us) service_pool.cc:224] Handling call
0709 13:09:11.368858 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.376469 (+  7611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.376516 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.377006 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.960070 (+583064us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:11.978273 (+ 18203us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.978619 (+   346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.978700 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.248311 (+269611us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b18004052e0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:09:12.360003 (+111692us) raft_consensus.cc:1685] finished
0709 13:09:12.368067 (+  8064us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.368219 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17154,"prepare.queue_time_us":19072,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":8658,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":8190,"spinlock_wait_cycles":19944320,"thread_start_us":576503,"threads_started":1,"wal-append.queue_time_us":683637}
I20260709 13:09:12.357365 26256 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:12.376475 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:12.374053 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2007) took 1266 ms. Trace:
I20260709 13:09:12.379657 23698 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:12.365267 26332 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.376889 26492 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.379520 23700 rpcz_store.cc:276] 0709 13:09:11.114251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.347845 (+233594us) service_pool.cc:224] Handling call
0709 13:09:11.362154 (+ 14309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.362472 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.362500 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.364577 (+  2077us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.010503 (+645926us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:12.372689 (+362186us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.373692 (+  1003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.373777 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.373835 (+    58us) raft_consensus.cc:1685] finished
0709 13:09:12.373854 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.373992 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25831,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":5345,"raft.queue_time_us":2542,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10668,"thread_start_us":951402,"threads_started":2,"wal-append.queue_time_us":835272}
W20260709 13:09:12.377326 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 493790us
I20260709 13:09:12.365890 26452 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:12.395332 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:12.391074 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:12.398931 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.370412 26471 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.399905 23775 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:12.401736 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:12.371217 26407 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:12.355931 26190 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:12.404748 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.405187 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:12.376992 26318 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:12.405767 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.410918 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.411373 23695 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:12.413277 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 295) took 1203 ms. Trace:
I20260709 13:09:12.414302 24394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:58744
I20260709 13:09:12.415060 24394 raft_consensus.cc:606] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:12.413691 23695 rpcz_store.cc:276] 0709 13:09:11.209928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.412198 (+1202270us) service_pool.cc:224] Handling call
0709 13:09:12.412489 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.412959 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.412984 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.413025 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:12.413064 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.413124 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.413223 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.419070 23776 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:12.422983 23696 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:12.425410 23696 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:09:12.427175 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 494063us
I20260709 13:09:12.404307 26407 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:12.406710 26450 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.438207 25880 raft_consensus.cc:359] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.377393 26494 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:12.506021 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 189518us
I20260709 13:09:12.418387 26318 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:12.409546 26492 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:12.512713 23620 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.032s	sys 0.023s
W20260709 13:09:12.643839 23620 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.044s	sys 0.045s
I20260709 13:09:12.636047 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:12.432576 26407 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:12.654871 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:12.655441 23627 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.016s	sys 0.049s
W20260709 13:09:12.655951 23627 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.017s	sys 0.049s
I20260709 13:09:12.445142 24386 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEARNER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:12.666407 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:12.667484 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:12.668191 23621 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:12.667521 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.669063 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:12.506637 26467 consensus_meta.cc:287] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.703s	user 0.013s	sys 0.000s
I20260709 13:09:12.499861 26395 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:12.669514 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.725436 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:12.725724 23702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 1955) took 3426 ms (client timeout 3093 ms). Trace:
W20260709 13:09:12.726102 23702 rpcz_store.cc:269] 0709 13:09:09.298889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.299098 (+   209us) service_pool.cc:224] Handling call
0709 13:09:12.725502 (+3426404us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b5400025654. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:12.725629 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4209976064}
I20260709 13:09:12.688586 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1602) took 1138 ms. Trace:
I20260709 13:09:12.727212 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.705963 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:12.504710 26505 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:12.732942 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.688076 23620 raft_consensus.cc:2955] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:12.734036 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1690) took 2188 ms. Trace:
I20260709 13:09:12.507262 26496 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.506186 26401 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:12.738684 23774 rpcz_store.cc:276] 0709 13:09:10.546018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.552932 (+  6914us) service_pool.cc:224] Handling call
0709 13:09:10.553281 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.638959 (+ 85678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.638990 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:10.639031 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:10.639069 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.733787 (+2094718us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b54002ca6d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:12.733845 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.733975 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196540672}
I20260709 13:09:12.727619 23627 rpcz_store.cc:276] 0709 13:09:11.549906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.550051 (+   145us) service_pool.cc:224] Handling call
0709 13:09:11.550340 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.550655 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.550679 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.551107 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.906524 (+355417us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:12.656361 (+749837us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.688147 (+ 31786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.688250 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.688307 (+    57us) raft_consensus.cc:1685] finished
0709 13:09:12.688320 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.688506 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31348,"raft.queue_time_us":36229,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":30242,"thread_start_us":1031194,"threads_started":2,"wal-append.queue_time_us":359542}
I20260709 13:09:12.596820 26500 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:12.619532 26495 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.754750 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:12.756098 23627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:09:12.444088 26452 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.563669 25880 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:09:12.763743 26318 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:12.764015 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.764668 23769 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:12.765512 26423 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:12.735656 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 327039us
W20260709 13:09:12.766628 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.767068 23769 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:12.703275 26450 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.767838 26495 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.768445 26494 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.769415 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:12.764029 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 293) took 1554 ms. Trace:
I20260709 13:09:12.752139 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.747495 23774 raft_consensus.cc:2955] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:12.576159 26510 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.728519 26520 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:12.764205 26377 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.865s	user 0.008s	sys 0.004s
I20260709 13:09:12.768241 26450 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.756793 23627 raft_consensus.cc:606] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:12.779130 23627 raft_consensus.cc:614] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:12.642163 26493 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:12.770557 23698 rpcz_store.cc:276] 0709 13:09:11.209270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.403805 (+1194535us) service_pool.cc:224] Handling call
0709 13:09:12.407361 (+  3556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.407682 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.407708 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.408159 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.729461 (+321302us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:12.742300 (+ 12839us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.742556 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.742659 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.763801 (+ 21142us) raft_consensus.cc:1685] finished
0709 13:09:12.763825 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.763963 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":223,"prepare.queue_time_us":29019,"raft.queue_time_us":3052,"raft.run_cpu_time_us":491,"raft.run_wall_time_us":42434,"thread_start_us":283785,"threads_started":1,"wal-append.queue_time_us":333183}
I20260709 13:09:12.772421 23621 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:12.777189 26423 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.763674 25880 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:09:12.781724 26423 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.783054 25880 ts_tablet_manager.cc:1434] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.406s	user 0.015s	sys 0.023s
I20260709 13:09:12.783854 26505 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:12.780929 26510 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.784351 26505 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:12.784704 23698 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:12.785604 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2015) took 1210 ms. Trace:
I20260709 13:09:12.785987 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.786053 23698 rpcz_store.cc:276] 0709 13:09:11.575564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.780541 (+1204977us) service_pool.cc:224] Handling call
0709 13:09:12.784294 (+  3753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.785267 (+   973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.785529 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.787431 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.788023 23769 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:12.788211 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.790288 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:12.796914 23592 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:12.798868 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.735193 26467 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:12.790071 26374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.612s	user 0.006s	sys 0.013s
W20260709 13:09:12.805814 26374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.628s	user 0.007s	sys 0.013s
I20260709 13:09:12.806953 23627 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:12.813356 26345 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:12.827162 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 84076.7us
I20260709 13:09:12.808878 26450 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.784749 26505 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.753589 26401 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:12.844327 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1603) took 1292 ms. Trace:
I20260709 13:09:12.801769 26496 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:12.847867 23620 rpcz_store.cc:276] 0709 13:09:11.551954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.552098 (+   144us) service_pool.cc:224] Handling call
0709 13:09:11.552586 (+   488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:11.611610 (+ 59024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.611688 (+    78us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:11.696088 (+ 84400us) log.cc:844] Serialized 582 byte log entry
0709 13:09:11.915781 (+219693us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:12.644341 (+728560us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.843578 (+199237us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.843925 (+   347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.844017 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.844069 (+    52us) raft_consensus.cc:1685] finished
0709 13:09:12.844087 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.844252 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15342,"prepare.queue_time_us":845459,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":47299,"spinlock_wait_cycles":29381376,"thread_start_us":793426,"threads_started":2,"wal-append.queue_time_us":178721}
W20260709 13:09:12.809753 26455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.629s	user 0.000s	sys 0.019s
W20260709 13:09:12.852088 23704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1418) took 2467 ms (client timeout 2050 ms). Trace:
I20260709 13:09:12.855419 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1606) took 1149 ms. Trace:
W20260709 13:09:12.857100 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.850986 23699 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:12.831401 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:12.858161 23699 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:12.862257 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:12.866951 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:12.869928 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:12.852600 23704 rpcz_store.cc:269] 0709 13:09:10.395011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.619288 (+224277us) service_pool.cc:224] Handling call
0709 13:09:12.851815 (+2232527us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54000a0fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:12.852005 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581912448}
I20260709 13:09:12.885802 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.887027 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:12.859182 23699 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:12.855971 23628 rpcz_store.cc:276] 0709 13:09:11.706173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.762541 (+ 56368us) service_pool.cc:224] Handling call
0709 13:09:11.762929 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:11.798271 (+ 35342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.855072 (+1056801us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b5400098b54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:12.855341 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69415808}
I20260709 13:09:12.794430 26377 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:12.897140 26498 consensus_meta.cc:287] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.658s	user 0.005s	sys 0.005s
I20260709 13:09:12.800356 26520 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:12.898362 26498 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:12.851596 26455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.673s	user 0.000s	sys 0.020s
I20260709 13:09:12.898684 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:12.848673 26496 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.849697 26256 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:12.906574 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:12.885811 26450 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.893326 26521 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:12.908342 26492 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.908274 26520 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:12.918620 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:12.919704 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2011) took 1345 ms. Trace:
I20260709 13:09:12.920300 23695 rpcz_store.cc:276] 0709 13:09:11.574290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.417872 (+843582us) service_pool.cc:224] Handling call
0709 13:09:12.432340 (+ 14468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.432806 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.432843 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.445153 (+ 12310us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.731965 (+286812us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:12.803941 (+ 71976us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.804143 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.804214 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.915863 (+111649us) raft_consensus.cc:1685] finished
0709 13:09:12.915883 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.919645 (+  3762us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10099,"prepare.queue_time_us":157025,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":2649,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":25325,"spinlock_wait_cycles":1792,"thread_start_us":278013,"threads_started":2,"wal-append.queue_time_us":307826}
I20260709 13:09:12.922430 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:12.925536 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:12.926429 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:12.926659 23778 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1683) took 2374 ms (client timeout 1879 ms). Trace:
I20260709 13:09:12.927378 23775 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:12.931806 26297 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.932412 26297 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:12.893031 26329 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:12.897562 26119 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:12.927099 23778 rpcz_store.cc:269] 0709 13:09:10.542930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.547901 (+  4971us) service_pool.cc:224] Handling call
0709 13:09:12.916678 (+2368777us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54000591d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:12.916840 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396598528}
I20260709 13:09:12.900804 26423 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.901832 26267 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:12.904917 26496 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.960971 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 292) took 1752 ms. Trace:
I20260709 13:09:12.962294 23776 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:12.961403 23700 rpcz_store.cc:276] 0709 13:09:11.208918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.402836 (+1193918us) service_pool.cc:224] Handling call
0709 13:09:12.442793 (+ 39957us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.447538 (+  4745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.447588 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.501553 (+ 53965us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.738124 (+236571us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:12.892194 (+154070us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.922897 (+ 30703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.922981 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.960766 (+ 37785us) raft_consensus.cc:1685] finished
0709 13:09:12.960786 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.960913 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54779,"prepare.queue_time_us":150410,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":40880,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":36477,"thread_start_us":288745,"threads_started":2,"wal-append.queue_time_us":237055}
I20260709 13:09:12.959187 26520 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.908354 26270 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.899605 26495 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.945405 26329 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.950572 26291 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:12.950217 26450 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:12.989451 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2018) took 1413 ms. Trace:
W20260709 13:09:12.990335 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 60636.5us
I20260709 13:09:12.990664 23695 rpcz_store.cc:276] 0709 13:09:11.576541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.963498 (+1386957us) service_pool.cc:224] Handling call
0709 13:09:12.988949 (+ 25451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.989134 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.989160 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.989198 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:12.989228 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.989277 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.989392 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.993202 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2020) took 1416 ms. Trace:
I20260709 13:09:12.993551 23695 rpcz_store.cc:276] 0709 13:09:11.577123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.992380 (+1415257us) service_pool.cc:224] Handling call
0709 13:09:12.992705 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.992879 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.992905 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.992947 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:12.992987 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.993039 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.993154 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:12.988721 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 70180.4us
I20260709 13:09:13.001437 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:12.999670 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 296) took 1416 ms. Trace:
I20260709 13:09:13.003708 23695 rpcz_store.cc:276] 0709 13:09:11.583139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.994580 (+1411441us) service_pool.cc:224] Handling call
0709 13:09:12.999030 (+  4450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.999219 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.999260 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.999317 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:12.999370 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.999446 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.999599 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.995920 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:12.963315 26454 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:13.014882 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:13.016265 23778 raft_consensus.cc:2410] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:13.017040 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:13.017853 23624 raft_consensus.cc:2410] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:12.992431 23667 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:12.981783 26332 consensus_meta.cc:287] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.600s	user 0.005s	sys 0.005s
W20260709 13:09:12.993009 26338 consensus_meta.cc:287] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.005s
I20260709 13:09:13.021849 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:13.014823 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:12.982038 26329 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.980242 26377 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:12.974251 26467 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.013916 26270 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:13.034389 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2017) took 1458 ms. Trace:
I20260709 13:09:13.034611 26544 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:13.016520 26454 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:13.034898 23704 rpcz_store.cc:276] 0709 13:09:11.576248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.873257 (+1297009us) service_pool.cc:224] Handling call
0709 13:09:12.873678 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.874179 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.874220 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.893892 (+ 19672us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.944281 (+ 50389us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:12.944359 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.945742 (+  1383us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.034080 (+ 88338us) raft_consensus.cc:1685] finished
0709 13:09:13.034114 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.034286 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4451,"raft.queue_time_us":11694,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7349,"thread_start_us":49918,"threads_started":1,"wal-append.queue_time_us":97245}
I20260709 13:09:13.020424 26495 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:13.037556 23624 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:13.038215 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2023) took 1252 ms. Trace:
I20260709 13:09:13.038796 23704 rpcz_store.cc:276] 0709 13:09:11.786318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.036844 (+1250526us) service_pool.cc:224] Handling call
0709 13:09:13.037146 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.037672 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.037717 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.037787 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:13.037842 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.037930 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.038136 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.041568 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2025) took 1153 ms. Trace:
I20260709 13:09:13.042001 23704 rpcz_store.cc:276] 0709 13:09:11.888022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.040549 (+1152527us) service_pool.cc:224] Handling call
0709 13:09:13.040865 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.041062 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.041092 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.041140 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:13.041183 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.041246 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.041507 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.044059 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 300) took 1107 ms. Trace:
I20260709 13:09:13.044562 23704 rpcz_store.cc:276] 0709 13:09:11.936279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.043121 (+1106842us) service_pool.cc:224] Handling call
0709 13:09:13.043467 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.043658 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.043689 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.043759 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:13.043809 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.043871 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.044000 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.974378 26520 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.027045 26297 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.051568 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 301) took 1037 ms. Trace:
I20260709 13:09:13.036453 26401 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:13.035133 26544 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.045670 26454 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:13.052861 26544 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.013844 26395 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:09:13.053444 23704 rpcz_store.cc:276] 0709 13:09:12.014134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.050732 (+1036598us) service_pool.cc:224] Handling call
0709 13:09:13.051044 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.051222 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.051251 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.051295 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:13.051333 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.051391 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.051510 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.025565 26332 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.047565 26270 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:13.058672 26270 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:13.059420 26520 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.059746 26270 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.046371 26495 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:13.064494 26495 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:13.064738 26428 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.001s
I20260709 13:09:13.065102 26332 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:13.065227 26428 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.065901 26371 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.066040 23698 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:13.067020 26434 raft_consensus.cc:3055] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:13.067453 26434 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:13.068312 26434 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.069360 26434 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.070811 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:13.071472 23625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1599) took 2028 ms (client timeout 2181 ms). Trace:
I20260709 13:09:13.049340 26338 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:13.068717 26510 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:13.072060 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:13.071878 23625 rpcz_store.cc:269] 0709 13:09:11.043141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.058797 (+ 15656us) service_pool.cc:224] Handling call
0709 13:09:13.071219 (+2012422us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540037da54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:13.071368 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4271554816}
I20260709 13:09:13.098326 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:13.093640 26332 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:13.094240 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:13.094974 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:13.096802 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:13.096972 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:13.102308 23621 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:13.052482 26297 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:13.102322 23697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 282) took 2548 ms (client timeout 1949 ms). Trace:
I20260709 13:09:13.103245 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:13.103935 23621 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:13.056416 26377 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:13.078630 23592 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:13.103291 23697 rpcz_store.cc:269] 0709 13:09:10.554345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.717576 (+163231us) service_pool.cc:224] Handling call
0709 13:09:13.102129 (+2384553us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b54000893d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:13.102238 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196743552}
I20260709 13:09:13.114539 23625 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:13.119094 23625 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:13.121235 23625 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:13.067688 26428 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:13.168038 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 55231us
I20260709 13:09:13.096685 26505 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:13.174302 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:13.175203 23621 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:13.113263 26371 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:13.138281 26297 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.205227 26297 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.205493 26309 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.104323 26338 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:09:13.208664 23699 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.190363 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:13.212718 26477 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.216799 23625 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:13.218101 23625 raft_consensus.cc:1217] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Deduplicated request from leader. Original: 3.5->[5.6-6.7]   Dedup: 5.6->[6.7-6.7]
I20260709 13:09:13.218583 23625 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 13:09:13.222014 23620 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:13.230468 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 297) took 1647 ms. Trace:
I20260709 13:09:13.230957 23695 rpcz_store.cc:276] 0709 13:09:11.583388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.005282 (+1421894us) service_pool.cc:224] Handling call
0709 13:09:13.005602 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.005921 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.005949 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.006368 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.048277 (+ 41909us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:13.057621 (+  9344us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.057827 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.057906 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.230244 (+172338us) raft_consensus.cc:1685] finished
0709 13:09:13.230267 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.230398 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9415,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":31651,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":14734,"thread_start_us":19665,"threads_started":1,"wal-append.queue_time_us":165683}
W20260709 13:09:13.233635 23773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1420) took 1715 ms (client timeout 1598 ms). Trace:
W20260709 13:09:13.234097 23773 rpcz_store.cc:269] 0709 13:09:11.518702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.518907 (+   205us) service_pool.cc:224] Handling call
0709 13:09:13.233390 (+1714483us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54002c9cd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:13.233561 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1895121152}
I20260709 13:09:13.236222 23770 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:13.120134 26332 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.238199 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2019) took 1661 ms. Trace:
I20260709 13:09:13.238651 23700 rpcz_store.cc:276] 0709 13:09:11.576839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.963878 (+1387039us) service_pool.cc:224] Handling call
0709 13:09:12.964342 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.989145 (+ 24803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.989170 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.989201 (+    31us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:12.989228 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.223553 (+234325us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b5400356e54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:13.223596 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.223713 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56638336}
I20260709 13:09:13.198227 26190 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:13.244998 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.210129 26338 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.250782 26332 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:13.258078 23699 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:09:13.259182 23699 pending_rounds.cc:85] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 6
I20260709 13:09:13.259531 23699 pending_rounds.cc:107] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:09:13.261359 23699 raft_consensus.cc:2889] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:13.260776 26505 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:13.141741 26377 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:13.264743 26386 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:09:13.215233 26496 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.274669 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1417) took 2937 ms. Trace:
I20260709 13:09:13.278765 23699 rpcz_store.cc:276] 0709 13:09:10.371167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.983177 (+612010us) service_pool.cc:224] Handling call
0709 13:09:10.983422 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.850880 (+1867458us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400193aa0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41283dc0 00007f2b4130e1c0 00007f2b4130f231 00007f2b4130bd8f 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c
0709 13:09:13.208424 (+357544us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b58006d1cd0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b412680aa 00007f2b412ea447 00007f2b41302fe7 00007f2b413047de 00007f2b4130eb49 00007f2b4130f416 00007f2b4130bd8f 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4
0709 13:09:13.262071 (+ 53647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.262267 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062810624}
I20260709 13:09:13.289959 23623 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:09:13.289440 26407 consensus_meta.cc:287] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.004s
I20260709 13:09:13.286031 26377 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:13.262814 26544 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.312958 26544 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.342854 26333 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:13.343394 26333 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:13.344352 26333 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.345662 26333 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:13.298630 26407 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.348176 26377 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:13.348830 26377 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.349913 26407 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.351439 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:13.353601 26548 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:09:13.354708 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:13.355235 26508 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:13.357170 26329 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.363051 23774 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:13.364472 26377 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:13.366492 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:13.367189 26496 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.359477 26329 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:13.388375 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.367822 26496 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:13.394146 26495 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.394817 26496 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:13.395339 26452 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.412032 26495 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:13.419070 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2014) took 1843 ms. Trace:
I20260709 13:09:13.419584 23702 rpcz_store.cc:276] 0709 13:09:11.575261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.726944 (+1151683us) service_pool.cc:224] Handling call
0709 13:09:12.739978 (+ 13034us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:12.790803 (+ 50825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.790847 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:12.804379 (+ 13532us) log.cc:844] Serialized 52 byte log entry
0709 13:09:12.959354 (+154975us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:12.987776 (+ 28422us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.988036 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.194843 (+206807us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b1800463120. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:09:13.418742 (+223899us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b5400196254. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:13.418796 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.418842 (+    46us) raft_consensus.cc:1685] finished
0709 13:09:13.418854 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.419005 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31772,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":10882,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":2056,"spinlock_wait_cycles":128423168,"thread_start_us":65395,"threads_started":1,"wal-append.queue_time_us":125333}
I20260709 13:09:13.391106 26454 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.425948 26454 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.427389 26496 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:13.450094 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:13.453630 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.455981 26223 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:13.456688 26223 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.458015 26471 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:13.458928 26223 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:13.459813 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:13.460965 24388 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:13.461114 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:13.455451 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:13.461294 26542 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:13.461864 24393 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
W20260709 13:09:13.466156 26530 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.541s	user 0.004s	sys 0.000s
W20260709 13:09:13.472954 26534 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.547s	user 0.001s	sys 0.002s
I20260709 13:09:13.474630 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1429) took 1673 ms. Trace:
I20260709 13:09:13.475028 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2013) took 1900 ms. Trace:
I20260709 13:09:13.468842 24386 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 13:09:13.475420 23696 rpcz_store.cc:276] 0709 13:09:11.574955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.444858 (+869903us) service_pool.cc:224] Handling call
0709 13:09:12.474454 (+ 29596us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:12.475042 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.475087 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:12.521781 (+ 46694us) log.cc:844] Serialized 52 byte log entry
0709 13:09:12.754855 (+233074us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:12.834442 (+ 79587us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.847005 (+ 12563us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.861103 (+ 14098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.861182 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.465449 (+604267us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:13.474823 (+  9374us) raft_consensus.cc:1685] finished
0709 13:09:13.474849 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.474974 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31223,"prepare.queue_time_us":177771,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":24912,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":37344,"spinlock_wait_cycles":44486912,"thread_start_us":171493,"threads_started":2,"wal-append.queue_time_us":229356}
I20260709 13:09:13.476948 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2176) took 1280 ms. Trace:
I20260709 13:09:13.465303 26542 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:13.477485 23629 rpcz_store.cc:276] 0709 13:09:12.196996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.206601 (+  9605us) service_pool.cc:224] Handling call
0709 13:09:12.206942 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.347553 (+140611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.476652 (+1129099us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400097c54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:13.476864 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279753984}
I20260709 13:09:13.478075 26542 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:13.464931 26531 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.556s	user 0.006s	sys 0.000s
I20260709 13:09:13.479066 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2179) took 1039 ms. Trace:
I20260709 13:09:13.475067 23771 rpcz_store.cc:276] 0709 13:09:11.801395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.801677 (+   282us) service_pool.cc:224] Handling call
0709 13:09:11.802054 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.008924 (+206870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.008961 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.009006 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:12.009051 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.474388 (+1465337us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400430dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:13.474440 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.474577 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473044224}
I20260709 13:09:13.467658 24389 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEARNER]: Advancing to term 5
I20260709 13:09:13.467644 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 490) took 1272 ms. Trace:
I20260709 13:09:13.485174 23772 rpcz_store.cc:276] 0709 13:09:12.195605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.195779 (+   174us) service_pool.cc:224] Handling call
0709 13:09:12.205097 (+  9318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.206378 (+  1281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.206413 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.206475 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:12.206513 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.467332 (+1260819us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5400021054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:13.467400 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.467574 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2421120}
I20260709 13:09:13.480376 23622 rpcz_store.cc:276] 0709 13:09:12.439488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.439677 (+   189us) service_pool.cc:224] Handling call
0709 13:09:12.440182 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.708356 (+268174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.708401 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.728729 (+ 20328us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.865162 (+136433us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:12.865222 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.415540 (+550318us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54000654d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:13.415592 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.472317 (+ 56725us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:13.478790 (+  6473us) raft_consensus.cc:1685] finished
0709 13:09:13.478820 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.478994 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1792,"raft.queue_time_us":11491,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"spinlock_wait_cycles":644688384,"thread_start_us":52182,"threads_started":1,"wal-append.queue_time_us":183310}
I20260709 13:09:13.448220 26495 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:13.487502 26495 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.490496 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:13.491255 24391 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:13.479166 26542 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:13.502530 23625 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:13.502732 26322 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:13.509824 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2016) took 1934 ms. Trace:
I20260709 13:09:13.510551 23698 rpcz_store.cc:276] 0709 13:09:11.575926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.787226 (+1211300us) service_pool.cc:224] Handling call
0709 13:09:12.787638 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.066498 (+278860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.509490 (+442992us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400405954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:13.509739 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639824128}
I20260709 13:09:13.516320 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:13.524911 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2005) took 2441 ms. Trace:
I20260709 13:09:13.503185 26322 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:13.528839 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:13.536599 23667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.065s	sys 0.059s
W20260709 13:09:13.537015 23667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.065s	sys 0.059s
W20260709 13:09:13.537410 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 516579us
W20260709 13:09:13.544891 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 108738us
I20260709 13:09:13.544348 26332 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:13.549521 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:13.549821 26332 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.550239 26358 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:13.550889 26358 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.550292 23775 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.552040 26322 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.552963 26358 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.549978 26356 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:09:13.553615 26322 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:13.559777 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.566987 23775 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
W20260709 13:09:13.582458 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.583248 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.583967 23669 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.031s	sys 0.056s
W20260709 13:09:13.584324 23669 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.031s	sys 0.056s
I20260709 13:09:13.546639 23668 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:13.586315 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:13.589309 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:13.588290 24389 raft_consensus.cc:2955] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEARNER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
W20260709 13:09:13.594009 24358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.019s	sys 0.037s
I20260709 13:09:13.599956 23778 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 13:09:13.599767 24358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.020s	sys 0.037s
I20260709 13:09:13.585112 23743 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:13.600554 26508 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:13.600637 26543 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.610401 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.601544 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 575236us
I20260709 13:09:13.590662 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:13.608280 23770 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:13.620577 24393 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:13.601333 26386 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:13.602984 26508 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:13.609457 26543 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.642304 26508 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.629580 26386 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:13.652732 26543 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:13.686924 23621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.030s	sys 0.022s
W20260709 13:09:13.688148 23621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.031s	sys 0.022s
I20260709 13:09:13.694176 23592 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:13.701777 23525 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 119) took 19964 ms (client timeout 15000 ms). Trace:
I20260709 13:09:13.704432 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:13.706118 23623 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
W20260709 13:09:13.708455 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 120452us
I20260709 13:09:13.525527 23701 rpcz_store.cc:276] 0709 13:09:11.083575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.336557 (+252982us) service_pool.cc:224] Handling call
0709 13:09:11.383718 (+ 47161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.420720 (+ 37002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.420780 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.422393 (+  1613us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.472076 (+ 49683us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:11.508471 (+ 36395us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.508728 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.508805 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.336732 (+827927us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b18002f4a00. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e1ed2a6 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1
0709 13:09:12.337448 (+   716us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b18002f4a00. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:09:12.340957 (+  3509us) raft_consensus.cc:1685] finished
0709 13:09:12.340989 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.524640 (+1183651us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b5400405450. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:13.524819 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36446,"prepare.queue_time_us":15557,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2734,"raft.queue_time_us":37849,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":10331,"spinlock_wait_cycles":118034816,"thread_start_us":18524,"threads_started":1,"wal-append.queue_time_us":58177,"wal-append.run_cpu_time_us":2381,"wal-append.run_wall_time_us":1018657}
W20260709 13:09:13.712298 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 124815us
I20260709 13:09:13.718173 26119 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:09:13.720678 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 136118us
I20260709 13:09:13.722643 26119 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:13.725171 26011 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:13.726210 26011 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:13.728256 26011 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.732424 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:13.733547 24393 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:13.734509 26300 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:13.735208 26300 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.735764 26300 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.736241 26333 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:13.737113 26333 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:13.738991 26333 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.739707 26318 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:13.756728 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:13.757004 26318 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.746698 26297 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:13.768699 26297 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.748894 23622 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:13.749264 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:13.747835 23623 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:13.750341 23629 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:13.741122 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:13.740650 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:13.778014 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54902.4us
I20260709 13:09:13.742035 26329 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.741576 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:13.735239 26233 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:09:13.792469 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:13.777055 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:13.755949 26495 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.749861 26356 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:13.801442 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:13.745774 26119 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.740603 26332 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.741963 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:13.808481 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 217762us
I20260709 13:09:13.809583 24388 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:13.796197 26333 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:13.812229 26339 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:13.812642 26516 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:13.813580 26339 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:13.814983 26232 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:13.812219 26333 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.817885 26297 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:13.820206 26476 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:13.821020 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 73777.6us
I20260709 13:09:13.821995 26193 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:13.822113 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:13.822568 26193 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:13.823482 26267 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:13.823956 26193 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.824796 26267 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.807888 26386 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.826560 23620 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:09:13.823689 23622 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:13.787468 26446 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:09:13.827939 23622 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:13.828030 26329 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.829310 23622 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.830739 26329 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:13.834514 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:13.840027 26495 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:13.840536 26495 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:13.841030 26495 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.841423 26318 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:13.841741 26552 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:09:13.842026 24386 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:13.824862 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:13.843515 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1608) took 1076 ms. Trace:
I20260709 13:09:13.843658 23627 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:13.843928 23621 rpcz_store.cc:276] 0709 13:09:12.767439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.183515 (+416076us) service_pool.cc:224] Handling call
0709 13:09:13.183893 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.184219 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.184246 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.184702 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.689257 (+504555us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:13.689443 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.689657 (+   214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.843206 (+153549us) raft_consensus.cc:1685] finished
0709 13:09:13.843223 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.843433 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":229,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":133,"thread_start_us":502287,"threads_started":1,"wal-append.queue_time_us":587191}
I20260709 13:09:13.845139 26505 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:13.752333 26421 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:09:13.846469 26421 consensus_queue.cc:1243] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:13.847123 26421 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:13.847491 26421 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:13.848125 26496 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.848649 26421 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.848851 26496 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.845963 26505 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.781010 26442 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:13.830778 23622 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.825614 26193 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:13.853982 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:13.855296 24394 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:13.855363 26337 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:13.802016 26356 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:13.856503 26232 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:13.857625 26232 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:13.857229 26356 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.858031 26232 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:13.858918 26356 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.859218 26232 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.862043 26297 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.860618 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:13.856287 26337 consensus_queue.cc:1243] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:13.862950 26297 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.856227 26119 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
W20260709 13:09:13.871971 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 176203us
I20260709 13:09:13.880256 26119 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:09:13.862425 26232 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.880944 26297 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:13.881975 26543 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.882757 26557 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260709 13:09:13.883031 26543 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:13.702478 23525 rpcz_store.cc:269] 0709 13:08:53.736893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.737127 (+   234us) service_pool.cc:224] Handling call
0709 13:09:13.701463 (+19964336us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:09.098598 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:09.104256 (+  5658us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:09.104310 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:09:09.104346 (+    36us) tablet.cc:662] Decoding operations
0709 13:09:09.104826 (+   480us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:09.104929 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:09.104985 (+    56us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:09.105267 (+   282us) tablet.cc:701] Row locks acquired
0709 13:09:09.105295 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:09:09.105514 (+   219us) write_op.cc:270] Start()
0709 13:09:09.105652 (+   138us) write_op.cc:276] Timestamp: P: 1783602549105449 usec, L: 0
0709 13:09:09.105672 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:09:09.106384 (+   712us) log.cc:844] Serialized 533 byte log entry
0709 13:09:10.531580 (+1425196us) op_driver.cc:464] REPLICATION: finished
0709 13:09:10.917081 (+385501us) write_op.cc:301] APPLY: starting
0709 13:09:10.928657 (+ 11576us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:10.934123 (+  5466us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:10.939434 (+  5311us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:10.939668 (+   234us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:10.939869 (+   201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:10.939912 (+    43us) write_op.cc:312] APPLY: finished
0709 13:09:10.940092 (+   180us) log.cc:844] Serialized 23 byte log entry
0709 13:09:10.940259 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:10.940333 (+    74us) write_op.cc:454] Released schema lock
0709 13:09:10.940372 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:10.940796 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:10.940828 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2130837,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":362337,"apply.run_cpu_time_us":2118,"apply.run_wall_time_us":31575,"num_ops":1,"prepare.queue_time_us":305854,"prepare.run_cpu_time_us":43596,"prepare.run_wall_time_us":212249,"raft.queue_time_us":840028,"raft.run_cpu_time_us":50592,"raft.run_wall_time_us":279825,"replication_time_us":1373340,"thread_start_us":921839,"threads_started":4,"wal-append.queue_time_us":398590,"wal-append.run_cpu_time_us":23455,"wal-append.run_wall_time_us":2406253}]]}
I20260709 13:09:13.886773 26549 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.887781 26549 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.819597 26516 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:13.889230 26516 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:13.901136 26421 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:13.920145 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:13.924769 23626 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:13.929812 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:13.931550 26452 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:13.932312 26452 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:13.933822 26452 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.934612 26267 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:13.908497 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 74448us
I20260709 13:09:13.872929 26333 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:13.913496 23701 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:13.886317 26543 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:13.950963 26542 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:13.851202 26442 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:13.955930 26486 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.914873 26496 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:13.973320 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 59914.9us
I20260709 13:09:13.935428 26267 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:13.900503 26300 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:13.977845 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 85736.9us
I20260709 13:09:13.991468 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:13.915549 26332 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 13:09:13.994367 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.997781 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.969458 26119 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:13.999051 26235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.024s	sys 0.039s
W20260709 13:09:13.999786 26235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.025s	sys 0.040s
I20260709 13:09:13.999186 26119 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.002704 26119 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:14.003166 26508 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.003966 24388 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:14.005625 26494 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:14.006443 26494 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.006964 26514 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.007460 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:14.008551 26514 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:14.009414 26494 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:14.011015 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.011755 23696 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:14.014257 23527 catalog_manager.cc:5697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 5, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 5 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.020408 26549 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:14.021147 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.022488 26514 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.023205 26514 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.024068 26486 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.025971 26514 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:14.026834 26486 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:14.028404 23771 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:14.021868 23527 catalog_manager.cc:5697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 6, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 6 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.030246 26235 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:13.900202 26516 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.037846 23527 catalog_manager.cc:5697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.039117 23698 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:14.039997 23527 catalog_manager.cc:5697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:14.041738 23527 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 4, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.005738 26508 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:14.043862 26476 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:14.047164 26267 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:14.053587 23527 catalog_manager.cc:5697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 6, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 6 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.056376 23527 catalog_manager.cc:5697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 7, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 7 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.058440 23527 catalog_manager.cc:5697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 3, term changed from 2 to 4, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.060504 26505 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:14.061002 23527 catalog_manager.cc:5697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 9, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 9 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.062849 26300 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:14.063678 26542 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.066622 26542 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:14.063884 23527 catalog_manager.cc:5697] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 5, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 5 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.068907 26508 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:14.068411 23527 catalog_manager.cc:5697] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 4, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:14.070441 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.071184 26476 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:14.072918 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.071076 23527 catalog_manager.cc:5697] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:09:14.050041 26442 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:14.073597 23771 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:14.075009 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.075255 23771 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:14.073274 26476 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:14.048226 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 65317.1us
I20260709 13:09:14.083130 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:14.086094 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.087508 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.105811 26542 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.106629 26542 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.107205 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.107857 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:14.110374 26542 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:14.116590 23702 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:14.117034 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:13.993075 26339 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:14.118299 26339 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.118717 26339 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:14.073550 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.089094 26476 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:14.140121 23527 catalog_manager.cc:5697] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 5, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 5 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.141426 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:14.142361 23696 raft_consensus.cc:2368] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6.
I20260709 13:09:14.142104 23527 catalog_manager.cc:5697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 8, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 8 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.136283 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:14.154261 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:14.155800 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:14.156109 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:14.156450 23701 raft_consensus.cc:2410] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:14.157569 23700 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:14.157234 23527 catalog_manager.cc:5697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 4, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.160346 23770 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:09:14.162439 26476 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.164142 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.164381 26476 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.164590 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:14.149556 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:14.159783 23527 catalog_manager.cc:5697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.173046 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:14.173656 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:14.174000 24394 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:14.174536 23703 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:14.175527 26337 raft_consensus.cc:3055] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:14.176047 26337 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:14.176255 23777 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:14.177163 26337 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.178745 26337 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.179905 23697 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.183948 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:14.185906 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:14.147039 26300 consensus_queue.cc:1059] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:09:14.190014 26119 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:14.190579 26119 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:14.196426 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:14.190014 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:14.207685 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:14.191159 26545 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:14.213608 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:14.217675 23702 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:14.206266 26300 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:14.232589 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:14.209697 26514 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:14.219439 23527 catalog_manager.cc:5697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 5, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 5 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.204946 26496 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:09:14.221305 26333 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.228950 26300 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.229851 26505 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:14.242321 26514 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:14.222649 26442 consensus_queue.cc:1059] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:09:14.248924 26318 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.297626 26318 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.299117 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:14.191704 26119 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.276237 26222 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.267134 26494 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:14.286134 26345 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:14.287168 26554 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.242s	user 0.004s	sys 0.001s
W20260709 13:09:14.313608 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.288586 26339 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.289499 23527 catalog_manager.cc:5697] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 4, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.293381 26386 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.293883 23714 tablet_copy_service.cc:342] P c885217113574e7489e6c3afb6950f76: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-334c9018414947cabb4405ef47b8018e received from {username='slave'} at 127.0.0.1:54670
I20260709 13:09:14.294270 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:14.294634 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:14.268919 26516 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:14.300195 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46953.1us
I20260709 13:09:14.287873 26396 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:09:14.268621 26300 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.325079 23697 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:14.241884 26495 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.329679 26222 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.330446 26119 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.307879 26494 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:14.301313 26514 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.287714 26377 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:09:14.333463 23699 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:14.364202 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.336267 23527 catalog_manager.cc:5697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 4, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.360275 23714 tablet_copy_service.cc:434] P c885217113574e7489e6c3afb6950f76: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-334c9018414947cabb4405ef47b8018e on tablet 334c9018414947cabb4405ef47b8018e with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:14.343091 23702 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:14.366483 23701 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:14.370180 23700 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:14.375074 26551 raft_consensus.cc:3055] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:14.375571 26551 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:09:14.377095 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.376646 26551 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.382570 26421 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:14.384351 26487 raft_consensus.cc:3055] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:14.384858 26487 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:14.386739 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.384397 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:14.388635 23622 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:14.385095 23527 catalog_manager.cc:5697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 4, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.401618 23623 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:14.400871 23527 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 6, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 6 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:14.396898 23770 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:14.405293 23527 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 5, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 5 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
W20260709 13:09:14.375074 26559 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 13:09:14.407603 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.367659 26494 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:14.414302 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.417500 23527 catalog_manager.cc:5697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 7, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 7 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.375159 26407 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:14.416887 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:14.423514 23778 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:14.403820 26222 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:14.412423 26318 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:14.446292 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.446563 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:14.447623 23777 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:14.447948 23624 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:14.449889 26339 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:14.420310 26233 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:14.452114 26233 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.453543 26495 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:14.444593 26318 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:14.454487 26318 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.454849 26318 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.423210 26407 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:14.456209 26407 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.458039 26407 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.441481 23527 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 3, term changed from 3 to 5, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3), NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 5 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.464668 26551 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.468132 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.469036 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:14.469569 23770 raft_consensus.cc:2410] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:14.462873 23527 catalog_manager.cc:5697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.369796 26345 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.396082 26487 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.486253 23626 pending_rounds.cc:85] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 1
I20260709 13:09:14.490777 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:14.495659 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:14.498744 26300 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.499346 26232 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:14.499552 26421 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:14.500962 26297 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:14.500618 26421 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.501612 26297 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.504545 26297 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:14.499862 26232 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:14.506129 26232 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.508414 26421 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:14.510178 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:14.511263 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:14.491425 23626 pending_rounds.cc:107] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:09:14.511981 23626 raft_consensus.cc:2889] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:14.512671 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:14.513347 23627 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.515327 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:14.486966 26233 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:14.528352 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:14.529042 24394 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:14.531199 23622 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
W20260709 13:09:14.544462 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.510208 26232 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.556037 26297 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:14.556723 26297 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.557143 26345 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:14.558131 26386 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:14.559011 26297 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:14.528579 26442 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:14.559955 26442 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.560493 26442 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.534135 26496 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:09:14.572613 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.573123 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.573727 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.574129 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:14.574846 23774 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.576227 23776 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:14.576397 23775 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:14.584187 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:14.584853 23774 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:14.584401 23527 catalog_manager.cc:5697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 5, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 5 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:09:14.586468 26297 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:14.587190 26297 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.591212 26297 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:14.603855 26421 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:14.604790 26421 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.608256 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:14.613703 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.614198 23771 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:14.614876 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.615151 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.615307 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.615768 26487 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.616026 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.616492 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.616636 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.617370 23770 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:14.620522 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 499) took 1004 ms. Trace:
I20260709 13:09:14.621003 24391 rpcz_store.cc:276] 0709 13:09:13.616234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.622016 (+  5782us) service_pool.cc:224] Handling call
0709 13:09:13.622668 (+   652us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:13.623168 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.623207 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:13.630672 (+  7465us) log.cc:844] Serialized 52 byte log entry
0709 13:09:13.992493 (+361821us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:14.081290 (+ 88797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.094679 (+ 13389us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.620173 (+525494us) raft_consensus.cc:1685] finished
0709 13:09:14.620194 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.620345 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":382,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":5310,"thread_start_us":205593,"threads_started":1,"wal-append.queue_time_us":404776}
I20260709 13:09:14.621171 26300 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:14.626621 26495 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:14.627550 26495 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.628108 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:14.629485 23620 raft_consensus.cc:2410] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:14.630306 26495 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:14.633011 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:14.586690 23527 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.654452 23777 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:14.672964 24394 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:14.668648 23627 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
W20260709 13:09:14.689105 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.571209 26318 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.696098 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.697503 23771 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:14.699986 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 56346.3us
I20260709 13:09:14.669253 26421 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:14.701332 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.711794 23771 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
W20260709 13:09:14.712568 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.708313 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:14.714116 24394 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.718668 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:14.698269 23527 catalog_manager.cc:5697] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 3, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.680409 26505 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:14.692147 26496 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.736192 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:14.742815 26337 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:14.805598 23769 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:14.809311 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:14.741847 26486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.046s	sys 0.036s
I20260709 13:09:14.820227 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.726967 26333 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:09:14.821740 26333 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:14.822144 26333 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:14.792052 26496 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.825220 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:14.825982 24391 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:14.826907 26496 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:14.823057 26333 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.828099 26333 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:14.830621 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:14.842918 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.843698 23773 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
W20260709 13:09:14.845726 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 201650us
I20260709 13:09:14.857590 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:14.860314 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.872710 23622 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:14.846905 26337 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:14.920207 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:14.921437 26337 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.923242 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:14.924078 23773 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:14.926450 26514 consensus_meta.cc:287] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.001s
I20260709 13:09:14.926867 26514 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.927881 23625 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:14.928313 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:14.929116 23775 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
W20260709 13:09:14.842559 26486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.046s	sys 0.036s
I20260709 13:09:14.875078 23667 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:14.880363 26318 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:14.885118 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.885447 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 442962us
I20260709 13:09:14.887523 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:14.888101 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:14.890131 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:14.892670 26567 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:09:14.842875 26505 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.904649 26442 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.908420 23624 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:14.912304 26119 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.912803 26421 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.938788 23668 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:14.941509 24394 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:14.949892 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:14.959630 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:14.877354 26494 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:14.975895 26297 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.965981 26119 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:14.956770 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.948055 26564 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:09:14.980911 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 105956us
I20260709 13:09:14.949010 26407 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:14.982758 23622 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.983314 24389 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:14.983762 26421 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:14.984951 26386 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:14.989713 23773 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
W20260709 13:09:14.990134 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.999641 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:15.000530 23620 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:15.000557 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:14.981860 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:14.989552 23772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.073s	sys 0.095s
W20260709 13:09:15.009487 23772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.073s	sys 0.095s
I20260709 13:09:15.011595 24386 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:15.014896 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.016592 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:15.018561 24359 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:15.024351 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:14.998989 26386 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.027444 23625 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:15.029713 23629 raft_consensus.cc:2410] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:09:15.031783 26505 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.032109 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:15.032404 26421 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.032992 26421 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:15.033234 26514 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.033418 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:15.034844 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:15.037017 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.037602 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.037846 26297 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:15.038107 26494 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:15.038451 26297 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.028033 26386 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.040939 23624 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:15.042014 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:15.042827 23624 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:15.030071 26446 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:15.023268 26407 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.040786 26297 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.043696 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:15.037056 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.048079 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:15.048422 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:15.044354 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:15.056017 23742 leader_election.cc:400] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6.
I20260709 13:09:15.046124 23623 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:15.061033 23742 leader_election.cc:403] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:15.058280 23622 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:15.038144 23592 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:15.050247 26446 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:15.051420 26011 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:09:15.064103 26446 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.051903 26396 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:09:15.068800 26476 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6.
I20260709 13:09:15.043713 26474 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.071069 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:15.068149 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:15.049369 26119 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.040823 26442 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.052755 24388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 513) took 1022 ms. Trace:
I20260709 13:09:15.088339 23623 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:09:15.052985 26407 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.089772 23624 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:15.074306 26514 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:15.098876 23743 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:15.073954 26297 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:15.103091 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:15.109280 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:15.110440 23778 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:15.060477 26486 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:09:15.124480 23625 pending_rounds.cc:85] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 7
I20260709 13:09:15.124833 23625 pending_rounds.cc:107] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:15.125084 23625 raft_consensus.cc:2889] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:15.094455 26318 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:15.090886 26333 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:15.131053 23771 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:15.132630 23743 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:15.099575 26514 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.141067 23624 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:09:15.146224 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 94662us
I20260709 13:09:15.148031 26119 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.148649 26119 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.150738 26119 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.109098 26297 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:15.123821 26233 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:15.104096 26232 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:09:15.164633 23623 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:15.099299 26505 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:09:15.172941 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:15.176136 23778 raft_consensus.cc:2393] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:15.140229 26452 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.173612 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 515) took 1126 ms. Trace:
I20260709 13:09:15.147478 26514 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:15.143160 26516 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:15.185086 26297 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:15.187007 26233 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:15.142746 26318 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:15.146281 26396 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:15.189172 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 175127us
I20260709 13:09:15.180348 23772 rpcz_store.cc:276] 0709 13:09:14.033142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.035903 (+  2761us) service_pool.cc:224] Handling call
0709 13:09:14.036378 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.036948 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:14.411946 (+374998us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.010827 (+598881us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:15.028834 (+ 18007us) log.cc:844] Serialized 26 byte log entry
0709 13:09:15.028976 (+   142us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:15.029020 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.029122 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.154865 (+125743us) raft_consensus.cc:1685] finished
0709 13:09:15.154891 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.159320 (+  4429us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3282,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":7572,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":5943,"thread_start_us":911875,"threads_started":2,"wal-append.queue_time_us":677756}
W20260709 13:09:15.195554 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 152306us
W20260709 13:09:15.207355 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 183058us
W20260709 13:09:15.213156 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 70490.8us
I20260709 13:09:15.178812 26119 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:15.143076 26333 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:15.221134 26318 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:15.195885 26233 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:15.079773 24388 rpcz_store.cc:276] 0709 13:09:14.030333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.030471 (+   138us) service_pool.cc:224] Handling call
0709 13:09:14.030849 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.031227 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.031254 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.031761 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.425222 (+393461us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:14.430180 (+  4958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.440980 (+ 10800us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.052540 (+611560us) raft_consensus.cc:1685] finished
0709 13:09:15.052564 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.052695 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":382687,"threads_started":1,"wal-append.queue_time_us":694812}
I20260709 13:09:15.211953 26300 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.228932 23743 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:15.237505 26586 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:15.243319 26586 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.245678 26586 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.246125 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:15.246876 24392 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:15.248018 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:15.250375 26508 raft_consensus.cc:3055] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:15.250838 26508 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:15.147616 26487 raft_consensus.cc:2955] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:15.210611 26452 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.257663 26421 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:15.239044 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.216840 26396 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:15.258224 26300 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.257186 26587 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.252938 24389 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:15.237212 26232 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:09:15.253860 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:15.230563 26297 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:15.252386 26386 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:15.277194 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:15.277488 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:15.291474 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 78705.5us
I20260709 13:09:15.242321 26333 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:15.278878 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 66064.8us
I20260709 13:09:15.281315 26486 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:15.295158 24359 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:15.294535 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:15.278398 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49536.6us
I20260709 13:09:15.297008 23743 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:15.298491 23667 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:15.288159 26587 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.240177 26119 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:15.302783 26300 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:15.304446 26119 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:15.298791 24388 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:15.299873 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:15.296139 26486 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.310357 26589 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:15.314904 26232 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:15.273666 26586 consensus_queue.cc:1059] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:09:15.319547 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:15.298084 26421 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:15.269706 26508 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:15.331262 26386 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:15.331840 26232 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:15.334878 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:15.336197 26232 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:15.322332 26119 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:09:15.342947 26595 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.319620 26486 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.304684 26233 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.334084 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:15.344813 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:15.351568 24389 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.320648 26594 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:15.358078 26119 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:15.359016 26119 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:15.360255 26119 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.342983 26232 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:15.353155 26386 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.373950 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:15.373898 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 97568.1us
I20260709 13:09:15.367581 26508 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.377051 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:15.392417 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.350550 26595 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:15.391603 26495 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:15.391803 26476 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:15.392908 26601 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:15.414743 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:15.429267 23778 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:15.354315 26396 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:15.379909 26386 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.436869 26587 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.440652 26297 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:15.395614 26452 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.391397 26446 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:15.427770 26601 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:15.459599 26592 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:09:15.481971 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.484392 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 110556us
I20260709 13:09:15.474033 26587 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:15.488669 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:15.489310 26594 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:15.543118 26594 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.499914 26421 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:15.549572 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 60987.7us
I20260709 13:09:15.550539 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:15.551157 26474 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:15.551919 26611 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:15.552485 26611 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:15.552875 26611 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.551952 26586 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:15.554698 26586 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:15.570448 23697 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:09:15.619606 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 287343us
W20260709 13:09:15.615525 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 232090us
W20260709 13:09:15.642727 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.621480 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:15.643316 23699 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:15.500192 26587 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:15.663350 24389 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:15.486579 26297 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:15.621825 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:15.556829 26586 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:16.069959 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.029276 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:16.322243 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.753146 23697 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:09:16.322798 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.323561 23592 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:16.324007 26587 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.167121 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:15.832567 26595 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:15.926028 26119 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.947208 26614 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.938216 26486 consensus_meta.cc:287] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.000s
I20260709 13:09:15.642416 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:15.974875 26337 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.852185 26318 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:16.063022 26607 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.293623 26570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.016s	sys 0.006s
I20260709 13:09:16.247087 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:15.973619 26407 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.838519 26495 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:15.988502 23696 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:15.933393 26487 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.007s
W20260709 13:09:15.880275 26604 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:09:16.097101 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:15.930325 26232 consensus_meta.cc:287] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.001s
I20260709 13:09:15.742985 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:16.171383 26474 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.974197 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:16.046150 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.328040 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:16.055385 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:15.745059 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:16.335781 23704 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:15.925868 26612 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:15.881217 26613 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:15.734201 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:15.741457 23702 pending_rounds.cc:85] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 3
I20260709 13:09:16.358070 23702 pending_rounds.cc:107] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:09:16.358446 23702 raft_consensus.cc:2889] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:15.927619 26386 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:15.948647 26222 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:16.329150 23626 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:16.303570 26235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.004s	sys 0.009s
I20260709 13:09:16.332479 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:16.363263 23696 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:15.880494 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:16.334200 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 713438us
W20260709 13:09:15.926559 26514 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.713s	user 0.007s	sys 0.004s
I20260709 13:09:16.347147 23699 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.069975 23629 raft_consensus.cc:2955] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:16.325452 26297 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:15.944175 26508 consensus_meta.cc:287] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.003s
I20260709 13:09:16.351150 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:16.351861 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:16.366704 23697 raft_consensus.cc:2410] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:16.352628 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:15.896132 26446 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:16.355428 23700 raft_consensus.cc:2410] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:09:16.355655 24359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.002s	sys 0.023s
I20260709 13:09:16.355865 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:16.370955 24359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.002s	sys 0.023s
I20260709 13:09:15.682009 26233 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:16.329456 26570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.017s	sys 0.007s
I20260709 13:09:15.682687 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:16.340406 26396 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.360149 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:16.333258 26232 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:16.365917 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:16.369079 23667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.033s	sys 0.023s
W20260709 13:09:16.382719 23667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.033s	sys 0.023s
W20260709 13:09:16.383203 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.365290 26612 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:16.385306 23667 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.3:45959 timed out after 1.553s (SENT) [suppressed 21 similar messages]
I20260709 13:09:16.374783 23698 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.377820 23668 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:16.371182 23775 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:16.364768 23695 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:09:16.365919 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:16.333796 26339 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.327769 26486 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:16.326563 26119 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:16.386777 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:16.387650 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:16.369256 26235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.004s	sys 0.010s
I20260709 13:09:16.391654 23704 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:09:16.411989 23771 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:16.412782 23696 raft_consensus.cc:2410] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:09:16.383688 26591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.002s	sys 0.010s
I20260709 13:09:15.930069 26611 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:16.400797 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:16.329071 26607 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:16.407498 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:16.328584 26337 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:16.333825 26474 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:16.401412 26011 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.370252 26514 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:16.429940 24389 raft_consensus.cc:2410] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:16.404186 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:16.387641 26396 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:16.430506 26617 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:16.430894 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:16.331037 26407 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:16.444927 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:16.328884 26318 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:16.459857 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:16.485639 23696 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:16.327088 26614 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:16.460654 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:16.331524 26495 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:16.491714 23700 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
W20260709 13:09:16.428364 26591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.003s	sys 0.010s
I20260709 13:09:16.479532 23776 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:16.486765 23703 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:16.409013 26233 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:09:16.496012 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:16.497074 26616 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:09:16.424393 26629 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:16.375334 26222 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:16.662451 23699 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:17.006647 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:16.895078 23701 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.008s	sys 0.017s
W20260709 13:09:17.032764 23701 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.012s	sys 0.024s
W20260709 13:09:17.013651 23698 consensus_meta.cc:287] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.000s
I20260709 13:09:17.033327 23698 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
W20260709 13:09:16.719417 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.031661 23696 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 13:09:17.034405 23696 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
W20260709 13:09:16.679901 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 300858us
I20260709 13:09:16.616233 23772 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:17.036530 23695 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:16.715389 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 355795us
I20260709 13:09:16.497141 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:16.726131 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 320914us
I20260709 13:09:17.037405 23704 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:16.712258 23626 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
W20260709 13:09:16.718819 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 333512us
W20260709 13:09:16.943670 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 1.60267e+06us
I20260709 13:09:17.038584 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:16.624070 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.039319 23700 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
W20260709 13:09:16.803098 24358 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.556s (SENT)
I20260709 13:09:17.040154 24358 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:17.041993 23699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1447) took 1351 ms (client timeout 1735 ms). Trace:
W20260709 13:09:17.042215 23698 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1445) took 1433 ms (client timeout 1701 ms). Trace:
I20260709 13:09:16.473870 26011 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:16.735770 26337 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:16.788451 26235 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.799284 26628 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.319231 26628 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:17.236979 23778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.010s	sys 0.014s
W20260709 13:09:17.320545 23778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.010s	sys 0.018s
W20260709 13:09:17.207072 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 113893us
I20260709 13:09:16.674290 26452 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:17.321599 23593 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.050s (SENT)
I20260709 13:09:17.036006 26612 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:16.639904 26407 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:17.323019 26612 raft_consensus.cc:2764] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:09:17.323117 23698 rpcz_store.cc:269] 0709 13:09:15.600682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.603898 (+  3216us) service_pool.cc:224] Handling call
0709 13:09:17.033729 (+1429831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.324028 26612 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:17.178398 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:17.324572 26612 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.324973 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.326084 23698 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:16.518945 24388 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:16.572875 26486 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:17.119696 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.329802 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.330175 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.007553 26635 log.cc:927] Time spent T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 13:09:17.322672 23699 rpcz_store.cc:269] 0709 13:09:15.681599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.681799 (+   200us) service_pool.cc:224] Handling call
0709 13:09:17.032715 (+1350916us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.044404 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:17.041448 26618 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.332841 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:16.631436 26596 raft_consensus.cc:3055] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:17.332973 26618 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.333810 26596 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:17.334038 23699 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:17.008236 26614 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:17.334833 26596 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:17.335449 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:16.479786 26617 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.353859 26617 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:17.121258 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:17.356344 23777 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.357693 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1733) took 1007 ms. Trace:
I20260709 13:09:16.632627 26601 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.359380 26601 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.360222 26222 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:17.176400 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:17.362138 23704 raft_consensus.cc:2410] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:17.363229 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.350983 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:17.281301 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 243548us
W20260709 13:09:17.338054 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 143708us
I20260709 13:09:17.281231 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 536) took 1883 ms. Trace:
I20260709 13:09:16.572898 26232 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:17.341553 26011 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:17.342857 26615 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.082s	user 0.013s	sys 0.002s
I20260709 13:09:17.321678 26452 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:17.332870 23696 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:16.892520 26396 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:17.319077 26235 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:16.893647 26514 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:16.884485 26454 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.422087 26591 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.422698 26591 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:17.350111 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:16.674045 26587 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:17.424361 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:17.424981 23625 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:17.425532 23624 raft_consensus.cc:2410] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:17.426311 26587 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:17.045034 23629 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.001s
I20260709 13:09:17.426692 26623 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.894622 26607 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:17.351784 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 548680us
I20260709 13:09:17.427260 26623 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.427901 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1730) took 1238 ms. Trace:
I20260709 13:09:17.428349 24359 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:17.428264 23772 rpcz_store.cc:276] 0709 13:09:16.166925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.167062 (+   137us) service_pool.cc:224] Handling call
0709 13:09:17.405193 (+1238131us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540016ba54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:17.405299 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":657706368}
I20260709 13:09:16.536047 26632 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:17.184468 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:17.429795 26589 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:16.869930 26474 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:17.006879 26636 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:09:17.430331 26589 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.155992 26572 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:17.430800 26589 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.017800 26611 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:17.372160 23699 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:17.432515 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.432641 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:17.433189 23699 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:17.433151 23624 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:17.434041 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.429817 26632 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.434623 23699 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:17.434697 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:17.339434 26629 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:17.422178 26454 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.436331 26632 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:17.436425 26629 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.437391 26454 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:17.437558 26632 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:17.438047 26632 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.438410 26632 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.373529 23698 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:17.066646 23626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58448 (request call id 445) took 1480 ms (client timeout 1561 ms). Trace:
W20260709 13:09:17.376025 23703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1449) took 1332 ms (client timeout 1588 ms). Trace:
I20260709 13:09:17.409232 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:17.184424 26570 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:17.336265 26596 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.374085 23770 rpcz_store.cc:276] 0709 13:09:15.397693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.397894 (+   201us) service_pool.cc:224] Handling call
0709 13:09:15.398295 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.398560 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:16.641526 (+1242966us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b180031fba0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b44d043c7 00007f2b413169a7 00007f2b413260bf
0709 13:09:16.641708 (+   182us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.280777 (+639069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.280854 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:17.280911 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.280981 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.281146 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45,"prepare.queue_time_us":4064,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"spinlock_wait_cycles":17499392,"thread_start_us":649499,"threads_started":3}
W20260709 13:09:17.440680 23626 rpcz_store.cc:269] 0709 13:09:15.558229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.558521 (+   292us) service_pool.cc:224] Handling call
0709 13:09:17.038128 (+1479607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.358435 23776 rpcz_store.cc:276] 0709 13:09:16.350014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.350150 (+   136us) service_pool.cc:224] Handling call
0709 13:09:17.357406 (+1007256us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b540032f354. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:17.357562 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229255552}
I20260709 13:09:16.490949 26508 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.398020 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1486) took 1061 ms. Trace:
I20260709 13:09:17.404414 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 450) took 1027 ms. Trace:
I20260709 13:09:17.407155 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:17.412271 23695 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:17.460528 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:17.412297 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:17.462366 23696 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:17.421511 26235 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:17.427536 23697 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:17.429720 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:17.431470 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2230) took 1360 ms. Trace:
I20260709 13:09:17.478155 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.431133 26572 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.478880 23695 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
I20260709 13:09:17.478116 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:17.442160 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.435524 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.443578 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:17.391376 26633 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:09:16.624428 26620 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:17.440856 23703 rpcz_store.cc:269] 0709 13:09:16.043933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.044070 (+   137us) service_pool.cc:224] Handling call
0709 13:09:17.375742 (+1331672us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540008a2d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:17.375951 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352495872}
I20260709 13:09:17.460021 23627 rpcz_store.cc:276] 0709 13:09:16.377059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.377200 (+   141us) service_pool.cc:224] Handling call
0709 13:09:16.389295 (+ 12095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.389518 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:16.718152 (+328634us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.390667 (+672515us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.390729 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:17.390782 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.390849 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.404337 (+ 13488us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1347,"raft.queue_time_us":301047,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":147713,"thread_start_us":972434,"threads_started":3}
I20260709 13:09:17.480158 23699 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:17.478389 23622 rpcz_store.cc:276] 0709 13:09:16.070739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.070889 (+   150us) service_pool.cc:224] Handling call
0709 13:09:16.071172 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.071531 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.071560 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.072118 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:09:16.404307 (+332189us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:16.404348 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.404439 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.431253 (+1026814us) raft_consensus.cc:1685] finished
0709 13:09:17.431275 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.431389 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1252,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"thread_start_us":331755,"threads_started":1,"wal-append.queue_time_us":686245}
I20260709 13:09:17.482774 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:17.483691 23622 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:17.410035 26407 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.403757 26119 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:17.461485 23628 raft_consensus.cc:2376] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5. Re-sending same reply.
I20260709 13:09:17.489552 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:17.459914 23778 rpcz_store.cc:276] 0709 13:09:16.336417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.336545 (+   128us) service_pool.cc:224] Handling call
0709 13:09:16.336820 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.337018 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:16.516526 (+179508us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.397639 (+881113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.397693 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:17.397745 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.397808 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.397943 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58271,"prepare.queue_time_us":905797,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":82251,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":44180,"thread_start_us":971089,"threads_started":2}
I20260709 13:09:17.483300 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:17.451647 23777 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:17.495682 23696 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:09:17.496630 26648 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:09:17.497840 24386 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:17.498943 26643 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.499704 26572 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:17.499536 26643 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.424918 26591 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:17.503522 23622 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:17.456102 26514 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.429550 26623 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:17.508894 23698 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:17.510491 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:17.515846 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.423715 26618 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:17.705490 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 298454us
W20260709 13:09:17.602298 24358 leader_election.cc:336] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.740s (SENT)
I20260709 13:09:17.709280 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:17.579885 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.710336 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1465) took 1088 ms. Trace:
I20260709 13:09:17.710434 23700 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:17.710703 23698 rpcz_store.cc:276] 0709 13:09:16.621837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.328304 (+706467us) service_pool.cc:224] Handling call
0709 13:09:17.710280 (+381976us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.594628 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:17.594470 23701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.003s	sys 0.036s
W20260709 13:09:17.712368 23701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.005s	sys 0.042s
I20260709 13:09:17.707999 23695 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:09:17.566546 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2229) took 1497 ms. Trace:
I20260709 13:09:17.716825 23629 rpcz_store.cc:276] 0709 13:09:16.069055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.069233 (+   178us) service_pool.cc:224] Handling call
0709 13:09:16.069571 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.069834 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:17.427045 (+1357211us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.566096 (+139051us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.566178 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:17.566248 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.566342 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.566484 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14040,"raft.queue_time_us":15434,"raft.run_cpu_time_us":1904,"raft.run_wall_time_us":83890,"thread_start_us":136514,"threads_started":1}
I20260709 13:09:17.718851 23629 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:09:17.719187 23629 pending_rounds.cc:85] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 8
I20260709 13:09:17.719485 23629 pending_rounds.cc:107] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:09:17.719771 23629 raft_consensus.cc:2889] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:17.519716 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:17.705448 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:17.705710 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:17.590230 23667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.012s	sys 0.020s
I20260709 13:09:17.725358 23696 raft_consensus.cc:2376] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7. Re-sending same reply.
W20260709 13:09:17.725442 23667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.014s	sys 0.027s
I20260709 13:09:17.723476 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1442) took 2135 ms. Trace:
I20260709 13:09:17.725970 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.726291 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.726908 23696 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:17.726846 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:17.725996 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 687442us
I20260709 13:09:17.728165 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:17.728232 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 125986us
I20260709 13:09:17.728242 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:17.728765 23696 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
W20260709 13:09:17.729302 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.729758 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.730885 23696 raft_consensus.cc:2410] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:17.732160 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1472) took 1011 ms. Trace:
W20260709 13:09:17.733011 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.733049 26119 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:17.735069 23696 rpcz_store.cc:276] 0709 13:09:16.727872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.729506 (+1001634us) service_pool.cc:224] Handling call
0709 13:09:17.732086 (+  2580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.724781 24392 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:17.733907 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1441) took 2164 ms. Trace:
I20260709 13:09:17.724843 23703 raft_consensus.cc:2376] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6. Re-sending same reply.
I20260709 13:09:17.731385 26623 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:17.736500 23696 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:17.720605 23593 connection.cc:256] RPC call timeout handler was delayed by -2.0573188859999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2439s for a response
I20260709 13:09:17.740355 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.556106 26514 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:17.746541 26514 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:17.503891 24388 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
W20260709 13:09:17.747797 26652 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:09:17.749231 26642 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 13:09:17.509527 26587 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:17.746655 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:17.753747 23620 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.755558 23667 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:17.756016 26637 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:09:17.746541 26655 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:17.756608 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:17.758594 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49406us
I20260709 13:09:17.770685 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1468) took 1118 ms. Trace:
I20260709 13:09:17.677002 26318 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:17.771763 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:17.773445 23696 rpcz_store.cc:276] 0709 13:09:16.622728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.735958 (+1113230us) service_pool.cc:224] Handling call
0709 13:09:17.736310 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.741081 (+  4771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.741490 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.774816 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:17.775853 23703 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:09:17.741452 26657 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:17.778380 26119 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:17.779481 23622 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:17.737929 23701 rpcz_store.cc:276] 0709 13:09:15.569912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.571765 (+  1853us) service_pool.cc:224] Handling call
0709 13:09:15.622514 (+ 50749us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:15.751370 (+128856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.751415 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:15.843397 (+ 91982us) log.cc:844] Serialized 52 byte log entry
0709 13:09:16.339699 (+496302us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:17.035978 (+696279us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.713502 (+677524us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.733536 (+ 20034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.733612 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.733656 (+    44us) raft_consensus.cc:1685] finished
0709 13:09:17.733669 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.733841 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19189,"prepare.queue_time_us":1058584,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":491492,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"thread_start_us":1761647,"threads_started":3,"wal-append.queue_time_us":631019}
I20260709 13:09:17.742285 26612 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:17.783807 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:17.751073 26643 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:17.785970 23700 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:17.784871 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:17.786459 23700 pending_rounds.cc:85] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 3
I20260709 13:09:17.787197 23700 pending_rounds.cc:107] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:17.787576 23700 raft_consensus.cc:2889] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:17.788112 23622 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:17.789096 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:17.791361 23622 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:17.786293 23592 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:17.478034 26508 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.795742 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:17.796406 23629 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:17.799830 26661 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:17.800282 26661 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.800626 26661 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.805946 23627 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:17.811700 26508 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:17.726137 23702 rpcz_store.cc:276] 0709 13:09:15.570229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.570349 (+   120us) service_pool.cc:224] Handling call
0709 13:09:15.621584 (+ 51235us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:16.582923 (+961339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.582964 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:16.616408 (+ 33444us) log.cc:844] Serialized 52 byte log entry
0709 13:09:17.269505 (+653097us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:17.518497 (+248992us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.594182 (+ 75685us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.705325 (+111143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.705404 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.705450 (+    46us) raft_consensus.cc:1685] finished
0709 13:09:17.705463 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.705599 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18047,"prepare.queue_time_us":235091,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":99,"raft.queue_time_us":163191,"raft.run_cpu_time_us":440,"raft.run_wall_time_us":20283,"spinlock_wait_cycles":25344,"thread_start_us":704271,"threads_started":2,"wal-append.queue_time_us":766098}
I20260709 13:09:17.820864 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:17.503772 26620 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:17.508184 26407 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.797034 26318 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:17.830484 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.831203 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1456) took 1482 ms. Trace:
I20260709 13:09:17.831740 23697 rpcz_store.cc:276] 0709 13:09:16.348828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.367381 (+ 18553us) service_pool.cc:224] Handling call
0709 13:09:17.830983 (+1463602us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001329d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:17.831141 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2341498752}
I20260709 13:09:17.823264 26587 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:17.834657 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:17.836776 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 78727us
I20260709 13:09:17.838410 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:17.843950 26586 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.844425 24388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
mode: GRACEFUL
new_leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:58744
I20260709 13:09:17.833743 26318 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:09:17.844573 26667 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:09:17.859355 23593 connection.cc:256] RPC call timeout handler was delayed by -1.96731888599993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2539s for a response
I20260709 13:09:17.862818 24390 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:17.864104 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:17.865080 26680 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:17.865410 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:17.868575 26601 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:09:17.869270 23704 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:17.869302 26601 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:17.874643 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:17.877307 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:17.881927 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.886497 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:17.887265 23699 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:17.848960 26452 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:17.847821 26587 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:17.892017 26653 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:17.898604 26653 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:17.899894 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:17.893740 26318 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:17.895860 26572 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.895255 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:17.903517 24386 raft_consensus.cc:2410] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:17.892047 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:17.886615 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:17.904750 23622 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:17.904947 23695 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:17.900532 24390 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:17.906810 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:17.908090 23620 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:17.872985 26611 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.902482 26601 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.923161 26658 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:17.926591 26617 consensus_meta.cc:287] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.572s	user 0.013s	sys 0.000s
I20260709 13:09:17.895485 26680 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:09:17.911542 26572 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:17.927903 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.896476 26628 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:17.942132 23593 connection.cc:256] RPC call timeout handler was delayed by -1.727018122000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 13:09:17.943611 23593 connection.cc:256] RPC call timeout handler was delayed by -1.617112367000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 13:09:17.944015 23593 connection.cc:256] RPC call timeout handler was delayed by -1.5416188860000375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3012s for a response
W20260709 13:09:17.944373 23593 connection.cc:256] RPC call timeout handler was delayed by -1.4840181220000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 13:09:17.944662 23593 connection.cc:256] RPC call timeout handler was delayed by -1.4780869270000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:09:17.944977 23593 connection.cc:256] RPC call timeout handler was delayed by -1.3991083319999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:09:17.945251 23593 connection.cc:256] RPC call timeout handler was delayed by -1.3544188859999622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32200000000000006s for a response
I20260709 13:09:17.949198 26620 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:17.932462 26611 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.942919 26617 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:17.985176 23625 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:17.921469 26632 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:17.998148 26407 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.006991 26661 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:18.010491 26589 consensus_meta.cc:287] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.004s
W20260709 13:09:18.023948 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 138441us
I20260709 13:09:18.011255 26589 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:18.042908 26684 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:09:18.070030 26617 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:18.070623 24388 raft_consensus.cc:606] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Received request to transfer leadership to TS 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:18.071086 24388 raft_consensus.cc:614] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:18.071702 24394 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:18.076038 26589 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:18.076056 26632 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:18.082973 26596 consensus_meta.cc:287] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
I20260709 13:09:18.083833 23698 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
W20260709 13:09:18.100785 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 70324.9us
W20260709 13:09:18.107072 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 80285.3us
I20260709 13:09:18.110345 26661 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:18.123544 26572 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:18.155308 26688 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:18.151845 26596 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.157001 26612 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.172132 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.176715 26612 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:18.175786 26596 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:18.178306 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.178980 26612 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:18.158552 26629 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.157804 26661 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:18.159904 23742 connection.cc:256] RPC call timeout handler was delayed by -1.4847468600000866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 13:09:18.160446 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.160549 26594 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:18.160857 26011 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:18.161444 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 749810us
I20260709 13:09:18.166524 26516 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:18.167181 26487 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:18.168037 26607 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:18.167273 26508 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.186795 26607 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.170012 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.170704 26591 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:18.171875 24357 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:18.172217 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.173358 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.189318 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.190086 23697 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:18.190354 26572 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.190707 26607 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.191072 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.192584 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.173601 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.175704 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.193282 23773 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:18.193845 23769 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:18.194777 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.194911 23776 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:18.195693 23697 raft_consensus.cc:2410] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:18.196079 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:18.176195 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.198096 23697 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:18.179172 23702 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:18.159245 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.199939 26011 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:18.182960 26516 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.202481 26011 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:18.203269 26516 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.181604 26688 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.204613 26596 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:18.205274 26594 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:18.185680 26661 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:18.206919 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.179632 26629 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:18.208181 26661 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:18.208348 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.186869 26508 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.209008 23702 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:18.209654 26629 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:18.209928 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.174135 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.184823 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.210500 23770 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
W20260709 13:09:18.211215 23742 connection.cc:256] RPC call timeout handler was delayed by -1.0835362990000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 13:09:18.211432 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.212077 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:18.214391 26607 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:18.214969 26607 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.217039 26516 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.217700 26516 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:18.217911 26643 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:18.218739 26516 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.203089 26487 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.205693 26688 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.168998 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.192334 26591 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:18.222910 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.230376 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:18.231348 23774 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.249606 23695 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:18.250893 23701 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:18.251642 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:18.259706 26476 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:18.260416 26476 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.262748 26476 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.263542 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:18.266340 26688 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:18.266865 26688 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.270273 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.276947 24394 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:18.282917 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.283870 24394 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:18.285104 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.285458 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.217952 26607 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.299899 26487 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.207624 26594 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:18.210512 26508 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.301708 26486 raft_consensus.cc:1064] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:09:18.304646 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:18.304903 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.305503 23700 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:18.306095 26623 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:18.305197 26486 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.306520 26623 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.306996 26623 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.278548 26688 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.267386 26632 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:18.310256 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.312777 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:18.295298 24358 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.122s (SENT)
I20260709 13:09:18.313170 24389 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:18.313547 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:18.306429 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.315155 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.316160 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.317749 23695 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
W20260709 13:09:18.319115 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 60031.2us
I20260709 13:09:18.320437 23774 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:18.321781 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:18.323858 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:18.325148 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.326040 23778 raft_consensus.cc:2410] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:09:18.326722 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:18.277422 26644 raft_consensus.cc:3055] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:18.328816 23773 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:18.316012 26603 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.330404 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:18.330626 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.328890 23769 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:18.331220 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.331951 23778 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:18.332178 23769 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:18.330542 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.331259 23776 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:18.333062 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.319576 26572 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:18.331223 23773 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:18.319303 26508 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:18.334376 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.334703 23778 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:18.334815 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.342370 23774 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:18.335599 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:18.341756 23769 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:18.341621 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.343381 23695 raft_consensus.cc:2410] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:18.331759 26487 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:09:18.344743 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.345932 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.346469 23776 raft_consensus.cc:2410] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:18.345005 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:18.347769 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.327787 26625 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.348305 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:18.349099 23696 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:18.329849 26644 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:18.363276 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.364785 23775 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:18.340221 26476 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:09:18.356438 26643 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:18.367524 26644 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.368124 26643 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.348448 26222 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:09:18.368690 26643 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.368853 26644 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:18.369419 23704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1464) took 1748 ms (client timeout 2083 ms). Trace:
W20260709 13:09:18.369818 23704 rpcz_store.cc:269] 0709 13:09:16.621511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.362949 (+741438us) service_pool.cc:224] Handling call
0709 13:09:18.369248 (+1006299us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b540008a7d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:18.369352 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162075520}
I20260709 13:09:18.370996 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.368160 26611 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.375610 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.376288 24394 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:18.371555 23704 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.377141 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.378006 23696 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:18.379086 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.379683 23696 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:18.379858 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.380609 23695 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:18.380594 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.381274 23696 raft_consensus.cc:2376] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9. Re-sending same reply.
I20260709 13:09:18.379200 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:18.383924 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.348261 26516 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:18.387912 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "334c9018414947cabb4405ef47b8018e"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43444
I20260709 13:09:18.389074 26476 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:18.375427 26688 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.392299 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.342012 26603 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:18.346583 26508 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.393625 23743 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:18.394467 26620 consensus_queue.cc:1059] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:18.395529 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:18.396168 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.425303 24392 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:18.383534 23769 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
W20260709 13:09:18.400727 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 53683.9us
I20260709 13:09:18.406929 23704 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:18.407065 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.408028 24391 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:18.407995 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.429721 23699 raft_consensus.cc:2376] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7. Re-sending same reply.
I20260709 13:09:18.408581 26476 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:18.448210 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54645.5us
I20260709 13:09:18.447909 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.683714 26011 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:18.681535 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:18.602541 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 656722us
I20260709 13:09:18.686275 26011 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.686625 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.471877 26337 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:18.687420 23620 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:18.687628 26337 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.680192 26452 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:18.645843 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.688441 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:18.688546 26011 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.688630 26452 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.689342 26505 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:18.684131 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 256825us
W20260709 13:09:18.548044 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.449595 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.497110 23770 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:18.448933 23743 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:18.692772 23704 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:18.630210 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.565893 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.591881 23774 raft_consensus.cc:606] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:09:18.688091 26337 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.397119 26516 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.679309 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.476426 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:18.480682 24387 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:18.700387 23696 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:18.694226 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:18.594347 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2239) took 1087 ms. Trace:
I20260709 13:09:18.580994 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.476447 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:18.602890 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.695281 23701 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:18.662954 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.704442 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.688890 23697 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
W20260709 13:09:18.494568 26693 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:09:18.507895 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.691781 24358 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:18.695320 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:18.710075 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.711122 23697 raft_consensus.cc:2410] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:18.698503 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.699482 23628 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:18.712157 23624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:09:18.703383 23702 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:18.712747 23624 raft_consensus.cc:606] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:18.713121 23624 raft_consensus.cc:614] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:18.709040 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:18.711408 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.713989 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:18.705371 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.701532 23629 rpcz_store.cc:276] 0709 13:09:17.506914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.815563 (+308649us) service_pool.cc:224] Handling call
0709 13:09:17.815947 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.816169 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:17.824885 (+  8716us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.856068 (+ 31183us) log.cc:844] Serialized 14 byte log entry
0709 13:09:18.260593 (+404525us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b180041c4a0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f557 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:09:18.593372 (+332779us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b180041c4a0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b3e221a40 00007f2b3e21c4e4 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287 00007f2b41327208
0709 13:09:18.593860 (+   488us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:18.593935 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:18.594004 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.594099 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.594271 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":734626,"prepare.queue_time_us":436273,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":90,"raft.queue_time_us":746265,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":8751,"spinlock_wait_cycles":8719616,"thread_start_us":30462,"threads_started":1,"wal-append.queue_time_us":97561}
I20260709 13:09:18.693503 24389 raft_consensus.cc:2955] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:18.706489 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.715806 23620 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:18.704696 23698 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:18.602900 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2233) took 1152 ms. Trace:
I20260709 13:09:18.714679 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.700177 26396 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:18.717186 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.717372 26496 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:18.717782 23627 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:18.718012 26222 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:18.718993 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:18.704715 26505 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:09:18.720716 23625 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:18.721131 26666 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:18.721529 26666 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:18.721909 26666 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:18.463979 26644 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:18.717309 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.614244 26598 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:18.491943 26620 consensus_queue.cc:1243] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer b1e32a12daf44ebbbd71cc3ce41d7d8e log is divergent from this leader: its last log entry 6.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:18.724269 26598 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.725390 26654 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:18.725876 26654 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.726294 26654 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:18.723649 26607 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:18.492513 26591 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:18.475492 26476 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.478507 26603 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:18.473462 26508 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.732900 23703 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:18.726787 26598 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.755853 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.741676 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:18.756759 23627 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.757258 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.705626 26516 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:18.745040 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.746335 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.746031 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.717831 26496 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.751664 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.723387 26644 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.752731 26643 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:18.794828 23703 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:18.735666 26607 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.699661 26661 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:18.798983 26607 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.799114 26661 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:18.801326 26661 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:18.801864 26661 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:18.806449 26396 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.807155 26396 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:18.713825 26623 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.808531 24393 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:09:18.809959 26623 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:18.811013 23703 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:18.812697 24359 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:18.813148 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:18.814380 24359 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:18.815320 26442 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:18.829231 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.795058 26644 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.780162 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.785028 23627 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:18.844432 23624 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:18.786654 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.787818 23702 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:18.790217 26496 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:18.796782 23593 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.506s (SENT)
I20260709 13:09:18.798367 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:18.845561 23625 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:18.716825 23623 rpcz_store.cc:276] 0709 13:09:17.450660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.450823 (+   163us) service_pool.cc:224] Handling call
0709 13:09:17.451204 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.451440 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:17.794423 (+342983us) log.cc:844] Serialized 14 byte log entry
0709 13:09:18.602482 (+808059us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:18.602547 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:18.602606 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.602692 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.602822 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":763932,"prepare.queue_time_us":298611,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":707010,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":18003,"thread_start_us":312831,"threads_started":2,"wal-append.queue_time_us":128749}
W20260709 13:09:18.840576 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 364224us
I20260709 13:09:18.842824 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.848665 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:18.849550 23624 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:18.858815 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 409921us
I20260709 13:09:18.802202 26661 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.867537 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.867988 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.830578 26588 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:18.872318 23623 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:18.872753 23743 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:18.874148 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.877818 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.878384 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.879806 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.881052 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.881973 23627 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:18.883792 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.877465 26702 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:09:18.884873 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.885425 26486 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:18.885623 23625 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 9: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:18.885864 26486 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.886221 26486 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.886459 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:18.887650 26702 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:18.895252 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.896003 23702 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:18.896853 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.897024 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:18.898285 24386 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:18.898801 26337 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:18.901077 26594 raft_consensus.cc:3055] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:18.901680 26594 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:18.902891 26594 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.871541 26688 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:18.910143 26666 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.847914 26625 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:18.912528 26625 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:18.914811 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:18.915639 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 118890us
W20260709 13:09:18.916361 23593 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.536s (SENT)
I20260709 13:09:18.916725 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:18.876225 26661 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:18.918413 26641 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:18.928115 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.930066 23622 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:18.897365 23702 raft_consensus.cc:2376] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7. Re-sending same reply.
W20260709 13:09:18.937736 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 66550.3us
I20260709 13:09:18.929054 23624 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:18.928745 23695 raft_consensus.cc:2376] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8. Re-sending same reply.
I20260709 13:09:18.929028 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:18.940951 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:18.946383 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:18.947218 26709 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:18.947458 23700 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:18.948681 26233 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:18.949295 26233 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.949791 26233 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.960801 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:18.961699 23624 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.895288 26643 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:18.966318 26654 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:18.969161 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 52855.4us
W20260709 13:09:18.969889 23593 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.572s (SENT)
I20260709 13:09:18.970304 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:18.976873 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:18.976874 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:18.977717 23625 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:18.977658 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:18.978461 23702 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:18.979055 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 139788us
I20260709 13:09:18.980845 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.982214 23627 raft_consensus.cc:2410] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:18.984249 23624 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:18.986157 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.987000 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:18.987427 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.980247 23743 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:18.988973 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.989862 23624 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:18.988871 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.991379 23771 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:09:18.993125 23593 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.588s (SENT)
I20260709 13:09:18.991294 23627 raft_consensus.cc:2410] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:18.993729 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:18.996812 23624 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:09:19.000008 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:19.000986 23627 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:19.002197 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:19.003046 23627 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:18.997915 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.915001 26607 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:19.011225 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.981848 24359 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.011425 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.012784 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.990973 26011 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:19.022452 23627 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:19.016577 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:19.026816 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45055.8us
I20260709 13:09:19.027680 23627 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:19.023308 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:19.028399 24359 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:19.029716 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:18.990640 26641 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.026118 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:18.999133 26505 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:19.041465 26654 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:19.007704 26702 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.009701 26688 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.031369 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:19.054237 23667 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.056779 23667 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:19.040908 26629 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.005287 26442 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:19.045253 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:19.037987 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:19.060000 23627 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:09:19.048946 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.060664 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 244593us
I20260709 13:09:19.042287 26704 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:19.041467 26641 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.050799 26702 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.062348 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:19.026144 26598 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.065850 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:19.077937 23627 raft_consensus.cc:2410] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:19.066982 26452 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:19.018383 26611 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:09:19.083808 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:19.076876 23625 raft_consensus.cc:2376] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6. Re-sending same reply.
I20260709 13:09:19.076327 24386 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEARNER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:19.067942 26661 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.068625 26714 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:19.052942 26011 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:19.069887 26337 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:19.070959 26496 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.042817 26222 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:19.072201 26442 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.074174 26607 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:19.078855 23702 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
W20260709 13:09:19.067150 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 74074.2us
W20260709 13:09:19.108173 23593 leader_election.cc:336] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.620s (SENT)
I20260709 13:09:19.108690 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.085820 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:19.088178 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:19.058421 26666 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:19.015139 26516 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.063736 26709 raft_consensus.cc:2764] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:09:19.071242 26233 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.092540 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:19.090492 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:19.031913 26476 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:09:19.098304 24393 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:19.084414 26702 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.098790 26629 raft_consensus.cc:2764] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:19.110809 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:19.114612 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:19.104408 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:19.093087 26710 raft_consensus.cc:2764] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:19.104324 26222 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.131819 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:19.142527 23702 raft_consensus.cc:2368] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10.
I20260709 13:09:19.148849 23628 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.149448 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.150418 23702 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:19.144622 23627 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:19.145417 23773 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:19.142521 23700 raft_consensus.cc:2376] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6. Re-sending same reply.
I20260709 13:09:19.097466 26688 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:09:19.152029 23702 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:19.165544 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:19.166241 23627 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:19.167277 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 110541us
W20260709 13:09:19.168668 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 60542.4us
I20260709 13:09:19.169137 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:19.169273 23593 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.701s (SENT)
I20260709 13:09:19.169785 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.096594 26486 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.170637 26598 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.174021 23624 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:19.176148 26714 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:09:19.179088 23593 leader_election.cc:336] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.439s (SENT)
I20260709 13:09:19.179762 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.180804 26598 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:19.182070 23593 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 3.012s (SENT)
I20260709 13:09:19.182711 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.141530 26407 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:19.135880 26706 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.188994 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:19.152531 26222 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.184965 23697 raft_consensus.cc:2955] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:09:19.195538 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 117689us
W20260709 13:09:19.200132 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 109001us
I20260709 13:09:19.202322 23627 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:19.262351 23625 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:19.276599 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 94621.4us
I20260709 13:09:19.188208 26688 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:19.279552 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:19.279652 26688 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:19.284754 26396 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:19.285873 26712 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:09:19.280274 23622 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:19.288098 26661 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:19.280917 26707 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:19.288802 26516 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:19.289057 26707 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:19.284763 26688 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:19.284674 26711 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:09:19.287451 26396 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:19.289894 26707 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.346275 26707 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.348021 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2055) took 1144 ms. Trace:
I20260709 13:09:19.180011 26714 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.324971 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:19.203717 26598 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.333256 26486 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:19.334867 26233 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:19.335753 26715 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:09:19.338158 26496 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:19.337719 26644 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.268100 26710 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:19.348435 23704 rpcz_store.cc:276] 0709 13:09:18.203794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.710991 (+507197us) service_pool.cc:224] Handling call
0709 13:09:18.719719 (+  8728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.835920 (+116201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.835965 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.870259 (+ 34294us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.096976 (+226717us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:19.097027 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.097117 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.347790 (+250673us) raft_consensus.cc:1685] finished
0709 13:09:19.347811 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.347956 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83756,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":320449,"threads_started":2,"wal-append.queue_time_us":448049}
I20260709 13:09:19.331243 26641 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:19.351459 24393 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:19.351933 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 319910us
I20260709 13:09:19.362638 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:19.363369 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2068) took 1090 ms. Trace:
W20260709 13:09:19.352798 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.357514 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:19.363933 23697 rpcz_store.cc:276] 0709 13:09:18.272943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.711894 (+438951us) service_pool.cc:224] Handling call
0709 13:09:18.714079 (+  2185us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:18.982926 (+268847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.982963 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:19.052811 (+ 69848us) log.cc:844] Serialized 582 byte log entry
0709 13:09:19.129545 (+ 76734us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:19.166247 (+ 36702us) log.cc:844] Serialized 14 byte log entry
0709 13:09:19.360600 (+194353us) log.cc:844] Serialized 14 byte log entry
0709 13:09:19.362233 (+  1633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.362302 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.362351 (+    49us) raft_consensus.cc:1685] finished
0709 13:09:19.362367 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.363315 (+   948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30873,"prepare.queue_time_us":72739,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":105820,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":62419,"thread_start_us":290676,"threads_started":2,"wal-append.queue_time_us":116433}
I20260709 13:09:19.365818 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:19.369076 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:19.356318 23628 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
W20260709 13:09:19.360646 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.372098 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.367131 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.379822 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:19.379871 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.383965 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:19.355629 26688 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.388294 23774 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:19.387292 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.392014 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.388794 23777 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:19.387252 26233 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:19.383096 26708 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.396253 23622 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:19.387799 26728 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:19.400748 26728 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.194308 26011 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.401139 26728 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.401299 26644 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:19.367516 26594 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.405295 26702 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.406517 23775 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:19.361141 26710 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:19.390406 26496 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:09:19.387235 26723 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.393290 23669 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.390961 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:19.409890 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:19.413264 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2053) took 1210 ms. Trace:
I20260709 13:09:19.413630 24393 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:19.428854 23696 rpcz_store.cc:276] 0709 13:09:18.203174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.706440 (+503266us) service_pool.cc:224] Handling call
0709 13:09:18.706805 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.983824 (+277019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.983872 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.999220 (+ 15348us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.132503 (+133283us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:19.132555 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.132648 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.412990 (+280342us) raft_consensus.cc:1685] finished
0709 13:09:19.413019 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.413188 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87096,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":348881,"threads_started":2,"wal-append.queue_time_us":355885}
I20260709 13:09:19.416080 23769 raft_consensus.cc:2410] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:09:19.433256 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:19.382244 26486 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:19.429602 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:19.417410 23628 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:19.436462 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:19.438591 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:19.444211 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 275124us
I20260709 13:09:19.445231 23667 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.432457 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:19.433748 26724 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:19.407688 26702 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:19.449071 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2079) took 1062 ms. Trace:
I20260709 13:09:19.449002 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:19.427892 26661 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.428041 26516 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.453531 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:19.453719 26222 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.454641 26611 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:19.446067 26708 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.433269 26586 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:19.409659 26710 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.456316 26641 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:19.455646 26452 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:19.456753 26644 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:19.434531 26486 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:19.449177 26709 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:19.416076 26598 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:09:19.459367 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.450976 26629 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.463639 23625 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:19.460867 23699 rpcz_store.cc:276] 0709 13:09:18.386348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.727767 (+341419us) service_pool.cc:224] Handling call
0709 13:09:18.732622 (+  4855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.842297 (+109675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.842352 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.849150 (+  6798us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.134881 (+285731us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:19.446352 (+311471us) log.cc:844] Serialized 14 byte log entry
0709 13:09:19.448780 (+  2428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.448860 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.448900 (+    40us) raft_consensus.cc:1685] finished
0709 13:09:19.448912 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.449017 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33922,"prepare.queue_time_us":140860,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":73259,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6846,"thread_start_us":524013,"threads_started":3,"wal-append.queue_time_us":301210}
I20260709 13:09:19.446256 26496 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:19.472133 23667 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.473230 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.471771 26704 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:19.458240 26495 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:19.480129 24389 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:19.484495 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:19.472849 26476 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:19.471635 26611 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:19.492764 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:19.480896 26486 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.477568 26644 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.513108 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:19.515848 24394 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:19.494354 26709 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:19.514060 26611 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.488428 26407 raft_consensus.cc:2764] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:09:19.490020 26723 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:19.525437 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.490001 26496 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:19.496481 26516 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.526747 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.517338 26476 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:19.548448 26476 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.514672 26598 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:19.498629 26233 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:09:19.534482 26594 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.546106 26656 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:19.520143 26644 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:19.506405 26396 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:09:19.497359 26661 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:09:19.518234 26701 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.530787 26496 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.523798 26707 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.524034 26629 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.498503 26702 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:09:19.568763 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 96707.6us
W20260709 13:09:19.585472 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 101097us
I20260709 13:09:19.594115 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.555007 26598 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:19.564090 26701 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:19.547709 26728 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.557140 26656 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:19.617223 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:19.574234 26396 consensus_queue.cc:1243] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:19.597822 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.621476 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:19.621798 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 163823us
I20260709 13:09:19.625237 23625 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:19.625982 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:19.627568 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:19.595965 26723 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.631664 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.573784 26654 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:09:19.615998 26701 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.594198 26709 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.629374 26707 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.632040 26495 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.634784 26607 raft_consensus.cc:2764] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:19.658489 23625 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:19.660316 26707 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:19.665676 26707 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.642125 26222 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:19.670652 26476 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.632575 26745 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:19.628890 26508 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:09:19.678504 26723 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:19.679533 26741 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:19.679157 26723 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.629542 26629 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:09:19.681927 26723 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:19.682497 26702 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:19.684068 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2078) took 1298 ms. Trace:
I20260709 13:09:19.688285 23698 rpcz_store.cc:276] 0709 13:09:18.385446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.722736 (+337290us) service_pool.cc:224] Handling call
0709 13:09:18.723006 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.804696 (+ 81690us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:18.805007 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 13:09:18.991970 (+186963us) log.cc:844] Serialized 14 byte log entry
0709 13:09:18.992164 (+   194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:18.992210 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:18.992264 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.346297 (+354033us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b180040c1e0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:09:19.683838 (+337541us) spinlock_profiling.cc:243] Waited 81.5 ms on lock 0x7b5400024c54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:19.683891 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.684012 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19729,"prepare.queue_time_us":7587,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":28872,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":15863,"spinlock_wait_cycles":198034176,"thread_start_us":177981,"threads_started":1,"wal-append.queue_time_us":331191}
I20260709 13:09:19.642797 26661 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:19.675624 23625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "737154dff44a498f96f906fc83416830"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:09:19.693547 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.694012 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.694478 23697 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.694334 23701 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.699901 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.700822 23702 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:19.701756 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.702337 23702 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.704643 23697 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:19.705770 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.707249 23697 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.713812 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.672037 26495 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:19.705904 26611 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.723698 23698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45060
I20260709 13:09:19.728832 23702 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:19.732239 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.733706 23698 raft_consensus.cc:606] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:09:19.729812 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:19.685487 26707 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.732389 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.734776 23701 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:19.706065 26702 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.739074 23697 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:19.641844 26598 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.741180 23699 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:19.742277 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 111748us
I20260709 13:09:19.741223 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:19.706769 26728 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:19.743615 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.745380 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:19.745672 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:19.749864 23703 raft_consensus.cc:2376] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7. Re-sending same reply.
I20260709 13:09:19.711848 26745 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:19.721426 26661 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:19.742619 26603 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:19.751353 23622 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.756875 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.734575 26495 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.676270 26656 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.785516 26750 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:19.792377 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.793081 23701 raft_consensus.cc:2376] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7. Re-sending same reply.
I20260709 13:09:19.793982 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.794610 23701 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.797277 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:19.798130 26611 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:19.798418 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1631) took 1055 ms. Trace:
W20260709 13:09:19.800557 26747 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:19.800835 26707 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:19.803222 26476 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:19.804129 26476 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.808034 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.814092 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.799005 23626 rpcz_store.cc:276] 0709 13:09:18.742758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.743273 (+   515us) service_pool.cc:224] Handling call
0709 13:09:19.797066 (+1053793us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:09:19.798336 (+  1270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11041024}
I20260709 13:09:19.820307 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.782078 26728 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:19.782682 26598 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.869571 26728 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.817842 26750 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:19.872887 26750 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.832260 26745 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.837842 26702 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:19.842777 26644 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.846037 26486 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.848815 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:19.849573 26641 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.850190 26661 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:19.855192 26709 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:19.861239 26496 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:19.862910 23626 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:19.863361 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:19.867588 26706 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:19.868249 26746 raft_consensus.cc:993] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: : Instructing follower b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:09:19.814591 26603 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:19.878719 23622 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:19.826974 26611 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:19.889724 23701 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:19.906658 23770 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:19.913949 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:19.916849 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:19.919430 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:19.922248 26486 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:19.923179 26706 raft_consensus.cc:3055] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:19.923897 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.924998 26644 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:19.929216 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42298 (request call id 567) took 1117 ms. Trace:
I20260709 13:09:19.931125 23777 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:19.932268 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.933177 23704 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.938071 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:19.939019 23701 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:19.893855 26707 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.929876 23774 rpcz_store.cc:276] 0709 13:09:18.811530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.812841 (+  1311us) service_pool.cc:224] Handling call
0709 13:09:19.928883 (+1116042us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54003403d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:19.929126 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320721280}
W20260709 13:09:19.961469 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 217906us
I20260709 13:09:19.965921 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:19.971681 23622 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:09:19.972735 23626 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:19.985236 23701 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:19.918565 26728 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:19.923648 26706 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:19.912559 26611 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.002168 24387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46566 (request call id 525) took 1249 ms. Trace:
I20260709 13:09:19.991453 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:19.991026 23704 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:19.900084 26709 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.012471 24387 rpcz_store.cc:276] 0709 13:09:18.743090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.745465 (+  2375us) service_pool.cc:224] Handling call
0709 13:09:19.977092 (+1231627us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54006ae0d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:19.992051 (+ 14959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569421696}
W20260709 13:09:20.020118 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 234638us
I20260709 13:09:19.959824 26222 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:09:20.017546 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 51737.3us
W20260709 13:09:20.011894 26710 consensus_meta.cc:287] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 13:09:19.969214 26688 raft_consensus.cc:1081] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Signalling peer b1e32a12daf44ebbbd71cc3ce41d7d8e to start an election
I20260709 13:09:20.021236 23743 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:19.989728 26641 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:19.995640 26714 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:09:20.021296 26746 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:19.968398 26707 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.002225 26665 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:09:20.055965 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.036572 26396 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:20.020010 26603 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.014343 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:20.062148 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:20.063620 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49404.8us
I20260709 13:09:20.074615 23743 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.034248 26710 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.082180 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.063210 26396 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:20.121232 26396 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.093318 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:20.125680 23697 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:20.093962 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:20.090396 26702 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:20.094759 26644 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.094746 26641 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:20.134002 26756 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:20.140669 26641 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.141079 26756 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:20.141685 26756 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.095556 26669 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:20.071167 26728 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:20.144006 26702 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:20.144656 26728 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:20.145288 26702 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.145495 26728 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.070335 26011 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.101912 26516 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:20.148640 26516 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:20.149647 26516 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.150857 26516 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.104282 26496 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:20.111294 26611 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:20.112417 26594 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.113584 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:20.090621 24387 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:09:20.114670 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:20.157502 24387 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:20.157909 24387 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.114722 26710 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:20.115399 23702 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:20.117774 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:20.133456 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.161679 26665 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.162449 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:20.107457 26495 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.137442 26707 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:20.138505 26758 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.147816 26751 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:20.154386 26011 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:20.156541 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.164383 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:20.165182 26407 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:20.163463 26594 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.156885 23743 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:20.170329 26495 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:20.184777 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:20.165506 26496 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.188019 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:20.195984 26407 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:20.196545 26755 raft_consensus.cc:2764] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:20.214634 23743 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:20.199122 26594 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:20.201388 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:20.212239 26011 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:20.217239 23593 leader_election.cc:400] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10.
I20260709 13:09:20.224020 23593 leader_election.cc:403] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:20.152765 26701 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.084785 26706 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.208550 26452 raft_consensus.cc:2764] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:09:20.239876 23774 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:20.223604 26669 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:20.241972 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.248746 26407 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.232822 26714 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:20.258245 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:20.258929 23699 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.252734 26701 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:20.226202 26750 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:20.222663 26771 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.265501 26750 raft_consensus.cc:697] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:20.266404 26750 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.266645 26771 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.268860 26771 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:20.271299 26714 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.271840 23699 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:20.234500 26495 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10.
I20260709 13:09:20.263350 24387 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.275152 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:20.231442 26011 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:20.277208 24393 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:20.286579 23625 raft_consensus.cc:606] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.287263 23625 raft_consensus.cc:614] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:20.290565 26745 consensus_queue.cc:1059] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:20.291757 26745 raft_consensus.cc:3055] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:20.292128 26745 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:20.293041 26745 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.290876 26714 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:20.297478 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.298609 23696 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:20.305402 26707 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:20.305938 24387 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:20.306241 26707 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:09:20.307318 26669 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:20.309122 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:20.308782 26669 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.311942 26641 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:20.312152 26707 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:20.314946 26709 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:20.332558 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 118000us
I20260709 13:09:20.333714 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:20.340219 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.342486 23770 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:20.342798 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.343771 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:20.344543 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.345003 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:20.345582 23776 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.345716 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:20.346829 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.347381 23627 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.354760 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.356156 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.361828 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:20.362336 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.363407 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:20.364219 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:20.367619 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:20.369043 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:20.371137 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:20.371438 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.371986 23769 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:20.372455 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:20.374372 23629 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:20.237859 26756 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.378803 23626 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:20.382736 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:20.388835 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:20.389052 23777 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:20.373718 26774 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.061s	user 0.003s	sys 0.009s
I20260709 13:09:20.370438 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:20.366577 26775 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.053s	user 0.000s	sys 0.011s
I20260709 13:09:20.392071 23621 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:20.390734 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 148867us
I20260709 13:09:20.391274 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:20.394224 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:20.359633 26738 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:20.396394 23627 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:20.396895 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:20.399242 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:20.400091 23777 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:20.401713 23620 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:20.405953 24393 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:20.406313 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:20.408360 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:20.409718 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:20.372329 26709 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:09:20.416014 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.412349 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.413504 23769 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:20.398934 26723 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.398101 26661 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.414188 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.414630 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.412747 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.420418 23704 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:20.402737 26701 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:20.417177 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:20.404132 26708 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:20.423523 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.425822 23593 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:20.427035 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:20.396109 26707 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:09:20.429446 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:20.431169 26753 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:09:20.428051 23770 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:09:20.433145 26745 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.439903 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.429713 26496 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.440759 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:20.441372 23620 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:20.414191 26407 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.442133 26407 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.444262 26407 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:20.441438 23699 raft_consensus.cc:2368] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:09:20.424423 26495 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.408284 26011 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.427753 26641 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:09:20.452220 23769 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:20.453820 26707 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:20.454461 26706 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.454783 26710 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:20.455188 26710 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:20.456218 26710 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.458860 26710 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.458958 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:20.459679 26723 raft_consensus.cc:3055] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:20.460078 26723 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:20.460886 26723 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.429353 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:20.465041 26756 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:20.423573 26701 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:20.466413 26701 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.415908 26396 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.468967 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.469630 23697 raft_consensus.cc:2368] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:09:20.470685 26396 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:20.471758 23776 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:20.473563 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.474097 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.475121 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:20.476013 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.476735 23697 raft_consensus.cc:2410] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:20.477407 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:20.477869 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.478520 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.478912 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.479293 23697 raft_consensus.cc:2410] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:20.481319 23697 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:09:20.477406 23696 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:20.424881 26708 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.482746 23699 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:20.485008 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.485754 23699 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:20.483819 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.486510 23704 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:20.486951 23623 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:20.487680 23699 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:20.488190 26708 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.488547 26496 raft_consensus.cc:3055] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:20.488726 24387 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:20.489220 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:20.490243 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:20.467571 26701 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:20.427917 26452 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.427691 26598 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.410683 26728 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.492223 23698 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:20.495491 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:20.485702 23627 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.507908 23769 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:20.513203 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:20.504377 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:20.536531 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:20.605849 26666 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.159s
I20260709 13:09:20.765903 26708 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.531975 26729 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.246s
I20260709 13:09:20.804250 26729 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:20.804661 26729 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:20.804567 26611 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:20.805805 26729 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.807276 26729 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.772092 26706 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.808002 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.808085 26706 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.605396 26588 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.169s
I20260709 13:09:20.809841 26588 consensus_queue.cc:1243] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:20.811046 26706 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:20.761797 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 332820us
I20260709 13:09:20.812778 23696 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:20.769320 23621 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:20.788642 23627 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
W20260709 13:09:20.768123 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 199751us
I20260709 13:09:20.815215 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:20.798640 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 260190us
I20260709 13:09:20.564103 26756 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.228s
I20260709 13:09:20.529867 26727 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.268s
I20260709 13:09:20.562158 26641 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.222s
I20260709 13:09:20.803089 23624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:09:20.806347 26611 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:20.816048 26666 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.500303 26496 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:20.564549 26753 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:20.824776 23776 pending_rounds.cc:85] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 8
I20260709 13:09:20.826797 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:20.846611 23776 pending_rounds.cc:107] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:09:20.847079 23776 raft_consensus.cc:2889] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.832100 26788 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:20.834277 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.852731 23697 raft_consensus.cc:2410] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:20.839093 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 333743us
I20260709 13:09:20.855161 23701 raft_consensus.cc:2368] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:20.840754 23699 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:20.842011 23704 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:20.843537 23624 raft_consensus.cc:606] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.856570 23624 raft_consensus.cc:614] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:20.828975 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:20.857424 23696 raft_consensus.cc:2376] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6. Re-sending same reply.
I20260709 13:09:20.857306 26666 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.832130 26598 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:20.858567 26598 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:20.859325 26598 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.860351 26598 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:20.862399 26777 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
I20260709 13:09:20.845042 26611 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:20.868975 26666 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:20.869524 26780 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.438s	user 0.003s	sys 0.000s
I20260709 13:09:20.869256 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:20.870782 26656 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.870903 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.851140 23695 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:20.874317 23770 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:20.875522 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:20.876443 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.878278 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:20.879323 23696 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:20.880403 26750 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:20.883692 26708 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:20.860361 26496 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:20.884743 26496 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.885547 26713 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.886781 23592 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:20.888263 26723 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.894856 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:20.891865 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.894454 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:20.902338 24393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
mode: GRACEFUL
new_leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:58744
I20260709 13:09:20.902658 23770 raft_consensus.cc:2410] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:20.902938 24393 raft_consensus.cc:606] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Received request to transfer leadership to TS 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:20.907617 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.909129 23770 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:09:20.910621 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.912473 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.871697 26611 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.914924 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.880702 26701 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:20.881676 26728 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.917179 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:20.907053 26233 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:09:20.906878 26750 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:20.924412 23593 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.935838 23593 leader_election.cc:400] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:09:20.935272 26750 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.937225 23593 leader_election.cc:400] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:09:20.938380 23593 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.929286 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:20.929862 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:20.930455 23629 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:20.930982 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:20.933084 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.933451 23626 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:20.943360 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:20.943600 23593 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.913888 26495 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.945598 23629 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:20.945739 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:20.915318 26669 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.946532 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:20.946786 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:20.922883 26407 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.939440 26505 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.948802 23626 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:20.948834 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:20.950140 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.927659 26754 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:20.951489 23623 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:20.965286 23593 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:20.925364 26452 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:09:20.971771 26669 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.933069 26728 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:20.978868 23627 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:20.954087 26611 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.964015 26701 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:20.948990 26598 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.948521 26757 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.986898 26669 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:20.957506 26781 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:20.971249 26011 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:21.007382 26516 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:21.007907 26516 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:21.008522 26759 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:21.008913 26759 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:21.007812 26781 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:21.009786 26759 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.010383 26781 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.011111 26759 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.009107 26516 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.015111 26516 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.000824 26669 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:21.018333 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:21.019217 23627 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:21.030126 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:21.032078 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:21.032934 23627 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.975966 26396 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:09:21.042220 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:21.003335 26755 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:21.053309 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 113016us
I20260709 13:09:21.057036 23629 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:21.059599 24358 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:21.060820 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:21.062244 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:21.065390 23626 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:21.086463 23627 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:21.017362 26701 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:21.091166 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49079.2us
I20260709 13:09:21.103478 23669 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:21.092919 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:21.107493 26701 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.044397 26728 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:21.111837 26708 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:21.112534 26728 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.036742 26706 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:21.095610 23629 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:21.096375 26572 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.090799 26665 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:21.090906 26632 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:21.090596 26729 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:09:21.099854 26723 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.095407 23627 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:21.036433 26011 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:21.125747 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 153660us
I20260709 13:09:21.114760 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:21.124033 26795 log.cc:927] Time spent T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:09:21.120880 26751 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:21.102972 26598 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:09:21.103111 26757 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:09:21.154765 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 189531us
I20260709 13:09:21.139582 26508 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.163081 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:21.115023 26669 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:21.189119 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 85723.1us
I20260709 13:09:21.191159 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:21.196305 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:21.203874 26754 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:21.192744 26723 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:09:21.205021 26708 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.211207 26496 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:21.211707 26496 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:21.212323 26669 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:21.212500 26496 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.213771 26496 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.183568 26598 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.215790 23620 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:21.216981 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:21.217931 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 75715.5us
I20260709 13:09:21.218983 23743 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:21.220453 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:21.238767 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:21.240619 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 47059.9us
I20260709 13:09:21.241580 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:21.207329 26495 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.238848 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:21.218060 26802 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.268993 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 126285us
I20260709 13:09:21.229660 26750 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:21.252715 23743 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:21.249609 23593 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:21.253038 23627 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:21.292404 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:21.293509 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:21.295835 23593 leader_election.cc:400] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:21.296258 23593 leader_election.cc:403] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:21.297022 26656 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:21.300889 24393 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:09:21.247233 26706 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:21.265269 26723 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:21.241786 26708 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:09:21.247750 26728 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:21.273538 26572 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.292856 26809 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.195842 26011 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.271473 26407 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:09:21.291460 26802 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.296016 26754 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:21.406831 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 103587us
I20260709 13:09:21.317993 23624 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:21.311890 26495 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:21.312595 26508 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.495924 23743 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:21.312213 26706 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:21.515962 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 212483us
I20260709 13:09:21.314225 26805 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:21.321116 26688 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:21.301705 26812 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.339713 26728 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:21.491288 26813 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:09:21.310346 26701 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.185s
I20260709 13:09:21.472141 26665 raft_consensus.cc:697] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:21.362573 26811 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.233s
I20260709 13:09:21.386363 26750 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.196s
I20260709 13:09:21.591822 23701 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:21.537606 26452 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.597440 26819 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:21.607921 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:21.586105 26727 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:21.582486 26728 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.610100 23701 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:09:21.597664 26810 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 13:09:21.471608 26809 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.589022 26708 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:21.575969 26723 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:21.584597 26688 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:21.624759 26803 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.409s	user 0.000s	sys 0.001s
W20260709 13:09:21.674729 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 178899us
W20260709 13:09:21.678987 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.609805 26452 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.606292 26812 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:09:21.628185 26819 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:21.636742 26816 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:21.620126 26727 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.628918 26708 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.720207 26723 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.725996 26708 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:21.628648 26706 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.728144 26706 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.708444 26816 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.731254 26816 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:21.727115 26824 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:21.733136 26750 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:21.733803 26824 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.734706 26827 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:21.735194 26827 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:21.736160 26824 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:21.736341 26827 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.700239 26665 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.691483 26819 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:21.741020 26819 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.742404 26819 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:21.744458 26817 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:09:21.748816 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 141022us
I20260709 13:09:21.687997 26822 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:21.754885 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 193862us
I20260709 13:09:21.757513 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:21.757730 26656 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:21.758699 26656 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:21.759130 26656 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:21.759891 26656 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.762279 26754 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:21.762933 26754 consensus_queue.cc:1243] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:21.766076 26812 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.768283 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:21.776387 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:21.722357 26516 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.000s
I20260709 13:09:21.714323 26826 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:21.787246 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.690047 26751 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:09:21.790889 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:21.794525 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 105828us
I20260709 13:09:21.794961 23701 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:21.797580 23701 pending_rounds.cc:85] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 4
I20260709 13:09:21.797634 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:21.798038 23701 pending_rounds.cc:107] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:09:21.798288 23701 raft_consensus.cc:2889] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:21.799782 23702 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:09:21.800176 23702 pending_rounds.cc:85] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 4
I20260709 13:09:21.800441 23702 pending_rounds.cc:107] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:09:21.800637 23696 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:21.800666 23702 raft_consensus.cc:2889] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:21.754420 26233 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.814669 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.815356 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.817013 23702 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:21.817334 23743 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:21.786531 26708 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:21.780071 26706 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:21.794061 26816 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:21.832275 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.841800 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "334c9018414947cabb4405ef47b8018e"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43444
I20260709 13:09:21.825414 26708 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.866967 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:21.867789 23698 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:21.878808 26756 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:21.879582 26756 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.882584 26486 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:21.883327 26486 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:21.884527 26486 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.886910 26788 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:21.887850 26788 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.889526 26758 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.890147 26758 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.898583 26755 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:21.899376 26755 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.909493 26656 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:21.910873 26603 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:21.913182 26516 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:21.914530 23629 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:21.922111 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:21.923666 23703 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:21.860455 26708 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.823848 26233 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.835039 26706 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.933898 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:21.877342 26632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.009s	sys 0.008s
I20260709 13:09:21.780681 26822 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.798166 26826 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.665333 26396 raft_consensus.cc:2955] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 3 to 5, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:21.843438 26816 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:21.931800 26802 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:21.952355 23776 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:21.940237 26632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.009s	sys 0.008s
I20260709 13:09:21.956684 26452 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:21.956918 26706 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:21.957724 26706 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:21.958263 26706 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.958588 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:21.957804 26632 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:21.960212 26632 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:21.962517 26496 consensus_meta.cc:287] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.748s	user 0.007s	sys 0.004s
I20260709 13:09:21.967602 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58448 (request call id 494) took 1524 ms. Trace:
I20260709 13:09:21.968067 23620 rpcz_store.cc:276] 0709 13:09:20.443274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.490031 (+ 46757us) service_pool.cc:224] Handling call
0709 13:09:21.967438 (+1477407us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54002459d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:21.967540 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641462528}
I20260709 13:09:21.975926 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:21.976722 23774 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:21.941511 26836 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:09:21.993027 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:21.969476 26713 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:21.994444 26713 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:21.994727 23526 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.995362 26713 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.995923 26830 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:21.996404 26832 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.996914 26834 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:21.946847 26688 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:21.950554 26809 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.037911 26809 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.037425 26834 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.038365 26809 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:21.946080 26828 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:22.039876 26828 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.040373 26828 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:22.044791 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 227524us
I20260709 13:09:22.033826 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.034099 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:22.047454 23777 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:22.047598 26729 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:22.047998 26729 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:22.048353 26729 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:21.950635 26823 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:21.972065 26825 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:22.076232 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.077788 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:22.078593 23770 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:22.079681 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.081243 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.082850 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.084828 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.034832 26727 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:22.087967 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.095959 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.098263 23777 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:22.092069 23628 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:22.054033 26713 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.073597 23526 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 2 to 8, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 8 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:22.075117 26759 consensus_meta.cc:287] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.064s	user 0.013s	sys 0.004s
I20260709 13:09:22.119763 23776 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:22.120286 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.126789 23778 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
W20260709 13:09:22.087962 26611 consensus_meta.cc:287] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.074s	user 0.013s	sys 0.000s
I20260709 13:09:22.131312 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.131340 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.132393 23629 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:22.073690 26496 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:22.075695 26753 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.184872 23527 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 179) took 15565 ms (client timeout 15000 ms). Trace:
I20260709 13:09:22.190999 23667 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:22.084301 26702 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 13:09:22.118840 26802 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.206228 23667 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:22.133615 26495 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:22.096024 26603 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:09:22.133270 26758 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.132167 26598 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.174710 26706 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.178870 26727 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:22.031319 26830 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:22.185575 23527 rpcz_store.cc:269] 0709 13:09:06.566471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.566733 (+   262us) service_pool.cc:224] Handling call
0709 13:09:07.258617 (+691884us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b5400002210. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e8640 00007f2b470bfb76 00007f2b471c9c3e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc 00007f2b45689392 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:22.132186 (+14873569us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:15.223912 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:15.224672 (+   760us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:15.224731 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:09:15.224745 (+    14us) tablet.cc:662] Decoding operations
0709 13:09:15.314984 (+ 90239us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:15.315065 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:15.315103 (+    38us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:09:15.317747 (+  2644us) tablet.cc:701] Row locks acquired
0709 13:09:15.317802 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:09:15.318001 (+   199us) write_op.cc:270] Start()
0709 13:09:15.318166 (+   165us) write_op.cc:276] Timestamp: P: 1783602555317929 usec, L: 0
0709 13:09:15.318189 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:09:15.393308 (+ 75119us) log.cc:844] Serialized 11057 byte log entry
0709 13:09:17.421348 (+2028040us) op_driver.cc:464] REPLICATION: finished
0709 13:09:17.748665 (+327317us) write_op.cc:301] APPLY: starting
0709 13:09:17.748782 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:17.749353 (+   571us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:17.749500 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:17.892383 (+142883us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:17.892851 (+   468us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:09:17.892901 (+    50us) write_op.cc:312] APPLY: finished
0709 13:09:17.893434 (+   533us) log.cc:844] Serialized 188 byte log entry
0709 13:09:17.893651 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:17.893886 (+   235us) write_op.cc:454] Released schema lock
0709 13:09:17.893974 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:17.894383 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:17.894409 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":750527,"reported_tablets":47,"spinlock_wait_cycles":150714240,"child_traces":[["op",{"apply.queue_time_us":326959,"apply.run_cpu_time_us":6216,"apply.run_wall_time_us":145732,"num_ops":28,"prepare.queue_time_us":302774,"prepare.run_cpu_time_us":26697,"prepare.run_wall_time_us":462319,"raft.queue_time_us":218250,"raft.run_cpu_time_us":23957,"raft.run_wall_time_us":206432,"replication_time_us":2103002,"thread_start_us":680872,"threads_started":4,"wal-append.queue_time_us":929733,"wal-append.run_cpu_time_us":47805,"wal-append.run_wall_time_us":2596965}]]}
I20260709 13:09:22.201970 23770 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:22.181890 26611 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:22.116938 26836 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:09:22.051321 26832 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.192834 26844 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:22.071231 26823 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:22.251032 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 368710us
I20260709 13:09:22.266556 26688 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:22.215286 26495 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.269841 26688 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.204291 26496 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:22.251592 26805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.008s	sys 0.005s
I20260709 13:09:22.269465 26849 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.216780 26486 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:09:22.266441 26669 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.053s	user 0.004s	sys 0.009s
I20260709 13:09:22.213841 26802 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:22.273998 26805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.009s	sys 0.006s
I20260709 13:09:22.087265 26825 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.247851 26598 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.286315 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.287500 26598 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.268277 26233 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.291962 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.253615 26611 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:22.203657 26753 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.273280 26816 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:22.304225 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.251523 26727 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.309378 26832 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.309523 26611 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:09:22.283003 26849 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.284343 26706 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:22.320708 23526 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 3 to 5, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 5 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:22.324043 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.339504 23771 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:22.340214 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:22.315714 26728 consensus_meta.cc:287] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.004s
I20260709 13:09:22.299556 26805 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:22.288564 26819 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:09:22.264242 26844 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.315810 26843 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.354714 26822 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:22.381310 26838 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:09:22.380343 26857 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.382452 26842 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:09:22.355875 26669 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:22.384158 26669 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.386488 26669 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.358330 26828 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.336987 26496 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.331159 26708 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.316133 26598 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:22.380726 26697 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:22.382005 26857 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.380501 26841 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:22.380646 26848 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:22.354285 26723 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:22.389420 23623 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:09:22.300323 26831 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.295s
I20260709 13:09:22.321445 26495 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.315879 26845 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:22.395454 26598 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.415844 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:22.360173 26816 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.364624 26611 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.332597 26759 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:22.410857 26723 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.398347 23627 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:22.433683 26759 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.364465 26826 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.372377 26755 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.404285 26697 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.436527 24359 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:22.366818 26847 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:22.437330 26836 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:22.437834 26847 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.438372 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:22.410116 23702 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:22.439716 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:22.423038 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.394161 26669 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:22.440855 26669 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.441515 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:22.442051 26844 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.442747 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:22.443061 26708 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.443436 24386 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:22.443301 26816 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:22.444308 26852 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260709 13:09:22.445361 26816 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.433414 26727 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.445880 26611 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.446882 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.438488 26697 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.429253 26857 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.439927 26821 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:22.442850 26669 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:22.448284 26853 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:09:22.448567 26821 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:22.448750 26669 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:22.449059 26821 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:22.449865 23624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1665) took 1541 ms (client timeout 1506 ms). Trace:
I20260709 13:09:22.387638 26849 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:22.450279 23624 rpcz_store.cc:269] 0709 13:09:20.908442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.912290 (+  3848us) service_pool.cc:224] Handling call
0709 13:09:22.449664 (+1537374us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54002b4b54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:22.449761 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872593152}
I20260709 13:09:22.420055 26845 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.432375 26802 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.395493 26828 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.452529 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.449268 26669 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.400205 26496 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:22.454044 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.457882 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.374022 26728 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.464059 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.458078 26830 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.470705 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:22.473627 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 184370us
I20260709 13:09:22.433425 26753 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:22.479985 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 273858us
I20260709 13:09:22.393863 26843 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.450325 26598 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.429852 26729 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.489693 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:22.524828 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:22.525828 23704 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:22.528708 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:22.529397 23697 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:22.530561 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:22.531325 23697 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 1.
I20260709 13:09:22.532195 23696 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:22.532552 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:22.534534 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45000.3us
I20260709 13:09:22.533336 26830 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:22.537371 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.543923 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.540270 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:22.574311 26840 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.300s	user 0.001s	sys 0.001s
I20260709 13:09:22.574543 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.539706 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:22.479429 26496 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.576097 26825 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.576700 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:22.471866 26805 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.577427 26496 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.578050 26864 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:22.534899 26857 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.578501 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:22.579062 26857 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.528731 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:22.580623 26816 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:22.529048 26849 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:09:22.581195 26816 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:22.582073 26816 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.582639 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.583374 23771 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 9: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:22.584196 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.585204 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:22.585310 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 62342.6us
I20260709 13:09:22.573462 23628 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:22.586186 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.586742 23771 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:22.530261 26828 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:22.588214 26828 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.589823 26729 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.590436 26865 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:22.590637 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:22.481022 26759 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.592751 26669 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:22.580101 26862 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:22.575196 23624 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:22.580121 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:22.586618 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.596939 23698 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:22.597682 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.547538 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.546941 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.540062 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.580617 23704 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:22.575218 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.606191 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.479137 26809 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.488075 26750 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:09:22.612779 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.813134 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.681978 23769 raft_consensus.cc:606] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:09:22.637990 23628 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:22.817843 23775 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:22.819073 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:22.682368 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:22.699421 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.605711 26669 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.612269 26759 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.822321 26669 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.822458 26759 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.825429 26669 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.826006 26802 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.830385 26755 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.830485 26802 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.830945 26755 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.832707 26802 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.825930 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.833619 23629 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 2.
I20260709 13:09:22.828114 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.836711 23624 raft_consensus.cc:2410] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:22.829217 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.821139 24393 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:22.837453 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.837689 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.829741 23627 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:22.832999 26755 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.827024 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:22.810627 26872 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:09:22.834596 26759 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.838526 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:22.849925 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.521718 26708 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:22.841199 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:22.839852 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:22.578496 26864 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:22.849515 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:22.655660 24386 raft_consensus.cc:2955] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:22.843789 23771 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:22.833863 23704 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:22.841531 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.594718 26826 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:22.576709 26825 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:22.842309 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.590471 26828 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.808703 26496 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:22.877344 26496 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.850675 26729 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:22.880365 26729 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.796437 26799 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.855512 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:22.853791 23628 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:22.854506 23629 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:22.884639 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.857417 26809 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:22.854843 26731 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.854684 26708 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.853699 26864 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:22.852711 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:22.859580 23699 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:09:22.865170 23775 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:22.866397 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:22.867090 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:22.868449 26875 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:09:22.809788 26728 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.841807 26844 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.873183 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:22.907425 23621 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:22.856519 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:22.892274 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.598693 26830 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.896692 23629 raft_consensus.cc:2410] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:09:22.898715 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:22.850804 26869 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.855894 26758 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.908146 24387 raft_consensus.cc:2410] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:22.908144 23628 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:22.899628 26809 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.909235 26496 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.915807 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:22.935177 23697 raft_consensus.cc:2410] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:22.894457 26729 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:22.900880 26826 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:22.918900 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.932049 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:22.893651 26799 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.909278 26857 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.905884 26731 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.939706 26496 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:22.998847 26826 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.999552 23624 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:23.015192 23624 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:23.016614 23628 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:22.922411 26816 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:23.009096 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.998082 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:23.017015 23624 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:22.959251 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:22.935134 26809 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.029841 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:23.033529 23629 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:09:23.040666 23621 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:22.959713 26708 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:22.986171 26830 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:22.971882 26828 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:22.920950 26844 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:22.934942 26758 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:22.932190 26869 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.077993 26880 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.087535 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.237545 26880 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.238263 26828 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.198282 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.240469 23702 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:23.240888 26828 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:23.242126 26755 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.038479 26759 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.071146 26799 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:23.243129 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.206207 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:23.243242 26759 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.244287 23626 raft_consensus.cc:2410] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:09:23.244742 26887 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:23.041066 23698 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
W20260709 13:09:23.245792 26860 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.836s	user 0.008s	sys 0.030s
I20260709 13:09:23.041762 23629 pending_rounds.cc:85] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 4
I20260709 13:09:23.246182 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.038329 26757 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.246997 23698 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:23.247116 26757 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.247887 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.248438 23698 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:23.249259 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.246481 23629 pending_rounds.cc:107] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:09:23.249876 23629 raft_consensus.cc:2889] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:23.249940 26757 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:23.020654 26496 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.164191 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.251807 24388 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:23.177454 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.252457 26496 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:23.252899 24391 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
W20260709 13:09:23.233197 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 203368us
I20260709 13:09:23.253551 26814 raft_consensus.cc:993] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: : Instructing follower 4466bf6d6cf84ee89e84ea074e3964c9 to start an election
I20260709 13:09:23.254041 26814 raft_consensus.cc:1081] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Signalling peer 4466bf6d6cf84ee89e84ea074e3964c9 to start an election
I20260709 13:09:23.254245 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:23.255473 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:23.257258 26755 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:23.257369 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2135) took 1428 ms. Trace:
I20260709 13:09:23.257725 26755 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.258260 26755 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:23.164495 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.129657 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:23.261104 26890 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:23.261632 26890 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:23.262698 26669 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:23.262516 26890 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.263098 26669 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.263449 26669 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.264349 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.028555 26598 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.140295 26594 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:23.266124 26594 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:23.078342 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.265806 26598 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:23.267299 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 137833us
I20260709 13:09:23.154784 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.020452 26826 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.073037 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.264349 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:23.241449 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.272531 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:23.273458 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:23.273960 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:23.171929 26821 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.002s
I20260709 13:09:23.279052 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.257805 23695 rpcz_store.cc:276] 0709 13:09:21.834323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.843755 (+  9432us) service_pool.cc:224] Handling call
0709 13:09:21.860078 (+ 16323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.113068 (+252990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.113100 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.127875 (+ 14775us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.266366 (+138491us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:22.266416 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.266524 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.245243 (+978719us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:23.257087 (+ 11844us) raft_consensus.cc:1685] finished
0709 13:09:23.257106 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.257295 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7654,"raft.queue_time_us":97020,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"spinlock_wait_cycles":4965248,"thread_start_us":317805,"threads_started":2,"wal-append.queue_time_us":186386}
I20260709 13:09:23.271940 26594 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.281318 26894 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:23.281551 26594 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.184314 26731 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.207304 26666 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:09:23.279860 23703 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:23.285506 23698 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:23.040725 26816 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:23.157531 26805 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.290345 26758 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:23.293959 26869 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.279392 26802 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:23.253223 26809 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.298579 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.332654 23704 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:23.294469 26759 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:23.278177 26828 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:23.278293 26757 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.286557 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:23.291877 26816 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.075199 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:23.341168 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 54701.9us
I20260709 13:09:23.307821 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:23.342553 23770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:42298
I20260709 13:09:23.343199 23770 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:09:23.340122 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 66233.2us
I20260709 13:09:23.343837 23770 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.317706 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.317991 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.318828 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.319413 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.319805 26812 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:23.319670 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.209975 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:23.323841 26847 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:23.336284 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:23.207506 26889 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:09:23.343084 23776 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:23.312446 26755 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.313997 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2131) took 1508 ms. Trace:
I20260709 13:09:23.346802 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.328321 26802 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:23.344918 24387 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:23.322763 26823 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.288584 26880 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:23.355645 23628 raft_consensus.cc:2410] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:09:23.355960 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:23.347975 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.372093 23704 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:23.372687 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.373169 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.287221 26821 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.311609 26827 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.365234 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:23.365034 23629 raft_consensus.cc:2955] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:23.396744 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.354159 26828 raft_consensus.cc:697] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:23.369068 23770 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.371757 26802 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.362551 23696 rpcz_store.cc:276] 0709 13:09:21.805351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.805495 (+   144us) service_pool.cc:224] Handling call
0709 13:09:21.805844 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.532761 (+726917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.313706 (+780945us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b5400025b54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:23.313931 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669672192}
I20260709 13:09:23.367015 26706 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:23.380462 26864 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.370289 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.348318 26869 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:23.353874 26407 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:23.340790 26757 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:23.349852 26812 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:23.306841 26805 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.327968 26843 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.361389 26815 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:09:23.400695 26880 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:23.367616 24385 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:23.402177 23770 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:23.378234 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.403967 26598 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.408972 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.367902 26844 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:23.413341 24394 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
W20260709 13:09:23.417093 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 72331.5us
I20260709 13:09:23.394785 26823 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.399677 26641 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:23.411134 26869 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.430330 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.374502 26476 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:09:23.494931 23696 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:23.407111 26706 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:23.488125 23592 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:23.405846 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49545.2us
I20260709 13:09:23.412158 26407 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.503504 26407 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:23.511269 26821 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:23.516191 26869 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.517006 26706 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:23.496613 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:23.480144 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.488600 23704 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:23.487804 26759 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.519604 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.520681 23704 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:23.520457 26759 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.522022 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.522895 23704 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:23.524848 23696 raft_consensus.cc:2410] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:23.524922 26828 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.532891 26864 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:23.498744 26862 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:09:23.542443 26755 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.545117 26688 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.589617 26754 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.418059 26757 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.593724 26754 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.594645 26407 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:23.595346 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 107315us
I20260709 13:09:23.595906 23622 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:09:23.596086 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:23.592103 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:23.580447 26452 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.598286 26407 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.581913 26893 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:23.546126 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.600068 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:23.600633 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 243331us
I20260709 13:09:23.612360 24391 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:23.602424 23695 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:23.615242 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:23.616439 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:23.620008 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:23.523478 26759 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.489245 26809 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.625317 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:23.626791 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.627513 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:23.591948 26788 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.628345 23696 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:23.636703 23592 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:23.567639 26815 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:23.642586 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:23.451220 26880 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.635433 26407 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:23.645128 26788 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.648083 26880 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:23.648311 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:23.648754 23696 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:23.651986 26788 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:23.652603 26788 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.599107 26812 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.654134 26812 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.654884 26788 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.624495 26898 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:23.656150 26898 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.656524 26898 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.657174 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:23.660768 23696 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:23.661859 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.662549 23696 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:23.658022 23624 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:23.624761 26753 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:23.663183 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 153299us
I20260709 13:09:23.577996 26823 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.664340 23696 raft_consensus.cc:2955] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 3 to 5, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:23.671177 23695 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:23.674088 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:23.635533 26759 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.619264 26452 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.639818 26754 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.683231 23704 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:23.701241 23624 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:23.674572 26788 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.724383 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2324) took 1433 ms. Trace:
I20260709 13:09:23.727272 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:23.736011 23623 rpcz_store.cc:276] 0709 13:09:22.290764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.291845 (+  1081us) service_pool.cc:224] Handling call
0709 13:09:22.306333 (+ 14488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.403332 (+ 96999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.713524 (+1310192us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b54002440d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:23.724301 (+ 10777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190463744}
I20260709 13:09:23.731629 23696 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:23.740213 23696 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.733748 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:23.668051 26815 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.745437 24359 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:23.749265 23695 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:09:23.734910 26899 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.096s	user 0.001s	sys 0.001s
I20260709 13:09:23.787760 23695 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:23.779456 26913 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:23.766829 26805 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:23.802404 26902 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:09:23.813428 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2313) took 1725 ms. Trace:
I20260709 13:09:23.813845 23620 rpcz_store.cc:276] 0709 13:09:22.087860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.088045 (+   185us) service_pool.cc:224] Handling call
0709 13:09:22.088349 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.288972 (+200623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.289011 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.289052 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:22.289085 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.813235 (+1524150us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54002454d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:23.813274 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.813374 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460960640}
I20260709 13:09:23.783989 26753 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:23.746354 26788 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.787657 26701 consensus_queue.cc:1059] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:09:23.829331 26669 consensus_meta.cc:287] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.000s
I20260709 13:09:23.839386 26805 raft_consensus.cc:3055] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:23.877465 23593 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.786s (SENT) [suppressed 29 similar messages]
I20260709 13:09:23.821409 26816 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:23.887053 26907 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:09:23.826560 26753 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.888778 26754 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:23.900736 23776 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:23.889449 26805 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:23.895956 26823 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.908862 23702 raft_consensus.cc:2393] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:23.864063 26669 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.923019 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:23.924388 23699 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:23.931572 26913 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:09:23.971294 26906 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:09:23.971410 26834 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:23.973770 26669 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.974763 26833 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.975394 26833 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.977985 26833 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:23.982597 26805 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.984364 26805 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:23.971064 26913 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:23.910053 26815 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:23.979212 26898 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:24.046229 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 128434us
I20260709 13:09:23.912284 26754 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:23.989889 26496 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:24.054764 26706 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
W20260709 13:09:24.094597 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47459.1us
I20260709 13:09:24.044178 26816 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:24.057107 26753 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.117647 26641 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.097656 26706 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:24.121764 26827 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.717s	user 0.006s	sys 0.003s
W20260709 13:09:24.121666 26826 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.842s	user 0.012s	sys 0.000s
I20260709 13:09:24.129601 23770 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:24.130465 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.131312 23775 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:24.109848 26788 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:24.134150 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.134119 23772 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:24.136284 26756 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.098789 26496 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:24.128597 26757 consensus_meta.cc:287] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.006s
I20260709 13:09:24.144022 24357 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:24.127213 26641 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.124819 26914 consensus_queue.cc:1059] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:09:24.137091 26918 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:24.133476 26818 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:09:24.138751 26826 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.164817 26835 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:24.165354 26835 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:24.166337 26826 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:24.166908 26802 consensus_meta.cc:287] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.764s	user 0.005s	sys 0.004s
I20260709 13:09:24.167050 26898 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.157495 26757 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.166332 26835 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.168617 26754 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.163187 26918 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.167392 26802 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.173022 26913 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:24.181742 26918 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:24.178860 26835 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.179183 26913 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.184186 26913 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.175563 26922 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:09:24.191310 26913 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.193401 26913 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.198544 26845 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:24.235263 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 357559us
I20260709 13:09:24.261637 23698 raft_consensus.cc:2368] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7.
I20260709 13:09:24.268007 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2147) took 1350 ms. Trace:
I20260709 13:09:24.268537 23704 rpcz_store.cc:276] 0709 13:09:22.917497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.523521 (+606024us) service_pool.cc:224] Handling call
0709 13:09:23.524013 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.683885 (+159872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.267433 (+583548us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400024c54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:24.267779 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365524736}
W20260709 13:09:24.270125 23702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1553) took 1216 ms (client timeout 1556 ms). Trace:
I20260709 13:09:24.270377 23696 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:24.270772 23702 rpcz_store.cc:269] 0709 13:09:23.053106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.241144 (+188038us) service_pool.cc:224] Handling call
0709 13:09:24.269556 (+1028412us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b540040db54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:24.269876 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465678848}
I20260709 13:09:24.145676 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:24.276779 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 357) took 1226 ms. Trace:
I20260709 13:09:24.277835 23696 rpcz_store.cc:276] 0709 13:09:23.050507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.747439 (+696932us) service_pool.cc:224] Handling call
0709 13:09:24.269845 (+522406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.271461 (+  1616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.276566 (+  5105us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540040db50. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:24.276719 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082876672}
I20260709 13:09:24.282202 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:24.276538 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:24.284233 23701 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:09:24.291915 23701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1542) took 1768 ms (client timeout 1786 ms). Trace:
W20260709 13:09:24.292496 23701 rpcz_store.cc:269] 0709 13:09:22.523298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.527620 (+  4322us) service_pool.cc:224] Handling call
0709 13:09:24.281548 (+1753928us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b580000ff98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:09:24.291818 (+ 10270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14409600}
W20260709 13:09:24.287756 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 149325us
W20260709 13:09:24.293795 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.283330 23668 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:24.301556 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.290939 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 145267us
I20260709 13:09:24.297834 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:24.306063 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:24.288806 23769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43444 (request call id 76) took 2458 ms. Trace:
I20260709 13:09:24.308467 23626 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:09:24.308698 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:24.308858 23769 rpcz_store.cc:276] 0709 13:09:21.829687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.841626 (+ 11939us) service_pool.cc:224] Handling call
0709 13:09:24.286435 (+2444809us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b4c00446300. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3f5d8a20 00007f2b3f5e9a29 00007f2b3f5af644 00007f2b3f5d6f2d 00007f2b3f5d6b93 00007f2b41306c92 00007f2b4130684a 00007f2b462d460a 00007f2b3f85a7d4 00007f2b3f85a762 00007f2b3f85a691
0709 13:09:24.288205 (+  1770us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b54003fe8d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41306853 00007f2b462d460a 00007f2b3f85a7d4 00007f2b3f85a762 00007f2b3f85a691 00007f2b3f85a60c 00007f2b3f8598c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:24.288469 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988550400}
I20260709 13:09:24.302800 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:24.309063 23626 pending_rounds.cc:85] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 4
I20260709 13:09:24.309587 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:24.310864 23626 pending_rounds.cc:107] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:09:24.316017 23626 raft_consensus.cc:2889] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:24.313581 23667 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:24.322505 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:24.323410 23624 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:24.323271 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:24.325376 23625 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:24.325982 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:24.327329 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:24.328269 23628 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:24.330276 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:24.330852 23620 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:24.336227 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:24.338065 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:24.338824 23628 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:24.346590 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:24.347460 23772 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42298 (request call id 611) took 1894 ms (client timeout 1688 ms). Trace:
I20260709 13:09:24.348352 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:24.347988 23772 rpcz_store.cc:269] 0709 13:09:22.452458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.453743 (+  1285us) service_pool.cc:224] Handling call
0709 13:09:24.346977 (+1893234us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540016bf54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:24.347195 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3829716352}
I20260709 13:09:24.349462 23771 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:24.349978 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.350710 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.351266 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:24.348268 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.353206 23770 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:24.353694 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:24.354763 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.355333 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.356007 23770 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:24.351902 23772 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:24.357540 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.357933 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:24.350800 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.360415 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.361192 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.361668 23777 raft_consensus.cc:2410] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:09:24.362272 23774 raft_consensus.cc:2410] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:09:24.363049 23778 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1780) took 2285 ms (client timeout 1720 ms). Trace:
I20260709 13:09:24.364061 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:24.372162 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.363684 23778 rpcz_store.cc:269] 0709 13:09:22.077316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.083834 (+  6518us) service_pool.cc:224] Handling call
0709 13:09:24.362483 (+2278649us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b540014e954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:24.362739 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68730624}
I20260709 13:09:24.375852 23628 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:09:24.376394 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50665.1us
I20260709 13:09:24.376574 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:24.382335 23620 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:24.382551 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:24.376677 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.379556 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.384130 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.384740 23771 raft_consensus.cc:2410] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:24.387566 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:24.388434 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.388793 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.389199 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.389652 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.390295 23771 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:24.390581 23776 raft_consensus.cc:2410] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:24.388841 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.391690 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:24.392613 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:24.375903 23770 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:24.391821 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:24.383684 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:24.404852 26572 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:24.406050 26496 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.412607 26011 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.412874 26496 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.413439 26011 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.413733 26496 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.406399 26452 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.416927 26452 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:24.417430 26452 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:24.418105 26452 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.418804 26486 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:24.419435 26011 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:24.420668 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46594 (request call id 492) took 1982 ms. Trace:
I20260709 13:09:24.423669 24394 rpcz_store.cc:276] 0709 13:09:22.438304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.439459 (+  1155us) service_pool.cc:224] Handling call
0709 13:09:24.420092 (+1980633us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b54001f1dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:24.420343 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2237491072}
I20260709 13:09:24.421365 26496 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:24.428335 26496 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:24.415485 26516 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:24.434309 26516 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.434870 26516 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:24.428514 26486 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:24.409375 26222 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:24.436303 26222 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:24.436892 26222 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:24.429574 26508 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.440330 26508 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.444249 26669 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:24.444818 26669 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.445230 26669 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.446091 26496 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:24.446530 26496 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:24.446954 26496 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.449263 26706 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:24.449951 26823 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:24.450150 26706 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.451373 26754 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:24.451916 26754 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.452334 26754 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:24.432210 26233 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:24.450169 26723 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.430125 26011 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:24.455768 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:24.457268 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.421626 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:24.463182 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.451046 26706 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.436299 26486 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.502592 23775 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:24.451056 26753 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:24.552057 26011 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:24.557612 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 174080us
I20260709 13:09:24.510172 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.496985 26233 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:24.563911 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 264251us
I20260709 13:09:24.565883 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.467643 26452 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.557928 26753 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:24.578673 26925 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:09:24.614487 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.615242 23775 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:24.593717 26753 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:24.617329 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 304019us
I20260709 13:09:24.617913 26486 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:24.619057 23667 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:24.619350 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 170078us
I20260709 13:09:24.619944 26828 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:24.620240 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:24.620889 23629 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:24.621172 23620 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
W20260709 13:09:24.622138 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.621954 26233 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.622679 26830 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:24.623397 26830 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.624452 26611 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:24.625530 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 481463us
I20260709 13:09:24.626044 26830 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.626524 26666 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.626869 26756 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:24.627461 26756 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.627964 26756 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.628432 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:24.622056 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.629705 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:24.622370 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:24.574865 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:24.639976 23627 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:24.626469 26826 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:24.643242 26871 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:24.646531 26834 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:24.641415 23773 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
W20260709 13:09:24.651925 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 86272.7us
I20260709 13:09:24.652204 26802 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:24.666102 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:24.652033 26828 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:24.642366 26826 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:24.679773 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 117714us
I20260709 13:09:24.656126 26723 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.656740 26508 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:24.657866 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:24.660559 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:24.661199 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:24.683025 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 64212.6us
I20260709 13:09:24.623653 26233 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.653333 26757 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.672783 26706 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:24.673976 26845 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:24.674750 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 263043us
I20260709 13:09:24.626720 26816 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:24.627561 26666 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.685482 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:24.714556 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.717021 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:24.721566 23775 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.676954 26834 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:24.723821 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 155138us
I20260709 13:09:24.689118 26823 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:24.725731 26828 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.726465 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:24.726261 26823 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.725445 26508 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:24.664983 26516 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:24.733649 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 73465.5us
I20260709 13:09:24.749059 23624 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:24.749961 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:24.749322 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 91902.7us
W20260709 13:09:24.734417 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45354.2us
I20260709 13:09:24.729125 26011 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:24.732255 23628 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.682377 26826 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.762935 23592 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:24.749809 26729 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:24.733157 26833 raft_consensus.cc:3055] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:09:24.730779 26897 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.004s	sys 0.013s
I20260709 13:09:24.768378 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:09:24.781260 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54914.2us
I20260709 13:09:24.782015 26516 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:24.761600 26823 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:24.783345 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 92103.7us
I20260709 13:09:24.734742 26940 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:24.813534 23775 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:24.786019 23772 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.786684 26931 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:24.786051 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 144963us
I20260709 13:09:24.774881 26611 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:24.749262 26788 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:24.727636 26496 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.748270 26669 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.720923 26799 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:09:24.750603 26935 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:09:24.792909 24358 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:24.734045 26934 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:24.739411 26827 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:09:24.818455 26931 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.801450 26938 raft_consensus.cc:993] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:09:24.803138 26826 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.740857 26831 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:09:24.760516 26452 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:24.723579 26834 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:24.816210 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 57269.2us
W20260709 13:09:24.818645 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55628.2us
I20260709 13:09:24.784473 26729 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:24.744496 26846 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:09:24.723021 26816 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:24.823381 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 55094.2us
I20260709 13:09:24.825424 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:24.819141 26897 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.418s	user 0.008s	sys 0.014s
I20260709 13:09:24.745307 26871 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.808779 26833 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:24.831707 26516 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:24.832531 26799 raft_consensus.cc:3055] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:24.888928 26799 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:24.890123 26799 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:24.832806 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 52457.7us
I20260709 13:09:24.833550 26937 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:24.893450 26937 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:24.893949 26937 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.837314 23620 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:24.834971 26496 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:24.821914 26788 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:24.897495 26788 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.800256 26754 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:24.899305 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.900389 26754 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.808136 26756 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:24.901460 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 81469.1us
I20260709 13:09:24.902313 23667 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:24.902586 26756 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.822625 26940 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:24.904033 26708 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:24.903978 26940 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.904404 26623 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:24.904819 26708 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:24.905503 26623 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:24.905841 26623 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:24.906760 26623 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.865027 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:24.869164 26934 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:24.908121 24394 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:24.908452 26934 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.909976 26811 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:24.910385 26811 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:24.910837 26934 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.845374 26931 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:24.911614 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 83963.8us
I20260709 13:09:24.911893 26588 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:09:24.912470 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:24.913813 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:24.914705 23622 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:24.915009 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:24.869129 26641 consensus_meta.cc:287] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.006s
I20260709 13:09:24.915716 24387 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:24.916141 26641 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.916885 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:24.918656 26641 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:24.919587 23626 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 8: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:24.920267 23624 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:24.920881 26508 raft_consensus.cc:1081] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:09:24.921950 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:24.871934 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 51842.8us
I20260709 13:09:24.922600 23525 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 4 to 8, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 8 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.924325 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:24.886726 26833 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:24.925447 26611 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:24.925109 23525 catalog_manager.cc:5697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 4 to 8, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 8 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:24.925952 26611 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.925992 26833 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.926469 26611 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:24.929212 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:24.931080 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:24.888006 26846 consensus_queue.cc:1243] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:24.893831 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:24.933214 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:24.933662 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:24.934947 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:24.936035 26910 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.936303 26669 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.936789 26910 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:24.937235 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:24.884596 26011 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:24.938354 26011 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:24.939292 26011 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.940632 26011 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:24.885464 26871 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.974713 24358 leader_election.cc:400] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7.
I20260709 13:09:24.974469 26697 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:09:24.975062 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 107165us
I20260709 13:09:24.975952 23592 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:24.977391 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:24.978744 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:24.980289 26830 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:24.980816 26830 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:24.981240 26830 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:24.981787 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.862512 26757 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:24.984110 26757 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.984637 26757 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.986002 26669 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:24.986698 26669 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.916945 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:24.891469 26799 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.990494 26611 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:24.907513 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.988809 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2346) took 1574 ms. Trace:
I20260709 13:09:24.992187 23621 rpcz_store.cc:276] 0709 13:09:23.413812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.414049 (+   237us) service_pool.cc:224] Handling call
0709 13:09:23.416400 (+  2351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.416642 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:24.565805 (+1149163us) log.cc:844] Serialized 14 byte log entry
0709 13:09:24.873069 (+307264us) log.cc:844] Serialized 14 byte log entry
0709 13:09:24.880651 (+  7582us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.929854 (+ 49203us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b48000b0358. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:09:24.938958 (+  9104us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b1800437aa0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f522 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:09:24.940148 (+  1190us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b1800437aa0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e1ed2a6 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1
0709 13:09:24.940637 (+   489us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b1800437aa0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:09:24.985135 (+ 44498us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:24.985220 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.988435 (+  3215us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.988597 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":830519,"prepare.queue_time_us":1206512,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":7637,"raft.run_cpu_time_us":2466,"raft.run_wall_time_us":90522,"spinlock_wait_cycles":133345024,"thread_start_us":494385,"threads_started":2}
I20260709 13:09:24.954202 23625 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:24.954816 26666 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.959211 26623 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.915357 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:24.964170 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:24.964891 26931 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:24.966436 26222 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:09:24.967937 26516 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:24.974280 26816 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:24.933688 26826 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:24.994596 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 90931.9us
I20260709 13:09:24.995208 23772 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:24.911399 26811 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:24.866784 26729 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.997125 23628 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:24.945851 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:24.926736 23525 catalog_manager.cc:5697] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 4 to 5, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 5 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:25.015372 24392 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:09:25.042831 23627 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:25.016980 26871 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:25.025301 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:25.026074 26823 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.021446 26669 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.046239 23622 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:25.050251 24390 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:25.035120 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:25.052552 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 106771us
I20260709 13:09:25.054198 24387 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:25.019172 26641 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:24.963460 26753 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:25.061882 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 83226.7us
I20260709 13:09:25.019403 26452 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:25.063583 24394 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.033828 26516 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:25.066417 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:25.047819 26871 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.075098 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.075862 23701 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:25.075435 26937 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.076661 23667 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:25.078068 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:25.078406 26937 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.078896 26864 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:25.079272 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:25.079561 26864 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:25.061308 26641 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:25.080120 26641 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.079946 26233 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:25.084995 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:25.083309 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:25.058020 26708 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:25.088351 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:25.098706 23623 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:25.025318 26834 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.103071 24392 raft_consensus.cc:2368] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6.
I20260709 13:09:25.090175 26816 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:25.102210 23668 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:25.064890 26452 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:25.045323 26222 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.106563 23525 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 8 to 9, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 9 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.107645 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:25.086889 26751 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:25.052529 23629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "334c9018414947cabb4405ef47b8018e"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
I20260709 13:09:25.117036 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:25.118340 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:25.119182 26611 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.132915 24388 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:25.133392 26222 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:25.129456 26751 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.134063 26751 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:25.134212 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.118973 26935 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:25.092166 26788 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.119990 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:25.154525 23696 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.079967 26864 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:25.121546 26846 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:25.122092 26756 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:25.182884 26756 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.183584 26753 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.153406 26611 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:25.184176 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:25.184362 26516 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.185135 26756 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.185250 23625 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:25.185523 26516 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.123055 26826 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:25.081625 26871 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.128515 23629 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.188030 23629 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.173971 23628 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:25.130882 23627 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:09:25.110003 26011 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:09:25.132210 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:25.127707 24390 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
W20260709 13:09:25.136313 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 57131.9us
W20260709 13:09:25.149761 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45103.5us
I20260709 13:09:25.151684 23697 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:25.106331 26706 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:25.127269 26452 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:25.170527 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 64910.9us
I20260709 13:09:25.200245 24357 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:25.171072 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 68988.3us
I20260709 13:09:25.174578 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:25.175896 26816 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:25.176031 23702 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:25.176748 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:25.177304 26788 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.179924 26572 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:25.182251 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:25.122658 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.091588 26708 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.190707 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:25.191947 24389 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:25.196727 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.169879 26864 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:25.218345 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.186447 26641 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.229458 26641 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.230209 26572 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:25.231277 26572 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.235282 26697 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:25.193082 26666 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:09:25.236043 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:25.236310 26753 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:25.236689 26666 raft_consensus.cc:3055] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:25.237190 26666 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:25.238260 26666 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.240875 26831 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:25.241310 26831 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:25.242506 26831 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:25.244069 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 53472.4us
I20260709 13:09:25.244692 26697 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:25.244900 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:25.245653 26697 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.248345 26611 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:25.248719 26880 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:25.249120 26880 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:25.249292 26611 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:25.249680 26611 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:25.250047 26880 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.250517 26611 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.251397 26880 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.219134 26708 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.214870 26757 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.203033 26826 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:25.259860 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.259315 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:25.259544 26011 consensus_queue.cc:1059] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:09:25.269287 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:25.269999 24394 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:25.261252 23629 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.271134 23668 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:25.268944 23776 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:25.272969 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:25.273327 24392 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:25.317159 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:25.322614 23775 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:25.317767 23525 catalog_manager.cc:5697] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 1 to 2, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 2 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.323442 26011 raft_consensus.cc:3055] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:25.337401 26011 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:25.338760 26011 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.251698 26611 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:25.255354 26952 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:09:25.261098 26831 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:25.342061 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 95549.4us
I20260709 13:09:25.216670 26830 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.254685 26757 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.350060 23769 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:25.351569 23629 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:25.347024 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:25.353920 23592 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:25.255427 26756 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:25.277294 26706 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.214308 26816 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.363161 24386 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
W20260709 13:09:25.367884 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.340178 26935 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:25.377063 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 101048us
I20260709 13:09:25.258435 26486 consensus_queue.cc:1059] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
W20260709 13:09:25.327155 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 54255.3us
I20260709 13:09:25.392160 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:25.412743 26011 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.418262 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:25.416651 24385 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:25.421628 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:25.282676 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:25.424515 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:25.424983 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:25.425324 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:25.436440 23621 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:25.439119 26486 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:25.439867 26486 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:25.441072 26486 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.441717 26834 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:25.442479 26834 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:25.442606 26486 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.427606 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:25.368297 26666 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.444834 26871 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.439325 26708 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.447294 26811 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:25.254066 26826 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.453943 26830 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.426178 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:25.455909 23769 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:09:25.443105 26834 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:25.486434 26834 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.492434 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:25.493237 23778 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.502156 26816 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:25.502988 26816 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.503823 26516 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:25.504657 26516 raft_consensus.cc:697] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:25.464596 24389 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:25.462925 23696 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:25.450767 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:25.376973 26931 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:25.385561 26935 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.455031 26751 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.380745 26706 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.477480 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:25.378525 26802 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:25.479255 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 63433.4us
I20260709 13:09:25.484719 23772 raft_consensus.cc:2410] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:25.484225 23769 pending_rounds.cc:85] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 3
I20260709 13:09:25.524470 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:25.529546 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:25.567514 23769 pending_rounds.cc:107] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:09:25.568069 23769 raft_consensus.cc:2889] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:25.280103 26222 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.205s
I20260709 13:09:25.539659 23777 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:25.541136 23624 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:25.543929 24357 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:25.531243 26708 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.570065 23770 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:25.579794 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:25.583348 23742 leader_election.cc:400] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6.
I20260709 13:09:25.583702 23742 leader_election.cc:403] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:25.539244 26935 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:25.587800 26508 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:25.588207 26508 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:25.589010 26508 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.590318 26508 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.590669 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:25.568214 26729 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.597448 26516 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.598673 26729 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.571810 26802 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.599438 26802 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:25.601003 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.602555 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:25.603111 23772 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.605195 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:25.612593 23621 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.503531 26816 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.615384 23742 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:25.626417 23775 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:25.629148 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:25.630016 23770 raft_consensus.cc:3055] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:25.569936 26830 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:25.630405 23770 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:25.638872 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:25.644385 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.655380 26757 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:25.656183 26757 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:25.649238 26827 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.656961 26827 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.657382 26757 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.663043 26729 raft_consensus.cc:3055] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:25.663601 26729 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:25.664753 26729 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.668751 26926 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:25.669317 26926 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:25.669703 26926 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:25.671252 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.673524 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 58270.1us
I20260709 13:09:25.674407 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:25.677322 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:25.679237 23622 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:25.680229 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.680751 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.649772 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:25.684295 23772 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
W20260709 13:09:25.684588 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.580034 26931 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:25.702601 23772 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:09:25.707880 23772 pending_rounds.cc:85] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 4
I20260709 13:09:25.708325 23772 pending_rounds.cc:107] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:09:25.708702 23772 raft_consensus.cc:2889] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:25.695868 23592 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:25.636077 26818 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6.
I20260709 13:09:25.713236 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:25.659559 26827 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:25.710974 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 441730us
I20260709 13:09:25.690016 23770 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.716075 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:25.707717 26850 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:25.749372 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 225672us
I20260709 13:09:25.736811 23592 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:25.742784 23770 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.746850 23778 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
W20260709 13:09:25.740875 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 469752us
I20260709 13:09:25.750180 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:25.758777 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.759485 23701 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:25.723968 26788 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:25.732262 26669 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:25.783035 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.788336 24357 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:25.763620 23777 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:09:25.681422 26864 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.791523 23777 pending_rounds.cc:85] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 4
I20260709 13:09:25.791942 23777 pending_rounds.cc:107] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:09:25.792452 23777 raft_consensus.cc:2889] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:25.793267 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:25.800704 23697 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.762262 26641 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:25.716456 26931 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.820253 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:25.733480 26828 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:09:25.758092 23696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45060
I20260709 13:09:25.832959 23696 raft_consensus.cc:606] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 13:09:25.833330 23696 raft_consensus.cc:614] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:25.811051 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:25.801788 26572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.030s	sys 0.067s
I20260709 13:09:25.828998 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.816161 24385 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:25.793737 26830 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:25.783411 26788 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:25.797165 26669 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:25.819245 26452 consensus_meta.cc:287] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
W20260709 13:09:25.837575 26572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.030s	sys 0.068s
I20260709 13:09:25.835541 26641 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:25.798151 26799 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:25.864897 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50657us
I20260709 13:09:25.867575 26931 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:25.848459 26669 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:25.871806 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.840659 26823 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.848220 26788 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:25.874835 26611 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.000s
I20260709 13:09:25.851492 26452 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.877539 26452 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.877297 26641 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.879881 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:25.880268 26960 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:25.880650 23703 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
W20260709 13:09:25.743129 26011 consensus_queue.cc:1175] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9ab488f10c434878a749f261e99a8065" responder_term: 6 status { last_received { term: 5 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:25.858631 26871 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.881788 26812 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:25.882220 26948 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:09:25.883096 23699 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:09:25.884158 26706 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.885282 26669 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.873976 26751 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:25.887707 26816 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.889159 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.890457 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:25.890972 23702 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.891767 26836 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:25.892174 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:25.892843 23701 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:25.892457 26836 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.840584 26708 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.894138 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.894517 26708 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.895196 26836 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:25.892182 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:25.896916 23698 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.896965 26708 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.854202 26588 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.899000 26935 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:25.900600 26864 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:25.901335 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:25.902201 23696 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
W20260709 13:09:25.905393 26880 consensus_meta.cc:287] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.003s
I20260709 13:09:25.905215 26802 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.905850 26963 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:25.906520 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.848070 26830 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:25.933595 23699 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:25.933571 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.933701 23698 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 4.
I20260709 13:09:25.913295 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:25.915015 26799 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.934867 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.924821 23701 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 2.
W20260709 13:09:25.945868 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.925948 23621 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:25.917323 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:25.908352 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:25.945761 23698 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:25.948043 23700 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.949065 23622 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:25.886140 23697 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:25.950243 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:25.932497 23770 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:25.951005 23701 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:25.933018 23702 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:25.922042 23774 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:25.927264 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:25.936820 23703 raft_consensus.cc:2393] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 3: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:25.937630 23771 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:25.940577 23773 raft_consensus.cc:2410] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:25.941838 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.954095 23620 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:25.943120 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:25.955099 23699 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.943563 26966 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:25.908849 26962 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:25.937955 26799 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:25.952612 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 51368.7us
I20260709 13:09:25.941009 26864 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:25.959444 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.970427 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:25.956664 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:25.971083 23702 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:26.005967 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:26.008414 24389 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:25.975816 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.997219 23698 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:09:26.007115 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 255842us
I20260709 13:09:25.992434 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.010494 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:25.975299 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:25.938454 26926 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:26.011209 24386 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 9: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:25.938673 26963 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.010738 23701 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:26.051657 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.013756 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 175044us
I20260709 13:09:26.035965 23667 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:25.971221 23697 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:26.071154 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.033532 23703 raft_consensus.cc:2368] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:26.036146 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:26.078059 23776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.058s	sys 0.132s
W20260709 13:09:26.094384 23776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.059s	sys 0.133s
I20260709 13:09:26.012164 23592 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:26.089573 24389 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
W20260709 13:09:26.119990 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 116872us
I20260709 13:09:26.111033 24392 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:25.998241 26669 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:26.112914 23696 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:26.114724 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.124024 23697 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
W20260709 13:09:26.124068 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 111975us
I20260709 13:09:26.140930 23775 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:26.111765 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:26.189139 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.189587 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:25.972992 26966 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:26.190567 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49330.7us
I20260709 13:09:26.191220 23700 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:26.193710 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:26.097306 26864 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:26.196764 23667 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:26.191816 23701 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
W20260709 13:09:26.193066 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 206255us
I20260709 13:09:26.143746 23702 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:26.037436 26756 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
W20260709 13:09:26.198922 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.114890 26831 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:26.185774 26971 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:09:26.202543 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.200129 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.147640 26871 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:26.200129 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:26.204022 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.204175 23700 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.201754 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.207857 23697 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:26.200884 24385 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:26.210328 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.142251 26850 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:26.211052 23703 raft_consensus.cc:2368] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:26.199309 26834 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:26.219539 26834 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:26.220618 26963 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:26.220582 26834 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:26.208714 26935 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:26.195451 26757 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:09:26.200377 26864 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:26.218361 26926 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:26.227371 26966 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:26.203943 26830 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:26.214269 26962 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:26.241178 26957 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 1.044s	user 0.006s	sys 0.001s
I20260709 13:09:26.211514 26880 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:26.242292 26880 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:26.243386 26916 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:26.243842 26916 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:26.244489 26788 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.244781 26916 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:26.245824 26916 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.246783 26788 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:26.219871 26802 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:26.241921 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 370) took 1055 ms. Trace:
I20260709 13:09:26.252735 23704 rpcz_store.cc:276] 0709 13:09:25.186765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.186911 (+   146us) service_pool.cc:224] Handling call
0709 13:09:26.241741 (+1054830us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b5400357fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:26.241863 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057588992}
I20260709 13:09:26.253826 26880 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:26.247596 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.252928 23699 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
W20260709 13:09:26.255872 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.256062 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 59425.2us
I20260709 13:09:26.256254 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:26.257014 23621 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 5: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:26.256909 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:26.257829 26962 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:26.258275 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:26.258809 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46566 (request call id 558) took 1078 ms. Trace:
I20260709 13:09:26.215149 26871 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:26.260713 26871 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.263399 23525 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 4 to 6, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:26.265308 23629 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:09:26.265616 23525 catalog_manager.cc:5697] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.269579 23592 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:26.271118 26756 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:26.271632 26756 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:26.272521 26756 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.259315 24391 rpcz_store.cc:276] 0709 13:09:25.180864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.183881 (+  3017us) service_pool.cc:224] Handling call
0709 13:09:26.258639 (+1074758us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54005b1dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:26.258756 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593852672}
I20260709 13:09:26.276548 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:26.277446 26969 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:26.277678 23700 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:26.279604 26864 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:26.280319 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.281067 23695 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:26.281774 26962 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:26.281944 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.282433 26830 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:26.284396 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.284317 23667 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:26.285177 26830 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:26.285650 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.286418 23775 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:26.286778 23667 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:26.288452 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.288945 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.289144 26751 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.289512 23771 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:26.289618 26751 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:26.292340 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.292282 26011 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:26.292874 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.292912 26011 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:26.294726 26011 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:26.294875 26976 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:26.295388 26976 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:26.297571 26976 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:26.301102 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.303912 26751 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:26.289398 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.297281 26799 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:26.283538 23695 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:26.305346 23702 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:26.308140 26830 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:26.309034 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.316512 23775 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:26.310005 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.305300 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.317531 23622 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:26.317771 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:26.316555 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.315016 23774 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:26.321368 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:26.328783 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:26.331799 23743 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:26.333194 26011 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:26.333668 26011 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.334067 26011 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:26.341246 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.342845 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.343504 23774 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:26.343947 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.344646 23702 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:26.348258 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:26.348980 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.312144 26850 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:26.351943 24392 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:26.351866 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:26.352856 24385 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:26.355237 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.356045 23695 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:26.361698 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:26.359997 23593 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.556s (SENT)
I20260709 13:09:26.328648 26802 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:26.365556 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:26.367479 26799 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:26.341132 26757 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:26.370232 23771 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:26.372051 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:26.372960 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.375829 23772 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:26.376292 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:26.373363 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.379005 23702 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:26.386831 23703 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:26.387506 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.388559 23702 raft_consensus.cc:2368] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6.
I20260709 13:09:26.393087 23778 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:26.396917 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.398789 23702 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:09:26.400492 23698 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:26.421743 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.437840 23702 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:26.425890 26011 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.438354 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.395330 26830 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.432215 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.450603 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:26.398118 26233 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:26.394712 26802 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:09:26.455472 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 53256.3us
I20260709 13:09:26.455685 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.456552 23698 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:09:26.456130 24391 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:26.457549 23698 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:26.458319 23695 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:26.459242 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.385012 26789 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 13:09:26.459900 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 99938.5us
W20260709 13:09:26.461076 23593 leader_election.cc:336] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.557s (SENT)
I20260709 13:09:26.400542 26757 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:26.462970 23592 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:26.463266 26011 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:26.462903 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.463965 23592 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:26.461511 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:09:26.464427 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.467700 23696 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:26.468977 23699 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:26.452240 26830 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:26.452263 26970 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:26.470968 23695 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:26.401705 26751 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:09:26.473307 23702 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:26.480270 23628 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:26.480685 23628 pending_rounds.cc:85] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 7
I20260709 13:09:26.480916 23628 pending_rounds.cc:107] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:09:26.481253 23628 raft_consensus.cc:2889] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:26.484869 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.485817 23699 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:26.467617 26753 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:26.488528 23703 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:26.480238 26812 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.474552 26830 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.490543 23700 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:26.483896 26756 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.479655 26788 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:26.505406 23699 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:26.472018 26962 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:09:26.511811 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:26.506104 23698 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:26.506290 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:26.507200 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:26.470652 26864 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.521132 26788 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:26.522634 26864 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:26.524160 23701 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:26.524471 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:26.525309 23771 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:26.526091 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:26.527185 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:26.512383 26802 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.492726 26812 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.509828 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.510908 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:26.505585 23695 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:26.535918 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.512073 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.512487 23773 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:26.535770 23775 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:26.538161 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.538561 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:26.539619 23775 raft_consensus.cc:2410] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:26.540390 23774 raft_consensus.cc:2410] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:26.540560 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.541244 23775 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.541301 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.542546 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.543274 23774 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:26.520206 26910 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:26.546048 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.546550 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:26.546988 23626 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:26.547266 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.522234 26788 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.509105 24385 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:26.560767 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:26.561489 23622 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:26.539470 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.562098 23773 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:26.519384 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.548102 23700 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:26.536710 23778 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10.
I20260709 13:09:26.538566 23701 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:26.516238 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:26.556543 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 95486us
I20260709 13:09:26.564735 26812 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:26.564934 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:26.565469 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.567598 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.574401 23699 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:26.577661 23575 auto_rebalancer.cc:893] Removing replace marker failed: Replica c885217113574e7489e6c3afb6950f76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:09:26.578301 23575 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:09:26.578619 23575 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:09:26.582069 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.604092 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "334c9018414947cabb4405ef47b8018e"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43444
I20260709 13:09:26.604861 23778 raft_consensus.cc:606] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 13:09:26.604962 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:26.605239 23778 raft_consensus.cc:614] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:26.606281 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:26.583678 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.607821 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:26.608017 23774 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:26.614003 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.615136 23777 raft_consensus.cc:2368] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8.
I20260709 13:09:26.614269 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:26.616014 23703 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:26.606292 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.618165 23771 raft_consensus.cc:2368] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9.
I20260709 13:09:26.613692 26753 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:26.517730 26757 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.692253 23775 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:26.790637 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:26.795748 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.796505 23774 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:09:26.797652 26753 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.645231 26864 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.154s
I20260709 13:09:26.798804 23622 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:26.664719 26812 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.803639 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.803524 26812 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.804522 23620 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:26.805984 26812 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:26.689963 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.740824 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 172299us
W20260709 13:09:26.724176 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 192482us
I20260709 13:09:26.808481 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.809383 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:26.810263 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.663980 26966 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:26.697474 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.628105 26962 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.627948 26836 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.826483 26836 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.829134 26836 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:26.829877 26966 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:26.811924 23667 leader_election.cc:400] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10.
I20260709 13:09:26.832069 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.833336 23628 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:09:26.791538 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.835229 23702 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 13:09:26.836927 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:26.837776 23704 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:26.841571 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:26.841666 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:26.842895 23667 leader_election.cc:400] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9.
I20260709 13:09:26.843256 23667 leader_election.cc:403] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:26.843423 23697 raft_consensus.cc:2368] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6.
W20260709 13:09:26.844967 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.846530 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.847487 23621 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:26.848093 23667 leader_election.cc:400] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8.
I20260709 13:09:26.848433 23667 leader_election.cc:403] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:26.853024 23771 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:26.841611 26834 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:09:26.860059 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.861366 24389 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:26.860796 23623 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:26.851413 26962 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9.
W20260709 13:09:26.865348 23593 leader_election.cc:336] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.786s (SENT)
I20260709 13:09:26.867378 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:26.870031 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:26.874688 23773 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:26.866267 26970 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.877439 26669 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:26.889974 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:26.890386 26830 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:26.871934 26871 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:09:26.868374 26910 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:09:26.879972 26997 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8.
I20260709 13:09:26.916476 26830 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:26.886075 26962 consensus_queue.cc:1059] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:09:26.924548 26962 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:26.903962 23695 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:26.882900 26970 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:26.949465 26729 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.953728 26970 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:26.957345 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.957958 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.960907 26998 raft_consensus.cc:3055] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:26.961654 26998 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:26.963094 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 87677.1us
I20260709 13:09:26.962873 26998 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:26.965056 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:26.972627 24385 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:26.973863 26998 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:26.974925 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 105980us
I20260709 13:09:26.969825 23778 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:26.975601 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:26.971259 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:26.976394 27002 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:26.976858 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:26.976944 23772 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:26.977192 27002 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:26.978533 26834 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.980509 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:26.979341 27002 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:26.988040 23743 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:26.997929 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:26.986503 26572 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.004827 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.013720 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.015144 27006 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.017552 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.018643 27006 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.020634 23669 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.022688 27006 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:27.026065 26572 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:26.999706 26751 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:27.028092 26751 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.028573 26751 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.996311 26834 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:27.037070 26997 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:27.007913 26864 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:27.040089 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 161545us
I20260709 13:09:27.041158 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:27.046986 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:27.043332 26572 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:27.048985 26987 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.537s	user 0.004s	sys 0.017s
I20260709 13:09:27.002995 27000 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:09:27.051589 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.052130 27001 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:27.038580 26997 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:27.053573 26997 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.054769 26997 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:27.022377 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:27.059578 26830 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:27.062659 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.065944 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:27.069056 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.070216 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:27.070905 26834 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:27.073957 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:27.078331 23773 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:27.077131 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 83283.2us
I20260709 13:09:27.080546 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:27.080786 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.071321 26788 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.071290 26830 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:27.086520 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.091923 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:27.093277 23743 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:27.096235 26588 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.096809 26588 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.082844 26757 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:09:27.103400 23667 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.108309 23701 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:09:27.109678 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.107872 26834 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:27.107890 26831 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:27.110908 23696 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:27.111188 26831 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.111645 26831 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.112066 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:27.112836 23695 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:27.083671 27002 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:27.117645 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:27.092643 26864 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.133904 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.134701 23702 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:27.084758 26788 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:27.133921 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:27.084499 27014 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.135051 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.136757 23623 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 2.
I20260709 13:09:27.137177 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:27.138070 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.138700 23697 raft_consensus.cc:2376] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11. Re-sending same reply.
I20260709 13:09:27.117451 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:27.102180 26969 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:27.148799 23627 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:27.141273 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:27.147385 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 55536.9us
I20260709 13:09:27.131649 26962 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:27.105065 26830 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:27.139397 23701 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:27.150036 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:27.148252 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:27.153769 23696 raft_consensus.cc:2376] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6. Re-sending same reply.
I20260709 13:09:27.107586 26588 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:27.158372 23593 leader_election.cc:400] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:27.158818 23593 leader_election.cc:403] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:27.139267 26788 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.160187 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.163201 23697 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:09:27.158938 24359 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:27.161871 24358 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.137379 26756 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:27.139003 27014 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.170486 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:27.171187 23695 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:27.153257 27000 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.154166 26969 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:27.161268 27004 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:27.171996 27014 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.175011 26979 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:27.176441 26996 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.259s	user 0.003s	sys 0.000s
W20260709 13:09:27.177959 27007 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:09:27.162626 26864 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:09:27.149688 26834 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:09:27.178301 23774 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:27.206279 26756 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:27.181748 26233 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:27.207463 26756 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:27.185830 26985 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.708s	user 0.013s	sys 0.001s
I20260709 13:09:27.174731 26572 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:27.210063 26572 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.210522 26572 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.186837 26969 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.194854 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.192399 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:27.196194 26966 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:27.213380 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:27.202064 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.193607 27004 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:27.207758 26233 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.215718 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:27.202677 26802 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:27.193871 24358 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:27.216894 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:27.222651 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.229331 23774 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:27.238612 23702 raft_consensus.cc:2376] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3. Re-sending same reply.
I20260709 13:09:27.247114 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:27.247692 23697 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:27.248723 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.248889 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.249217 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:27.249814 23696 raft_consensus.cc:2410] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:09:27.250032 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:27.251441 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:27.251899 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.257320 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:27.271430 23699 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:27.252135 23742 leader_election.cc:400] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6.
I20260709 13:09:27.256738 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:27.258742 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 64946.8us
I20260709 13:09:27.273581 23700 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:27.274334 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.257648 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.275714 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.276634 23695 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:27.253162 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.255565 23525 catalog_manager.cc:5697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.170178 26588 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 13:09:27.256304 26999 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.286s	user 0.005s	sys 0.000s
W20260709 13:09:27.288115 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 173624us
I20260709 13:09:27.223374 26880 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.227084 26508 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.227340 26669 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:27.294494 27018 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:27.235086 26753 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:09:27.294922 27014 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.296547 26789 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:27.286317 26926 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.218500 26966 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:27.295313 23526 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52058 (request call id 188) took 21936 ms (client timeout 15000 ms). Trace:
I20260709 13:09:27.336328 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:27.322882 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:27.338423 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:27.339162 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:27.289573 27004 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.290218 26990 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:27.279927 26812 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:27.329576 23575 auto_rebalancer.cc:893] Removing replace marker failed: Replica 4466bf6d6cf84ee89e84ea074e3964c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:27.327188 23525 catalog_manager.cc:5697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.282929 26729 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.282984 26976 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:27.287768 26970 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:27.254866 26979 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:27.290393 27005 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:27.360224 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 69905.2us
I20260709 13:09:27.258239 26802 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:27.364564 26995 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.445s	user 0.003s	sys 0.000s
I20260709 13:09:27.330804 26751 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.376452 26831 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.328951 26508 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.372606 26233 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:27.372985 26966 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.336159 26669 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:27.333062 26789 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.342952 26926 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.380574 27004 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.381822 23625 raft_consensus.cc:2368] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6.
I20260709 13:09:27.383359 27014 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:27.325500 26830 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.328578 26880 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.481807 26669 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.483513 26880 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:27.321591 26836 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:27.399545 23575 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:09:27.496970 23575 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:09:27.349334 26641 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:27.415560 26976 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:27.390293 27013 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:27.514812 26976 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:27.519045 27004 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:27.440964 23525 catalog_manager.cc:5697] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 3 to 6, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 6 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.391185 27021 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.520182 27021 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.416437 26916 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:27.448671 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 197299us
I20260709 13:09:27.525753 23593 leader_election.cc:400] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
W20260709 13:09:27.450615 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.472990 26831 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:27.474974 26508 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:27.529408 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 86648.2us
I20260709 13:09:27.458981 26910 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:27.460417 26789 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.480345 26788 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.480963 26802 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:27.444387 27005 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:27.505403 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.548148 23697 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:09:27.478950 26572 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:27.336107 23526 rpcz_store.cc:269] 0709 13:09:05.358481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.421057 (+ 62576us) service_pool.cc:224] Handling call
0709 13:09:05.909690 (+488633us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b54000b90d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41276090 00007f2b41314f3a 00007f2b470cb1cc 00007f2b471c937e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc 00007f2b45689392 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:27.295023 (+21385333us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:22.900283 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:22.989480 (+ 89197us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:22.989531 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:09:22.989562 (+    31us) tablet.cc:662] Decoding operations
0709 13:09:22.990316 (+   754us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:22.990413 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:22.990455 (+    42us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:09:22.990870 (+   415us) tablet.cc:701] Row locks acquired
0709 13:09:22.990894 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:09:22.991198 (+   304us) write_op.cc:270] Start()
0709 13:09:22.991347 (+   149us) write_op.cc:276] Timestamp: P: 1783602562991129 usec, L: 0
0709 13:09:22.991375 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:09:23.128814 (+137439us) log.cc:844] Serialized 1298 byte log entry
0709 13:09:23.400934 (+272120us) op_driver.cc:464] REPLICATION: finished
0709 13:09:24.200159 (+799225us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b3e2020ac 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b44d42ef0
0709 13:09:24.647561 (+447402us) write_op.cc:301] APPLY: starting
0709 13:09:24.647687 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:24.647895 (+   208us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:24.647932 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:24.648595 (+   663us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:24.648908 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:09:24.648962 (+    54us) write_op.cc:312] APPLY: finished
0709 13:09:24.649328 (+   366us) log.cc:844] Serialized 35 byte log entry
0709 13:09:24.700423 (+ 51095us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:24.700709 (+   286us) write_op.cc:454] Released schema lock
0709 13:09:24.700791 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:24.879158 (+178367us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:24.883924 (+  4766us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":237914,"reported_tablets":44,"spinlock_wait_cycles":167119104,"child_traces":[["op",{"apply.queue_time_us":1246222,"apply.run_cpu_time_us":8967,"apply.run_wall_time_us":54013,"num_ops":3,"prepare.queue_time_us":393532,"prepare.run_cpu_time_us":19630,"prepare.run_wall_time_us":390604,"raft.queue_time_us":100934,"raft.run_cpu_time_us":22461,"raft.run_wall_time_us":1483657,"replication_time_us":409394,"spinlock_wait_cycles":10860800,"thread_start_us":1815730,"threads_started":5,"wal-append.queue_time_us":254390,"wal-append.run_cpu_time_us":5614,"wal-append.run_wall_time_us":2167952}]]}
I20260709 13:09:27.477176 26926 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:27.457999 27024 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:27.531257 23629 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:27.534952 23623 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:27.535439 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:27.496636 26836 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:27.543610 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 205218us
I20260709 13:09:27.566183 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:27.569180 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:27.572156 23669 leader_election.cc:400] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6.
I20260709 13:09:27.579142 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:27.578943 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:27.579927 23774 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:27.551045 26729 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.582044 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:27.582734 23775 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.592039 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:27.545709 27014 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:09:27.602877 23775 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:27.580227 26836 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.580396 26990 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:27.586810 27004 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:27.627125 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:27.628015 23769 raft_consensus.cc:606] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.628433 23769 raft_consensus.cc:614] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:27.629457 23775 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:27.574761 27006 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:09:27.631328 26508 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:27.594193 26729 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.632432 26751 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:27.677356 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 95692.9us
I20260709 13:09:27.551110 26979 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.655916 27027 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.621898 27013 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:09:27.664999 26757 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:09:27.690671 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a97c483343c425ea75f1f6632924819"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:27.708738 27042 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:27.709280 23769 raft_consensus.cc:606] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.709730 23769 raft_consensus.cc:614] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:27.709470 27042 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.710906 27021 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:27.711226 27013 consensus_queue.cc:1243] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:27.711830 27013 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:27.659993 27005 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.696197 26788 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:27.695996 26997 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:27.701439 26729 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:27.703284 26572 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:27.707484 26834 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:27.763808 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 80811.3us
I20260709 13:09:27.761349 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:27.765094 23769 raft_consensus.cc:606] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:09:27.765446 23769 raft_consensus.cc:614] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:27.762818 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 74945.1us
I20260709 13:09:27.712224 27013 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:27.768422 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.778633 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 203064us
I20260709 13:09:27.780468 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:27.781172 23701 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.781426 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.782346 23702 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:27.780359 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.789577 23742 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:27.794318 26976 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.797403 23777 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:27.801215 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 249984us
I20260709 13:09:27.802103 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:27.808408 23701 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:27.817584 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.818854 23697 raft_consensus.cc:2410] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:27.816922 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.823318 23701 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:27.830221 23701 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:27.836002 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:27.836862 23701 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.839954 23702 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:27.843504 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:27.854176 27032 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:27.855038 27032 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.857848 27032 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:27.877220 23699 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:27.872869 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:27.885861 24385 raft_consensus.cc:2410] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:27.763666 27030 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:09:27.891253 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:27.891979 24386 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:27.892194 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.778286 27004 raft_consensus.cc:697] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:27.892925 23698 raft_consensus.cc:2376] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9. Re-sending same reply.
I20260709 13:09:27.893643 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.894858 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:27.896536 23697 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:27.904822 23702 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:27.907562 23704 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:27.908070 23704 pending_rounds.cc:85] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 3
I20260709 13:09:27.908317 23704 pending_rounds.cc:107] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:27.908550 23698 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:27.908558 23704 raft_consensus.cc:2889] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:27.900450 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:27.911432 24389 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.913080 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:27.961922 23701 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
W20260709 13:09:27.874775 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 243554us
I20260709 13:09:27.769095 26834 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:27.974015 23774 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:27.874217 27014 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:27.787928 27038 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.146s
I20260709 13:09:27.874719 27040 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:28.006006 26789 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:28.006399 27047 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.200s
W20260709 13:09:28.007849 27034 log.cc:927] Time spent T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 13:09:27.806367 26836 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:27.762732 26990 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.019163 23703 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:28.029788 24392 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:28.030645 24389 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:28.020315 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:28.013656 27032 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:09:28.002584 27031 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.164s
I20260709 13:09:28.077473 27043 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.089088 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 183226us
I20260709 13:09:28.079114 26830 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.977535 27013 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.129917 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:28.132622 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:28.092067 26976 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:28.091377 26850 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:09:28.109468 27047 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:09:28.122761 27014 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:09:28.087291 27004 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:28.161415 27006 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.123024 26830 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.163363 26976 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:28.123872 27043 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:28.182866 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.198132 23627 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:28.183236 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:28.186772 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 89714.8us
I20260709 13:09:28.191985 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:28.194754 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.197279 27063 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:28.206022 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 74333.2us
W20260709 13:09:28.203368 27052 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:09:28.199178 26789 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:28.217656 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:28.200274 26836 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:28.232244 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:28.237452 27067 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:28.238415 27067 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.239796 27051 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:09:28.241834 27048 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:09:28.243616 27061 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.244361 27061 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.252137 27065 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:28.252983 27065 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.255694 27044 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 13:09:28.266505 27043 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:28.219353 27063 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.279642 27063 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.280838 27024 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:28.281857 27024 consensus_queue.cc:1243] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:09:28.284970 27062 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:09:28.288570 27060 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:09:28.190470 27006 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.316968 26836 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.336534 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:28.337908 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:28.354665 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:28.357857 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:28.353554 27013 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.377498 27000 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.387656 27050 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.388505 26833 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:28.392974 27058 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:28.395939 26757 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:28.398644 26871 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:28.382423 27056 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.269s
I20260709 13:09:28.402221 27042 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:28.404210 27035 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:09:28.405112 26830 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:28.431073 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:28.460493 23774 raft_consensus.cc:606] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:09:28.460932 23774 raft_consensus.cc:614] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:28.466116 26830 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.466912 26830 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.431228 27058 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.431628 26871 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:28.478849 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:28.479338 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 119813us
I20260709 13:09:28.484673 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:28.485337 23774 raft_consensus.cc:606] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:09:28.430522 26833 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:28.420925 27000 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.428306 27050 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.489369 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:28.481189 26830 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:28.493765 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:28.496500 23701 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:28.496609 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:28.496326 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:28.497304 23698 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.497689 23697 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 2.
I20260709 13:09:28.485554 27036 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:28.526870 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.528417 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:28.527607 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:28.512694 23698 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:28.505446 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:28.483861 27072 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.494948 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:28.508760 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:28.535837 23702 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:28.537352 23699 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:28.542335 27078 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:09:28.535252 27086 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:28.553859 27086 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:28.559499 26880 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.560177 26880 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.562589 26880 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:28.562737 26836 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:28.527480 27073 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.524941 27066 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.189s
I20260709 13:09:28.565614 27050 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:28.566023 27000 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:28.563278 26836 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:28.577744 23701 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:28.585489 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:28.581384 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.599187 26833 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:28.535313 27036 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.580360 27076 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:28.619119 27000 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.581278 26233 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:28.590058 27067 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:28.580425 27073 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:28.616070 27036 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:28.603621 27027 consensus_meta.cc:287] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.845s	user 0.008s	sys 0.000s
I20260709 13:09:28.615216 26880 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.632637 23699 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:28.619208 27076 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:28.678093 23626 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:28.683082 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:28.688997 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:28.650041 27027 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.691016 23699 raft_consensus.cc:1217] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-10.9]   Dedup: 5.7->[8.8-10.9]
I20260709 13:09:28.695853 23699 pending_rounds.cc:85] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 7
I20260709 13:09:28.696195 23699 pending_rounds.cc:107] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:28.696487 23699 raft_consensus.cc:2889] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:28.697582 23628 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:28.623170 27000 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:28.633530 26836 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.626245 26233 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:28.676328 26880 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.698657 27044 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:09:28.711915 27086 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:28.741163 26871 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.726951 27058 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:28.756413 26962 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.759188 26962 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.721252 27004 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:28.759796 26864 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.760185 27004 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:28.760456 26864 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:28.761477 26962 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:28.757593 24385 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:09:28.762341 27004 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:28.762663 24385 pending_rounds.cc:85] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Aborting all ops after (but not including) 7
I20260709 13:09:28.762946 24385 pending_rounds.cc:107] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:09:28.763258 24385 raft_consensus.cc:2889] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:28.758315 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:28.764118 24389 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:28.764681 27065 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:28.765690 27063 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:28.768100 27067 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:28.768615 26998 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:28.768903 27067 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.769289 26998 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.743481 26966 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.772723 27076 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:28.774807 27082 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.240s	user 0.002s	sys 0.000s
I20260709 13:09:28.721408 27081 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:28.776922 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 191559us
I20260709 13:09:28.726352 27073 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:28.748588 27084 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:09:28.794304 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.784909 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:28.795498 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.796591 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:28.797075 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.798067 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.798520 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:28.800354 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.801029 23772 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:28.805032 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.806322 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.771581 26998 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:28.794776 23668 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:28.808925 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.808050 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:28.808812 26812 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:28.798763 23771 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:28.814810 23770 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:28.808534 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.820192 23771 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:28.822453 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.778237 27081 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.776621 27067 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:28.820453 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:28.826689 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.762801 26864 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:28.817248 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:28.816694 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:28.835649 23770 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:28.803423 26871 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.833442 27100 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.819015 26976 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:28.839025 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.839565 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.839798 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.840808 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.814098 27076 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:28.813969 27086 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:28.836803 23667 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:28.826898 27081 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.851691 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:28.778726 26836 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:28.915961 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 79255.9us
I20260709 13:09:28.916232 23773 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:28.853468 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:28.883335 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 75364.7us
I20260709 13:09:28.921486 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:28.836397 24385 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:28.914063 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.912813 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.828469 27065 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:28.916431 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 88983.5us
I20260709 13:09:28.931239 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.839881 26864 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:28.944171 26812 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:28.837546 26998 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:09:28.952309 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:28.943550 27013 consensus_meta.cc:287] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.001s
I20260709 13:09:28.922546 27044 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:28.941823 27099 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:09:28.957197 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.947414 27065 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:28.964560 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.922250 26962 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:29.205987 26962 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:29.206753 26998 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:29.206864 26962 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.200875 23622 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
W20260709 13:09:29.120376 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 199008us
I20260709 13:09:29.208680 26998 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:29.212285 26998 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:29.212751 27109 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.213253 26998 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:29.201929 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 236308us
I20260709 13:09:29.213425 27109 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.214238 27113 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.214759 27113 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:29.214687 26998 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.202971 27111 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.203547 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:29.216360 27111 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.202711 27044 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.223290 27053 consensus_queue.cc:1059] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:29.225221 26836 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.225698 27044 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.223425 23700 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:29.201630 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 244133us
I20260709 13:09:29.216799 23628 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:28.958148 27067 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.021708 27095 log.cc:927] Time spent T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:09:28.943106 27086 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:29.021697 27100 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.202s
I20260709 13:09:29.240569 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:29.243115 26990 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:29.244863 27063 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:29.245352 27063 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:29.246186 27063 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:28.962056 27068 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:29.247972 27068 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:29.248399 27068 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.249137 27038 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:29.250237 27001 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:29.250669 27001 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:29.229892 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:28.950493 27106 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.225854 26836 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.219031 27109 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:28.947993 26864 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:28.962613 27091 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:09:29.233867 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:28.960655 26880 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:28.953958 26976 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:29.217175 27113 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:29.251163 27014 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.268s
I20260709 13:09:29.524325 26812 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:29.258621 23621 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:29.362241 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:29.564126 23700 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:29.251555 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:29.575560 27014 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:29.576131 27014 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.576591 27014 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:29.365576 26966 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.000s
I20260709 13:09:29.365347 27001 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:29.590279 27001 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.592031 26864 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:29.596009 27109 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.596771 27109 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.364652 26233 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.600713 26233 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.601373 26233 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:29.603964 26233 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:29.151165 27085 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:29.616539 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 365022us
I20260709 13:09:28.958388 27058 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.561210 27013 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.562858 23625 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
W20260709 13:09:29.231256 27036 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.562s	user 0.002s	sys 0.008s
I20260709 13:09:29.632423 23698 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:29.252411 23776 raft_consensus.cc:2410] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:29.599399 27109 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.060972 27000 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.587152 27014 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.675998 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:29.676290 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:29.324479 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:29.671464 27038 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:29.708434 27038 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.609365 27106 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.710534 27038 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.671583 27072 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.711364 27072 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.713543 27072 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:29.714627 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.717247 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:29.718185 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1621) took 1377 ms. Trace:
I20260709 13:09:29.718561 23778 rpcz_store.cc:276] 0709 13:09:28.340662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.340988 (+   326us) service_pool.cc:224] Handling call
0709 13:09:28.341474 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.490440 (+148966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.490491 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.495555 (+  5064us) log.cc:844] Serialized 26 byte log entry
0709 13:09:28.627562 (+132007us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:28.627619 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.627718 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.717923 (+1090205us) raft_consensus.cc:1685] finished
0709 13:09:29.717945 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:29.718096 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66406,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":6179,"thread_start_us":242145,"threads_started":2,"wal-append.queue_time_us":174393}
I20260709 13:09:29.720259 26669 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:29.720826 26669 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:29.722990 26669 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:29.252351 27067 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.684108 27065 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.700019 23625 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:29.726132 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:29.726743 23625 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:29.633666 26966 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.727973 26966 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:29.729964 26966 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:29.698129 27013 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.732612 27013 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.703846 26976 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:29.735847 26998 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.727583 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:29.736822 23625 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:29.737037 27111 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.634189 27037 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:29.737799 27037 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.739915 27037 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:29.742097 27068 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:29.671406 27081 consensus_meta.cc:287] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.722s	user 0.008s	sys 0.003s
I20260709 13:09:29.705724 26836 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.752373 23628 raft_consensus.cc:2393] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:29.731379 26962 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:29.753113 23774 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.012s
I20260709 13:09:29.699918 27066 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.759449 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:29.755533 23774 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.008s	sys 0.012s
W20260709 13:09:29.757484 23667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.032s	sys 0.020s
I20260709 13:09:29.693642 27058 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:29.760959 23667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.032s	sys 0.020s
I20260709 13:09:29.739915 27067 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.760310 23625 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
W20260709 13:09:29.762269 23670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.005s	sys 0.046s
W20260709 13:09:29.764938 23670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.005s	sys 0.046s
W20260709 13:09:29.765460 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.765842 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.766363 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.769809 23668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.010s	sys 0.010s
W20260709 13:09:29.770318 23668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.011s	sys 0.010s
I20260709 13:09:29.785516 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:29.699429 27036 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:29.769173 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:29.792414 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:29.794682 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:29.795468 23773 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:29.796722 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 564) took 1963 ms. Trace:
I20260709 13:09:29.799011 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:29.799685 23772 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:29.797309 24392 rpcz_store.cc:276] 0709 13:09:27.821620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.821822 (+   202us) service_pool.cc:224] Handling call
0709 13:09:27.878642 (+ 56820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.030341 (+151699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.784396 (+1754055us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001a4fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:29.784603 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347052288}
I20260709 13:09:29.800940 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:29.806779 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:29.807785 23774 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:29.810690 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:29.811586 23625 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:29.812978 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:29.813356 27068 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.813696 23771 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:29.814939 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:29.813005 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:29.764210 27111 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.816403 24394 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 5: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:29.749183 27081 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:29.796444 26871 consensus_meta.cc:287] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.945s	user 0.005s	sys 0.006s
I20260709 13:09:29.821044 26962 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:29.791384 27067 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.824538 27111 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.798374 27044 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:29.762199 27066 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.826484 23592 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:29.827805 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:29.784932 27085 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.776710 26998 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:29.823251 26864 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.835595 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:29.833398 23622 raft_consensus.cc:2410] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:29.831974 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:29.865650 24394 raft_consensus.cc:2410] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:29.838141 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:29.828473 23742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.000s	sys 0.036s
W20260709 13:09:29.866950 23742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.000s	sys 0.037s
I20260709 13:09:29.866463 23771 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:29.895305 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:29.895638 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:29.896541 27100 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:29.896910 27100 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.896987 23773 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:29.897373 27100 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:29.901409 26864 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.902820 27058 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.903951 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:29.904882 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:29.910849 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:29.914569 23773 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:29.904568 23774 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:29.922518 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:29.923825 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:29.862309 26753 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:29.837917 27044 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.946632 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:29.948112 23771 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:29.952348 23773 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:29.914301 27037 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.944412 26997 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.955984 26864 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:29.914825 27121 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.869124 27085 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.869318 26998 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:29.961598 26836 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:09:29.978358 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:29.838127 27067 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:29.959532 27076 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.955302 27044 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.947410 26753 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:29.949128 27058 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:29.973399 23775 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:29.959477 27119 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.981950 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:29.953919 26962 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:09:29.963436 27014 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.964286 27122 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.969108 26864 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:29.989485 24394 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:30.000873 27116 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:29.976830 27121 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:30.004487 26864 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:30.006161 26998 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:29.985365 27076 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.009616 27076 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:29.971499 27037 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:30.014087 27037 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:29.995126 27036 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:30.009514 27067 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:29.995244 27119 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:30.019661 27081 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:30.020989 27066 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:30.022890 27111 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:30.024853 27085 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:30.029826 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:30.030601 24389 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:30.030576 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:29.987268 26753 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:30.033785 27121 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:30.035079 27119 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:30.037844 27094 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 1.294s	user 0.006s	sys 0.012s
I20260709 13:09:30.036902 24394 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:30.037753 26997 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:30.042181 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:30.044797 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:30.045331 27081 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:30.045754 27081 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:30.046183 27081 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.047993 27085 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:30.048506 27085 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.048897 27085 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.049130 26962 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:30.049696 26962 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.051400 27067 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:30.051805 26962 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:30.051973 27067 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.053449 26508 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:30.053853 26508 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:30.054118 27067 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:30.054682 26508 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.055305 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:30.026233 27122 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:30.057372 26508 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.058717 27122 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:30.059254 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1620) took 2235 ms. Trace:
I20260709 13:09:30.059597 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:29.986888 27058 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.060421 27058 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.061282 23698 raft_consensus.cc:2410] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:30.059621 23703 rpcz_store.cc:276] 0709 13:09:27.823673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.823917 (+   244us) service_pool.cc:224] Handling call
0709 13:09:27.824280 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.023215 (+198935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.059022 (+2035807us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540040e054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:30.059175 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441562368}
I20260709 13:09:30.063839 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:30.078611 23742 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.747s (SENT) [suppressed 18 similar messages]
I20260709 13:09:30.088486 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:30.089285 23698 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:30.100718 23627 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:30.107333 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:30.111229 23701 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:30.114285 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:30.115180 24394 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
W20260709 13:09:30.119505 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 57428.2us
I20260709 13:09:30.118065 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1748) took 1168 ms. Trace:
I20260709 13:09:30.131676 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:30.116518 27042 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:30.132428 23696 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:30.133162 27042 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:30.133716 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:30.134413 23696 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:30.135308 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.136256 23624 raft_consensus.cc:2410] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:30.134052 27042 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:30.136888 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.141621 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.142556 23623 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:30.123227 23627 rpcz_store.cc:276] 0709 13:09:28.949296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.949446 (+   150us) service_pool.cc:224] Handling call
0709 13:09:30.100312 (+1150866us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:09:30.100531 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.117729 (+ 17198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.117989 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5990656}
I20260709 13:09:30.141772 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2209) took 1476 ms. Trace:
I20260709 13:09:30.138697 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:30.144222 23698 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.143579 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:30.139173 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:30.135106 26753 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.150472 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.151119 23625 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:30.144021 23699 rpcz_store.cc:276] 0709 13:09:28.640282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.690530 (+ 50248us) service_pool.cc:224] Handling call
0709 13:09:28.690836 (+   306us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:28.702438 (+ 11602us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:29.825315 (+1122877us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b180022d020. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b44d043c7 00007f2b413169a7 00007f2b413260bf
0709 13:09:29.825491 (+   176us) log.cc:844] Serialized 14 byte log entry
0709 13:09:29.978318 (+152827us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:29.978878 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 13:09:29.983311 (+  4433us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:29.983347 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.983408 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.088003 (+104595us) raft_consensus.cc:1685] finished
0709 13:09:30.116146 (+ 28143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.116325 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18021,"prepare.queue_time_us":135927,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":291,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":5973,"spinlock_wait_cycles":17228032,"thread_start_us":318927,"threads_started":2,"wal-append.queue_time_us":220408}
I20260709 13:09:30.146724 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:30.147439 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1751) took 1184 ms. Trace:
I20260709 13:09:30.152653 23701 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:30.151891 23624 rpcz_store.cc:276] 0709 13:09:28.963333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.974911 (+ 11578us) service_pool.cc:224] Handling call
0709 13:09:30.135164 (+1160253us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:09:30.147327 (+ 12163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5721984}
I20260709 13:09:30.155369 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.100615 27119 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:30.157434 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:30.174227 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.174922 23627 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:30.160179 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.163345 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:30.176028 23624 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:30.164254 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.165282 23698 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 3.
I20260709 13:09:30.166256 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:30.136348 26864 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:30.135792 27067 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:30.150333 26962 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.178350 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.182389 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:30.179890 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:30.183763 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:30.156131 26997 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.155109 27071 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:30.185245 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 106667us
W20260709 13:09:30.188509 23742 leader_election.cc:336] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.844s (SENT)
I20260709 13:09:30.188903 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:30.186579 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:30.190230 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:30.190478 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.193356 23703 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:30.202849 26864 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:30.187228 26998 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:30.203851 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.185182 27124 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:30.207379 23700 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: [5.3-8.5]
I20260709 13:09:30.213881 23699 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:30.215334 23623 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:30.192569 27113 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:30.190897 27123 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.218418 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.207381 26998 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:30.219866 27049 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 2.142s	user 0.008s	sys 0.018s
I20260709 13:09:30.192782 27024 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.177107 27119 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.195303 26966 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.234447 26753 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:30.236958 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.194281 27071 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:30.204353 27002 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:30.217690 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:30.187657 27067 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:30.253682 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.224721 27113 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.252470 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:30.231812 26998 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.206902 27114 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:09:30.261852 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:30.266177 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.279583 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:30.283761 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:30.289875 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:30.291095 23695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 2199) took 1799 ms (client timeout 1844 ms). Trace:
I20260709 13:09:30.292848 27086 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:30.295611 27072 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:30.298584 27119 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:30.273180 26850 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.304183 26850 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.304924 27024 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:30.305169 27036 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:30.305543 27024 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:30.305820 27036 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:30.306445 27024 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.306712 27036 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.252941 27030 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:30.255584 27113 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:30.308034 27030 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.278438 27051 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:30.309872 27085 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.310555 27051 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:30.256748 27002 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:30.312853 27002 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:30.256201 27031 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:30.313557 27031 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.313891 27031 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.315824 27040 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:30.316385 27040 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.317757 24359 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:30.318421 27040 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:30.319105 27113 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:30.316414 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 517) took 2768 ms. Trace:
I20260709 13:09:30.311013 27051 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.322291 23624 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:30.340736 27061 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:30.291566 23695 rpcz_store.cc:269] 0709 13:09:28.491634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.491839 (+   205us) service_pool.cc:224] Handling call
0709 13:09:30.289679 (+1797840us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b580000ff98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:09:30.291005 (+  1326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4800384}
I20260709 13:09:30.342370 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:30.343066 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1844) took 1548 ms. Trace:
I20260709 13:09:30.348177 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:30.340760 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:30.343273 23695 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:30.294963 27081 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:30.343629 23776 rpcz_store.cc:276] 0709 13:09:28.794851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.797743 (+  2892us) service_pool.cc:224] Handling call
0709 13:09:30.342801 (+1545058us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54003f5f54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:30.342978 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929335040}
I20260709 13:09:30.321162 24391 rpcz_store.cc:276] 0709 13:09:27.547845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.553542 (+  5697us) service_pool.cc:224] Handling call
0709 13:09:27.553938 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:27.656415 (+102477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.656464 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:27.659823 (+  3359us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.772386 (+112563us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:27.772431 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.772613 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.218873 (+2446260us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:30.316098 (+ 97225us) raft_consensus.cc:1685] finished
0709 13:09:30.316119 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.316332 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1387,"raft.queue_time_us":71278,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":24130,"spinlock_wait_cycles":3011968,"thread_start_us":181137,"threads_started":2,"wal-append.queue_time_us":335482}
I20260709 13:09:30.353899 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:30.381162 23777 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.350451 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:30.383477 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:30.378353 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:30.384442 23621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1747) took 1471 ms (client timeout 1693 ms). Trace:
I20260709 13:09:30.385376 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:30.385092 23621 rpcz_store.cc:269] 0709 13:09:28.913390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.922409 (+  9019us) service_pool.cc:224] Handling call
0709 13:09:30.384220 (+1461811us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b54002b4154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:30.384370 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129167232}
I20260709 13:09:30.386305 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1750) took 1423 ms. Trace:
I20260709 13:09:30.386736 23626 rpcz_store.cc:276] 0709 13:09:28.962967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.975556 (+ 12589us) service_pool.cc:224] Handling call
0709 13:09:30.385243 (+1409687us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:09:30.386233 (+   990us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5797632}
I20260709 13:09:30.393004 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:30.393762 24388 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.394972 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:30.395306 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44973.3us
I20260709 13:09:30.396436 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:30.305052 27067 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
W20260709 13:09:30.434439 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.384443 23776 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
W20260709 13:09:30.490048 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 93688.7us
I20260709 13:09:30.490715 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:30.490839 23669 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:30.352779 27037 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:30.352510 26508 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.497754 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:30.504372 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:30.505806 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:30.488442 27087 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:30.485600 27056 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.508095 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:30.496471 27044 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.506s	user 0.003s	sys 0.012s
I20260709 13:09:30.485931 27061 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.511137 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:30.518558 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:30.517153 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:30.507407 27087 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.521291 23770 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:30.521507 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:30.521750 23776 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:30.496699 27067 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.500934 27085 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:30.501660 27037 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:30.644243 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 285383us
W20260709 13:09:30.522063 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 227353us
I20260709 13:09:30.667694 23771 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:30.523912 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:30.929461 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 405638us
I20260709 13:09:30.930737 23669 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:30.502678 26830 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:30.939180 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:30.927929 23769 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:30.518070 27002 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:30.604854 27091 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:09:30.962430 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:30.993897 23770 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:30.950208 27058 consensus_meta.cc:287] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.889s	user 0.010s	sys 0.005s
I20260709 13:09:30.932422 27113 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:30.774394 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:30.938627 27114 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:31.054780 23696 raft_consensus.cc:2368] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
W20260709 13:09:31.049412 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 62441.2us
W20260709 13:09:31.049595 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 97283.9us
I20260709 13:09:30.601313 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:30.800526 27099 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
W20260709 13:09:30.962698 27141 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.447s	user 0.001s	sys 0.000s
I20260709 13:09:30.570657 27119 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:31.052500 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:30.962525 26864 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.953850 27087 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.061818 23695 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:31.062004 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:31.048040 27036 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.952773 27037 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.518522 27056 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.705585 26966 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:30.509624 26508 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:30.600941 27071 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:31.066359 27040 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:31.076961 24358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.001s	sys 0.017s
I20260709 13:09:31.081053 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:31.110074 24358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.001s	sys 0.017s
I20260709 13:09:31.110946 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:30.947233 26830 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:30.606536 27122 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:31.081231 23769 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
W20260709 13:09:31.105898 27148 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:09:31.087363 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:31.089993 23777 consensus_meta.cc:287] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.000s
I20260709 13:09:31.119520 23777 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:31.119642 23698 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
W20260709 13:09:31.120647 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 64448.2us
W20260709 13:09:31.128144 23774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.030s	sys 0.050s
I20260709 13:09:31.063176 27114 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:31.101289 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 172960us
I20260709 13:09:31.071244 23776 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:31.076098 27119 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:31.132669 27119 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:31.135998 27153 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.136576 27153 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:31.099371 27100 consensus_meta.cc:287] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.202s	user 0.014s	sys 0.004s
I20260709 13:09:31.137765 27100 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:31.138834 27153 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:31.092754 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1628) took 2282 ms. Trace:
I20260709 13:09:31.062590 27058 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:30.522087 27044 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:31.117508 23778 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
W20260709 13:09:31.110487 24358 connection.cc:256] RPC call timeout handler was delayed by -1.1561019569999189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:09:31.121086 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:31.122255 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:31.153767 23698 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:09:31.125281 27031 consensus_meta.cc:287] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.811s	user 0.009s	sys 0.000s
I20260709 13:09:31.097352 27036 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:31.127369 27051 consensus_meta.cc:287] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.774s	user 0.003s	sys 0.003s
W20260709 13:09:31.130792 26998 consensus_meta.cc:287] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.849s	user 0.006s	sys 0.003s
I20260709 13:09:31.113838 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:31.168212 23696 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
W20260709 13:09:31.145531 24388 consensus_meta.cc:287] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.000s
W20260709 13:09:31.146327 23774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.030s	sys 0.050s
I20260709 13:09:31.140892 23775 rpcz_store.cc:276] 0709 13:09:28.810479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.812673 (+  2194us) service_pool.cc:224] Handling call
0709 13:09:28.813142 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:29.987353 (+1174211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.092396 (+1105043us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000023d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:31.092645 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667784064}
I20260709 13:09:31.160151 23777 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:31.115609 26830 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.170796 24388 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:31.170195 23770 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:31.172821 24388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46594 (request call id 534) took 1335 ms. Trace:
I20260709 13:09:31.185140 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:31.185912 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:31.186419 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:31.145591 24359 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:31.188779 23777 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:31.189327 23696 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:31.190768 23696 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:31.192129 23696 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:31.194126 23698 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:31.082929 26969 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:09:31.130237 27122 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:31.170581 27031 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.173369 24388 rpcz_store.cc:276] 0709 13:09:29.837365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.838148 (+   783us) service_pool.cc:224] Handling call
0709 13:09:30.392889 (+554741us) spinlock_profiling.cc:243] Waited 872 us on lock 0x7b5800010e98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7eee 0000000000375939 00007f2b4625b1e0 00007f2b463240c4 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:09:31.172143 (+779254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068992}
I20260709 13:09:31.196241 23698 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:31.106683 26966 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.208712 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.213361 23700 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 9. Ops: [7.5-7.5]
I20260709 13:09:31.207350 24394 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:31.208115 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:31.208797 24393 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:31.209031 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:31.210668 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.209173 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.224254 24387 raft_consensus.cc:2368] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:09:31.142738 27114 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:31.227288 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:31.227917 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.232726 23770 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:31.113454 27040 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:31.252530 23770 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:31.234858 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 89376.1us
I20260709 13:09:31.260643 23769 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:31.248137 24391 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:31.266387 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.269145 27160 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:31.269357 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:31.269779 27160 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.271693 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:31.272185 27147 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:09:31.272552 24392 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:31.273370 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1644) took 1058 ms. Trace:
W20260709 13:09:31.273583 27146 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:09:31.273871 23699 rpcz_store.cc:276] 0709 13:09:30.214960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.215068 (+   108us) service_pool.cc:224] Handling call
0709 13:09:30.215391 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.221295 (+  5904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:30.221321 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:30.231137 (+  9816us) log.cc:844] Serialized 26 byte log entry
0709 13:09:30.508752 (+277615us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:30.508789 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.508856 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:31.273157 (+764301us) raft_consensus.cc:1685] finished
0709 13:09:31.273174 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.273309 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18712,"raft.queue_time_us":6208,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":14974,"thread_start_us":235028,"threads_started":1,"wal-append.queue_time_us":532486}
I20260709 13:09:31.275447 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.276644 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:09:31.235266 27145 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.442s	user 0.000s	sys 0.001s
I20260709 13:09:31.208384 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.200093 27122 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:31.205986 27031 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:31.207098 26757 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
W20260709 13:09:31.307514 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.188508 26998 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.313087 26834 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:31.315239 27030 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:31.317440 27154 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:31.318449 26850 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:31.319224 27144 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:09:31.319792 27040 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:31.321776 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:31.265672 27081 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:31.321936 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1642) took 1109 ms. Trace:
I20260709 13:09:31.294211 27155 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:31.200243 27150 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:09:31.188159 27051 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:31.323688 23776 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:31.328619 23701 rpcz_store.cc:276] 0709 13:09:30.212339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.212717 (+   378us) service_pool.cc:224] Handling call
0709 13:09:30.212993 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.221139 (+  8146us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:30.221171 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:30.221640 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:09:30.489069 (+267429us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:30.489123 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.491409 (+  2286us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:31.321731 (+830322us) raft_consensus.cc:1685] finished
0709 13:09:31.321750 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.321878 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1034,"raft.queue_time_us":8491,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":14943,"thread_start_us":215379,"threads_started":1,"wal-append.queue_time_us":451605}
I20260709 13:09:31.329587 23778 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:31.427747 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:31.297524 27160 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:31.465952 23778 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:31.466840 23772 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:31.466650 23776 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:31.325857 26508 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:31.489861 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 519678us
I20260709 13:09:31.482301 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:31.528661 23777 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:09:31.445024 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 254272us
I20260709 13:09:31.551198 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:09:31.552429 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.560421 23742 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:31.563163 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:31.563992 23701 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.331408 27056 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:31.567108 23668 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:31.513088 23620 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
W20260709 13:09:31.435611 27145 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:09:31.592159 23699 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:09:31.598675 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47524.5us
I20260709 13:09:31.330590 27158 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:31.599795 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:31.600679 23699 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:31.601914 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:31.603266 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:31.429991 27150 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:31.615581 23699 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.617575 23701 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
W20260709 13:09:31.619578 23620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1754) took 2624 ms (client timeout 1662 ms). Trace:
I20260709 13:09:31.619797 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:31.620702 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:31.621495 23624 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:31.623595 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:31.331946 27037 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:31.620018 23620 rpcz_store.cc:269] 0709 13:09:28.964493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.967694 (+  3201us) service_pool.cc:224] Handling call
0709 13:09:31.482081 (+2514387us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:09:31.588809 (+106728us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4905728}
W20260709 13:09:31.625223 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 58266.5us
I20260709 13:09:31.628628 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:31.496016 27031 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:31.630312 23620 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:31.630475 23623 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.495692 27156 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:31.630975 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:31.636626 27156 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.637431 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:31.638948 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:31.633828 23621 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:31.634375 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:31.642295 23701 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:31.643817 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:31.644634 23701 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:31.647022 27156 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:31.651016 23623 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:31.579473 27160 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:31.636034 23620 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:09:31.634821 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 424652us
I20260709 13:09:31.624660 27002 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.328899 27155 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.668015 23743 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:31.634577 27081 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:31.661662 23629 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:31.630354 27150 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.665305 23626 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:31.676371 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.659895 23620 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.624857 26508 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.631237 27100 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:31.681479 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1749) took 2712 ms. Trace:
I20260709 13:09:31.629197 27158 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:31.633375 26864 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:31.681867 23629 rpcz_store.cc:276] 0709 13:09:28.962396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.041665 (+ 79269us) service_pool.cc:224] Handling call
0709 13:09:31.657586 (+2615921us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:09:31.657764 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.674872 (+ 17108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.675058 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6123776}
I20260709 13:09:31.683642 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.679993 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:31.678846 23626 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:31.656577 27058 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:31.660689 24358 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:31.687820 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.664309 27006 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:31.661375 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:31.685753 23626 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.656813 27031 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.668738 27160 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.667344 27002 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.793814 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1641) took 1582 ms. Trace:
I20260709 13:09:31.724452 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1656) took 1120 ms. Trace:
W20260709 13:09:31.749814 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 79864.3us
I20260709 13:09:31.695446 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.825131 23699 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
W20260709 13:09:31.729125 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.826817 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:31.823028 23623 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.696189 24390 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:31.822522 23626 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:31.725893 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.829419 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:31.674439 27081 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.681114 26831 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:31.771611 27026 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:09:31.711516 26998 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:31.730801 27087 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.000s
I20260709 13:09:31.725592 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.732010 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1758) took 2056 ms. Trace:
I20260709 13:09:31.731330 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.740934 23621 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.729285 26834 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.797087 27051 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:31.687351 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:31.759076 26850 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:09:31.694795 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:31.813261 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 152627us
I20260709 13:09:31.830078 23699 raft_consensus.cc:2368] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
W20260709 13:09:31.835459 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 1.44386e+06us
I20260709 13:09:31.852137 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:31.852919 23699 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
W20260709 13:09:31.854027 23667 connection.cc:256] RPC call timeout handler was delayed by -1.0129011540000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2278s for a response
I20260709 13:09:31.854120 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:31.854962 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:31.841404 24394 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:31.848551 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1657) took 1187 ms. Trace:
I20260709 13:09:31.850420 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:31.824177 23700 rpcz_store.cc:276] 0709 13:09:30.211497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.211610 (+   113us) service_pool.cc:224] Handling call
0709 13:09:30.211938 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.221785 (+1009847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.793441 (+571656us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400024c54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:31.793731 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302494976}
I20260709 13:09:31.858640 23777 rpcz_store.cc:276] 0709 13:09:30.661096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.206617 (+545521us) service_pool.cc:224] Handling call
0709 13:09:31.465348 (+258731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.529386 (+ 64038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.848342 (+318956us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54003fe8d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:31.848487 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260723072}
I20260709 13:09:31.841707 23622 rpcz_store.cc:276] 0709 13:09:29.675834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.675978 (+   144us) service_pool.cc:224] Handling call
0709 13:09:31.731781 (+2055803us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400097c54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:31.731936 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299334016}
I20260709 13:09:31.842837 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.824540 23775 rpcz_store.cc:276] 0709 13:09:30.604310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.201442 (+597132us) service_pool.cc:224] Handling call
0709 13:09:31.201777 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.202026 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:31.504772 (+302746us) log.cc:844] Serialized 14 byte log entry
0709 13:09:31.724010 (+219238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:31.724078 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:31.724136 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.724222 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.724384 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2201,"prepare.queue_time_us":454250,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":3781,"raft.queue_time_us":80,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7570,"spinlock_wait_cycles":17190272,"thread_start_us":521082,"threads_started":2,"wal-append.queue_time_us":247864}
I20260709 13:09:31.848699 23701 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:31.889465 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:31.892762 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:31.894352 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:31.895125 23777 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.898190 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:31.899046 23778 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:31.900830 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:31.902597 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:31.903384 23773 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.833847 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:31.891423 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 259771us
I20260709 13:09:31.912187 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.915462 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:31.796602 26830 consensus_meta.cc:287] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.004s
W20260709 13:09:31.838356 27123 consensus_meta.cc:287] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.593s	user 0.012s	sys 0.000s
W20260709 13:09:31.714393 27119 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.001s
I20260709 13:09:31.843962 27142 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:31.928355 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1865) took 1423 ms. Trace:
I20260709 13:09:31.695933 27040 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:31.684876 27044 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:31.847455 27066 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:31.924558 26998 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:31.971910 23621 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:31.971863 23623 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:31.974702 23621 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:31.846622 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.682394 27036 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:31.785677 27063 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:31.831967 27114 consensus_meta.cc:287] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.572s	user 0.007s	sys 0.002s
I20260709 13:09:31.932636 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:31.712181 27150 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:31.695556 26966 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:31.925244 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:31.836079 27081 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:31.844254 27061 consensus_meta.cc:287] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.323s	user 0.008s	sys 0.004s
I20260709 13:09:31.831046 27037 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:31.969669 27056 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:31.847569 26850 raft_consensus.cc:3055] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:31.844393 27159 raft_consensus.cc:3055] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:31.946396 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:31.844020 27006 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.953121 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:31.837260 27115 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:31.961171 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.961185 23703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 2220) took 1898 ms (client timeout 1691 ms). Trace:
I20260709 13:09:31.964548 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:31.992049 23703 rpcz_store.cc:269] 0709 13:09:30.063249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.063501 (+   252us) service_pool.cc:224] Handling call
0709 13:09:31.960925 (+1897424us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400088ed4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:31.961109 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295649536}
I20260709 13:09:31.965476 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:31.840766 27087 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.931514 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:31.714357 27158 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:31.759689 27171 consensus_queue.cc:1059] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.209s
I20260709 13:09:31.960372 27119 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.947244 27123 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:31.982093 23704 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:31.838552 26831 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.948381 26757 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.844914 26834 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.979092 26998 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:32.000191 26998 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.984323 23622 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.960412 27142 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:32.005005 27142 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:31.960670 27177 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.985093 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 251907us
I20260709 13:09:31.935011 27051 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:09:32.008742 24357 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:31.929251 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:31.838173 27002 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:31.992870 23593 leader_election.cc:400] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:09:31.992472 24393 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:32.010210 23593 leader_election.cc:403] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:31.959211 23773 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:31.996491 23778 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:31.987798 24389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.006s	sys 0.006s
I20260709 13:09:31.979015 27066 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.939867 26830 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:32.013063 24389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.006s	sys 0.006s
I20260709 13:09:32.015954 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:31.987462 27061 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:32.018978 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 89849.9us
I20260709 13:09:32.031919 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:09:32.020087 23704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 2200) took 3521 ms (client timeout 1747 ms). Trace:
W20260709 13:09:31.998693 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 328114us
I20260709 13:09:31.987926 26966 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:31.987741 26864 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:31.984021 27114 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:31.990437 27159 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:31.988811 26850 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:32.207260 23698 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:32.193907 23622 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:32.183079 23775 raft_consensus.cc:2410] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:09:32.207126 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 175290us
I20260709 13:09:32.044673 23700 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:32.213220 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:32.211534 23704 rpcz_store.cc:269] 0709 13:09:28.492579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.492714 (+   135us) service_pool.cc:224] Handling call
0709 13:09:31.932480 (+3439766us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b580000ff98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:09:32.013917 (+ 81437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4708736}
W20260709 13:09:32.182292 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 229257us
I20260709 13:09:32.216991 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:32.219187 23627 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:32.219065 23628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 2440) took 2502 ms (client timeout 1845 ms). Trace:
W20260709 13:09:32.016839 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 127468us
I20260709 13:09:31.990581 27056 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.221414 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:32.200524 23777 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
W20260709 13:09:32.042472 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.222261 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 210987us
W20260709 13:09:32.219944 23628 rpcz_store.cc:269] 0709 13:09:29.716755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.716973 (+   218us) service_pool.cc:224] Handling call
0709 13:09:32.218820 (+2501847us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b54002026d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:32.218995 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78771584}
I20260709 13:09:32.018523 26962 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:32.048575 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2231) took 1726 ms. Trace:
I20260709 13:09:32.494938 27181 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:32.251500 26962 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:32.276818 26508 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 13:09:32.466842 27106 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:32.447762 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 439033us
I20260709 13:09:32.255349 23699 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:32.355885 26864 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.224682 27051 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:32.213701 26751 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:32.276306 27175 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.017689 26757 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.012755 26834 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.537596 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2243) took 1012 ms. Trace:
I20260709 13:09:32.538084 23700 rpcz_store.cc:276] 0709 13:09:31.525448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.943085 (+417637us) service_pool.cc:224] Handling call
0709 13:09:31.943459 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.212918 (+269459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.535853 (+322935us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400131ad4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:32.537532 (+  1679us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232089344}
W20260709 13:09:32.266101 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49212.6us
I20260709 13:09:32.025489 27044 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:32.214389 27090 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 3.435s	user 0.023s	sys 0.008s
W20260709 13:09:32.248502 27097 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 3.509s	user 0.020s	sys 0.034s
I20260709 13:09:32.192765 27187 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 3. Current term is 4.
I20260709 13:09:31.998103 27006 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.528445 26508 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.531095 27066 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:32.260941 27167 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:09:32.184473 27168 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:32.379168 27179 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:32.475332 27190 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:32.260538 27188 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:32.500988 27053 raft_consensus.cc:3055] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:32.223763 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.223029 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:32.413264 23626 consensus_meta.cc:287] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.000s
W20260709 13:09:32.598688 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 375722us
I20260709 13:09:32.599036 23626 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:09:32.599645 23626 pending_rounds.cc:85] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 1
I20260709 13:09:32.599962 23626 pending_rounds.cc:107] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:32.600260 23626 raft_consensus.cc:2889] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:32.601383 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.602161 23626 raft_consensus.cc:2393] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:32.299405 27159 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.253928 27121 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:32.385638 27026 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:32.393973 26830 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:32.395206 27087 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:32.384892 27182 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:32.535795 26751 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.359361 27119 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.301684 27031 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:32.189899 27177 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.504971 27071 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:32.506151 27150 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:32.507691 27183 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.299s	user 0.002s	sys 0.006s
I20260709 13:09:32.611122 27066 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.685210 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:31.998812 27115 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.510819 23696 rpcz_store.cc:276] 0709 13:09:30.322149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.219858 (+897709us) service_pool.cc:224] Handling call
0709 13:09:31.220166 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.220378 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:31.220644 (+   266us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.019772 (+799128us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.048044 (+ 28272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.048128 (+    84us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:32.048211 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.048309 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.048496 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32367,"prepare.queue_time_us":364850,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":2627,"raft.queue_time_us":294335,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":40168,"thread_start_us":772072,"threads_started":3,"wal-append.queue_time_us":460300}
I20260709 13:09:32.526461 26962 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.541014 23667 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:32.629817 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 88883.4us
I20260709 13:09:32.630786 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:32.613867 27187 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:32.547583 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:32.548575 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:32.632754 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:32.633826 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:32.021526 27186 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:32.526273 27114 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.552610 27122 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:32.557785 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1649) took 2160 ms. Trace:
W20260709 13:09:32.559229 27125 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 2.590s	user 0.010s	sys 0.011s
W20260709 13:09:32.567586 23772 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 1866) took 2062 ms (client timeout 1721 ms). Trace:
W20260709 13:09:32.635001 27185 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:09:32.635653 26966 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.634843 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:32.636561 27122 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:32.573460 24388 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:32.637037 27122 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:32.569087 23776 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:32.637482 27115 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.581518 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:32.635078 23771 rpcz_store.cc:276] 0709 13:09:30.397440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.397609 (+   169us) service_pool.cc:224] Handling call
0709 13:09:30.495882 (+ 98273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.928865 (+432983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.557414 (+1628549us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400347954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:32.557692 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394481920}
I20260709 13:09:32.638258 23695 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.638193 27122 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.619696 27123 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:32.640241 27123 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.641265 23771 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:32.550046 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.642436 23700 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:32.642477 27123 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:32.643576 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.635042 27184 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:32.194103 27171 raft_consensus.cc:3055] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:32.586180 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2244) took 1060 ms. Trace:
I20260709 13:09:32.644344 27184 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.586820 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 603) took 1329 ms. Trace:
I20260709 13:09:32.644383 27171 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:32.645449 23627 rpcz_store.cc:276] 0709 13:09:31.257711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.257905 (+   194us) service_pool.cc:224] Handling call
0709 13:09:32.218995 (+961090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.225865 (+  6870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.586638 (+360773us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54002026d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:32.586767 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209493888}
I20260709 13:09:32.646677 27184 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.646262 27171 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.647933 27171 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.648682 27177 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.649480 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:32.650223 27187 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:32.651389 27142 consensus_meta.cc:287] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.646s	user 0.006s	sys 0.001s
I20260709 13:09:32.537950 27051 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:32.602411 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:32.604413 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.540760 27044 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:32.542688 27056 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:32.606312 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 99129.1us
I20260709 13:09:32.527315 27181 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.608245 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:32.698074 23624 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.698642 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.606326 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.612607 23592 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:32.396289 26831 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:32.701035 23626 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:32.700937 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.614866 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.615538 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:32.702313 23593 leader_election.cc:400] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:32.607281 27050 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:32.594691 27053 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:09:32.615173 26998 consensus_meta.cc:287] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.002s
I20260709 13:09:32.622702 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:32.509189 23620 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:32.589570 26834 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:09:32.624349 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1632) took 4093 ms. Trace:
I20260709 13:09:32.720036 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:32.720130 23702 rpcz_store.cc:276] 0709 13:09:28.530709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.546279 (+ 15570us) service_pool.cc:224] Handling call
0709 13:09:28.546804 (+   525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.547272 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.547318 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.576938 (+ 29620us) log.cc:844] Serialized 26 byte log entry
0709 13:09:28.692341 (+115403us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:28.692381 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.692447 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.067072 (+1374625us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b4800190158. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:09:31.969331 (+1902259us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:32.624135 (+654804us) raft_consensus.cc:1685] finished
0709 13:09:32.624159 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.624294 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":17934,"raft.run_wall_time_us":1497740,"spinlock_wait_cycles":39098880,"thread_start_us":88220,"threads_started":1,"wal-append.queue_time_us":122837}
I20260709 13:09:32.722383 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.723080 23702 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:32.646706 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.724551 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:32.590655 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 369293us
I20260709 13:09:32.725925 23627 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:32.620956 27188 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:09:32.726141 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 600) took 2535 ms. Trace:
I20260709 13:09:32.652159 23700 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:32.654419 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.726979 27188 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:32.635319 23772 rpcz_store.cc:269] 0709 13:09:30.505403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.505528 (+   125us) service_pool.cc:224] Handling call
0709 13:09:32.567170 (+2061642us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54003408d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:32.567445 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207777024}
I20260709 13:09:32.658607 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:32.659397 27119 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:32.727473 27188 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:32.727872 27119 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:32.728019 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 700) took 1432 ms. Trace:
I20260709 13:09:32.728369 27119 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.728606 27188 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.644778 23699 rpcz_store.cc:276] 0709 13:09:31.525722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.934481 (+408759us) service_pool.cc:224] Handling call
0709 13:09:31.934801 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.526596 (+591795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.585789 (+ 59193us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540040e554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:32.586083 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736726400}
I20260709 13:09:32.729792 27175 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:32.730531 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.731178 23699 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:32.732124 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.732793 26508 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:32.733280 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.733750 27051 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.734752 23699 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:32.615796 27121 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:32.662607 27178 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:09:32.665514 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 399) took 2440 ms. Trace:
I20260709 13:09:32.736451 27121 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.736783 23698 rpcz_store.cc:276] 0709 13:09:30.224909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.226882 (+1001973us) service_pool.cc:224] Handling call
0709 13:09:31.227183 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.212789 (+985606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.665157 (+452368us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b540026b1d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:32.665424 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253390208}
W20260709 13:09:32.737567 23742 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Timed out: RequestConsensusVote RPC to 127.21.244.4:36767 timed out after 2.169s (SENT)
I20260709 13:09:32.737751 27155 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:32.738103 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:32.738291 23698 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:32.739023 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1656) took 1132 ms. Trace:
I20260709 13:09:32.739899 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2238) took 1215 ms. Trace:
W20260709 13:09:32.740108 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 81584.7us
I20260709 13:09:32.740655 26834 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:32.740929 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:32.741343 26834 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:32.741436 27106 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:32.742240 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:32.742544 27061 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:32.666571 26757 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.652326 27187 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.700382 27142 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.715440 27056 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:32.743834 27160 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:32.668540 27006 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:32.669382 27066 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.750200 27066 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.594322 27179 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:32.751329 27063 consensus_meta.cc:287] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.769s	user 0.007s	sys 0.003s
I20260709 13:09:32.751906 27111 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:32.752381 27111 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:32.752714 27179 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:32.670055 27168 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:32.753474 27168 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.753257 27111 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.753968 23620 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:09:32.754472 27111 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.733362 26508 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.755582 23620 pending_rounds.cc:85] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 4
I20260709 13:09:32.756042 23620 pending_rounds.cc:107] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:09:32.755662 27053 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.756709 23620 raft_consensus.cc:2889] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:32.756912 26508 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:32.757031 27053 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.757798 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2452) took 1130 ms. Trace:
I20260709 13:09:32.758213 23620 rpcz_store.cc:276] 0709 13:09:31.627527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.629960 (+  2433us) service_pool.cc:224] Handling call
0709 13:09:31.630205 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.509014 (+878809us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b58003260d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b412680aa 00007f2b412ea447 00007f2b41302fe7 00007f2b413047de 00007f2b4130eb49 00007f2b4130f416 00007f2b4130bd8f 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4
0709 13:09:32.757268 (+248254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.757735 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367108352}
W20260709 13:09:32.759011 27093 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 4.011s	user 0.014s	sys 0.017s
I20260709 13:09:32.672247 26751 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:32.674775 24389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 570) took 1467 ms. Trace:
I20260709 13:09:32.709873 27162 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:32.760176 26751 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:32.676309 27040 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:32.621923 27026 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:09:32.760919 27162 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.761914 27026 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:32.762303 27026 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:32.763311 27162 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:32.679306 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.772476 23624 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:32.683090 27122 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:32.642328 27081 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.002s
I20260709 13:09:32.702211 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:32.780987 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:09:32.620829 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 90796.9us
I20260709 13:09:32.782434 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.702224 23623 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
W20260709 13:09:32.711563 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 99040us
I20260709 13:09:32.716436 23626 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:32.741859 26834 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:32.692973 27044 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:32.667088 23695 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:32.784399 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:32.745152 24391 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:32.790529 23667 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:32.791306 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 608) took 1060 ms. Trace:
I20260709 13:09:32.726673 23625 rpcz_store.cc:276] 0709 13:09:30.191162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.193089 (+  1927us) service_pool.cc:224] Handling call
0709 13:09:30.195399 (+  2310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.273097 (+ 77698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:30.273132 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:30.273174 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:30.273207 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.725927 (+2452720us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b5400099a54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:32.725973 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.726088 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178187648}
I20260709 13:09:32.791921 24387 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:32.740335 23701 rpcz_store.cc:276] 0709 13:09:31.524057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.646737 (+122680us) service_pool.cc:224] Handling call
0709 13:09:31.648100 (+  1363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.891526 (+243426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.739630 (+848104us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400025154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:32.739839 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460597504}
I20260709 13:09:32.739365 23698 rpcz_store.cc:276] 0709 13:09:31.607061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.737783 (+1130722us) service_pool.cc:224] Handling call
0709 13:09:32.738084 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.738769 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.738971 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:32.726193 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:32.735494 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1655) took 1128 ms. Trace:
I20260709 13:09:32.715076 27050 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:32.761379 26751 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:32.680912 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1654) took 1074 ms. Trace:
I20260709 13:09:32.745559 23696 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:32.763103 27026 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:32.764261 27161 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:09:32.759568 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:32.765206 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.817209 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 57709.7us
I20260709 13:09:32.726306 23627 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:32.769755 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1657) took 1162 ms. Trace:
I20260709 13:09:32.818401 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:32.818567 23702 rpcz_store.cc:276] 0709 13:09:31.607312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.747250 (+1139938us) service_pool.cc:224] Handling call
0709 13:09:32.747569 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.747765 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.747792 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.747839 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:32.747875 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.747934 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.769679 (+ 21745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:32.819389 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:32.770385 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.728457 23776 rpcz_store.cc:276] 0709 13:09:31.296121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.578706 (+282585us) service_pool.cc:224] Handling call
0709 13:09:32.568783 (+990077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.637773 (+ 68990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.727683 (+ 89910us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54003408d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:32.727960 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2247817088}
I20260709 13:09:32.772738 23703 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:32.731037 26850 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.702775 23593 leader_election.cc:403] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:32.791779 23621 rpcz_store.cc:276] 0709 13:09:31.731296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.972961 (+241665us) service_pool.cc:224] Handling call
0709 13:09:31.974524 (+  1563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.975319 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.791117 (+815798us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b54002030d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:32.791242 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2843008}
I20260709 13:09:32.793962 23699 rpcz_store.cc:276] 0709 13:09:31.606824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.734297 (+1127473us) service_pool.cc:224] Handling call
0709 13:09:32.734571 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.735234 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.735435 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:32.840330 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 138161us
I20260709 13:09:32.841040 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:32.842144 23699 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:32.843473 23699 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:32.796080 27142 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.801117 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:32.714115 27031 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:32.858350 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 57367us
I20260709 13:09:32.790279 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.859541 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.806377 23704 rpcz_store.cc:276] 0709 13:09:31.606575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.225178 (+618603us) service_pool.cc:224] Handling call
0709 13:09:32.225581 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:32.254039 (+ 28458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.254070 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:32.275314 (+ 21244us) log.cc:844] Serialized 52 byte log entry
0709 13:09:32.608865 (+333551us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:32.620975 (+ 12110us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.627345 (+  6370us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.627552 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.627625 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.680668 (+ 53043us) raft_consensus.cc:1685] finished
0709 13:09:32.680689 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.680847 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12583,"prepare.queue_time_us":25072,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":4791,"raft.queue_time_us":36656,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":36770,"thread_start_us":272634,"threads_started":1,"wal-append.queue_time_us":378522}
W20260709 13:09:32.812196 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 86101.4us
I20260709 13:09:32.837574 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:32.862135 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:32.805915 27050 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.744481 27160 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:32.815272 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.764621 27040 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.806149 26751 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:32.796309 27123 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:32.823108 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1633) took 4283 ms. Trace:
I20260709 13:09:32.681524 24385 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:32.760103 24389 rpcz_store.cc:276] 0709 13:09:31.207057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.207428 (+   371us) service_pool.cc:224] Handling call
0709 13:09:31.207806 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.252830 (+ 45024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.252861 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.264460 (+ 11599us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.022147 (+757687us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:32.022191 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.022274 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.674544 (+652270us) raft_consensus.cc:1685] finished
0709 13:09:32.674564 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.674713 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44633,"raft.queue_time_us":122813,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":120,"thread_start_us":748180,"threads_started":1,"wal-append.queue_time_us":939915}
I20260709 13:09:32.727372 26998 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.779680 27061 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:32.786012 27081 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.782055 27076 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.785816 27114 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:32.813719 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:32.922571 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 108928us
I20260709 13:09:32.923451 23592 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:32.862879 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:32.924461 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 61660.1us
I20260709 13:09:32.806792 26757 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:32.806290 27058 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:32.740711 27181 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.872959 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:32.893550 27024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.746s	user 0.013s	sys 0.049s
W20260709 13:09:32.915141 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 53091us
I20260709 13:09:32.872386 23697 rpcz_store.cc:276] 0709 13:09:28.530968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.552350 (+ 21382us) service_pool.cc:224] Handling call
0709 13:09:28.552744 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.555183 (+  2439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.555237 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.557551 (+  2314us) log.cc:844] Serialized 26 byte log entry
0709 13:09:28.691928 (+134377us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:28.786965 (+ 95037us) log.cc:844] Serialized 14 byte log entry
0709 13:09:28.787287 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.787397 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:31.257105 (+2469708us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b1800497800. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e1ed2a6 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e1ed2a6 00007f2b3e1ed240
0709 13:09:32.756727 (+1499622us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b1800497800. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e1ed2a6 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db
0709 13:09:32.758448 (+  1721us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:32.813681 (+ 55233us) raft_consensus.cc:1685] finished
0709 13:09:32.813719 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.813853 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7400,"prepare.queue_time_us":144949,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3928,"raft.queue_time_us":1819,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":7815,"spinlock_wait_cycles":111855616,"thread_start_us":192676,"threads_started":2,"wal-append.queue_time_us":179885}
I20260709 13:09:32.867815 27066 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:32.836453 26508 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:32.835876 27171 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:32.922605 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:32.928372 27157 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.928975 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 130946us
I20260709 13:09:32.867074 27087 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:32.931715 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:32.956178 27024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.815s	user 0.015s	sys 0.059s
I20260709 13:09:32.918190 26850 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:32.883762 23699 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: [5.3-8.5]
I20260709 13:09:32.975497 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:32.977244 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.866906 27115 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.954299 27150 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:32.861267 26641 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:32.862459 27179 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:32.822751 27056 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
W20260709 13:09:32.933842 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 60948.2us
I20260709 13:09:32.991297 23667 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:32.957132 27058 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.915648 27036 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:09:33.004408 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.955052 26864 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.894665 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.893419 27123 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.008339 27123 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.956537 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.011443 23697 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:33.012176 27005 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:33.012435 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:32.871418 27176 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:33.013494 27176 raft_consensus.cc:697] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:32.861564 27162 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:32.933744 27177 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:32.933612 26757 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:32.797079 26962 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.022917 24359 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:32.962451 27093 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:32.982672 23777 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:32.982524 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 165459us
I20260709 13:09:32.983224 26751 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.895830 27155 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:09:32.921639 27186 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:32.916270 27184 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:09:32.867514 27031 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.959120 27006 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:33.055200 26962 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:33.056299 27031 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:33.056571 27081 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:32.960044 27066 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.930570 27158 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:09:32.963590 27171 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:33.005822 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.934468 27076 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.933957 27121 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:32.984366 27047 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:33.081843 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 71746.9us
I20260709 13:09:32.921831 27200 consensus_queue.cc:1059] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 13:09:33.006393 27197 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:33.007999 26864 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:32.958504 23593 connection.cc:256] RPC call timeout handler was delayed by -1.0215163550001307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 13:09:33.014469 27176 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.024068 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.066931 27066 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.989252 27051 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:33.074255 27171 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.047796 27177 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:09:33.048537 27205 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:09:33.032115 26757 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.028729 27150 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:33.108744 27150 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:32.982079 27157 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.093823 26969 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:09:33.114219 27157 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:33.115199 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 534) took 1387 ms. Trace:
I20260709 13:09:33.115626 24391 rpcz_store.cc:276] 0709 13:09:31.727407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.924832 (+197425us) service_pool.cc:224] Handling call
0709 13:09:31.925448 (+   616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.789006 (+863558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.114901 (+325895us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b540035e154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:33.115139 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1884677504}
I20260709 13:09:33.049865 27037 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:33.024684 27142 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:09:33.051347 27123 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:33.052345 27201 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:09:33.020750 27162 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:33.118610 27162 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.118731 26864 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:32.964872 26508 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.119478 27123 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:33.120988 26508 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:33.059971 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 124790us
W20260709 13:09:33.060967 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 103168us
I20260709 13:09:33.121866 23701 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:33.123520 26998 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:33.124665 23698 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:33.125459 27177 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:32.988432 27063 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:09:32.988183 27115 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.129552 27115 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:33.134222 27040 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:33.134428 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:31.948855 23774 rpcz_store.cc:276] 0709 13:09:30.504832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.505174 (+   342us) service_pool.cc:224] Handling call
0709 13:09:30.520326 (+ 15152us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:31.169278 (+648952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.169308 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:31.170046 (+   738us) log.cc:844] Serialized 52 byte log entry
0709 13:09:31.445393 (+275347us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:31.913627 (+468234us) log.cc:844] Serialized 14 byte log entry
0709 13:09:31.927921 (+ 14294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.928032 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:31.928090 (+    58us) raft_consensus.cc:1685] finished
0709 13:09:31.928109 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.928277 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13910,"prepare.queue_time_us":240414,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":12917,"raft.queue_time_us":168036,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":92429,"thread_start_us":1285429,"threads_started":3,"wal-append.queue_time_us":449495}
I20260709 13:09:33.081315 27047 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:33.138664 27047 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.140007 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1659) took 1377 ms. Trace:
I20260709 13:09:33.140215 27087 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:33.141402 26830 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.141139 27087 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:33.142617 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 151455us
I20260709 13:09:33.143322 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:33.144062 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1658) took 1536 ms. Trace:
I20260709 13:09:33.144402 23700 rpcz_store.cc:276] 0709 13:09:31.607627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.766922 (+1159295us) service_pool.cc:224] Handling call
0709 13:09:32.767235 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.767439 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:32.813280 (+ 45841us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.139653 (+326373us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.139696 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:33.143845 (+  4149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.143909 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.144012 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162913,"prepare.queue_time_us":45675,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":19624,"raft.queue_time_us":163305,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":55,"thread_start_us":163128,"threads_started":1,"wal-append.queue_time_us":211563}
I20260709 13:09:33.140435 23695 rpcz_store.cc:276] 0709 13:09:31.762343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.787040 (+1024697us) service_pool.cc:224] Handling call
0709 13:09:32.787439 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:32.787959 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.788004 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:32.788686 (+   682us) log.cc:844] Serialized 52 byte log entry
0709 13:09:32.959960 (+171274us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:32.975353 (+ 15393us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.975916 (+   563us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.139422 (+163506us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b18001cb340. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b3e221a40 00007f2b3e21c4e4 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287 00007f2b41327208
0709 13:09:33.139597 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.139668 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.139803 (+   135us) raft_consensus.cc:1685] finished
0709 13:09:33.139820 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.139951 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16320,"prepare.queue_time_us":49438,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":165421,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":25688,"spinlock_wait_cycles":25168000,"thread_start_us":98679,"threads_started":1,"wal-append.queue_time_us":246334}
I20260709 13:09:33.147171 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:33.147614 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.064859 27056 consensus_queue.cc:1243] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:32.989637 27179 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:33.091068 23699 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:33.150872 23703 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
W20260709 13:09:33.091194 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 57343.6us
W20260709 13:09:33.091766 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 54049.3us
I20260709 13:09:33.052736 27193 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:09:33.004741 27058 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:33.068614 26751 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:33.157987 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 68609.1us
I20260709 13:09:33.165282 24389 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:09:33.165725 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 43831.8us
I20260709 13:09:33.165324 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.166772 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:33.091073 23592 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:33.098477 27051 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:33.177320 27051 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:33.163002 27030 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:09:33.177983 26757 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.178670 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.179949 27006 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:33.180240 27217 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:33.180965 27006 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.181605 27217 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:33.182781 27197 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:33.183246 27197 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:09:33.188891 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.141873 26830 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.149585 23698 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:33.190708 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.191696 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.147792 24391 raft_consensus.cc:2376] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6. Re-sending same reply.
W20260709 13:09:33.156126 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 276976us
I20260709 13:09:33.166893 24387 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:33.078018 27121 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:33.172246 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.173978 23742 leader_election.cc:336] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Timed out: RequestConsensusVote RPC to 127.21.244.4:36767 timed out after 2.001s (SENT)
I20260709 13:09:33.175043 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:33.052778 27061 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.195206 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:33.197607 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:33.157024 27179 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:33.157157 26962 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:33.208148 26830 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:33.202971 27175 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.208796 27058 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.209782 26757 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:33.162858 27156 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:33.210798 27058 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:33.216034 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 125034us
I20260709 13:09:33.188483 27056 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.216922 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:33.199891 27121 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:33.220569 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 68525us
I20260709 13:09:33.201711 27040 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:33.229295 27040 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:33.229727 27040 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.230966 27219 consensus_queue.cc:1059] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:33.199193 26641 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:09:33.232038 27142 raft_consensus.cc:3055] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:33.232415 27142 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:33.198902 27036 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:09:33.233175 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.233261 27142 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.234669 27142 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.218981 27119 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:33.235401 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.235891 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.236542 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.236872 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:33.237241 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:33.237660 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.238121 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.238389 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.238270 23702 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:33.239302 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.220795 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:33.221053 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 68800us
I20260709 13:09:33.238267 24386 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:33.221804 23593 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:33.222359 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.222906 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:33.242379 23629 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.221686 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.243187 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:33.224309 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:33.211491 27071 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:33.203330 27114 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.240911 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.238920 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:33.217533 27037 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:33.223569 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.263253 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:33.263020 27037 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.263993 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.265111 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.266040 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.156836 27198 consensus_queue.cc:1059] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:09:33.239306 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.158149 27168 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.261291 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.305344 24386 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:33.243821 23778 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:33.244117 23621 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.268610 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:33.306506 24393 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:33.272105 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50369.5us
I20260709 13:09:33.184144 27197 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.273336 27004 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.275887 26641 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.250424 26757 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.313267 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:33.277539 27076 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:33.284198 23772 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:33.318570 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:33.288856 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.321038 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:33.321827 23620 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.290613 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.293296 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.294704 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:33.324074 23624 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:33.300511 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.281571 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.217828 27073 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.342463 26969 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:33.304169 23629 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:33.343626 24393 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:33.344389 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:33.344561 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.305958 23628 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:33.236884 27119 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
W20260709 13:09:33.352527 27044 consensus_meta.cc:287] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.000s
I20260709 13:09:33.353039 27044 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.354127 23773 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:33.358067 27121 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.251582 27056 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.361816 27056 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:33.362599 23628 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
W20260709 13:09:33.364172 23669 leader_election.cc:336] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 1.662s (SENT)
I20260709 13:09:33.364629 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:33.344561 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.308182 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:33.310765 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:33.368000 23700 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:33.310896 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:33.316219 24357 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:33.328048 26641 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.330343 27168 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:33.375367 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:33.376506 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:33.377498 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:33.331244 26834 consensus_meta.cc:287] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.002s
I20260709 13:09:33.310518 27162 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.283584 27114 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.279703 27050 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.338125 27177 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:33.396461 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.397014 23625 raft_consensus.cc:2410] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:09:33.368631 24386 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:33.369238 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 53124us
I20260709 13:09:33.392252 23621 raft_consensus.cc:2410] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:33.369488 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:33.370388 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.399084 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.381304 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.400483 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.401705 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:33.371521 27119 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.404338 23620 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:33.405721 24389 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:33.411693 23698 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:33.355325 27044 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:33.407249 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:33.372995 26669 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:09:33.414141 24389 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:09:33.414367 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44619.3us
I20260709 13:09:33.403859 27177 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.407505 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.416718 27121 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:33.417507 24386 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:33.418264 27040 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.428241 27050 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:33.429431 27040 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:33.429452 26669 consensus_queue.cc:1243] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:33.430869 27162 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:33.432591 27122 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.002s
I20260709 13:09:33.418335 27066 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.422441 27191 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:33.394562 26834 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.444612 27156 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:33.445209 27156 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:33.447706 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 233805us
I20260709 13:09:33.448982 27210 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:33.449461 27210 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:33.410344 27047 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:33.453198 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 279253us
I20260709 13:09:33.597118 23697 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:33.753892 23698 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:33.755103 23698 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:33.604933 27050 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:09:33.615198 24387 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:09:33.756494 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 307776us
I20260709 13:09:33.532392 23626 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:33.745406 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1665) took 1198 ms. Trace:
I20260709 13:09:33.636330 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.758364 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:33.758744 23704 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 3.
I20260709 13:09:33.744629 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:33.759996 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:33.760311 23704 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:33.721001 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.521255 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1664) took 1757 ms. Trace:
I20260709 13:09:33.424471 27177 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:33.644945 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.625947 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1662) took 1862 ms. Trace:
I20260709 13:09:33.790602 23698 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:33.812489 23701 rpcz_store.cc:276] 0709 13:09:31.763367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.798311 (+1034944us) service_pool.cc:224] Handling call
0709 13:09:32.807077 (+  8766us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.122304 (+315227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.625593 (+503289us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400356e54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:33.625872 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723368704}
I20260709 13:09:33.814172 23629 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:33.762252 23702 rpcz_store.cc:276] 0709 13:09:31.763981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.819849 (+1055868us) service_pool.cc:224] Handling call
0709 13:09:32.820150 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.239478 (+419328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.520971 (+281493us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54003b3154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:33.521182 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961093376}
I20260709 13:09:33.744530 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:33.815248 24389 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:33.816509 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 56584.2us
I20260709 13:09:33.596728 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.817339 23621 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
W20260709 13:09:33.786597 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.455687 26508 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.348s
I20260709 13:09:33.757901 23773 rpcz_store.cc:276] 0709 13:09:32.547453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.634618 (+ 87165us) service_pool.cc:224] Handling call
0709 13:09:33.745211 (+1110593us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54002c9cd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:33.745334 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649009408}
I20260709 13:09:33.785135 27122 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.799491 23696 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:33.793859 23627 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:33.603488 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.453022 26641 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:33.505499 26753 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:33.524017 27224 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:09:33.798882 27066 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:33.806861 27142 consensus_meta.cc:287] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 13:09:33.803577 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1660) took 1257 ms. Trace:
I20260709 13:09:33.785334 27175 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:33.810263 27188 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.505821 27004 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:33.625011 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.866763 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.819128 23704 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:33.747567 23622 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:33.768667 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:33.745908 23703 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
W20260709 13:09:33.871332 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 102790us
I20260709 13:09:33.871981 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:33.795452 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.826411 23620 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:33.671927 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1663) took 1125 ms. Trace:
I20260709 13:09:33.829190 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:33.421633 27157 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:33.838547 23627 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.805555 26834 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:33.839216 23626 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:33.875396 23770 rpcz_store.cc:276] 0709 13:09:32.546949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.549151 (+  2202us) service_pool.cc:224] Handling call
0709 13:09:32.744767 (+195616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.744961 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:32.919331 (+174370us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.151300 (+231969us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.151354 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:33.151401 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.151466 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.447297 (+295831us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18002a34c0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b451e058f 00007f2b3e21f571 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd
0709 13:09:33.671606 (+224309us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54001cb950. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:33.671835 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73113,"prepare.queue_time_us":265482,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":62802,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":22088,"spinlock_wait_cycles":451616896,"thread_start_us":287865,"threads_started":2,"wal-append.queue_time_us":285283}
I20260709 13:09:33.885699 23776 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:33.527385 27171 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.839664 23743 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:33.510277 27225 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:09:33.457224 27104 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.899462 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.843463 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.900261 23626 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 3.
I20260709 13:09:33.845364 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:33.902042 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:33.902179 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:33.903018 23698 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:33.849324 24386 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:33.763942 27159 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:33.504169 27162 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.590380 27179 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.457674 27114 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:33.856225 26753 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.739614 26757 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.858757 23777 rpcz_store.cc:276] 0709 13:09:32.546122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.547750 (+  1628us) service_pool.cc:224] Handling call
0709 13:09:32.548026 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.037481 (+489455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.803339 (+765858us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b5400340dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:33.803516 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999089408}
I20260709 13:09:33.808509 27197 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.421445 27219 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.421s
I20260709 13:09:33.836608 27085 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:33.669744 26751 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.837608 26508 consensus_queue.cc:1243] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:33.864758 24389 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:33.878597 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:33.868736 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:33.879451 23699 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:33.585376 27006 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.275s
I20260709 13:09:33.844551 27121 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:09:33.902981 23701 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:33.856880 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:33.894237 23703 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:33.858139 27047 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:33.908135 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 68619.4us
I20260709 13:09:33.899480 27198 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:09:33.915714 24394 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:33.885246 27157 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.917912 24393 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:33.923015 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:33.907825 27037 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:09:33.942973 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.910946 27122 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:33.949726 23625 raft_consensus.cc:2376] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12. Re-sending same reply.
I20260709 13:09:33.887957 27156 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.865001 27175 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.885838 27004 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:33.892549 27191 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:09:33.967247 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.956020 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:33.968304 23620 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:33.923142 27085 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:33.909096 27162 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.937340 27172 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:33.955060 23698 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:33.936400 27161 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:33.972270 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 138106us
I20260709 13:09:33.956736 27157 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:33.987002 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:33.993222 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:33.941164 26751 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:33.998342 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:33.964962 27114 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.005580 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:33.982885 27085 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:34.012615 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:34.002856 27187 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:09:34.013679 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.013864 23625 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:34.013906 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.014431 23778 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:34.014771 27191 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:34.015237 27142 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:34.010905 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:34.015810 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.016212 27219 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:34.016636 23773 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:34.017613 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.016568 27051 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:34.020043 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:34.020349 27142 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:34.020717 27142 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:34.020864 27171 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:34.021703 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:34.021570 27142 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.022770 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:34.023051 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:34.015131 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.024539 23771 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.015715 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.029500 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:34.029583 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:34.030362 23628 raft_consensus.cc:2376] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9. Re-sending same reply.
I20260709 13:09:34.032533 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:34.035455 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:34.037559 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:34.043273 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:34.046522 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:34.024147 26669 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:34.031340 27121 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:34.050932 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.051942 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:34.058646 23775 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.054276 23770 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:34.025779 27006 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:34.061062 23771 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:34.000032 26757 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:09:34.040095 27122 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.073941 23774 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:34.039547 27142 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.072640 23772 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:34.000586 27161 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.079790 27121 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:34.086179 27195 raft_consensus.cc:3055] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:34.092229 26757 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:34.092995 26751 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:34.092893 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:34.092945 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:34.093886 27162 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:34.094185 27004 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:34.096050 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:34.097483 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.098107 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.098939 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:34.099665 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.038394 27051 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.056970 26669 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.101326 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.010730 27114 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.105064 27175 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:34.066049 27053 consensus_queue.cc:1059] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:09:34.171917 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:34.173273 23772 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:34.174219 23769 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.175047 23773 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:34.141909 23775 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:34.170424 23770 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.171128 23776 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:34.145191 23627 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:34.182276 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2472) took 1469 ms. Trace:
I20260709 13:09:34.182842 23627 rpcz_store.cc:276] 0709 13:09:32.713254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.725495 (+ 12241us) service_pool.cc:224] Handling call
0709 13:09:32.725789 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.793478 (+1067689us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b5400178020. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4128a06f 00007f2b41302f60 00007f2b413047de 00007f2b4130eb49 00007f2b4130f416 00007f2b4130bd8f 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62
0709 13:09:34.181761 (+388283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.182208 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765620480}
I20260709 13:09:34.064414 27171 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:09:34.192204 27026 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:34.192550 27156 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:34.112082 27179 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:34.116941 27219 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:34.193642 27177 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:34.198069 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 99185.7us
I20260709 13:09:34.199601 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:34.191005 27066 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.203205 27066 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.109876 27161 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:34.109956 27195 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:34.177877 26757 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:34.178723 26669 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:34.215524 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 165956us
I20260709 13:09:34.172247 26753 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:34.068619 27187 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.146s
I20260709 13:09:34.223884 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:34.201606 23667 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:34.199826 27004 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.199571 27177 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:34.199225 27175 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.214715 27230 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:34.211036 23773 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:09:34.225831 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:34.239018 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 349732us
I20260709 13:09:34.228910 26834 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:34.240607 23770 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:34.243602 27056 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.229373 27161 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:09:34.232620 27004 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.247216 27187 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:34.250556 26834 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:34.251916 27114 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:34.259876 27175 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:34.290251 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 218356us
I20260709 13:09:34.296312 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:34.297528 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1679) took 1405 ms. Trace:
I20260709 13:09:34.289358 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:34.259159 23593 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:34.327243 23769 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:34.244061 26757 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:34.330636 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 71529.7us
I20260709 13:09:34.327203 23742 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:34.336144 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.338485 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:09:34.335322 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 46045.4us
I20260709 13:09:34.342182 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:34.329783 23695 rpcz_store.cc:276] 0709 13:09:32.891993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.749965 (+857972us) service_pool.cc:224] Handling call
0709 13:09:33.750249 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.750438 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:34.002601 (+252163us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.297199 (+294598us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.297252 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:34.297299 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.297362 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.297471 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99255,"prepare.queue_time_us":445846,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":12087,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3672,"thread_start_us":413078,"threads_started":3,"wal-append.queue_time_us":296929}
W20260709 13:09:34.344702 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 44745.5us
I20260709 13:09:34.345625 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:34.353576 27085 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.356040 23770 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:34.348145 27114 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:34.357419 27114 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.360338 27114 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:34.349049 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:34.350314 27156 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.346598 27161 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.364732 23623 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:34.329075 27175 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:34.328454 27122 raft_consensus.cc:2764] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:34.365744 27243 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:09:34.368232 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2272) took 1098 ms. Trace:
I20260709 13:09:34.368649 23704 rpcz_store.cc:276] 0709 13:09:33.269505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.949891 (+680386us) service_pool.cc:224] Handling call
0709 13:09:33.950207 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:33.950592 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.950630 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:33.953814 (+  3184us) log.cc:844] Serialized 52 byte log entry
0709 13:09:34.227926 (+274112us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:34.227975 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.228060 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.368004 (+139944us) raft_consensus.cc:1685] finished
0709 13:09:34.368024 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.368164 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":768,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4235,"thread_start_us":215727,"threads_started":1,"wal-append.queue_time_us":274472}
I20260709 13:09:34.298403 27006 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:34.279160 27187 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.261543 27195 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.347995 27230 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:34.345288 27056 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:34.368403 26751 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.329716 27179 consensus_queue.cc:1059] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:09:34.380616 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:34.394428 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:34.395773 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.364850 27161 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:09:34.377445 27051 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:34.365859 27175 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:34.401775 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 59661.9us
I20260709 13:09:34.402117 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1685) took 1131 ms. Trace:
I20260709 13:09:34.385182 27156 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:34.402611 23701 rpcz_store.cc:276] 0709 13:09:33.270431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.973126 (+702695us) service_pool.cc:224] Handling call
0709 13:09:34.000098 (+ 26972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.000371 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:34.224679 (+224308us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.401659 (+176980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.401732 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:34.401795 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.401885 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.402045 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21443,"prepare.queue_time_us":202695,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"thread_start_us":362280,"threads_started":2,"wal-append.queue_time_us":169268}
I20260709 13:09:34.402547 23667 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:34.415427 27237 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:09:34.417057 27006 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.371778 26753 consensus_queue.cc:1059] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:09:34.421439 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1683) took 1491 ms. Trace:
I20260709 13:09:34.410607 23742 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:34.423925 23697 rpcz_store.cc:276] 0709 13:09:32.957919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.754411 (+796492us) service_pool.cc:224] Handling call
0709 13:09:33.754756 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.755007 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:34.217816 (+462809us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.381734 (+163918us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.421113 (+ 39379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.421166 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:34.421217 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.421281 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.421383 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168484,"prepare.queue_time_us":461163,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"spinlock_wait_cycles":5743872,"thread_start_us":463815,"threads_started":2,"wal-append.queue_time_us":173043}
I20260709 13:09:34.395665 27248 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:34.380265 27219 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:09:34.430671 24388 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
W20260709 13:09:34.435802 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 85392.6us
I20260709 13:09:34.422966 27122 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.439605 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:34.442189 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:34.442981 24391 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:34.391822 26834 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.436733 27085 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:34.421146 27114 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:34.396077 27235 consensus_queue.cc:1059] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:09:34.459362 23775 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:34.459697 23742 leader_election.cc:336] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Timed out: RequestConsensusVote RPC to 127.21.244.4:36767 timed out after 1.527s (SENT)
I20260709 13:09:34.420957 27230 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:34.466225 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.462621 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:34.468016 23701 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:34.424086 27066 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:34.463857 23742 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Timed out: RequestConsensusVote RPC to 127.21.244.4:36767 timed out after 1.691s (SENT)
I20260709 13:09:34.429894 27162 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:34.469944 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:34.436021 27192 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.472744 27161 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:34.460537 27114 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.473344 27259 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.476502 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:34.456647 27004 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:34.455353 27159 consensus_meta.cc:287] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.002s
I20260709 13:09:34.479118 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:09:34.483614 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 81145.3us
I20260709 13:09:34.439136 27119 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:34.439165 27156 raft_consensus.cc:2764] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:34.494369 27119 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.494831 27119 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:34.491389 23742 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:34.528703 23701 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:34.493546 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:34.477571 27066 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.477327 27234 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:09:34.516501 24392 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:34.508226 27187 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:34.474385 27162 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:34.479959 27161 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:34.457111 27157 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.480437 27179 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:34.436301 27248 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.487644 27114 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.533567 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:34.497066 27122 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.565286 27162 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:34.531692 27188 consensus_meta.cc:287] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.656s	user 0.004s	sys 0.011s
I20260709 13:09:34.530079 27245 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.576398 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:34.610247 24391 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:09:34.491297 27192 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.537688 27168 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.497247 27259 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.604717 24389 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:09:34.617980 24390 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
W20260709 13:09:34.622637 23742 leader_election.cc:336] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Timed out: RequestConsensusVote RPC to 127.21.244.4:36767 timed out after 1.845s (SENT)
I20260709 13:09:34.623319 23742 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:34.538252 27066 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.539162 26834 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:34.628324 26834 raft_consensus.cc:697] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:34.613286 27234 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.620545 27122 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:09:34.577775 27230 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:34.644271 27244 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:09:34.644405 27030 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:34.645545 27053 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:34.648365 27248 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:34.650104 26757 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.612856 27261 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:34.637593 27197 consensus_meta.cc:287] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.003s
I20260709 13:09:34.634296 27265 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.629498 26834 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.633899 27245 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.627056 27168 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.680555 27053 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:34.632359 27161 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.692224 27157 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:34.692449 27161 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:34.688403 27248 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:34.693311 27248 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:34.662318 27234 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.694319 27248 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.695626 27211 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:34.696059 27211 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:34.696341 27053 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:34.697572 27053 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.699101 27047 raft_consensus.cc:3055] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:34.699489 27047 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:34.695026 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 586) took 1354 ms. Trace:
I20260709 13:09:34.702756 24393 rpcz_store.cc:276] 0709 13:09:33.340220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.402583 (+ 62363us) service_pool.cc:224] Handling call
0709 13:09:33.402916 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.954255 (+551339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.694769 (+740514us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54006e0ad4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:34.694966 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183798144}
I20260709 13:09:34.682855 27030 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:34.700371 27047 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.686342 27261 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.684158 27265 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.723644 27259 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:34.724792 27261 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:34.725498 27265 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:34.778385 23622 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:34.646907 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2271) took 1377 ms. Trace:
I20260709 13:09:34.784914 23702 rpcz_store.cc:276] 0709 13:09:33.269188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.816384 (+547196us) service_pool.cc:224] Handling call
0709 13:09:33.816770 (+   386us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:33.831261 (+ 14491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.831307 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:34.288172 (+456865us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b2c00001418. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:09:34.301947 (+ 13775us) log.cc:844] Serialized 78 byte log entry
0709 13:09:34.464025 (+162078us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:34.476467 (+ 12442us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.476697 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.476762 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.646582 (+169820us) raft_consensus.cc:1685] finished
0709 13:09:34.646685 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.646848 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11267,"prepare.queue_time_us":16395,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":15450,"raft.queue_time_us":23360,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10694,"spinlock_wait_cycles":17422848,"thread_start_us":91522,"threads_started":1,"wal-append.queue_time_us":255844}
W20260709 13:09:34.803647 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 269956us
I20260709 13:09:34.805500 23667 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:34.807410 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:34.815506 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:34.817885 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:34.818974 23769 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:34.690447 26669 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.818105 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:34.828998 27278 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.830245 23623 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:34.830193 27278 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.834921 26669 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:34.835112 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:34.836465 27026 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.837530 27026 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.837635 27030 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.838749 27278 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:34.838202 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:34.839684 27030 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.840739 27278 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:34.842269 27047 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.845263 27230 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:34.846454 27230 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:34.853562 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:34.857625 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.868954 23698 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:34.870363 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.855420 23627 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:34.850332 27278 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:34.887817 27278 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:34.871521 27066 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:34.862790 27026 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:34.857162 27219 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:34.900453 23769 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:34.902052 27114 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:34.903906 27026 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:34.900475 27219 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.905612 27219 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.853643 27230 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:34.913820 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:34.914762 23769 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:34.917586 23623 raft_consensus.cc:2410] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:34.928351 27026 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:34.931982 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.942718 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1672) took 2057 ms. Trace:
I20260709 13:09:34.945808 23696 rpcz_store.cc:276] 0709 13:09:32.884859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.130660 (+245801us) service_pool.cc:224] Handling call
0709 13:09:33.130935 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.841968 (+711033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.942135 (+1100167us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b540026acd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:34.942453 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536982400}
I20260709 13:09:34.959226 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:34.931497 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 616) took 1399 ms. Trace:
I20260709 13:09:34.960544 23629 rpcz_store.cc:276] 0709 13:09:33.532365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.532505 (+   140us) service_pool.cc:224] Handling call
0709 13:09:33.761505 (+229000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.814751 (+ 53246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.930573 (+1115822us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b5400099a54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:34.931314 (+   741us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120690048}
W20260709 13:09:34.970332 24392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46580 (request call id 543) took 1734 ms (client timeout 1845 ms). Trace:
I20260709 13:09:34.970959 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:34.972437 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:34.976671 24394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46580 (request call id 541) took 1741 ms (client timeout 1732 ms). Trace:
W20260709 13:09:34.977356 24394 rpcz_store.cc:269] 0709 13:09:33.234749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.236973 (+  2224us) service_pool.cc:224] Handling call
0709 13:09:34.976162 (+1739189us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400600ed4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:34.976383 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429925760}
I20260709 13:09:34.979868 26751 raft_consensus.cc:3055] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:34.980485 26751 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:34.971477 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.961575 27114 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:34.984298 27245 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:34.971046 24392 rpcz_store.cc:269] 0709 13:09:33.235314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.237898 (+  2584us) service_pool.cc:224] Handling call
0709 13:09:34.969890 (+1731992us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54006ae0d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:34.970098 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2910506240}
I20260709 13:09:34.999254 27026 consensus_queue.cc:1059] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:35.001196 27265 raft_consensus.cc:3055] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:35.001683 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.001734 27265 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:35.002839 24385 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:35.004119 26751 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.011191 26751 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.019827 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:35.021106 23629 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:35.032903 27168 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.033689 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:34.983685 27119 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.003507 27265 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.040223 23627 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:35.041280 27119 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.041733 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.041435 27210 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.042339 23623 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:35.042770 23621 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:35.043200 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.043905 23626 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:35.044821 27245 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:35.045758 27245 consensus_queue.cc:1243] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:35.049929 27192 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.053911 27119 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:35.052234 27198 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:35.052412 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:35.052310 27168 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.054901 27119 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.060145 27168 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.062577 27119 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:35.062680 27168 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.064348 23628 raft_consensus.cc:2368] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
I20260709 13:09:35.065353 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.068116 27245 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.068969 27245 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.071805 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:35.072016 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.072654 23776 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.073805 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.075210 23627 pending_rounds.cc:85] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 3
I20260709 13:09:35.075680 23627 pending_rounds.cc:107] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:35.076085 23627 raft_consensus.cc:2889] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:35.078154 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:35.078506 27245 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:35.078812 23621 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:35.079638 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:35.080505 23629 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:35.080967 27265 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.083196 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:35.068167 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:35.085700 24392 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
W20260709 13:09:35.086512 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.094995 27277 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.057716 27198 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:35.095935 27277 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.096820 27198 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.098755 27198 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:35.098726 27277 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.100441 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:35.101042 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:35.101994 23770 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.102321 27119 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.102655 23626 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:35.102845 27119 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:35.103106 23626 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:35.103410 27119 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.104149 23626 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.105549 23626 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.101938 23667 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:35.106885 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.107775 23628 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:35.107949 27278 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:35.108429 27278 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:35.108873 27278 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.109105 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:35.109623 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.075439 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.113802 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:35.114310 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.114902 27277 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:35.116628 24392 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:09:35.118503 27247 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.704s	user 0.002s	sys 0.000s
I20260709 13:09:35.118198 27277 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:09:35.102694 23525 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 120) took 20720 ms (client timeout 15000 ms). Trace:
W20260709 13:09:35.121322 23525 rpcz_store.cc:269] 0709 13:09:14.381961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.385265 (+  3304us) service_pool.cc:224] Handling call
0709 13:09:35.102388 (+20717123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:27.840026 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:27.891218 (+ 51192us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:27.891277 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:09:27.891298 (+    21us) tablet.cc:662] Decoding operations
0709 13:09:28.405117 (+513819us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:28.405212 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:28.405242 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:09:28.406238 (+   996us) tablet.cc:701] Row locks acquired
0709 13:09:28.406300 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:09:28.406475 (+   175us) write_op.cc:270] Start()
0709 13:09:28.406642 (+   167us) write_op.cc:276] Timestamp: P: 1783602568406399 usec, L: 0
0709 13:09:28.406666 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:09:28.407380 (+   714us) log.cc:844] Serialized 4016 byte log entry
0709 13:09:28.961020 (+553640us) op_driver.cc:464] REPLICATION: finished
0709 13:09:29.208074 (+247054us) write_op.cc:301] APPLY: starting
0709 13:09:29.208160 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:29.208364 (+   204us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:29.208476 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:29.209827 (+  1351us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:29.210062 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:09:29.210109 (+    47us) write_op.cc:312] APPLY: finished
0709 13:09:29.210381 (+   272us) log.cc:844] Serialized 77 byte log entry
0709 13:09:29.210543 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:29.210668 (+   125us) write_op.cc:454] Released schema lock
0709 13:09:29.210722 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:29.212786 (+  2064us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:29.212819 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2027559,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":246776,"apply.run_cpu_time_us":3055,"apply.run_wall_time_us":4668,"num_ops":10,"prepare.queue_time_us":143453,"prepare.run_cpu_time_us":28955,"prepare.run_wall_time_us":698740,"raft.queue_time_us":232786,"raft.run_cpu_time_us":21599,"raft.run_wall_time_us":237481,"replication_time_us":554201,"spinlock_wait_cycles":62336,"thread_start_us":490422,"threads_started":4,"wal-append.queue_time_us":124638,"wal-append.run_cpu_time_us":33775,"wal-append.run_wall_time_us":1682228}]]}
I20260709 13:09:35.130328 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:35.132149 24388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46580 (request call id 538) took 1899 ms (client timeout 1527 ms). Trace:
I20260709 13:09:35.134783 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.134076 23770 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:35.136924 23742 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:35.137840 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:35.138804 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:35.141793 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:35.154106 27279 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:09:35.154695 27190 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.155433 27190 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.156231 27047 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:35.156647 27281 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:09:35.157161 27047 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.158255 27190 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:35.143509 24388 rpcz_store.cc:269] 0709 13:09:33.232797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.232910 (+   113us) service_pool.cc:224] Handling call
0709 13:09:35.131716 (+1898806us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400600254. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:35.131920 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2752125824}
I20260709 13:09:35.164005 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:35.165216 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:35.166672 27122 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:35.186395 23629 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:35.188300 23626 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:35.191929 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.204066 23775 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:35.189467 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:35.196296 27228 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.179s	user 0.003s	sys 0.000s
I20260709 13:09:35.174373 27122 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:35.199082 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 410) took 1405 ms. Trace:
I20260709 13:09:35.218704 23698 rpcz_store.cc:276] 0709 13:09:33.793560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.985867 (+192307us) service_pool.cc:224] Handling call
0709 13:09:33.986198 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.892810 (+906612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.198780 (+305970us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b5400088ed4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:35.199019 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986041728}
I20260709 13:09:35.198020 27121 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:35.215015 23628 raft_consensus.cc:2410] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:35.222851 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.224386 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 620) took 1473 ms. Trace:
I20260709 13:09:35.227427 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.228664 23628 raft_consensus.cc:2410] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:35.229025 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:35.218247 26751 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:35.227106 23624 rpcz_store.cc:276] 0709 13:09:33.750623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.752724 (+  2101us) service_pool.cc:224] Handling call
0709 13:09:33.753006 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.993439 (+240433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.993485 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.993544 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:33.993591 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.198444 (+1204853us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400099554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:35.204021 (+  5577us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.224221 (+ 20200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552388864}
I20260709 13:09:35.232530 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:35.235338 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.237102 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.236896 27122 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.237509 27179 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:35.237921 27179 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:35.238969 23628 pending_rounds.cc:85] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 4
I20260709 13:09:35.239418 23628 pending_rounds.cc:107] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:09:35.239682 23628 raft_consensus.cc:2889] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:35.239912 27006 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:35.240764 27006 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:35.243804 27162 consensus_meta.cc:287] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.552s	user 0.018s	sys 0.005s
I20260709 13:09:35.244061 27258 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:35.244347 27162 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.245379 27258 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:35.245744 27258 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:35.245836 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:35.246560 23625 raft_consensus.cc:2376] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8. Re-sending same reply.
I20260709 13:09:35.246667 27162 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:35.225164 27047 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.238927 27179 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:35.261173 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.258750 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.256387 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:35.318351 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.258853 27177 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:09:35.270026 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.251583 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2283) took 1417 ms. Trace:
I20260709 13:09:35.254586 24389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 562) took 1246 ms. Trace:
I20260709 13:09:35.250887 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1674) took 2360 ms. Trace:
I20260709 13:09:35.255798 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.247941 23778 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:35.257656 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:35.322190 23669 connection.cc:256] RPC call timeout handler was delayed by -1.0248914530000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 13:09:35.329608 23669 connection.cc:256] RPC call timeout handler was delayed by -1.0077914529999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 13:09:35.330224 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:35.330976 23669 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.1:37537 timed out after 2.696s (SENT) [suppressed 34 similar messages]
I20260709 13:09:35.331933 27277 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.332748 27277 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.248358 27211 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.335172 27211 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.335834 27272 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.336583 27272 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:35.339895 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 66562.1us
I20260709 13:09:35.342442 23621 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:35.344535 27257 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:35.345263 27257 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.346027 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:35.247579 27162 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:35.346737 24388 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:35.251017 27234 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.246675 27258 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:35.253279 24390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46580 (request call id 540) took 2018 ms (client timeout 1691 ms). Trace:
I20260709 13:09:35.272696 26751 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.346155 27236 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.331626 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:35.335248 27277 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:35.353299 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.324777 24389 rpcz_store.cc:276] 0709 13:09:34.008231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.008355 (+   124us) service_pool.cc:224] Handling call
0709 13:09:34.008711 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:34.620834 (+612123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.253922 (+633088us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400612bd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:35.254346 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370034944}
I20260709 13:09:35.348968 23776 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:35.343613 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.360131 23621 raft_consensus.cc:2410] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:09:35.354151 24390 rpcz_store.cc:269] 0709 13:09:33.234460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.235595 (+  1135us) service_pool.cc:224] Handling call
0709 13:09:35.252816 (+2017221us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54005dd254. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:35.253048 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3176831872}
I20260709 13:09:35.324031 23697 rpcz_store.cc:276] 0709 13:09:33.834064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.425765 (+591701us) service_pool.cc:224] Handling call
0709 13:09:34.459475 (+ 33710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.612108 (+152633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.612148 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.612204 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:34.612252 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.223110 (+610858us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540015e854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:35.226182 (+  3072us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.251353 (+ 25171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350505728}
I20260709 13:09:35.247483 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.383014 23772 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:35.347811 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:35.387635 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.339581 27272 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:35.385169 24391 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:35.313660 27006 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.396225 23774 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:35.396324 23776 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:35.356999 26998 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:35.358063 26751 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.347649 27257 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.404897 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:35.405352 27030 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.005s
I20260709 13:09:35.405894 23772 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:35.406096 26998 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.406797 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.408676 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1798) took 1466 ms. Trace:
I20260709 13:09:35.409070 23622 rpcz_store.cc:276] 0709 13:09:33.942847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.942985 (+   138us) service_pool.cc:224] Handling call
0709 13:09:33.943273 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.779578 (+836305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.408384 (+628806us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54002b5554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:35.408603 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917688576}
I20260709 13:09:35.397013 27179 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:35.412145 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.325260 23700 rpcz_store.cc:276] 0709 13:09:32.890422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.407199 (+516777us) service_pool.cc:224] Handling call
0709 13:09:33.416887 (+  9688us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:33.417344 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.417373 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:33.418056 (+   683us) log.cc:844] Serialized 78 byte log entry
0709 13:09:33.635330 (+217274us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:34.653734 (+1018404us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b1800493120. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b44d043c7 00007f2b413169a7 00007f2b413260bf
0709 13:09:34.653943 (+   209us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.834607 (+180664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.834794 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.194032 (+359238us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b1800493120. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:09:35.195153 (+  1121us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:35.250389 (+ 55236us) raft_consensus.cc:1685] finished
0709 13:09:35.250429 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.250662 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":413568,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":50,"raft.queue_time_us":44269,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":438,"spinlock_wait_cycles":76735872,"thread_start_us":536379,"threads_started":3,"wal-append.queue_time_us":569103}
I20260709 13:09:35.252104 27245 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.143s
I20260709 13:09:35.413575 23626 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.405014 27050 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:09:35.418583 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.407440 23772 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:09:35.349800 27219 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.348902 27278 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.432488 23621 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:09:35.428145 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.441184 23621 pending_rounds.cc:85] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 4
I20260709 13:09:35.448971 23621 pending_rounds.cc:107] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:09:35.449311 23621 raft_consensus.cc:2889] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:35.399689 27277 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:35.408828 26998 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:35.453819 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.446105 27006 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:35.459561 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.455683 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:35.447588 27121 raft_consensus.cc:697] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:35.461598 23775 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:35.396847 27236 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.452813 27258 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:35.476162 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:35.476227 27246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.009s	sys 0.013s
I20260709 13:09:35.483855 27006 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.484228 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:35.485415 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:35.487116 23703 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:35.488011 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:35.488238 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:35.488998 24388 raft_consensus.cc:1217] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Deduplicated request from leader. Original: 5.7->[8.8-10.9]   Dedup: 10.9->[]
I20260709 13:09:35.489390 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:35.518131 23699 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.490006 27119 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.490408 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:35.490669 23626 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
W20260709 13:09:35.515511 27246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.009s	sys 0.014s
I20260709 13:09:35.493462 24386 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:35.500294 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:35.501117 27248 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:35.528998 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:35.510453 23773 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:35.511037 23700 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:35.469213 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:35.512128 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.473323 23668 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:35.517596 24388 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
W20260709 13:09:35.493016 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.518544 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 330185us
I20260709 13:09:35.532155 23769 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:35.538616 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:35.543411 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 79231.5us
I20260709 13:09:35.538045 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:35.549887 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:35.553128 23696 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:35.508119 27277 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:35.558255 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.470301 26998 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:09:35.557121 24390 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:09:35.560060 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:35.560820 27175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.013s	sys 0.035s
W20260709 13:09:35.565097 27284 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:09:35.551541 27030 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:35.547303 27050 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:35.583938 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.584824 23772 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 5: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:35.585289 27277 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.580610 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.589960 27236 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.590761 24386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 564) took 1314 ms. Trace:
I20260709 13:09:35.592151 27219 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.594113 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.594849 23776 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:35.594576 27292 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:35.595666 27292 consensus_queue.cc:1243] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:35.596938 27195 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:35.598872 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.570317 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:35.601186 27006 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.573501 24391 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:35.565330 27278 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.549993 24385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 549) took 1694 ms. Trace:
I20260709 13:09:35.580619 27271 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:35.581220 27177 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:35.594131 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.614557 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.606806 23702 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:35.608297 24357 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:35.583987 27050 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.618750 27050 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:35.620291 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.591153 24386 rpcz_store.cc:276] 0709 13:09:34.276209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.276470 (+   261us) service_pool.cc:224] Handling call
0709 13:09:35.256094 (+979624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.547351 (+291257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.589929 (+ 42578us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54005dd254. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:35.590549 (+   620us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b54005dd250. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:35.590699 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2594321536}
W20260709 13:09:35.578186 27175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.014s	sys 0.035s
I20260709 13:09:35.628677 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:35.638422 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:35.635547 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:35.640504 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:35.637607 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:35.642127 23698 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.631520 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:35.647589 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 147459us
I20260709 13:09:35.650053 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:35.651031 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.615700 27271 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:35.566735 27248 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:35.654752 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.659214 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:35.629349 27121 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:35.675402 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.657902 27235 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:35.677187 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:35.684165 24393 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:35.661207 27177 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.682703 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:35.653934 27219 consensus_queue.cc:1059] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:09:35.692866 23702 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:35.690320 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:35.656036 26751 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.687166 27037 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:35.607038 24385 rpcz_store.cc:276] 0709 13:09:33.847617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.847787 (+   170us) service_pool.cc:224] Handling call
0709 13:09:34.404495 (+556708us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800010e98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7e9c 00007f2b3e1e7a5b 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:09:35.002066 (+597571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.003349 (+  1283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.520794 (+517445us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400600ed0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:35.542252 (+ 21458us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316395520}
W20260709 13:09:35.698861 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.678257 27030 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:35.705978 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.685789 27235 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.700026 23703 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:35.685189 27236 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:35.714154 23773 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:35.716497 27053 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:35.717101 27053 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.719241 27053 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.719583 27277 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.720448 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:35.720260 27277 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.721176 23704 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:35.722978 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:35.724097 23703 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 3.
I20260709 13:09:35.680205 26998 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:09:35.726125 23774 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:35.727926 27119 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.728775 23777 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:35.729009 27179 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:35.730785 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:35.701297 27037 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.732282 27037 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.709404 27235 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:35.737160 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 87260.7us
I20260709 13:09:35.758293 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:35.739934 27161 raft_consensus.cc:3055] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:35.760227 27161 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:35.761134 27161 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.762497 27161 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.762884 23770 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:35.747942 27171 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:35.764046 27171 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.764438 27171 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.698650 27177 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.769927 27177 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.770785 27177 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:35.773481 23776 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:35.776871 27298 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:09:35.778434 27271 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.780443 27271 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:35.783936 23695 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:35.785545 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.785982 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.786916 23778 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 4.
I20260709 13:09:35.788812 23772 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:35.790118 27277 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.791335 23772 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:09:35.779331 27248 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.797260 23770 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:35.711922 27236 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.800444 27236 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.802597 24357 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:35.804699 26751 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:35.721481 23669 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:35.752374 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.809019 23623 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:35.754611 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:35.812275 23697 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 5. Current term is 7. Ops: []
I20260709 13:09:35.814013 23769 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 10. Ops: []
I20260709 13:09:35.729946 27179 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.751988 27291 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:35.750705 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:35.824777 23629 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:35.824635 27291 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.826081 27179 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:35.826846 27291 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:35.827946 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.715641 23773 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:35.829442 23769 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:35.840857 23696 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
W20260709 13:09:35.749169 27290 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:09:35.842612 23698 raft_consensus.cc:2410] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:35.842828 23699 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:35.853083 23592 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:35.866683 27210 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:35.899067 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 761320us
I20260709 13:09:35.907080 23667 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:35.908951 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:35.909770 23627 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:35.910609 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:35.912045 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.913416 27179 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.913923 27179 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:35.916018 27179 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:35.889379 27258 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:35.918239 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.898483 27175 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:35.896733 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:35.872138 27122 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:09:35.929773 23773 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:35.932199 23769 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:35.933189 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.941277 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:35.947963 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 118025us
I20260709 13:09:35.951560 23772 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:35.950114 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:35.952682 23776 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:35.948828 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:35.944706 27278 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:35.959077 23774 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:35.959712 23778 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:35.972045 27159 raft_consensus.cc:3055] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:35.972543 27159 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:09:35.971920 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 274779us
I20260709 13:09:35.973845 27142 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.973555 27159 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.974361 27142 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.974870 27159 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.975764 24390 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:09:35.976001 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 173515us
I20260709 13:09:35.976259 27198 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:35.976572 27142 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:35.976718 27198 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.977098 27198 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:35.977248 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.978910 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:35.979691 24390 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
W20260709 13:09:35.980211 27295 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.303s	user 0.004s	sys 0.000s
I20260709 13:09:35.961038 27087 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:35.984035 24387 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:35.984383 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.985179 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:35.989465 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:35.991017 23778 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 9: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:35.991669 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 63144.8us
I20260709 13:09:35.995445 26751 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:35.995586 27050 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:35.996150 26751 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:35.996202 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 275010us
I20260709 13:09:35.996627 26751 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.998075 27050 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:36.002240 23702 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:35.968302 27278 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:36.006385 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:36.008525 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.013792 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:36.014474 24386 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.013094 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.017882 27175 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:36.001044 27087 raft_consensus.cc:697] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:36.004472 27258 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:36.020401 23771 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:09:36.020519 27304 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:09:36.020671 27177 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:36.019709 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:35.991858 27006 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:09:36.026069 27258 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:36.033213 27258 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:36.041379 23778 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:09:36.042402 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.043289 27175 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.045601 24388 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:36.045739 27175 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.046788 27087 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.050829 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:36.051092 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 88497.9us
I20260709 13:09:36.027825 27177 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.012053 27050 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:09:36.054298 27037 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:36.063139 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.063925 24391 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:36.064046 27030 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.064908 27030 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.065639 27037 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.067916 27053 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.068631 27053 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.070664 27198 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.072160 27252 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.072990 27252 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.050168 27119 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:36.037274 27277 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:36.056557 27177 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.076843 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:36.097711 23775 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:36.099565 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.075253 23526 catalog_manager.cc:5697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
W20260709 13:09:36.104828 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.104921 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 92632.2us
I20260709 13:09:36.108134 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:36.109303 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.109709 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:36.076105 27119 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:36.075690 27252 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:36.119135 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.134009 24387 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:36.136973 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:36.141707 23700 raft_consensus.cc:2410] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:09:36.145721 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.055841 27235 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.135435 23526 catalog_manager.cc:5697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 8, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 8 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:09:36.168411 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 68530.9us
I20260709 13:09:36.134547 27234 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.170795 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 93728us
I20260709 13:09:36.174912 23773 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:36.175187 27271 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:36.176319 23592 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:36.178023 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:36.179431 27252 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.180167 27252 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.180990 26751 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.182016 27030 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:36.164253 27053 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:36.183401 26751 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:36.183261 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:36.184018 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:36.168239 27056 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.202675 27235 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.203508 27246 raft_consensus.cc:3055] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:36.204037 27246 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:36.205020 27246 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.206311 27246 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.112908 27278 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.208395 23743 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:36.209767 27291 consensus_queue.cc:1059] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:36.189460 27037 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.194253 27161 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:36.196070 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 59229.5us
I20260709 13:09:36.196717 24387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46594 (request call id 571) took 1238 ms. Trace:
I20260709 13:09:36.196547 27236 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.174446 27234 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.198530 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:36.218360 23627 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.214428 24387 rpcz_store.cc:276] 0709 13:09:34.958369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.958669 (+   300us) service_pool.cc:224] Handling call
0709 13:09:36.196540 (+1237871us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400700dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:36.196641 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2339149184}
I20260709 13:09:36.210302 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:36.221186 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:36.221876 23777 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:36.212778 27179 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.220595 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.228479 24393 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:36.236124 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:36.241142 27198 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.227936 27053 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.244251 27053 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.246335 27053 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.247013 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:36.248028 27179 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.235683 27119 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.249001 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:36.249989 27277 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:36.250428 27277 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:36.250857 27277 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.236024 27291 raft_consensus.cc:2764] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:36.252868 27006 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:36.218466 27037 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.253690 24394 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:36.254343 27153 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.254765 27153 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.195509 27258 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.255946 27177 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.256834 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:36.249117 27119 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.257839 27258 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:36.258100 27177 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:36.260303 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:36.261335 23771 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.261945 24388 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:36.264117 23620 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:36.265038 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.255432 27037 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:36.266387 27171 consensus_meta.cc:287] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.003s
I20260709 13:09:36.266808 27171 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.268077 23526 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 5, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 5 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:36.270618 23526 catalog_manager.cc:5697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 8, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 8 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:09:36.275279 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:36.276005 23773 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:36.276274 27305 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:09:36.238410 27161 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.284570 27171 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.285275 23777 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:09:36.285923 27161 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:36.290697 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:36.291806 27159 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:36.292413 27159 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:36.286403 23627 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:36.299659 23775 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:36.303803 23773 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:36.315115 23620 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:09:36.310387 23771 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:36.316885 24386 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
W20260709 13:09:36.319216 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.233741 27235 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.318435 24357 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:36.321625 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:36.323014 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:36.323707 23629 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.325260 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:36.326022 23627 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
W20260709 13:09:36.329074 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 72339.8us
I20260709 13:09:36.325353 23668 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:36.315383 27252 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.331835 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:36.338177 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 127951us
I20260709 13:09:36.339519 23743 leader_election.cc:400] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
I20260709 13:09:36.340924 23743 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:36.315326 27159 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:36.360013 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 182066us
I20260709 13:09:36.335289 27171 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:36.365480 24357 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:36.328243 27006 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:36.364542 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:36.361336 23526 catalog_manager.cc:5697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 3 to 5, term changed from 4 to 5, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to <none>, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:36.371345 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:36.335037 27248 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:36.378522 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.381472 23526 catalog_manager.cc:5697] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 8, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 8 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:09:36.363181 27121 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:36.386516 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 188890us
I20260709 13:09:36.328555 27235 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.371819 27198 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:36.390107 27198 raft_consensus.cc:697] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:36.391142 27198 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.393329 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:36.382390 27267 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:36.394670 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:36.395176 27267 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.368091 27210 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.396090 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:36.396001 27210 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.387471 27248 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:36.395190 26751 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:36.400704 26751 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:36.401201 27248 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:36.402084 27308 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.212s	user 0.001s	sys 0.002s
I20260709 13:09:36.401688 26751 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.403133 26751 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.369170 27037 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:36.395551 24390 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:36.369310 27006 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:36.408370 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 67591.1us
I20260709 13:09:36.410729 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:36.372689 27171 raft_consensus.cc:697] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:36.411480 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:36.413748 23627 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:09:36.367103 27161 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:09:36.423228 27171 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.428545 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:36.363517 27252 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.418315 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:36.412112 27153 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.420779 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:36.413604 27246 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.395605 27267 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.434017 23526 catalog_manager.cc:5697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 6, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 6 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } }
I20260709 13:09:36.442173 24387 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:36.452734 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.453491 23771 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:36.447105 27246 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.454828 27236 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.456662 27234 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.457489 27246 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:36.447876 27177 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:09:36.430686 27037 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:36.458256 27252 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.448256 27121 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:36.459419 27121 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.459120 27037 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.447571 27219 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:36.460271 27219 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.460007 27121 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.460687 27219 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:36.462349 27121 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:36.464500 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:36.464820 27235 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.443553 27258 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:09:36.465919 27210 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:36.466554 27258 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:36.466979 27258 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.467358 27258 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.415206 27006 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.469322 27177 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:36.469759 27177 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:36.469887 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.470589 23773 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:36.470707 27177 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.471647 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.454901 27161 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:36.474300 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:36.474058 27252 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:09:36.491356 27056 raft_consensus.cc:3055] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:36.491431 27053 consensus_queue.cc:1059] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:36.492030 27056 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:36.492830 27053 raft_consensus.cc:3055] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:36.493335 27053 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:36.493251 27056 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.494757 27056 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.494520 27053 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:36.490736 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 124423us
I20260709 13:09:36.496310 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:36.497275 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:36.497491 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:36.497938 24388 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:36.480177 23629 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:36.480621 24357 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:36.502768 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:36.504482 23628 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:36.505563 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:36.506381 23775 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:36.507478 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:36.508396 23771 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.501364 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:36.472307 27177 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.512192 23526 catalog_manager.cc:5697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.511538 27299 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:36.485939 27161 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:36.514956 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:36.524168 23526 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 2 to 3, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.485562 27122 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:09:36.511361 27195 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:36.512936 27198 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:36.521167 27315 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:09:36.520895 27085 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.523572 27053 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:36.540012 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.527233 27030 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:36.542332 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 56471.6us
I20260709 13:09:36.529075 27198 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.531888 27291 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.529361 27195 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.523032 27252 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:09:36.551332 23526 catalog_manager.cc:5697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.553541 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:36.555158 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 53900.9us
I20260709 13:09:36.564638 23771 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:36.543215 27085 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.569556 27161 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.570322 27085 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:36.570804 27161 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:36.546332 27030 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:36.581662 27030 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.584533 23526 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 11, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 11 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:09:36.586513 27006 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.587419 27122 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:36.587949 27122 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.588378 27122 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.589438 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:36.549589 27198 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.586665 23526 catalog_manager.cc:5697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.592471 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:36.593286 24390 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:36.590314 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:36.603946 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:36.554481 27195 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.568816 27121 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.607455 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 84577.2us
I20260709 13:09:36.616118 23526 catalog_manager.cc:5697] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:36.600559 27037 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.622879 23526 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 6, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 6 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:09:36.633082 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 110251us
I20260709 13:09:36.633973 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:36.635476 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:36.639684 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 50339.5us
I20260709 13:09:36.613926 27235 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:36.622242 27037 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.602012 27277 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.616082 27299 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:36.606124 27291 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:09:36.662490 23526 catalog_manager.cc:5697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.648819 27119 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:36.658542 27037 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.620643 27121 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:36.683542 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 48184.3us
I20260709 13:09:36.672215 27056 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:36.669684 27291 consensus_queue.cc:1243] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:36.662549 27235 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:36.706707 27235 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:36.690040 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.665803 27179 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.691322 27056 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:36.709064 27056 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.710484 27056 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.672521 27252 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:36.673600 27323 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:36.712100 27252 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.712497 27323 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.714486 27252 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.714609 27323 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.700289 27006 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:36.702607 27316 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:09:36.705446 27277 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:36.678164 27246 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:36.716929 27246 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:36.717442 27246 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:36.725276 23668 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:36.724797 23526 catalog_manager.cc:5697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 8, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 8 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:36.726284 27119 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:36.744705 27122 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.746060 23669 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:36.747936 27122 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:36.747927 27278 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:36.749974 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.729539 27257 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:36.750931 27257 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.751286 27257 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.744583 27119 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:36.755746 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 86398.4us
I20260709 13:09:36.752871 23526 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 3 to 5, term changed from 5 to 6, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to <none>, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:36.703495 27219 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.726742 27267 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.770830 23526 catalog_manager.cc:5697] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 6, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 6 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.776795 23771 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:36.776558 27267 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:36.778697 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:36.779819 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:36.780515 23629 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
W20260709 13:09:36.778960 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.783063 23629 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:36.785264 23627 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:09:36.787585 23773 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:36.787985 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:36.789921 23627 pending_rounds.cc:85] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 4
I20260709 13:09:36.790290 23627 pending_rounds.cc:107] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:09:36.790529 23627 raft_consensus.cc:2889] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:36.792515 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:36.794268 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:36.799991 23621 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:36.800145 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:36.793685 23526 catalog_manager.cc:5697] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.803855 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:36.803974 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:36.804108 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:36.804580 23626 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.805672 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.808954 27291 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:36.809456 27291 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.809867 27291 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.808676 27085 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:36.811484 23775 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:36.812228 23625 raft_consensus.cc:2410] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:09:36.812798 23743 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:36.808750 27179 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:36.820125 23777 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 4.
I20260709 13:09:36.828974 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:09:36.833000 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.856108 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 62473.1us
I20260709 13:09:36.772722 27258 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.800546 27278 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:09:36.765542 27299 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.829648 27271 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:36.793049 27236 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:09:36.819686 27327 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:09:36.818962 27326 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.793991 27248 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:09:36.887904 27320 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:36.887977 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 55272.1us
I20260709 13:09:36.928033 27085 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:36.888348 27121 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:36.937428 23628 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:36.889829 27198 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.800310 27006 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:09:36.792649 27277 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:09:36.890920 27291 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:36.893070 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:36.895550 23626 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
W20260709 13:09:36.889099 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.904004 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 91296.2us
W20260709 13:09:36.945050 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.917925 27322 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:36.919906 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.920113 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.949918 23771 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:36.946830 23526 catalog_manager.cc:5697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 8, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 8 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:09:36.950876 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.920228 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.920495 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:36.921008 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.921615 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.921862 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:36.922307 23776 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:09:36.922550 27332 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.927013 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 111691us
I20260709 13:09:36.946075 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:36.928931 23777 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:36.889056 27195 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.936779 27085 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.917260 27122 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:36.952392 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:36.972170 23770 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:36.969298 23774 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:36.970170 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:36.974404 23772 raft_consensus.cc:2368] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13.
W20260709 13:09:36.988087 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.988370 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:36.988744 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.989596 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.994508 23526 catalog_manager.cc:5697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.936127 27320 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:37.003266 24388 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:37.007037 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.948525 27322 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.983335 27085 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:37.011919 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:37.014284 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.943693 27030 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:36.994544 27198 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:36.993721 27159 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:36.998611 27053 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:36.982985 27277 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:09:36.944388 27328 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:09:36.935696 27326 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:37.030292 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:37.060237 23627 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:37.039505 27053 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:37.055949 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 109930us
W20260709 13:09:37.063843 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 131284us
I20260709 13:09:37.064777 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:37.061064 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 54069.2us
I20260709 13:09:37.002709 27122 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.069517 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:37.069953 23628 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:36.983528 27332 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:37.086522 27332 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:37.064478 27053 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.020409 27278 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:09:37.089865 27161 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.519s	user 0.014s	sys 0.000s
I20260709 13:09:37.066725 27219 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:37.095906 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.097182 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 87916.2us
I20260709 13:09:37.097674 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:37.043782 27159 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.133230 23627 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:09:37.134430 24388 raft_consensus.cc:2368] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:37.138361 27171 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.138998 27171 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.141575 27171 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:37.142153 23593 leader_election.cc:400] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:37.142537 23593 leader_election.cc:403] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:37.081552 27337 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:37.148267 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:37.148943 23627 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:37.151541 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:37.152227 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.152315 23626 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:09:37.161316 23627 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:37.162362 23776 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:37.115953 27030 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.095288 27210 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:09:37.147912 27161 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:37.176071 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 205989us
W20260709 13:09:37.180621 27329 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:09:37.181169 27336 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:37.181967 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:37.182603 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:37.183655 27327 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:37.184767 27119 consensus_queue.cc:1059] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:37.185115 27331 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:37.064577 27320 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:37.233927 27320 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.236052 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:37.186163 27322 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.240073 27195 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:37.186611 23667 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:37.240756 27159 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:37.187188 27277 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:37.192804 27326 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:37.199743 23774 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:37.204193 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:37.244262 24388 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:37.244354 27122 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.244679 27257 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.245201 27119 raft_consensus.cc:3055] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:37.245716 27119 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:37.246810 27257 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.246599 27119 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.248467 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:37.197774 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 106678us
W20260709 13:09:37.251533 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 64995.6us
W20260709 13:09:37.210836 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.226241 23770 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.230542 27341 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.231129 23775 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:37.231654 27085 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:37.264623 23774 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:37.268990 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:37.269654 23627 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:37.271705 23627 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:37.272126 27119 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.272564 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:37.274276 27085 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:37.255355 27322 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:37.275102 27322 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.275478 27322 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:37.276013 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:37.276640 23773 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.277220 23772 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:37.272157 27340 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.278548 27340 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.281920 27340 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.285787 23770 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:37.296646 23773 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:37.302543 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:37.303427 23627 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:37.228406 27291 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:37.203290 27246 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:37.264213 27327 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:37.263160 27219 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:09:37.259315 27277 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:37.325285 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:37.254208 27337 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:37.325997 23621 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:37.312299 27340 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.335012 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:37.197708 27037 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.333182 27246 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:37.335271 23625 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:09:37.253563 27248 consensus_queue.cc:1175] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" responder_term: 7 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:37.339351 23772 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:37.309767 27056 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.259047 27210 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
W20260709 13:09:37.360707 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.349859 24357 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:37.342870 24393 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:37.376490 23626 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 13:09:37.376983 23626 pending_rounds.cc:85] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 8
I20260709 13:09:37.377404 23626 pending_rounds.cc:107] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:09:37.377638 23626 raft_consensus.cc:2889] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:37.378578 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:37.379180 24393 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.356360 23627 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
W20260709 13:09:37.381052 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 78694.9us
I20260709 13:09:37.381377 23592 leader_election.cc:400] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13.
I20260709 13:09:37.388547 23592 leader_election.cc:403] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:09:37.272604 27341 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.381845 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:37.381646 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:37.345007 27326 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.343199 27277 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:37.342918 27331 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.390579 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:37.395767 23743 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:37.391180 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.370460 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:37.387297 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:37.397665 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 328213us
I20260709 13:09:37.398967 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:37.392582 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 186253us
I20260709 13:09:37.393464 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:37.345297 27327 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:37.414408 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.396850 24359 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:37.381106 27347 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:37.377009 27219 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:09:37.424171 24388 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:09:37.432273 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:37.380347 27030 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:09:37.376464 27267 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:09:37.394062 27323 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13.
I20260709 13:09:37.350303 27340 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.401218 27159 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:37.446162 24390 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 12: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:37.435909 24359 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:37.447484 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.431596 27236 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:37.487424 27236 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.487910 27236 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.488551 27340 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.448418 27327 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:37.401404 27326 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.440227 27258 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.380396 27056 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:37.419535 27122 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:37.480687 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44886.9us
I20260709 13:09:37.477612 27337 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:37.450639 27336 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:37.416214 27053 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:37.445273 27006 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:37.416535 27234 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:37.393960 27346 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:09:37.494949 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:37.526449 24388 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:37.487445 27159 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:37.434433 27198 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
W20260709 13:09:37.518931 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.476462 27347 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:37.520648 24393 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
W20260709 13:09:37.522215 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.486704 27211 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:37.509708 27350 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:37.530658 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:37.506950 27030 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:37.419359 27331 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.509188 27336 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.504562 27323 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.557626 23668 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:37.555928 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:37.527619 27122 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:37.577522 27122 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:37.548753 27234 raft_consensus.cc:697] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:37.555691 27258 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:37.529635 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 130777us
I20260709 13:09:37.592425 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:37.564280 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.572395 23622 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.524629 27171 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:09:37.520125 27219 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:09:37.554977 27211 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:37.574456 27323 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:37.562928 27030 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.575665 27347 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:37.563831 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 173301us
I20260709 13:09:37.619745 23592 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:37.612869 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.616071 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:37.568462 27246 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:37.620610 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.571787 27336 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:37.609380 27211 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.561435 27343 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:09:37.639140 24390 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:37.604302 27326 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.604045 27258 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:37.586414 27340 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:37.646881 23769 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:09:37.611475 27365 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.653487 27346 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:37.620041 27030 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.617062 27037 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:37.556876 27277 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:37.673601 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 81293.8us
I20260709 13:09:37.677675 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:37.678925 27372 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:37.572969 27350 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:37.709460 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.730440 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54107.5us
W20260709 13:09:37.741207 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 63617.8us
W20260709 13:09:37.680584 27358 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:09:37.743366 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.749007 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:37.749770 27346 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:37.674945 27340 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:37.751232 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 102837us
I20260709 13:09:37.662565 27246 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.771287 27053 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:37.772959 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.774233 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.774765 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.662199 27159 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.675143 27365 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:37.766163 27333 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:09:37.759087 27278 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:37.766924 27056 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:37.731624 27234 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:37.796831 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.798327 27355 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:09:37.799435 27323 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:37.800477 27349 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:37.801854 27375 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:09:37.803047 27362 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:09:37.807104 27340 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.783620 27257 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:37.810304 27363 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:09:37.821003 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:37.825306 27353 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:09:37.781246 27346 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:37.822407 27323 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:37.830065 27323 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.830399 27323 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.837306 27365 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:37.840480 27350 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.843886 27331 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.845734 27030 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:37.848131 27322 consensus_meta.cc:287] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.572s	user 0.000s	sys 0.010s
I20260709 13:09:37.848623 27322 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:37.852138 27369 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:09:37.853909 27378 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.854084 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:37.854321 27211 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.855321 23777 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:37.856575 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:37.857266 23777 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.854498 27378 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.860208 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:37.864383 27246 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.869596 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:37.792949 27278 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.876730 23771 raft_consensus.cc:2368] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:37.895985 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:37.896526 23592 leader_election.cc:400] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:37.896692 23771 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:37.889254 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.885197 23622 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:37.896450 23777 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:37.904044 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:37.922693 23771 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:37.923111 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:37.924688 24357 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:37.925110 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:37.925951 23777 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
W20260709 13:09:37.931704 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 182759us
I20260709 13:09:37.900128 27235 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:37.932906 27235 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.933126 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:37.935236 27235 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:37.927070 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:37.939249 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:37.943765 23771 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:37.913239 27322 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:37.948899 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.950623 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:37.956233 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:37.956902 23700 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.953157 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:37.961995 27378 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:37.962034 23771 raft_consensus.cc:606] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:09:37.963980 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:37.946743 27331 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:09:37.938956 27246 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:37.950086 27119 consensus_meta.cc:287] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.002s
I20260709 13:09:37.939342 27056 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:37.957763 27161 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.000s
W20260709 13:09:37.979809 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 55211.6us
I20260709 13:09:37.982023 23700 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
W20260709 13:09:37.983016 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.941969 27257 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:09:37.976675 27198 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:37.954757 27323 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.989384 27056 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:37.948696 27236 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:37.989593 27161 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8.
I20260709 13:09:37.998396 23702 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:37.988220 27320 consensus_meta.cc:287] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.754s	user 0.009s	sys 0.004s
W20260709 13:09:38.001761 27360 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.238s	user 0.001s	sys 0.001s
I20260709 13:09:38.005388 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:38.009168 23704 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:38.009577 27278 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:38.011746 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.999410 27030 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:38.013051 27236 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:38.015086 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.015401 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:37.992623 27382 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:38.016492 23699 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:38.141844 27382 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:38.143450 23698 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
W20260709 13:09:38.011938 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 136475us
I20260709 13:09:38.128161 23777 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:38.085844 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.067098 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.081871 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.145814 23703 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
W20260709 13:09:38.147128 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.145804 23696 raft_consensus.cc:2410] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:09:38.051100 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.116158 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:38.150444 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:38.151044 23700 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.153694 23769 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:38.154732 23695 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:09:38.010279 27198 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:38.140144 27323 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:38.160429 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:38.161669 23622 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.161500 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:38.162477 23628 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.161484 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:38.124761 27161 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.164285 24390 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.171939 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:38.172500 23593 leader_election.cc:336] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.577s (SENT)
I20260709 13:09:38.173547 23702 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:38.178002 23700 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:38.173110 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:38.141247 27258 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:38.154460 27336 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:38.180080 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:38.213541 23622 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:38.226505 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:38.159263 27006 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:38.227507 27006 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:38.228616 27006 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:38.124104 27056 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:38.229907 27006 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.197180 23701 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:38.208212 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.233037 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.233656 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:38.227406 23769 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.205322 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:38.235915 23777 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.238384 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:38.239624 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.240837 23593 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.690s (SENT)
I20260709 13:09:38.241333 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:38.238281 27030 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:09:38.243393 23773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:38.244134 23773 raft_consensus.cc:606] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:38.244534 23773 raft_consensus.cc:614] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:38.245106 27382 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:38.247709 23773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:38.248445 23773 raft_consensus.cc:606] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:09:38.251677 23773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa38658745b04f268c400fe20554d483"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:38.252452 23773 raft_consensus.cc:606] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:09:38.252931 23773 raft_consensus.cc:614] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:38.253533 23777 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:38.258950 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.259682 23702 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
W20260709 13:09:38.262450 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.258213 27367 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:38.237156 27323 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:38.203622 27383 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:38.180310 27161 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:38.288182 23773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:38.288900 23773 raft_consensus.cc:606] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:09:38.289688 23773 raft_consensus.cc:614] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:38.301712 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.256654 27198 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:38.311779 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.313025 23702 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:38.313457 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:38.321136 27367 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.325066 27367 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:38.327476 27367 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:38.328815 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:38.329550 23773 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
W20260709 13:09:38.333803 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.337116 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.328990 27161 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:38.341063 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:38.339541 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.342785 24358 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.991s (SENT)
I20260709 13:09:38.342885 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:38.339450 23593 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.838s (SENT)
I20260709 13:09:38.343473 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:38.338143 27368 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.685s	user 0.001s	sys 0.002s
I20260709 13:09:38.341436 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.343868 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:38.341055 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.345881 23700 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:38.341910 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:38.318529 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:38.350837 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:38.352303 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1947) took 1078 ms. Trace:
I20260709 13:09:38.360401 24390 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:38.364435 27211 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:38.358346 27161 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:38.375355 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.376157 23700 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:38.354229 23774 rpcz_store.cc:276] 0709 13:09:37.266744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.274592 (+  7848us) service_pool.cc:224] Handling call
0709 13:09:37.274890 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.470834 (+195944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.470862 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.500318 (+ 29456us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.666083 (+165765us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:37.792027 (+125944us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.792379 (+   352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.327639 (+535260us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54000591d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:38.327692 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.339340 (+ 11648us) raft_consensus.cc:1685] finished
0709 13:09:38.345109 (+  5769us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.345335 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54512,"prepare.queue_time_us":91706,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":90077,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":36585,"spinlock_wait_cycles":331560704,"thread_start_us":163817,"threads_started":2,"wal-append.queue_time_us":254352}
W20260709 13:09:38.367237 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.367789 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.345213 27364 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:38.376087 24357 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:38.380889 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.382095 23695 raft_consensus.cc:2410] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:09:38.383490 23772 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:38.383638 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:38.385447 23776 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:09:38.389279 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49857.3us
I20260709 13:09:38.391561 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.396062 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:38.396967 27367 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.397349 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.397639 27367 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:38.398907 24390 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:38.399266 27258 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.398053 23701 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:38.409556 27367 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:38.411813 27336 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:38.411933 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 69208.2us
I20260709 13:09:38.412005 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:38.411839 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.412935 23701 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
W20260709 13:09:38.413568 27402 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:09:38.412608 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:38.415217 23774 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:09:38.416244 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:38.379832 27364 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.394327 27347 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:38.415556 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:38.380312 27195 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:38.418452 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:38.418262 23769 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:38.418262 23628 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:38.439297 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:38.447053 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.449025 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:38.449751 23695 raft_consensus.cc:2376] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10. Re-sending same reply.
I20260709 13:09:38.450588 27365 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:38.451233 27365 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:38.452356 27365 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:38.453066 27386 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.545s	user 0.003s	sys 0.002s
I20260709 13:09:38.423166 27364 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.454339 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.455039 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.455690 23700 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:38.436991 27159 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:09:38.456432 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.991519 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:38.985558 23593 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.876s (SENT)
I20260709 13:09:38.456600 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.420694 27367 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.561972 23742 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.735s (SENT)
I20260709 13:09:38.464128 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:38.457718 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.457266 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:38.987274 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.547900 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:38.459682 23702 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:39.010443 23700 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:39.011173 23699 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:38.421634 27161 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:38.711628 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.936808 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.458036 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:38.989198 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.018821 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:39.019383 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.019814 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.860109 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1941) took 1595 ms. Trace:
I20260709 13:09:39.009711 23626 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:39.021421 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:39.022656 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.018700 23701 raft_consensus.cc:2376] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7. Re-sending same reply.
I20260709 13:09:39.021816 23776 rpcz_store.cc:276] 0709 13:09:37.264985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.267599 (+  2614us) service_pool.cc:224] Handling call
0709 13:09:37.267910 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.386016 (+1118106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.856421 (+470405us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540016ba54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:38.860035 (+  3614us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2569301760}
I20260709 13:09:39.023021 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.025056 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.025696 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.011965 23698 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:09:39.013028 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 451085us
I20260709 13:09:38.994336 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:39.010380 23629 raft_consensus.cc:2368] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
W20260709 13:09:39.018170 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.029464 23742 leader_election.cc:336] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.847s (SENT)
I20260709 13:09:39.026461 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.031955 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.030355 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:38.824586 27383 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:38.791972 27345 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:38.548305 27291 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.490s
I20260709 13:09:38.485783 27056 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:39.037598 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.918550 27122 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.824179 27341 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:39.038026 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:38.946228 27378 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:39.044624 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:39.046042 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.460769 27347 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:38.578902 27364 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.017175 27161 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.063829 27161 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:39.063630 27378 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.048676 27030 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:39.050791 27322 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:39.056689 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:39.023125 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.060411 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.065908 23702 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.066227 23628 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:09:39.067062 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.037070 23695 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:39.039767 27037 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:39.033455 27367 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.065164 27364 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:39.084087 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.079589 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:39.086141 23776 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.092717 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:39.089681 23702 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:39.070930 23626 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:09:39.037632 27383 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.106552 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.054064 27122 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.038049 27345 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:39.111119 23695 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:39.125674 23698 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:39.137328 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:39.137384 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.074344 27037 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:39.148880 24358 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.603s (SENT)
W20260709 13:09:39.150748 27006 consensus_meta.cc:287] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.920s	user 0.010s	sys 0.006s
I20260709 13:09:39.165792 23776 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:39.168076 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:39.169090 24386 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:39.172150 23696 raft_consensus.cc:2368] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 5. Current term is 6.
I20260709 13:09:39.176177 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:39.153995 27258 consensus_meta.cc:287] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.754s	user 0.012s	sys 0.000s
I20260709 13:09:39.148432 27378 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:39.178090 23624 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:39.178665 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.180119 27420 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:39.180703 27420 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.182895 27420 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:39.184073 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.184757 23697 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:09:39.192413 23777 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:39.134174 27347 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.187325 27006 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.203202 27056 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:39.225072 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:39.226130 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:39.226768 24386 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:39.208664 27367 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:39.202481 27258 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.220978 27006 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.248917 24386 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:09:39.230150 27198 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 13:09:39.253237 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.231860 27234 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 13:09:39.262996 27419 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:09:39.266475 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.272399 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:39.267911 27122 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:39.235471 27056 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.282577 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.283429 23701 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:39.297318 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:39.298027 23778 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:39.305019 23743 leader_election.cc:400] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
I20260709 13:09:39.305411 23743 leader_election.cc:403] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:39.306196 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:39.308496 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:39.307883 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 206948us
I20260709 13:09:39.309803 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:39.312214 27367 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:39.312915 27367 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:39.314149 27367 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.318248 23777 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:39.323657 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:39.273556 27341 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.269953 27345 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:39.239707 27258 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.347036 27428 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:39.349546 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:39.274088 27383 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:39.356762 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 371220us
W20260709 13:09:39.360299 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 157606us
W20260709 13:09:39.355721 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 326269us
I20260709 13:09:39.278901 27122 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:39.382562 27122 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:39.383850 23742 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.898s (SENT)
I20260709 13:09:39.384467 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:39.385440 27122 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:39.385504 27425 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:39.389670 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:39.329116 27327 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
W20260709 13:09:39.373379 27415 log.cc:927] Time spent T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.187s	user 0.001s	sys 0.001s
I20260709 13:09:39.415807 27383 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.348758 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:39.416363 27383 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.426404 27383 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:39.432015 27383 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.432545 27383 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.434829 27383 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:39.436259 23622 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:39.436617 27037 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:39.448846 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.449774 23629 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:39.437839 23622 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:39.437963 27006 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:39.445037 27258 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:39.452893 24388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 608) took 1021 ms. Trace:
I20260709 13:09:39.453965 27161 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.460973 23778 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:09:39.463464 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:39.467471 23627 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:39.466730 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:39.403347 27428 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:39.476064 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 141608us
W20260709 13:09:39.476759 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.478364 23622 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:39.466588 24388 rpcz_store.cc:276] 0709 13:09:38.431443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.431581 (+   138us) service_pool.cc:224] Handling call
0709 13:09:38.431959 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:38.460415 (+ 28456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.460445 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:38.461101 (+   656us) log.cc:844] Serialized 52 byte log entry
0709 13:09:39.016668 (+555567us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:39.016750 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.016866 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.452664 (+435798us) raft_consensus.cc:1685] finished
0709 13:09:39.452684 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.452834 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28023,"raft.queue_time_us":28290,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":92482,"threads_started":1,"wal-append.queue_time_us":651842}
I20260709 13:09:39.484823 27427 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.485658 27427 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.488838 27427 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:39.490792 23628 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:39.493621 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.495671 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.497668 23626 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:39.498903 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.499929 23625 raft_consensus.cc:2368] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11.
I20260709 13:09:39.500548 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.501539 23624 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:39.502121 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.502444 27327 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.504065 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:39.412914 27236 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:39.378387 27341 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.512308 24359 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:39.525058 23773 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:39.526881 23773 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:39.529831 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:39.525357 23742 leader_election.cc:336] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.097s (SENT)
I20260709 13:09:39.530879 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:39.538688 23628 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:09:39.539121 23628 pending_rounds.cc:85] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 5
I20260709 13:09:39.539425 23628 pending_rounds.cc:107] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:09:39.539700 23628 raft_consensus.cc:2889] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.542045 23625 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:09:39.541870 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:39.542469 23625 pending_rounds.cc:85] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 6
I20260709 13:09:39.542840 23625 pending_rounds.cc:107] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:09:39.543097 23625 raft_consensus.cc:2889] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:39.543223 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 236106us
W20260709 13:09:39.544245 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 293973us
I20260709 13:09:39.544613 23627 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:39.527884 23773 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.546252 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:39.546677 23773 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.541766 23702 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:39.548296 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.549010 23769 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
W20260709 13:09:39.548481 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.550486 23695 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:39.550845 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.523020 27427 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:39.558094 23699 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:39.539165 27234 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:39.562983 23629 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
W20260709 13:09:39.560810 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.560825 23696 pending_rounds.cc:85] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 3
I20260709 13:09:39.564190 23696 pending_rounds.cc:107] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:39.564524 23696 raft_consensus.cc:2889] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.561769 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:39.566682 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.567154 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.566602 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.572839 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:39.573151 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 191358us
I20260709 13:09:39.503113 27327 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.573789 23773 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:39.574323 23773 pending_rounds.cc:85] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 7
I20260709 13:09:39.574512 23697 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:39.574630 23773 pending_rounds.cc:107] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:39.575119 23773 raft_consensus.cc:2889] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.583364 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.585424 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:39.587980 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 207253us
I20260709 13:09:39.588806 23695 raft_consensus.cc:2410] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:39.588644 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:39.589767 23593 leader_election.cc:336] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.585s (SENT)
I20260709 13:09:39.590328 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:39.594297 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:39.595489 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:39.594854 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:39.597959 23593 leader_election.cc:336] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.797s (SENT)
I20260709 13:09:39.598973 23593 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:39.602349 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.608312 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.608587 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.530923 27236 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.603250 23695 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:39.608312 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.612310 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.613039 23695 raft_consensus.cc:2376] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8. Re-sending same reply.
I20260709 13:09:39.613140 23704 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:09:39.545583 27037 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:09:39.610570 23623 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:39.559057 27322 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:39.573036 27122 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:39.578088 27427 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.622051 27122 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.623970 27427 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:39.624717 27122 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:39.624634 27439 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:39.609573 27258 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.627303 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.628576 23701 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
W20260709 13:09:39.618935 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.621343 27429 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.617911 23625 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:39.618623 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.647925 23629 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:09:39.629786 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.593611 27234 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:39.649201 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.662981 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.667060 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.648343 23697 raft_consensus.cc:2376] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12. Re-sending same reply.
I20260709 13:09:39.667979 23701 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:39.648541 23629 pending_rounds.cc:85] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 5
I20260709 13:09:39.667985 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.668943 23629 pending_rounds.cc:107] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:09:39.669229 23629 raft_consensus.cc:2889] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.671175 27258 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:39.632905 27428 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.671785 27258 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:39.673237 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 131442us
W20260709 13:09:39.674337 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 76813.4us
I20260709 13:09:39.690613 27236 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:39.648489 27434 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:39.694209 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 98839.6us
I20260709 13:09:39.716337 23667 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:39.675696 27446 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.708578 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.712863 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:39.697228 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:39.724098 23629 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 6: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:39.729657 23704 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13.
I20260709 13:09:39.728629 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.733299 23695 raft_consensus.cc:2410] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:39.741340 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:39.755093 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 197579us
I20260709 13:09:39.765017 23704 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:39.767602 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 769) took 1014 ms. Trace:
I20260709 13:09:39.768325 23775 rpcz_store.cc:276] 0709 13:09:38.753463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.755379 (+  1916us) service_pool.cc:224] Handling call
0709 13:09:38.755716 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.755952 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:39.523983 (+768031us) log.cc:844] Serialized 14 byte log entry
0709 13:09:39.766828 (+242845us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.766962 (+   134us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:39.767098 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.767254 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.767505 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":235163,"prepare.queue_time_us":352609,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":732511,"threads_started":2}
I20260709 13:09:39.776818 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.779683 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:39.780540 23623 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.727470 27445 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.790266 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:39.812863 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:39.813218 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.820425 23625 raft_consensus.cc:2393] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 4: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:39.764395 27161 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:39.829243 27320 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:09:39.830041 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:39.831238 23622 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:39.728039 27440 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:09:39.860523 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.861637 23700 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:39.813112 27291 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:39.777727 27236 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:09:39.771714 27234 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.763309 27462 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:09:39.880378 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.872218 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.894469 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.870967 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:39.887985 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.870666 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.896291 23703 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
W20260709 13:09:39.896968 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 73923.3us
I20260709 13:09:39.871279 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:39.868081 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 54151.8us
W20260709 13:09:39.897842 23742 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.158s (SENT)
I20260709 13:09:39.898355 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:39.898803 24358 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.028s (SENT)
I20260709 13:09:39.875277 27440 consensus_queue.cc:1243] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:39.873430 27469 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:39.903673 27440 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:39.904371 27320 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.902907 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.906667 27258 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:39.903824 27469 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:39.910250 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.912086 27327 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:39.831096 27341 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:39.871443 27448 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.179s	user 0.001s	sys 0.001s
I20260709 13:09:39.912689 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.907862 27469 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.915191 27291 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.916783 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.914744 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.917752 27291 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:39.904487 27440 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:39.891299 27391 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.921599 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.920717 23703 raft_consensus.cc:2410] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:39.920431 27391 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:39.924602 27462 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.925117 27462 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:39.925496 27391 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:39.922713 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.927127 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.928120 23775 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:39.928912 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:39.929253 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:39.929821 23773 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:39.919281 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.934410 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.897691 23695 raft_consensus.cc:2376] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8. Re-sending same reply.
W20260709 13:09:39.937851 24358 leader_election.cc:336] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.074s (SENT)
I20260709 13:09:39.866544 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:39.940479 23742 leader_election.cc:336] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.537s (SENT)
I20260709 13:09:39.939193 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.939249 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:39.947134 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.927505 27462 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:39.889792 27466 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:09:39.923113 27425 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:39.959041 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.887281 23623 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:39.959640 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.961809 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.976155 23701 raft_consensus.cc:2410] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:09:39.963020 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.877074 27454 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.965603 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:39.968997 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:40.005247 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.016311 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:40.017237 23700 raft_consensus.cc:2368] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9.
I20260709 13:09:40.019541 23627 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:09:40.027603 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:39.921386 27440 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:40.037948 23695 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:09:40.046947 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.048388 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:40.049253 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:40.055701 23700 raft_consensus.cc:2410] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:40.060472 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:40.061573 23695 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:40.063174 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:40.064486 23697 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:40.065804 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:40.065852 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:40.066788 23695 raft_consensus.cc:2410] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:40.070765 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:40.053069 27432 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:09:40.072031 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:40.024343 27161 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:09:40.081744 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:40.089373 23701 raft_consensus.cc:2410] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:09:40.083796 23742 leader_election.cc:336] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.693s (SENT)
I20260709 13:09:40.090269 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:40.083254 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:40.086174 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 373352us
I20260709 13:09:40.091393 23695 raft_consensus.cc:2410] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:40.091572 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:40.073514 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:40.090559 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:40.093503 23743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.011s
W20260709 13:09:40.094012 23743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.000s	sys 0.011s
W20260709 13:09:40.094530 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 522012us
I20260709 13:09:40.095314 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:40.067569 27440 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:40.173477 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.174652 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 84154.9us
W20260709 13:09:40.177721 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 85877.5us
I20260709 13:09:40.178062 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:40.179265 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:40.179850 23701 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:40.181030 27473 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:40.181609 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 97888.2us
I20260709 13:09:40.181562 27473 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:40.183391 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.184850 27428 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:40.187172 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 91816.9us
W20260709 13:09:40.187505 27464 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:09:40.190128 27428 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:39.977165 27425 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:40.023999 27454 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:40.089946 27429 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:40.183633 27473 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:40.202121 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:40.206347 23701 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5.
I20260709 13:09:40.207129 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:40.208145 23697 raft_consensus.cc:2376] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5. Re-sending same reply.
I20260709 13:09:40.209540 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:40.219274 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:40.220220 23701 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:40.210719 23697 raft_consensus.cc:2376] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 5. Re-sending same reply.
I20260709 13:09:40.211848 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:40.264704 23770 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:40.234004 23742 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.863s (SENT)
I20260709 13:09:40.269326 23700 raft_consensus.cc:2410] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:40.269418 23772 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:40.230507 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:40.231643 23776 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:40.272431 23769 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:09:40.227661 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:40.275225 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:40.276569 23701 raft_consensus.cc:2410] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:09:40.278272 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 101200us
I20260709 13:09:40.279191 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:40.229327 27006 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:40.268081 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:40.284951 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:40.307782 23776 raft_consensus.cc:2393] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:40.265345 27383 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:40.270962 27056 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:40.264958 27443 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:09:40.210692 27428 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.274901 27429 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:40.348480 23698 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:40.354770 23769 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:40.355014 23698 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:40.227162 27457 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:09:40.355469 23698 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:40.311837 27460 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:40.374464 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 436622us
W20260709 13:09:40.372151 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50014.4us
W20260709 13:09:40.378961 24358 leader_election.cc:336] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.891s (SENT)
I20260709 13:09:40.379509 24358 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:40.283627 27432 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
W20260709 13:09:40.394754 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 453669us
I20260709 13:09:40.349262 27056 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:40.390828 23698 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:40.403175 23698 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:40.380098 27327 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:40.376590 27006 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:09:40.388162 27444 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:40.392205 27457 consensus_queue.cc:1243] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:40.383425 27469 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:09:40.388342 27480 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:40.379034 27428 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:40.429677 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 150563us
I20260709 13:09:40.401816 27460 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:40.432770 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44798.7us
I20260709 13:09:40.408684 27383 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.435961 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:40.425403 27432 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:40.432452 27006 consensus_queue.cc:1243] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:40.423483 27444 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:40.460158 27472 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:09:40.478936 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:40.483093 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 50488.1us
I20260709 13:09:40.414141 27327 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:40.486124 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50139.4us
I20260709 13:09:40.492442 23698 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:40.478384 27432 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:40.520880 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:40.496116 27006 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:40.511245 27383 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:40.480214 27476 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:09:40.435348 27056 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:40.537115 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 303149us
I20260709 13:09:40.542616 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:40.543687 23698 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:40.436203 27480 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:40.547686 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:40.549642 23623 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:40.565794 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:40.566481 23623 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:40.550875 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:40.567476 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:40.568022 23742 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 3.126s (SENT) [suppressed 62 similar messages]
I20260709 13:09:40.564705 23627 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:40.568266 23623 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:40.557821 23698 pending_rounds.cc:85] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 7
I20260709 13:09:40.555075 23620 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:40.569288 23698 pending_rounds.cc:107] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:40.569615 23698 raft_consensus.cc:2889] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:40.569895 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:40.570516 23620 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:40.571400 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:40.572604 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:40.463296 27460 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:40.542124 27006 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.541674 27258 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.582940 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:40.609938 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:40.539911 27491 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.582410 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:40.620568 23699 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:09:40.622720 23699 pending_rounds.cc:85] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 5
I20260709 13:09:40.623160 23699 pending_rounds.cc:107] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:09:40.552851 27454 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:40.623395 23699 raft_consensus.cc:2889] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:40.587512 27470 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:09:40.477380 27429 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:40.558815 27425 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:40.611173 27378 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.580286 27383 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:40.637881 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:40.584357 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:40.642853 23624 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 4.
I20260709 13:09:40.617296 27006 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:40.623907 23623 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
W20260709 13:09:40.657836 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.660763 23621 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:40.651855 27495 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:40.666072 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.581957 27496 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.577172 27432 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:40.708880 27445 consensus_meta.cc:287] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.874s	user 0.007s	sys 0.011s
I20260709 13:09:40.666368 27258 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:40.747378 27486 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:40.749575 27460 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:40.743589 27428 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:40.751645 27477 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:09:40.743089 27445 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.755959 23704 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:40.757018 27444 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:40.745113 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 162241us
I20260709 13:09:40.765515 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:40.766355 27258 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:40.767262 23593 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:40.735435 27482 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:09:40.790684 27258 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:40.791131 27258 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:40.791520 27258 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.794554 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:40.798715 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:40.798914 23627 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:40.799708 27496 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:40.800256 27496 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:40.801249 27496 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:40.801545 27006 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:40.805106 27258 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:40.737047 27484 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
W20260709 13:09:40.807447 23628 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.011s
W20260709 13:09:40.814527 23628 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.007s	sys 0.011s
I20260709 13:09:40.815289 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 684) took 1039 ms. Trace:
I20260709 13:09:40.730270 27493 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.867667 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:40.868000 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 164871us
I20260709 13:09:40.874096 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 685) took 1089 ms. Trace:
I20260709 13:09:40.815920 23628 rpcz_store.cc:276] 0709 13:09:39.776335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.776620 (+   285us) service_pool.cc:224] Handling call
0709 13:09:39.823865 (+ 47245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.831658 (+  7793us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:39.898079 (+ 66421us) log.cc:844] Serialized 14 byte log entry
0709 13:09:40.814929 (+916850us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:40.814985 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:40.815029 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.815098 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.815231 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22901,"prepare.queue_time_us":68997,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":92733,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":7303,"thread_start_us":902804,"threads_started":2,"wal-append.queue_time_us":518048}
I20260709 13:09:40.875432 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:40.874727 23629 rpcz_store.cc:276] 0709 13:09:39.784640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.785352 (+   712us) service_pool.cc:224] Handling call
0709 13:09:39.785775 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.786256 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.786297 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.828287 (+ 41990us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.320946 (+492659us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:40.320992 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.321068 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:40.873817 (+552749us) raft_consensus.cc:1685] finished
0709 13:09:40.873844 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.874027 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1927,"raft.queue_time_us":628,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10702,"thread_start_us":440077,"threads_started":1,"wal-append.queue_time_us":629214}
I20260709 13:09:40.879119 27513 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.880092 27513 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.881590 27506 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:40.881959 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:40.882902 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:40.884042 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:40.884249 27509 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:40.884873 23743 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:40.885414 27510 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:40.888000 27506 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:40.888214 27428 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.888546 27506 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:40.889125 27506 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.889886 27327 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:40.887542 27510 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:40.891767 27510 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.891877 27258 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:40.892217 27510 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.893136 27480 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:40.884829 27509 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:40.866794 27432 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.866279 27443 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.904461 24357 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.005s	sys 0.009s
W20260709 13:09:40.906186 24357 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.005s	sys 0.009s
I20260709 13:09:40.866218 27383 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:40.901393 27509 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:40.915027 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.924604 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.930409 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:40.931056 27521 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:09:40.938772 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 423) took 1071 ms. Trace:
I20260709 13:09:40.928817 24357 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:40.939273 23702 rpcz_store.cc:276] 0709 13:09:39.868690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.948280 (+ 79590us) service_pool.cc:224] Handling call
0709 13:09:40.938411 (+990131us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b540015d7a8. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470e9924 00007f2b462d2227 00007f2b462d1ab8 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:40.938707 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3720448}
I20260709 13:09:40.907694 27443 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:40.953356 27443 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:40.956954 27510 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:40.958678 27509 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:40.968119 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 82176.5us
I20260709 13:09:40.970355 23743 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:40.972401 27467 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:40.973001 27467 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.973399 27467 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:40.972487 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:40.969060 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:40.976970 24388 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:40.977284 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:40.978103 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 424) took 1108 ms. Trace:
I20260709 13:09:40.978444 23703 rpcz_store.cc:276] 0709 13:09:39.869510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.953877 (+ 84367us) service_pool.cc:224] Handling call
0709 13:09:40.977109 (+1023232us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b580000ff98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:09:40.978035 (+   926us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3652864}
I20260709 13:09:40.979190 27480 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:40.979782 27480 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:40.981243 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 2343) took 1114 ms. Trace:
I20260709 13:09:40.981972 27480 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:40.982523 27480 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:40.983122 23701 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:40.983600 27510 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:40.983355 27480 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:40.981680 23700 rpcz_store.cc:276] 0709 13:09:39.866559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.073180 (+206621us) service_pool.cc:224] Handling call
0709 13:09:40.980948 (+907768us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b540040e554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:40.981179 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404272384}
I20260709 13:09:40.983628 23701 pending_rounds.cc:85] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 3
I20260709 13:09:40.984932 23701 pending_rounds.cc:107] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:40.985172 23701 raft_consensus.cc:2889] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:40.985679 27480 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:40.979387 27327 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:40.986742 27327 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:40.987432 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2337) took 1122 ms. Trace:
I20260709 13:09:40.971318 27455 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:41.012755 23701 rpcz_store.cc:276] 0709 13:09:39.865104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.310985 (+445881us) service_pool.cc:224] Handling call
0709 13:09:40.982747 (+671762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.985606 (+  2859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.987248 (+  1642us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b540040e550. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:40.987376 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1484591360}
I20260709 13:09:40.982017 27509 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:40.991343 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 454) took 1059 ms. Trace:
I20260709 13:09:40.995915 27479 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:40.991447 27475 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.438s	user 0.000s	sys 0.000s
W20260709 13:09:40.989367 27492 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
I20260709 13:09:40.989744 27327 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:41.005757 24358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.007s	sys 0.009s
I20260709 13:09:41.012068 23668 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:41.020251 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:41.032733 24358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.007s	sys 0.010s
I20260709 13:09:41.018088 23698 rpcz_store.cc:276] 0709 13:09:39.931986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.570758 (+638772us) service_pool.cc:224] Handling call
0709 13:09:40.613876 (+ 43118us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.620436 (+  6560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.620480 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.622189 (+  1709us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.900927 (+278738us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:40.908195 (+  7268us) log.cc:844] Serialized 14 byte log entry
0709 13:09:40.908421 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.908499 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:40.991111 (+ 82612us) raft_consensus.cc:1685] finished
0709 13:09:40.991133 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.991283 (+   150us) inbound_call.cc:177] Queueing success response
0709 13:09:40.994338 (+  3055us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b180048d540. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
Metrics: {"mutex_wait_us":10096,"prepare.queue_time_us":8957,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":6344,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":4695,"spinlock_wait_cycles":9650816,"thread_start_us":241034,"threads_started":1,"wal-append.queue_time_us":325595}
W20260709 13:09:41.027745 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 58616.4us
I20260709 13:09:41.029326 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:41.034699 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 655721us
W20260709 13:09:41.035310 23593 leader_election.cc:336] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.782s (SENT)
I20260709 13:09:41.036366 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:41.035854 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:41.015079 27455 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:41.080749 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:41.096668 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:41.097460 27453 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:41.098105 27453 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.099126 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.021690 27479 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:41.097502 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:41.102604 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.031189 27006 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:41.102579 27455 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.077780 27446 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:41.082741 27383 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:41.127770 27446 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.131713 27479 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.131937 27467 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.132725 27446 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.133266 27479 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:41.134616 27467 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:41.137938 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2298) took 1596 ms. Trace:
I20260709 13:09:41.138362 23696 rpcz_store.cc:276] 0709 13:09:39.541477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.548508 (+  7031us) service_pool.cc:224] Handling call
0709 13:09:39.560617 (+ 12109us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:39.735178 (+174561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.735240 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:39.736147 (+   907us) log.cc:844] Serialized 52 byte log entry
0709 13:09:40.231004 (+494857us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:40.277849 (+ 46845us) log.cc:844] Serialized 14 byte log entry
0709 13:09:40.281463 (+  3614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.281565 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:40.990869 (+709304us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:41.137632 (+146763us) raft_consensus.cc:1685] finished
0709 13:09:41.137730 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.137877 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3304,"prepare.queue_time_us":46655,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3806,"raft.queue_time_us":66967,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":165,"spinlock_wait_cycles":136520448,"thread_start_us":541965,"threads_started":2,"wal-append.queue_time_us":701220}
W20260709 13:09:41.148906 27487 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.572s	user 0.001s	sys 0.000s
I20260709 13:09:41.150980 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 687) took 1214 ms. Trace:
I20260709 13:09:41.151489 23626 rpcz_store.cc:276] 0709 13:09:39.936795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.951391 (+ 14596us) service_pool.cc:224] Handling call
0709 13:09:39.951898 (+   507us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:39.968158 (+ 16260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.968203 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:39.978303 (+ 10100us) log.cc:844] Serialized 52 byte log entry
0709 13:09:40.351971 (+373668us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:40.352012 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.352103 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.148251 (+796148us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:41.150434 (+  2183us) raft_consensus.cc:1685] finished
0709 13:09:41.150457 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.150906 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8732,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":28309,"spinlock_wait_cycles":72160512,"thread_start_us":292535,"threads_started":1,"wal-append.queue_time_us":446955}
W20260709 13:09:41.153839 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.155927 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.158869 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:41.159448 23774 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:41.160202 23772 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:41.164623 27322 raft_consensus.cc:993] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
W20260709 13:09:41.164924 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.166081 23772 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 13:09:41.165169 27322 raft_consensus.cc:1081] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
W20260709 13:09:41.171478 27483 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.663s	user 0.001s	sys 0.001s
W20260709 13:09:41.187227 23742 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.789s (SENT)
W20260709 13:09:41.201958 23704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 434) took 1321 ms (client timeout 1603 ms). Trace:
W20260709 13:09:41.202708 23704 rpcz_store.cc:269] 0709 13:09:39.892506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.938868 (+ 46362us) service_pool.cc:224] Handling call
0709 13:09:41.201558 (+1262690us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b540026b1d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:41.201737 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1873355136}
I20260709 13:09:41.204705 23695 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:41.209578 27469 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:41.210106 27469 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:41.211051 27469 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.213872 27469 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:41.216073 27488 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.671s	user 0.000s	sys 0.002s
I20260709 13:09:41.220405 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 777) took 1292 ms. Trace:
I20260709 13:09:41.220866 23778 rpcz_store.cc:276] 0709 13:09:39.927997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.928102 (+   105us) service_pool.cc:224] Handling call
0709 13:09:39.928395 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.928696 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.928721 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.205169 (+1276448us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b2c0012bcd8. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:09:41.205606 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.219965 (+ 14359us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:41.220012 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.220086 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.220129 (+    43us) raft_consensus.cc:1685] finished
0709 13:09:41.220140 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.220335 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88678,"raft.queue_time_us":45939,"raft.run_cpu_time_us":5698,"raft.run_wall_time_us":112706,"spinlock_wait_cycles":73815424,"thread_start_us":13875,"threads_started":1,"wal-append.queue_time_us":8623}
I20260709 13:09:41.225037 23697 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:41.225495 23697 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:41.226428 23697 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.242940 23592 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:41.244486 27425 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:41.245136 27425 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.248785 27425 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:41.252398 24359 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:41.257061 27496 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:41.259457 27367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.937s	user 0.011s	sys 0.036s
I20260709 13:09:41.422247 27496 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.272030 27434 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.423026 27496 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.278576 27457 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:41.424000 27457 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:41.425122 27457 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.426227 27457 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:41.275403 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.285933 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:41.430565 23696 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:41.287120 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:41.293292 23742 leader_election.cc:336] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.891s (SENT)
W20260709 13:09:41.432468 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 139216us
W20260709 13:09:41.433423 23742 leader_election.cc:336] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.943s (SENT)
I20260709 13:09:41.433972 23742 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:41.435447 23742 leader_election.cc:336] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.954s (SENT)
W20260709 13:09:41.436331 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.437068 27122 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:41.297137 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:41.437654 27493 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.438191 27493 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.301463 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:41.302950 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.439492 23622 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:41.440564 27493 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:41.304343 23697 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.310381 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:41.330785 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 436) took 1437 ms. Trace:
W20260709 13:09:41.336526 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.446106 23695 rpcz_store.cc:276] 0709 13:09:39.893156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.310419 (+417263us) service_pool.cc:224] Handling call
0709 13:09:41.204307 (+893888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.205181 (+   874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.330434 (+125253us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b540026b1d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:41.330682 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054715136}
W20260709 13:09:41.447150 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.409408 27378 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:41.451128 27378 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:41.455328 27378 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:41.458101 27236 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.459542 23622 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:41.410101 27432 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:41.413049 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.417671 27542 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.465368 27542 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:41.466485 23622 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:41.457866 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 205597us
W20260709 13:09:41.422485 27367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.100s	user 0.011s	sys 0.036s
I20260709 13:09:41.282375 27497 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.423156 27434 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:41.437103 23742 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.002s (SENT)
I20260709 13:09:41.468544 27236 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:41.468966 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:41.296716 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:41.468580 27497 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:41.471666 27493 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:41.473250 23742 leader_election.cc:336] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.515s (SENT)
I20260709 13:09:41.474931 27497 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:41.475749 27497 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:41.477408 27542 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:41.479065 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:41.483470 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:41.484411 23626 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:09:41.487264 23626 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:41.490031 27493 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:41.490523 27493 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:41.490756 27480 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:41.491429 27493 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.492697 23742 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:41.493606 27428 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.495466 23527 catalog_manager.cc:5697] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 3 to 6, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 6 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.498374 27056 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.498663 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:41.500272 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:41.550148 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49518.5us
I20260709 13:09:41.502593 27453 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:41.483249 23701 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:41.503472 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:41.495497 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:41.537693 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:41.504036 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 291176us
W20260709 13:09:41.541252 24358 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.063s	sys 0.081s
W20260709 13:09:41.558122 24358 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.063s	sys 0.081s
W20260709 13:09:41.558543 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 523091us
I20260709 13:09:41.558578 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:41.544557 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 75917.2us
I20260709 13:09:41.554061 23771 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:41.554527 23626 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:09:41.560271 24358 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.638s (SENT)
W20260709 13:09:41.561779 24358 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.954s (SENT)
I20260709 13:09:41.483891 27258 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:41.563150 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.567334 23772 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:41.538548 27518 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:41.465934 27432 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:41.568168 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.571648 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 76230.1us
W20260709 13:09:41.573518 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.563187 24358 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.056s (SENT)
I20260709 13:09:41.487620 27434 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:41.586292 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.576439 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:41.596201 23742 leader_election.cc:336] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.588s (SENT)
I20260709 13:09:41.577697 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:41.574716 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:41.564662 27457 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:41.596854 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:41.631183 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:41.595795 27506 consensus_meta.cc:287] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.003s
I20260709 13:09:41.642135 27506 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:41.575412 27442 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:41.640524 27458 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.640486 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 63006.4us
I20260709 13:09:41.640849 27453 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:41.646767 23697 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:09:41.583992 27006 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.574041 27258 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.579265 27345 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:09:41.665633 27441 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:41.638866 27471 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.661010 27458 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:41.660818 27006 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.648900 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:41.660992 27378 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.650417 23697 pending_rounds.cc:85] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 5
I20260709 13:09:41.638882 27480 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:41.672508 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 108385us
I20260709 13:09:41.672756 23697 pending_rounds.cc:107] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:09:41.675119 23697 raft_consensus.cc:2889] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:41.666316 27441 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.610185 27457 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:41.678944 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2336) took 1814 ms. Trace:
I20260709 13:09:41.679422 23697 rpcz_store.cc:276] 0709 13:09:39.864878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.221388 (+356510us) service_pool.cc:224] Handling call
0709 13:09:40.221635 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.224933 (+1003298us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54003f05a0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41283dc0 00007f2b4130e1c0 00007f2b4130f231 00007f2b4130bd8f 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c
0709 13:09:41.678672 (+453739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.678888 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444223872}
I20260709 13:09:41.684326 23773 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:09:41.684825 23773 pending_rounds.cc:85] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 5
I20260709 13:09:41.685186 23773 pending_rounds.cc:107] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:09:41.685510 23773 raft_consensus.cc:2889] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:41.689260 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 126107us
W20260709 13:09:41.678026 27452 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 2.006s	user 0.005s	sys 0.000s
W20260709 13:09:41.683739 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 87564.1us
W20260709 13:09:41.683674 27478 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:09:41.651332 27367 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:09:41.675103 27521 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.673273 27471 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.743990 24386 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:41.684854 27473 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.647680 27496 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.676159 27453 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.756947 23622 raft_consensus.cc:2368] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9.
I20260709 13:09:41.757120 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:41.757855 24386 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:41.676661 27378 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:41.749629 27535 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:09:41.750901 27458 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:41.753257 27496 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:41.722208 27546 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:41.753665 27531 log.cc:927] Time spent T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.568s	user 0.000s	sys 0.001s
I20260709 13:09:41.755245 27471 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:41.762727 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:41.775143 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:41.784173 23774 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.003s
I20260709 13:09:41.790324 23774 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
W20260709 13:09:41.768777 27455 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.652s	user 0.006s	sys 0.004s
I20260709 13:09:41.741775 27161 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:41.765782 27506 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:41.793926 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:41.800257 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:41.794983 23776 raft_consensus.cc:2393] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:41.768617 27442 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:41.801290 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:41.811110 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.811822 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.785354 27548 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.812206 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.787531 27546 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.813012 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:41.785912 27458 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:41.820432 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 51068.3us
I20260709 13:09:41.819813 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.765282 27473 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.823447 23776 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:41.823477 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:41.791859 27006 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:41.831092 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:41.831955 23776 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.824923 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.834993 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.798065 27471 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:09:41.843683 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.814546 27521 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:09:41.845089 27534 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:09:41.822829 27548 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.849001 27548 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:41.849583 27548 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:41.850231 27548 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:41.850863 27548 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:41.851220 27548 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.846122 27006 raft_consensus.cc:2764] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:41.846156 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:41.852118 24391 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.829401 27458 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.851584 27548 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:41.853950 27458 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:41.855223 27541 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:09:41.825974 27546 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:41.862272 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.864074 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.880103 23776 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:41.840602 27441 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:41.899880 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.900213 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2332) took 2040 ms. Trace:
I20260709 13:09:41.870515 27551 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:41.870854 27006 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.904016 27006 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:41.906579 27006 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:41.798796 27455 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:41.907567 24390 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:41.900600 23699 rpcz_store.cc:276] 0709 13:09:39.859399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.862008 (+  2609us) service_pool.cc:224] Handling call
0709 13:09:39.904207 (+ 42199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.634140 (+729933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.899594 (+1265454us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b5400131ad4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:41.900155 (+   561us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1646700800}
I20260709 13:09:41.817147 27442 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:41.911497 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:41.895602 27446 consensus_meta.cc:287] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.762s	user 0.003s	sys 0.009s
I20260709 13:09:41.899624 27258 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:41.941712 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 141547us
I20260709 13:09:41.943400 23669 leader_election.cc:400] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11.
I20260709 13:09:41.943787 23669 leader_election.cc:403] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:41.948160 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 111107us
I20260709 13:09:41.932610 27432 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:41.948277 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:41.954665 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:41.954794 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:41.908201 27554 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:09:41.950024 24391 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
W20260709 13:09:41.969429 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54911.8us
I20260709 13:09:41.972172 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:41.940948 27551 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:09:41.972425 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:41.955718 27453 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:41.930868 27446 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:41.974582 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:41.960255 27440 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.951107 27558 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11.
I20260709 13:09:41.961257 27432 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:41.975545 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:41.976714 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:41.962800 27458 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:41.991287 24389 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:41.990600 23669 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:41.976405 27551 consensus_queue.cc:1243] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:09:41.994501 27006 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:09:42.001811 27549 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 13:09:42.002372 27481 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 1.522s	user 0.000s	sys 0.009s
I20260709 13:09:42.003507 27556 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:42.013625 23778 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:42.015805 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:42.016932 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:42.027103 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.030768 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:42.031560 23620 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:42.035830 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:41.972056 27552 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:09:41.990211 27453 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:09:42.042325 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 71864us
I20260709 13:09:42.044505 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:42.045491 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:42.049641 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:42.052220 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:42.053633 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:42.054296 23629 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.050465 23627 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:42.036921 27561 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:09:41.990633 27432 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.037356 27473 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:42.065419 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:42.050403 27455 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:42.073813 23620 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
W20260709 13:09:42.062219 27553 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:09:42.037734 27441 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:09:42.063951 27442 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:42.079284 27518 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:42.099975 27518 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.082046 27457 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:42.082461 27432 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:42.074839 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 79343.5us
I20260709 13:09:42.111944 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:42.113298 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:42.086468 23624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
W20260709 13:09:42.087718 27479 consensus_meta.cc:287] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.954s	user 0.010s	sys 0.005s
I20260709 13:09:42.042459 27548 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:42.106031 24390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 620) took 1141 ms. Trace:
I20260709 13:09:42.125823 24390 rpcz_store.cc:276] 0709 13:09:40.964211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.986306 (+ 22095us) service_pool.cc:224] Handling call
0709 13:09:40.986643 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.908040 (+921397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.105782 (+197742us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54004713d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:42.105971 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117436672}
I20260709 13:09:42.115507 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:42.115235 23624 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:42.127341 23624 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.127388 23627 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:42.130249 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:42.131075 23627 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.133966 27548 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:42.120005 27457 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:42.114471 27471 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:42.117609 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:42.100700 27446 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:42.142169 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:42.119364 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:42.144800 27479 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:42.160229 27546 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:42.160995 24393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46580 (request call id 569) took 3766 ms (client timeout 1620 ms). Trace:
W20260709 13:09:42.161469 24393 rpcz_store.cc:269] 0709 13:09:38.395287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.395512 (+   225us) service_pool.cc:224] Handling call
0709 13:09:42.160734 (+3765222us) spinlock_profiling.cc:243] Waited 3.36 s on lock 0x7b54004218d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:42.160892 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7727857408}
I20260709 13:09:42.162730 27546 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:42.144508 23623 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:42.164564 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:42.165829 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:42.166750 27378 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:42.173481 27434 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:42.177704 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:42.178754 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:42.178927 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:42.179431 23769 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
W20260709 13:09:42.180922 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 154695us
W20260709 13:09:42.189893 24358 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.130s (SENT)
I20260709 13:09:42.146445 23743 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:42.191908 23626 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:09:42.193521 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47168.9us
I20260709 13:09:42.194402 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:42.166751 23623 raft_consensus.cc:2393] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:42.196640 23771 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:42.198591 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:42.198999 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:42.199221 23774 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:42.128800 27549 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:09:42.189265 23629 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 5.
I20260709 13:09:42.206310 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:42.214629 23774 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:42.146910 27442 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:42.207207 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 63793us
I20260709 13:09:42.173930 27440 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:42.227213 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:42.228783 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:42.220607 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:42.190013 23627 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:42.222589 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:42.232218 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:42.223409 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:42.196098 27320 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:42.234364 27446 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:42.235306 27432 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:42.235152 27056 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:42.234625 27495 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:42.237118 27495 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.237571 27495 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.195863 27501 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:42.245700 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:42.207495 27479 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:09:42.247848 27469 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:42.224620 23593 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:42.249184 27471 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:42.249542 27161 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:42.251111 27161 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:42.252153 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:42.255678 27479 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:42.256278 27479 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:42.195015 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:42.257323 27434 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:42.257185 27479 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:42.257939 27434 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:42.258973 27434 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.263664 27549 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:42.264684 27446 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:42.265142 27446 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:42.265285 27495 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:42.266173 27562 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:09:42.266028 27446 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:42.267660 27446 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.253677 23624 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:42.264310 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 69353.1us
W20260709 13:09:42.272514 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.258909 23527 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 6 to 5, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 5 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:09:42.278172 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47786.1us
W20260709 13:09:42.279692 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 221064us
I20260709 13:09:42.278769 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:42.278240 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:42.285475 24390 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:42.287463 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:42.287954 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:42.288583 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:42.289230 23624 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:42.288630 23777 raft_consensus.cc:3055] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:42.290002 23777 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:42.290218 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:42.290796 23777 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.279680 27428 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:42.279994 27432 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:09:42.309327 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 127330us
W20260709 13:09:42.310051 23742 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.878s (SENT)
I20260709 13:09:42.292171 27501 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:42.301898 23743 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:42.198602 23623 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:42.295326 27462 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:42.302127 27383 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:42.302492 27471 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:42.281802 27469 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:09:42.303223 27428 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:42.307777 27457 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:42.391489 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55762.6us
W20260709 13:09:42.393909 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 115744us
I20260709 13:09:42.399434 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:42.400174 23772 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.413637 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:42.389570 27428 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.342669 27462 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:42.342101 27429 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:42.309496 27546 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:09:42.297387 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:42.393131 27441 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.304441 27518 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:42.431497 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 105910us
I20260709 13:09:42.409709 27558 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:42.395890 27320 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:42.395807 27471 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:42.409529 27495 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:42.444635 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 142848us
W20260709 13:09:42.445266 23742 leader_election.cc:336] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.886s (SENT)
I20260709 13:09:42.420020 27056 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.417214 27543 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.453469 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:42.442749 23774 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:42.410451 27457 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.456957 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:42.491930 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:42.502844 24386 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:42.497067 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 51936us
I20260709 13:09:42.503549 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:09:42.504030 23742 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.178s (SENT)
I20260709 13:09:42.504462 24391 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:42.503969 23778 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:42.504649 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:09:42.522604 23593 leader_election.cc:336] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.720s (SENT)
I20260709 13:09:42.523476 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:42.453327 27558 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:42.499888 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48697.6us
I20260709 13:09:42.454501 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:42.424290 27473 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:09:42.553246 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 158239us
W20260709 13:09:42.567092 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.568409 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45876.1us
I20260709 13:09:42.452374 27320 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:42.504504 27544 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:09:42.575415 24386 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:42.576354 24391 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:09:42.491355 27440 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.585980 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 131589us
I20260709 13:09:42.587021 23743 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:42.587515 27560 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:09:42.501999 27341 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:42.595654 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:42.450392 27429 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:42.579250 27538 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:09:42.452816 27441 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.596446 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:42.609894 23622 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:42.611663 23777 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.614655 23621 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.580309 27496 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:42.617583 23669 leader_election.cc:400] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9.
I20260709 13:09:42.580967 27320 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:42.574316 27558 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.620769 23669 leader_election.cc:403] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:42.498050 27056 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:42.619706 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:42.631847 23593 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 3.252s (SENT)
I20260709 13:09:42.632354 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:42.632691 24391 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:09:42.613879 27462 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.638900 27341 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:42.639425 27341 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:42.639864 27341 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:42.642226 27427 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:42.625303 27383 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:42.643923 27578 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:09:42.643479 27383 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.505079 27432 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:42.639876 27579 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:09:42.600021 27440 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:42.651892 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 94266.8us
I20260709 13:09:42.655974 27590 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:42.656585 27550 consensus_queue.cc:1059] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:09:42.657534 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.673213 24358 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.807s (SENT)
I20260709 13:09:42.694061 27441 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:42.695973 27429 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:42.698199 27457 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:42.701609 27581 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:42.702603 27545 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:09:42.705359 27577 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:42.713050 23621 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
W20260709 13:09:42.715147 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 128185us
I20260709 13:09:42.619504 27458 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:42.725045 23777 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
W20260709 13:09:42.728410 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 110995us
I20260709 13:09:42.731791 23697 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:42.504367 27543 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.703541 27545 raft_consensus.cc:3055] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:42.736863 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:42.740388 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.745445 23697 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:42.740945 23593 leader_election.cc:336] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.641s (SENT)
I20260709 13:09:42.741462 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.746790 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:42.747031 23695 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:42.742750 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.744242 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:42.748041 23700 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:42.749454 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.659369 27161 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:42.753537 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 133920us
I20260709 13:09:42.750412 23700 raft_consensus.cc:2410] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:42.678282 27511 raft_consensus.cc:3055] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:42.752650 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.752812 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.753454 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.754449 23668 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:42.629825 27479 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:09:42.768580 23699 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:42.777371 27458 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.778000 27458 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:42.780272 27518 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:42.780648 27458 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:42.761543 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.782028 27495 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:42.782348 27543 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:42.782639 27495 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.783422 27440 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:42.761102 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.784595 23702 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:42.758122 27561 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:42.782246 23698 raft_consensus.cc:2410] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:09:42.788403 27561 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:42.788980 27561 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:42.790030 27561 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:42.791958 23742 leader_election.cc:336] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.615s (SENT)
I20260709 13:09:42.792498 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:42.793172 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:42.795192 27458 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:42.795984 27458 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:42.796063 23696 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:09:42.796671 23696 pending_rounds.cc:85] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 4
I20260709 13:09:42.796960 23696 pending_rounds.cc:107] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:09:42.797369 23696 raft_consensus.cc:2889] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:42.797055 27458 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:42.797799 23696 pending_rounds.cc:107] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:09:42.798141 23696 raft_consensus.cc:2889] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:42.777036 23697 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:42.783316 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:42.776687 23704 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:42.664727 27367 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:09:42.801303 27367 raft_consensus.cc:3055] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:42.801698 27367 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:42.802560 27367 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:42.803951 27367 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:42.756197 27429 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:42.768378 27511 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:42.806092 27320 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.807190 27511 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:42.808506 27511 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:42.809120 27056 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:42.812054 27574 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
W20260709 13:09:42.813750 27446 consensus_meta.cc:287] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.002s
I20260709 13:09:42.815676 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:42.816423 23698 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.627008 27471 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:42.822623 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.737337 27434 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.830052 27495 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:42.831100 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 84503.5us
I20260709 13:09:42.831957 23743 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:42.832437 27493 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:42.832901 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:42.834455 27518 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:42.834527 27593 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:42.835105 27518 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:42.836236 27593 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:42.836081 27518 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.836800 27593 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:42.837821 23593 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.696s (SENT)
I20260709 13:09:42.838340 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:42.839154 27427 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:42.839562 27495 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:42.745185 27545 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:42.843901 27545 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:42.845328 27545 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.848145 27479 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:42.848659 27479 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:42.849151 27558 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.849860 27341 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:42.851191 27479 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:42.852559 27341 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:42.826305 23698 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
W20260709 13:09:42.853657 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 61738.8us
W20260709 13:09:42.826756 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 57689.3us
I20260709 13:09:42.859968 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:42.860713 23772 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:42.844045 27593 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:42.872488 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.853485 27558 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:42.873380 23698 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:42.875957 23698 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:42.876426 23704 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:42.877374 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:42.877630 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.877985 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.878285 23704 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:42.879141 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.878588 23695 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:42.879678 23704 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:42.881264 23703 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:42.881381 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:42.881953 23695 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.882295 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.883333 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.884148 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.869674 27427 consensus_queue.cc:1059] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:09:42.888417 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:42.888968 23771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.001s	sys 0.008s
W20260709 13:09:42.889333 23771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.001s	sys 0.008s
I20260709 13:09:42.881973 23702 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:42.891557 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:42.869616 27367 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:42.892187 23704 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.888232 27320 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:42.911399 23623 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:42.895393 27367 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:42.925837 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.953227 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.954041 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.955056 23698 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:42.924388 27590 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:42.962071 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:42.966578 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.968981 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:42.972124 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.972127 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:42.974393 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.975996 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.976136 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:42.976825 23628 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:42.978331 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.979033 23698 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:42.979883 27367 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:42.980854 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:42.981389 23703 raft_consensus.cc:2368] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7.
I20260709 13:09:42.973130 27446 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.991004 23628 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:09:42.996721 23704 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:43.011368 23702 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:43.019791 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:43.018426 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:43.022186 24388 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:42.987161 27434 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9.
I20260709 13:09:43.025082 23700 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:43.023794 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:43.012662 27378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.001s	sys 0.016s
I20260709 13:09:43.027906 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.029868 23704 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:09:43.025015 27428 consensus_meta.cc:287] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.003s
I20260709 13:09:43.063239 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:43.063347 27428 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:43.065230 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.066390 23704 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:43.066862 27428 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:43.010959 27446 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:43.032428 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.069727 23702 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:43.042321 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:43.043113 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:43.029213 27378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.001s	sys 0.016s
I20260709 13:09:43.043208 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:43.045528 27479 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.069346 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.073688 27557 consensus_queue.cc:1059] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:43.074173 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:43.074661 27485 raft_consensus.cc:3055] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:43.045645 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:43.050249 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.075311 27485 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:43.076299 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.076771 27485 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:43.077666 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:43.078974 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.074342 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.080451 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.081947 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:43.051877 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.084725 23627 raft_consensus.cc:2410] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:43.052764 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.083230 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.055828 23695 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:43.056653 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.058755 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.058938 23701 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:43.060231 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:43.034318 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.075107 23704 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:43.078787 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.050876 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.089462 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:43.091625 23620 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:43.092576 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.096720 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:43.099476 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.099668 23695 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:43.103000 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:43.103073 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:43.104422 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:43.105331 23626 raft_consensus.cc:2410] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:43.105207 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.104343 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.107566 23698 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:09:43.107086 23620 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:09:43.111670 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 51517.6us
I20260709 13:09:43.101336 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.111709 23698 pending_rounds.cc:85] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 6
I20260709 13:09:43.112757 23698 pending_rounds.cc:107] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:09:43.112695 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.113233 23698 raft_consensus.cc:2889] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:43.111512 23628 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:09:43.113992 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.114260 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.123190 23620 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:09:43.124778 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.124769 23626 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:09:43.125134 23620 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:09:43.126024 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.127674 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.127283 23592 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:43.144531 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.122268 23702 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:43.145820 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.068728 27432 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:09:43.061683 27511 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:09:43.148145 23620 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:09:43.147261 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.153553 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.110441 27383 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:43.155025 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.156100 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.156474 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.156613 27603 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:43.145685 27056 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:43.191087 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:43.189441 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:43.163370 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:43.164094 27546 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:43.166672 27607 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:09:43.126991 27367 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:43.186960 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.153136 27161 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:43.159951 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.190264 24390 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:43.192869 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.186064 23703 raft_consensus.cc:2376] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9. Re-sending same reply.
W20260709 13:09:43.204061 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.197010 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:43.204720 23771 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.198880 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:43.207043 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:43.196920 27367 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:43.202708 27543 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:43.207162 23669 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:43.213502 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:43.195515 27235 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.208408 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:43.189570 27462 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:43.208619 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:43.215927 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:43.222239 23772 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:43.222574 23620 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:43.216637 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:43.224896 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:43.226436 23772 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:43.209918 27471 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:43.228259 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.212241 27367 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:43.228937 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 68469.8us
I20260709 13:09:43.228878 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:43.220723 27561 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.212270 27493 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:43.209687 27546 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:43.230880 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:43.236507 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:43.237469 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:43.237643 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:43.258700 23770 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:09:43.260089 27543 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:43.239286 23593 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:43.217788 27469 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:43.229743 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:43.261276 23769 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:43.241271 23703 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:43.214578 27458 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:09:43.252710 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:43.268282 23771 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:09:43.223994 27462 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:43.269297 23703 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:43.270097 23701 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:43.270644 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 43943.5us
I20260709 13:09:43.276002 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:43.276315 27469 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:43.277787 27613 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:43.278100 27606 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:09:43.278385 27613 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:43.269474 27611 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:43.279241 27613 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:43.279436 27611 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:43.282259 27611 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:43.284446 27546 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:43.285866 27584 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.701s	user 0.002s	sys 0.000s
I20260709 13:09:43.287765 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:43.288041 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2571) took 1259 ms. Trace:
I20260709 13:09:43.288373 23625 rpcz_store.cc:276] 0709 13:09:42.028223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.030359 (+  2136us) service_pool.cc:224] Handling call
0709 13:09:42.030683 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.031021 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.031051 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.038302 (+  7251us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.309706 (+271404us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:42.309885 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.309953 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.285326 (+975373us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:43.287751 (+  2425us) raft_consensus.cc:1685] finished
0709 13:09:43.287773 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.287970 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":495,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7772,"spinlock_wait_cycles":27970816,"thread_start_us":232856,"threads_started":1,"wal-append.queue_time_us":375512}
I20260709 13:09:43.289875 27122 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.328890 23701 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:43.272187 27446 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:43.341576 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45394.2us
W20260709 13:09:43.343860 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 67947.2us
I20260709 13:09:43.345588 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:43.347124 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 71259.7us
I20260709 13:09:43.249569 27493 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:43.340842 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 64945.4us
I20260709 13:09:43.361299 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:43.264863 27434 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:09:43.361800 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 169110us
I20260709 13:09:43.367182 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:43.294642 27471 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:43.363220 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.370039 23701 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:43.373385 27469 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:43.374217 27345 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:43.374662 27345 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:43.347882 27478 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:43.374915 27493 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:43.376379 23775 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:43.331591 23704 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:43.371477 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.396202 23701 pending_rounds.cc:85] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 9
I20260709 13:09:43.396649 23701 pending_rounds.cc:107] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:09:43.396991 23701 raft_consensus.cc:2889] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:43.375524 27345 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:43.400365 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.377681 27235 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.378602 27479 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:09:43.409855 27367 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:43.395395 27473 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.395260 27161 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:43.401958 27557 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:43.401643 27345 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:43.453775 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 166118us
W20260709 13:09:43.453909 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 75099.3us
W20260709 13:09:43.459906 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 114212us
I20260709 13:09:43.462186 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:43.470825 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:43.364662 27543 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:43.475845 27618 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:43.475181 23593 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.402662 27621 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:09:43.405473 27471 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:09:43.418288 27161 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:43.483364 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.449959 27479 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:43.481194 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 107979us
I20260709 13:09:43.450865 27056 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:09:43.478941 27618 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:43.483378 27161 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:43.484634 27427 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:43.487759 27473 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:43.488432 27479 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:43.540351 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.525660 27618 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.506131 27434 consensus_queue.cc:1059] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:09:43.547330 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:43.549214 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 74222us
I20260709 13:09:43.550747 23593 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.554414 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.559296 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.489490 27440 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:09:43.565955 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.533900 27473 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:43.555964 27613 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:43.520879 27549 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:09:43.521521 27628 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:09:43.547897 27427 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:43.527065 27561 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:09:43.583865 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 110396us
I20260709 13:09:43.592667 27367 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:43.594308 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:43.568169 27621 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:43.576800 27462 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:43.546944 27557 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:09:43.605019 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:43.609061 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:43.609297 23773 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:43.609733 23772 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:43.629029 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:43.631129 23623 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:43.632393 23625 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:43.633105 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.637719 23625 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:43.615038 27613 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:43.648195 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:43.649307 23621 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:43.649582 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:43.594470 27429 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:09:43.619166 27640 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:43.625342 27367 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:43.636390 27564 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.663411 23627 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:43.595324 27479 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:43.684535 23628 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
W20260709 13:09:43.684877 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49561.1us
I20260709 13:09:43.637161 27473 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:43.680852 27549 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:43.696843 27479 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:43.705072 27623 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:09:43.712435 27518 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:43.713287 23778 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:09:43.713799 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.714244 27425 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:43.715031 23772 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:09:43.717363 27617 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:09:43.718080 27473 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.698951 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:43.805433 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 106583us
W20260709 13:09:43.782222 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.802227 23627 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
W20260709 13:09:43.750711 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.806813 23627 pending_rounds.cc:85] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 8
I20260709 13:09:43.807173 23627 pending_rounds.cc:107] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:09:43.807463 23627 raft_consensus.cc:2889] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:43.807657 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.698077 27235 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:43.805665 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 200723us
I20260709 13:09:43.668252 27564 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:43.806401 23743 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:43.863000 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 56706.1us
I20260709 13:09:43.869004 23628 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:09:43.871142 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 53602.2us
I20260709 13:09:43.873373 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:43.690622 27427 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:43.898427 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 332526us
I20260709 13:09:43.868891 27122 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:43.907618 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:43.909428 27631 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 13:09:43.910981 27646 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:09:43.883647 27518 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:43.921859 27518 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:43.924933 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:43.925745 23703 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.931231 27628 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:43.932233 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.933420 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:43.934672 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.936301 27613 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:43.937189 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.895744 27462 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:43.946046 23703 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:09:43.868124 27235 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:43.880386 27543 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:09:43.913359 27122 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:43.869683 27471 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:09:43.967070 27235 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:43.950771 27613 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.952548 27628 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:43.975221 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.959431 27462 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:43.922920 27518 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.007336 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:44.008252 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 59505.5us
I20260709 13:09:44.010238 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:44.010538 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:44.011433 27634 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:44.012799 23667 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:44.013589 27634 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:44.016955 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:44.017872 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 207375us
I20260709 13:09:44.019884 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:43.980059 27654 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.969277 27618 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:43.976404 27161 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:44.039251 23742 connection.cc:256] RPC call timeout handler was delayed by -1.0325733929998933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 13:09:44.014860 27478 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:44.029866 27235 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.045013 27651 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:44.053881 27651 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:44.054862 27651 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.055665 27618 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:44.056063 27644 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:44.059933 27564 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:44.052418 27471 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:44.060776 27345 consensus_meta.cc:287] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.000s
I20260709 13:09:44.021109 27122 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.062300 27122 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:44.047216 27161 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:44.047847 23629 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:44.045233 27641 log.cc:927] Time spent T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:09:44.053196 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.030434 27649 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:09:44.098644 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1781) took 1220 ms. Trace:
I20260709 13:09:44.099117 23700 rpcz_store.cc:276] 0709 13:09:42.877959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.878862 (+   903us) service_pool.cc:224] Handling call
0709 13:09:42.879193 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.028103 (+148910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.098378 (+1070275us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54000a0fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:44.098576 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335120000}
W20260709 13:09:44.106915 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.121316 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:44.124557 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:44.125209 23700 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.035682 27654 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.080884 27479 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:09:44.132608 23593 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.164s (SENT)
I20260709 13:09:44.147028 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:44.148058 27654 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:44.148393 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:44.149402 23700 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:44.151402 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:44.160071 27663 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:44.160673 27663 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:44.161563 27663 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.076074 27462 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:44.179771 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 139607us
W20260709 13:09:44.190979 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 117440us
W20260709 13:09:44.192271 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.195756 23625 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:44.204402 23777 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:44.211272 27501 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.212009 27501 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.212932 27590 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:44.212337 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:44.218880 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:44.204406 27506 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.207298 27564 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.221746 27595 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:44.222148 27663 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.209582 27520 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:44.227370 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:44.226567 27661 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.227977 27520 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.230712 27661 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.232474 27520 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:44.233933 27664 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.234545 27664 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.229285 27291 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:44.236398 27672 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:09:44.236913 27664 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:44.238292 27501 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:44.226307 27506 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.227347 27564 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.240061 27485 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.242403 27564 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:44.243865 27425 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:44.244563 27506 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:44.244647 27425 consensus_queue.cc:1243] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:44.221959 27657 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.249271 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:44.252511 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:44.255807 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:44.255229 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:44.233142 27520 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:44.261560 27520 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:44.262006 27520 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:44.263965 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 1791) took 1049 ms. Trace:
I20260709 13:09:44.264394 23775 rpcz_store.cc:276] 0709 13:09:43.214244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.215593 (+  1349us) service_pool.cc:224] Handling call
0709 13:09:44.263786 (+1048193us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540014e454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:44.263907 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360443136}
I20260709 13:09:44.258931 27595 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:09:44.267333 27595 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:44.267755 27595 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:44.268658 27595 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.269974 27595 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.278507 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:44.280151 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:44.281273 24388 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:44.284425 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:44.235119 27661 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:44.286154 23742 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:44.260774 27664 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.228348 27663 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.302692 24390 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:09:44.303345 24390 pending_rounds.cc:85] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Aborting all ops after (but not including) 10
I20260709 13:09:44.303682 24390 pending_rounds.cc:107] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:09:44.303996 24390 raft_consensus.cc:2889] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:44.273592 27657 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.306460 27661 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:44.308413 27657 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:44.314105 27663 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:44.299016 27664 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.315587 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:44.317953 27664 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:44.319392 27604 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.133s	user 0.000s	sys 0.013s
I20260709 13:09:44.321049 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 707) took 1712 ms. Trace:
I20260709 13:09:44.319415 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:44.321458 23624 rpcz_store.cc:276] 0709 13:09:42.609103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.610217 (+  1114us) service_pool.cc:224] Handling call
0709 13:09:42.610496 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.637410 (+ 26914us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:42.716702 (+ 79292us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.024870 (+308168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:43.024944 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:43.025001 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.320823 (+1295822us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b54000dc0d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:44.320869 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.320992 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12545,"prepare.queue_time_us":79481,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":13761,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"spinlock_wait_cycles":61136640,"thread_start_us":295140,"threads_started":1,"wal-append.queue_time_us":385357,"wal-append.run_cpu_time_us":1364,"wal-append.run_wall_time_us":1069424}
I20260709 13:09:44.297889 27518 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.328616 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:44.329730 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1771) took 1507 ms. Trace:
I20260709 13:09:44.330154 23697 rpcz_store.cc:276] 0709 13:09:42.822625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.328256 (+1505631us) service_pool.cc:224] Handling call
0709 13:09:44.329640 (+  1384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:44.330693 23625 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:44.333602 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:44.334358 23624 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:44.336140 27462 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:44.336308 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:44.337265 27428 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:44.337647 27428 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.337677 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2003) took 1098 ms. Trace:
I20260709 13:09:44.338169 27428 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.338236 23777 rpcz_store.cc:276] 0709 13:09:43.239673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.239806 (+   133us) service_pool.cc:224] Handling call
0709 13:09:43.240163 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.205038 (+964875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.337440 (+132402us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b540016b054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:44.337620 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2216967040}
I20260709 13:09:44.343005 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:44.366561 27496 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.367313 27496 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.368407 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2359) took 1375 ms. Trace:
I20260709 13:09:44.368824 23698 rpcz_store.cc:276] 0709 13:09:42.993343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.995564 (+  2221us) service_pool.cc:224] Handling call
0709 13:09:42.995866 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.113767 (+117901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.368015 (+1254248us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540026acd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:44.368350 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252323584}
I20260709 13:09:44.362533 27518 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.374210 27446 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:44.374744 27446 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:44.374729 27664 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.377532 27496 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:44.383260 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:44.376585 27664 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:44.410208 27627 log.cc:927] Time spent T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.771s	user 0.003s	sys 0.000s
I20260709 13:09:44.411276 27664 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:44.414358 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:44.418450 27622 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.419008 27622 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.422739 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 465) took 1321 ms. Trace:
I20260709 13:09:44.423163 23704 rpcz_store.cc:276] 0709 13:09:43.101707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.102765 (+  1058us) service_pool.cc:224] Handling call
0709 13:09:44.422571 (+1319806us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400131fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:44.422677 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404900224}
I20260709 13:09:44.376582 27446 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.433250 27428 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.435493 27622 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:44.437350 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:44.437976 23622 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.412871 27485 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:44.445456 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:44.449613 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:44.450443 24390 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:44.463106 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:44.465111 23622 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:44.466960 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:44.435549 27428 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:44.464223 27446 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:44.468713 27664 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:44.461565 27485 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.479846 23622 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:44.475589 27657 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:44.476240 27258 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:44.476740 27428 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.478371 27593 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.479228 27664 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.488974 27595 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:09:44.495410 27485 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:44.499948 27685 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:44.500550 27685 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.500805 27442 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.507479 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:44.516758 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:44.489347 27657 raft_consensus.cc:697] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:44.492262 27664 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.490530 27428 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.553359 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 1992) took 1358 ms. Trace:
I20260709 13:09:44.553757 23778 rpcz_store.cc:276] 0709 13:09:43.194535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.194691 (+   156us) service_pool.cc:224] Handling call
0709 13:09:43.195112 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.796700 (+601588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.553098 (+756398us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b5400347954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:44.553300 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191065856}
I20260709 13:09:44.534073 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:44.555473 23777 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:44.557647 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:44.491950 27593 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.543332 27685 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:44.546962 23628 raft_consensus.cc:1217] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Deduplicated request from leader. Original: 7.5->[10.6-10.6]   Dedup: 10.6->[]
I20260709 13:09:44.560489 23628 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:09:44.507529 27493 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.490815 27258 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.518533 27442 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.595158 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:44.552841 27496 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:44.592587 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:44.593531 23627 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:44.597524 23769 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:09:44.600540 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.602459 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:44.584713 27161 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:44.606241 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:44.613564 23625 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
W20260709 13:09:44.604755 27624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.012s	sys 0.025s
I20260709 13:09:44.620592 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:44.621390 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:44.622025 27548 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.622746 27657 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.589929 27320 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:44.630339 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.682408 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.630813 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:44.631879 27653 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.685410 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:44.632551 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:44.632721 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:44.632666 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:44.633509 27479 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.581295 27520 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.600898 27549 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.634040 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:44.634423 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:44.634963 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2368) took 1602 ms. Trace:
I20260709 13:09:44.637919 23770 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:44.634461 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:44.637975 27495 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:44.639387 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:44.634461 27593 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:44.640471 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 468) took 1519 ms. Trace:
I20260709 13:09:44.640388 27595 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:44.640872 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:44.595280 27518 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 10.6, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:09:44.586879 27493 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:44.646106 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:44.650735 27258 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:44.625540 27573 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.657506 23620 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:44.632033 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:44.688020 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:44.612866 27496 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:44.921957 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 326736us
I20260709 13:09:44.956750 24390 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:45.172420 23698 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:45.173959 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:45.174746 27495 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:45.176122 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 489662us
I20260709 13:09:45.176494 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:45.177181 23697 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:45.174057 23625 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:45.178889 24388 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:45.053783 27291 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.892359 27611 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:45.178129 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:44.959635 27458 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.720082 27320 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.181912 27458 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:45.183804 23700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.013s	sys 0.000s
W20260709 13:09:45.184324 23700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.013s	sys 0.000s
W20260709 13:09:44.985409 27652 log.cc:927] Time spent T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:09:45.184885 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:44.654742 27624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.013s	sys 0.026s
I20260709 13:09:44.812574 27501 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.876052 27634 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.680384 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:44.681511 27485 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:45.181914 23699 rpcz_store.cc:276] 0709 13:09:43.120601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.336253 (+215652us) service_pool.cc:224] Handling call
0709 13:09:43.336634 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.337130 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.337171 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.497220 (+1160049us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b2c00001418. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:09:44.497627 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.580642 (+ 83015us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:44.580677 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.580742 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.640150 (+ 59408us) raft_consensus.cc:1685] finished
0709 13:09:44.640170 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.640411 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27437,"raft.queue_time_us":118,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":22200,"spinlock_wait_cycles":32639232,"thread_start_us":82689,"threads_started":1,"wal-append.queue_time_us":117601}
I20260709 13:09:45.180670 27291 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.180778 27611 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.191120 24357 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:45.194206 23769 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:45.185583 23701 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:44.612949 27161 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:45.212606 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:44.812999 27506 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:45.193125 27006 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:45.187389 27633 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:44.960043 27564 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.218072 23774 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:44.865489 27198 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.832518 27345 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:44.735822 27653 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.876132 27622 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:44.900084 27473 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:45.250624 27473 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.251065 27493 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.232326 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:45.252619 24357 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:45.232887 27161 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.211187 27518 consensus_queue.cc:1243] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:45.192939 27549 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:44.690578 27548 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.243912 27345 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.237437 27667 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:45.204739 27428 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:45.214999 27634 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.207372 27479 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.240943 27506 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.298702 27291 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.300426 27473 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.300559 27345 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.217648 27501 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.246548 27458 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:45.423754 23622 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.005s	sys 0.007s
W20260709 13:09:45.503698 23622 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.005s	sys 0.008s
I20260709 13:09:45.429499 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1801) took 1509 ms. Trace:
I20260709 13:09:45.506403 23695 rpcz_store.cc:276] 0709 13:09:43.919535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.149305 (+229770us) service_pool.cc:224] Handling call
0709 13:09:44.149712 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.590299 (+440587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.590330 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.590914 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.049460 (+458546us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:45.171297 (+121837us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.208881 (+ 37584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.208957 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.428648 (+219691us) raft_consensus.cc:1685] finished
0709 13:09:45.428710 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.429169 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":498284,"prepare.queue_time_us":136678,"prepare.run_wall_time_us":45,"raft.queue_time_us":482550,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":9786,"spinlock_wait_cycles":17631616,"thread_start_us":414483,"threads_started":1,"wal-append.queue_time_us":694132}
I20260709 13:09:45.509642 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:45.511155 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:45.492590 27712 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:45.511961 23621 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.004s	sys 0.003s
I20260709 13:09:45.182108 23696 rpcz_store.cc:276] 0709 13:09:43.032587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.149606 (+117019us) service_pool.cc:224] Handling call
0709 13:09:43.150003 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.155491 (+  5488us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:44.348680 (+1193189us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b1800387100. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b44d043c7 00007f2b413169a7 00007f2b413260bf 00007f2b41326038
0709 13:09:44.380956 (+ 32276us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.624073 (+243117us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.624267 (+   194us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.624708 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.624845 (+   137us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:44.625049 (+   204us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.625204 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.625395 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.634743 (+  9348us) raft_consensus.cc:1685] finished
0709 13:09:44.634772 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.634908 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159301,"prepare.queue_time_us":130759,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":113,"raft.queue_time_us":160807,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":8295,"spinlock_wait_cycles":21095808,"thread_start_us":100482,"threads_started":2,"wal-append.queue_time_us":95602}
I20260709 13:09:45.514817 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2606) took 1884 ms. Trace:
I20260709 13:09:45.515166 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:45.430028 23625 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:45.431216 23704 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:45.183698 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:45.496253 27561 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:45.521380 27561 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:45.431492 23741 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.000s	sys 0.026s
W20260709 13:09:45.528083 23741 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.000s	sys 0.026s
I20260709 13:09:45.528162 23697 raft_consensus.cc:2376] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8. Re-sending same reply.
I20260709 13:09:45.531984 27469 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:45.532491 27469 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:45.493119 27520 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:45.492362 27496 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.534307 27469 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.516921 23696 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
W20260709 13:09:45.432155 23744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.007s	sys 0.018s
W20260709 13:09:45.535979 23744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.008s	sys 0.019s
I20260709 13:09:45.537930 23696 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:09:45.432426 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:45.231381 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:45.434358 23743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.010s	sys 0.032s
W20260709 13:09:45.435005 23771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.005s	sys 0.011s
W20260709 13:09:45.435536 23773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.006s	sys 0.010s
I20260709 13:09:45.257951 27320 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.439633 27473 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:45.542294 23743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.011s	sys 0.032s
I20260709 13:09:45.542459 27473 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.441583 27558 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:45.544338 27558 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.547271 27558 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.548017 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:45.548893 23771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.006s	sys 0.011s
I20260709 13:09:45.442183 27647 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:45.550033 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:45.550020 27647 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.551257 23620 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
W20260709 13:09:45.552069 23773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.007s	sys 0.011s
I20260709 13:09:45.552538 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:45.495098 27479 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.553732 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:45.289994 27667 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.232170 27485 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.304365 27545 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:45.246122 27564 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.568941 27647 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.570714 27564 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:45.571133 27485 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.254765 27622 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.574441 27473 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.245589 27633 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.575428 23702 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:09:45.341861 27634 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.355777 27653 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.576018 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:45.264225 27656 consensus_queue.cc:1059] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
W20260709 13:09:45.373335 27664 consensus_meta.cc:287] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.814s	user 0.009s	sys 0.003s
I20260709 13:09:45.474213 27718 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.577750 27718 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.249168 27198 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.579293 24391 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:45.475209 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 794706us
I20260709 13:09:45.581002 27667 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.581537 27198 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.583396 24393 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:45.241258 27006 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.585431 27624 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:45.585924 27624 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:45.499334 24415 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260709 13:09:45.587052 27655 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:45.500801 23777 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:45.491665 27549 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.502314 27611 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.512617 27712 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.216723 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:45.612911 23699 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
W20260709 13:09:45.513000 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 302677us
I20260709 13:09:45.258666 27258 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:45.432200 23698 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:45.531374 23697 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:45.554016 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:45.539572 23696 pending_rounds.cc:85] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 2
I20260709 13:09:45.548043 27291 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:45.556074 23621 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.004s	sys 0.004s
I20260709 13:09:45.515318 23629 rpcz_store.cc:276] 0709 13:09:43.630295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.630401 (+   106us) service_pool.cc:224] Handling call
0709 13:09:43.630644 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.069080 (+438436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.514185 (+1445105us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54002b3c54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:45.514553 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958903168}
I20260709 13:09:45.527555 27561 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.621793 27291 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.622525 23620 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:45.617982 23697 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:45.518992 27548 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.557128 27469 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:45.574559 27622 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.577809 27664 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.319111 27693 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:45.500936 27506 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:45.634222 27693 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:45.634663 27656 raft_consensus.cc:3055] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:45.634824 27693 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:45.635192 27656 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:45.636617 27656 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.638319 27656 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.639505 27712 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.616752 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:45.640226 23703 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:45.640235 27718 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.588022 23700 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:45.588642 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:45.590453 23701 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:45.621547 23696 pending_rounds.cc:107] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:45.588786 27458 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.643622 23696 raft_consensus.cc:2889] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:45.592868 27633 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.588378 27006 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.647775 27291 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.648574 27664 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.649346 23628 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:45.644591 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2398) took 1002 ms. Trace:
I20260709 13:09:45.593441 27495 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.656023 27501 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:45.656637 23593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.006s	sys 0.018s
I20260709 13:09:45.656173 27520 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:45.657712 27700 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.669582 27520 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.670203 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 2388) took 1039 ms. Trace:
I20260709 13:09:45.670588 23704 rpcz_store.cc:276] 0709 13:09:44.630686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.633783 (+  3097us) service_pool.cc:224] Handling call
0709 13:09:45.669916 (+1036133us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400357354. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:45.670115 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578267008}
I20260709 13:09:45.658627 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:45.659137 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.672632 23593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.007s	sys 0.018s
I20260709 13:09:45.661454 23696 rpcz_store.cc:276] 0709 13:09:44.641859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.536419 (+894560us) service_pool.cc:224] Handling call
0709 13:09:45.537144 (+   725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.644314 (+107170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.644531 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:45.665483 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 412799us
I20260709 13:09:45.666453 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2630) took 1107 ms. Trace:
I20260709 13:09:45.667045 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1885) took 1088 ms. Trace:
I20260709 13:09:45.674510 23628 rpcz_store.cc:276] 0709 13:09:44.578359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.579571 (+  1212us) service_pool.cc:224] Handling call
0709 13:09:44.581802 (+  2231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.665705 (+1083903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.666719 (+  1014us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540037da54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:45.666964 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454134656}
W20260709 13:09:45.675032 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 496791us
I20260709 13:09:45.658679 27591 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:45.669575 27700 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.676033 27591 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.678233 27591 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:45.674206 23624 rpcz_store.cc:276] 0709 13:09:44.558909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.559620 (+   711us) service_pool.cc:224] Handling call
0709 13:09:44.559951 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.606429 (+ 46478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.606474 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:44.606538 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:44.606583 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.666005 (+1059422us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b540012dc54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:45.666072 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.666256 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106414848}
I20260709 13:09:45.680649 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1818) took 1015 ms. Trace:
I20260709 13:09:45.680913 24358 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:45.681116 23696 rpcz_store.cc:276] 0709 13:09:44.664780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.679574 (+1014794us) service_pool.cc:224] Handling call
0709 13:09:45.680011 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.680219 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.680243 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.680309 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:45.680345 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.680426 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.680580 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.672079 27458 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.685676 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2401) took 1042 ms. Trace:
I20260709 13:09:45.686169 23695 rpcz_store.cc:276] 0709 13:09:44.647415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.561322 (+913907us) service_pool.cc:224] Handling call
0709 13:09:45.652040 (+ 90718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.685264 (+ 33224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.685294 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.685378 (+    84us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:45.685417 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.685481 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.685602 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.687691 23704 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:45.688107 27198 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:45.688477 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1816) took 1027 ms. Trace:
I20260709 13:09:45.688910 27198 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:45.688841 23704 rpcz_store.cc:276] 0709 13:09:44.661148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.671438 (+1010290us) service_pool.cc:224] Handling call
0709 13:09:45.687217 (+ 15779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.688215 (+   998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.688399 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.690979 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 483) took 1024 ms. Trace:
I20260709 13:09:45.690668 27198 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.587416 27624 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.694809 27593 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.695590 27593 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.697060 24359 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:45.698230 27655 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:45.699304 27520 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.678254 27700 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.704762 27593 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:45.706610 27442 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.691382 23704 rpcz_store.cc:276] 0709 13:09:44.666838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.689957 (+1023119us) service_pool.cc:224] Handling call
0709 13:09:45.690418 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.690644 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.690671 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.690732 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:45.690771 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.690837 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.690932 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:45.667807 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 1.02679e+06us
I20260709 13:09:45.702986 27161 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.723717 23697 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:45.728637 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1809) took 1069 ms. Trace:
I20260709 13:09:45.724601 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 481) took 1058 ms. Trace:
I20260709 13:09:45.730185 23695 rpcz_store.cc:276] 0709 13:09:44.666174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.687193 (+1021019us) service_pool.cc:224] Handling call
0709 13:09:45.687675 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.724208 (+ 36533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.724241 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.724311 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:45.724354 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.724413 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.724541 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.729137 23697 rpcz_store.cc:276] 0709 13:09:44.658941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.624522 (+965581us) service_pool.cc:224] Handling call
0709 13:09:45.723023 (+ 98501us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b580000ff98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:09:45.723275 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.728301 (+  5026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.728564 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7060736}
I20260709 13:09:45.736296 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2633) took 1083 ms. Trace:
I20260709 13:09:45.737840 27658 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.736862 23621 rpcz_store.cc:276] 0709 13:09:44.652623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.653350 (+   727us) service_pool.cc:224] Handling call
0709 13:09:44.653747 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.654012 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:45.624051 (+970039us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.732018 (+107967us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.735796 (+  3778us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:45.735904 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.736023 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.736234 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":713961,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":58568,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":2322,"thread_start_us":1013421,"threads_started":2,"wal-append.queue_time_us":50817}
I20260709 13:09:45.738489 27658 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:45.742588 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 84120.6us
I20260709 13:09:45.757946 27593 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:45.758499 27593 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:45.758927 27593 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.759153 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1806) took 1101 ms. Trace:
I20260709 13:09:45.759052 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:45.759653 23700 rpcz_store.cc:276] 0709 13:09:44.657946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.231023 (+573077us) service_pool.cc:224] Handling call
0709 13:09:45.758947 (+527924us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b540026b1d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:45.759095 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87059712}
I20260709 13:09:45.760780 27495 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:45.760952 27712 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:45.761497 27495 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.761775 27712 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.760826 27664 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.764801 27495 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.764693 27664 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.765254 27618 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:45.767102 27712 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.768276 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:45.769034 24389 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.769591 27664 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.768301 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:45.771759 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:45.775079 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:45.776055 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:45.776502 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1815) took 1115 ms. Trace:
I20260709 13:09:45.776883 23701 rpcz_store.cc:276] 0709 13:09:44.660858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.673090 (+1012232us) service_pool.cc:224] Handling call
0709 13:09:45.775813 (+102723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.776175 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.776200 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.776258 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:45.776307 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.776361 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.776452 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.777915 27712 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:45.778357 27712 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:45.778837 27712 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.778900 27591 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:45.781188 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 2397) took 1139 ms. Trace:
I20260709 13:09:45.781778 23698 rpcz_store.cc:276] 0709 13:09:44.641620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.173645 (+532025us) service_pool.cc:224] Handling call
0709 13:09:45.780939 (+607294us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400196254. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:45.781126 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590789888}
I20260709 13:09:45.782372 27658 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:45.784246 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2403) took 1127 ms. Trace:
I20260709 13:09:45.784468 27458 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:45.784700 23702 rpcz_store.cc:276] 0709 13:09:44.657303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.584790 (+927487us) service_pool.cc:224] Handling call
0709 13:09:45.585287 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.631415 (+ 46128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.631453 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.631527 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:45.631614 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.783979 (+152365us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54001324d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:45.784030 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.784175 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25943936}
I20260709 13:09:45.786191 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:45.787297 27442 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:45.789250 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:45.790323 27442 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:45.790838 27442 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:45.791334 27442 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.774209 27383 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:45.795049 27383 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:45.795508 27383 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.797500 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:45.798763 27428 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:45.800951 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:45.802500 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:45.802572 27291 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:45.807858 27442 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:45.809705 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:45.811362 27618 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.811750 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1814) took 1175 ms. Trace:
I20260709 13:09:45.812016 27618 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:45.812166 23776 rpcz_store.cc:276] 0709 13:09:44.636646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.189300 (+552654us) service_pool.cc:224] Handling call
0709 13:09:45.189730 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.434740 (+245010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.434838 (+    98us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.434915 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:45.434961 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.811344 (+376383us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b540032fd54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:45.811393 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.811572 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561361280}
I20260709 13:09:45.813798 23527 catalog_manager.cc:5697] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.815937 27621 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.802737 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:45.814661 27618 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:45.852035 27428 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:45.853181 27428 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:45.853505 27428 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:45.854482 27428 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.851404 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:45.820960 27621 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:45.781111 27591 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.866626 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 169717us
I20260709 13:09:46.110321 27718 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.157078 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.157568 27611 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:46.158342 27611 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:45.904217 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 62314.4us
I20260709 13:09:45.864131 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 823) took 1302 ms. Trace:
I20260709 13:09:46.066818 23774 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:45.855719 24389 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:45.857236 23527 catalog_manager.cc:5697] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:09:46.105844 27489 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.180141 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:46.180403 27489 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.181114 27611 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:46.182051 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.182243 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:45.820621 27664 raft_consensus.cc:476] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:45.909536 27367 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.272s
W20260709 13:09:46.135707 27721 log.cc:927] Time spent T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 13:09:46.064488 27434 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.160745 23777 rpcz_store.cc:276] 0709 13:09:44.562117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.564270 (+  2153us) service_pool.cc:224] Handling call
0709 13:09:44.564647 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.646671 (+1082024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.863638 (+216967us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54002cb0d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:45.863990 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151521152}
I20260709 13:09:45.820225 27667 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.248615 27603 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:46.248381 27549 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:09:46.245353 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 63514.1us
I20260709 13:09:45.884583 27658 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:46.109361 27709 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:45.910048 27618 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.926976 27633 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.016078 27291 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:46.186367 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 383748us
I20260709 13:09:46.157522 27718 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:46.087749 27654 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.101320 27685 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:46.131863 27432 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:45.950927 27520 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:46.027781 27640 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:45.865589 27591 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.123132 27495 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:46.260497 27429 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:46.261866 27603 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:46.262526 23592 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:46.263427 27715 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.777s	user 0.003s	sys 0.000s
I20260709 13:09:46.265223 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.108175 27713 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.855654 27428 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:46.186765 27621 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:45.897751 27458 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:46.300477 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:45.859997 27649 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:46.133637 27693 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.099224 27593 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.287719 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.275676 27291 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.294246 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.277181 27161 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.300248 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.301074 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.307195 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.319368 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:46.320418 27649 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:46.320876 27656 consensus_meta.cc:287] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.682s	user 0.013s	sys 0.001s
W20260709 13:09:46.306922 27712 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.002s
I20260709 13:09:46.326210 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.327104 27713 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.300690 27495 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.333330 27440 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:46.334791 27693 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.274051 27434 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.335356 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.342167 24391 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:46.358114 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.350268 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.292584 27618 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:46.342098 27573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.016s	sys 0.012s
I20260709 13:09:46.364241 27489 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.365146 27718 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
W20260709 13:09:46.365355 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 104030us
I20260709 13:09:46.298779 27685 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.366106 27667 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.366397 27624 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:46.367055 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.367743 27440 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.368402 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:46.371158 27723 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:09:46.374058 23704 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:46.336872 27429 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:46.316375 27432 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.377969 23621 raft_consensus.cc:2410] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:46.380964 23772 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:46.357470 27658 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:46.316920 27633 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.322600 27458 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.296018 27654 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.386327 23627 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:46.391062 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1803) took 1757 ms. Trace:
I20260709 13:09:46.391536 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:46.384840 27383 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.000s
I20260709 13:09:46.353291 27712 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.417771 23701 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:46.398147 27434 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.399456 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.400774 27593 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:46.401214 27291 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:46.402225 27649 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.402616 27713 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:46.402753 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 113152us
I20260709 13:09:46.404349 27685 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:46.405851 27618 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.406770 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.395143 23778 rpcz_store.cc:276] 0709 13:09:44.597115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.597296 (+   181us) service_pool.cc:224] Handling call
0709 13:09:44.616388 (+ 19092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.678816 (+ 62428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.678860 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:45.535379 (+856519us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b2c0012bcd8. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:09:45.536161 (+   782us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.631640 (+ 95479us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:45.631692 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.631793 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.658168 (+ 26375us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b4800280758. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:09:46.354661 (+696493us) raft_consensus.cc:1685] finished
0709 13:09:46.354691 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.354887 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62023,"raft.queue_time_us":62540,"raft.run_cpu_time_us":12246,"raft.run_wall_time_us":976880,"spinlock_wait_cycles":74013440,"thread_start_us":94961,"threads_started":1,"wal-append.queue_time_us":196341}
I20260709 13:09:46.353523 27709 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:46.407593 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.408303 27495 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:46.411648 27633 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.413663 27458 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:46.395071 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.421903 23769 raft_consensus.cc:2410] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:46.419286 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.422461 23773 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:09:46.425592 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:46.427892 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 269629us
I20260709 13:09:46.373373 27640 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.415849 27654 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.433594 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.445166 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.437273 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:46.429634 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.447506 23775 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:46.451856 27657 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:46.452188 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:46.452446 27657 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.454600 27657 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:46.457319 27712 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.459602 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1814) took 1799 ms. Trace:
I20260709 13:09:46.461170 27692 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:46.460042 23703 rpcz_store.cc:276] 0709 13:09:44.660545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.642778 (+982233us) service_pool.cc:224] Handling call
0709 13:09:45.672842 (+ 30064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.679405 (+  6563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.679436 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:45.680043 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.818068 (+138025us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:45.840948 (+ 22880us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.849265 (+  8317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.849483 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.459324 (+609841us) raft_consensus.cc:1685] finished
0709 13:09:46.459345 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.459508 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8009,"prepare.queue_time_us":22623,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":17804,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":178,"spinlock_wait_cycles":19152128,"thread_start_us":137631,"threads_started":1,"wal-append.queue_time_us":580895}
I20260709 13:09:46.461767 27692 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.462457 23776 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:46.464098 27692 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:46.464329 27440 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.464743 27692 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:46.465456 27692 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.469553 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 480) took 1803 ms. Trace:
I20260709 13:09:46.470034 23696 rpcz_store.cc:276] 0709 13:09:44.665847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.682197 (+1016350us) service_pool.cc:224] Handling call
0709 13:09:45.763948 (+ 81751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.764219 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.764252 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.764322 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:45.764358 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.764419 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.469367 (+704948us) spinlock_profiling.cc:243] Waited 81.2 ms on lock 0x7b540026b1d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:46.469493 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186838912}
I20260709 13:09:46.472059 27618 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:46.472870 27618 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:46.474346 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.479282 27432 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.480628 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.480829 27442 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:46.421895 27383 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.484673 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.485481 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.489382 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.490576 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.491185 23703 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:46.492718 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.496522 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.498056 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.446113 27593 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:46.502532 27693 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:46.508033 27593 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.508864 27693 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.510466 27593 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:46.503513 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.504142 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.504498 27591 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:46.504649 27383 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:46.503533 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.505885 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.507259 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.522075 23703 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:09:46.522799 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.522002 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.521240 23697 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:46.520226 23778 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:46.525571 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:46.523626 24391 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:46.485018 27692 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.529891 23773 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:46.523718 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:46.528117 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:46.513388 23742 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.537s (SENT) [suppressed 27 similar messages]
I20260709 13:09:46.511173 27469 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.536114 23776 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:46.538877 23696 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:46.543022 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.543799 24388 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:46.547874 27469 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.550488 27469 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.551568 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.557852 27709 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.560416 27685 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:46.561059 27685 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:46.569010 24386 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:46.571245 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:46.575855 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.583926 23777 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:46.584190 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1807) took 1926 ms. Trace:
I20260709 13:09:46.584728 23699 rpcz_store.cc:276] 0709 13:09:44.658295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.613821 (+955526us) service_pool.cc:224] Handling call
0709 13:09:45.792900 (+179079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.793448 (+   548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.793478 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:45.794012 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.190505 (+396493us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:46.255069 (+ 64564us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.255323 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.255412 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.408416 (+153004us) raft_consensus.cc:1685] finished
0709 13:09:46.408437 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.582171 (+173734us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b1800485e00. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:09:46.583952 (+  1781us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400196250. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:46.584114 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":66377,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":26534,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":46229,"spinlock_wait_cycles":420281984,"thread_start_us":395994,"threads_started":1,"wal-append.queue_time_us":498411}
I20260709 13:09:46.590466 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.591157 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.591849 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.592161 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.592423 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.593518 23695 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:46.593649 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:46.593679 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:46.592545 23769 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:46.596230 27006 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:46.599900 27469 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:46.600921 27654 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:46.605278 27709 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:46.606827 27603 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:46.607474 27603 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.608292 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.610838 23527 catalog_manager.cc:5697] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:09:46.612838 27603 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.613631 23527 catalog_manager.cc:5697] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.618934 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.561443 27693 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:46.656747 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.673769 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.679158 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.680073 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.680908 23620 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:46.682199 23769 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:46.685902 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.688169 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.694024 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.686827 23772 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:09:46.709950 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:46.710860 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.706282 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.707222 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:46.717368 23624 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:46.719128 23628 raft_consensus.cc:1217] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 9.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 13:09:46.713526 24388 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:46.716075 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.718223 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.723407 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:46.723853 27727 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.332s	user 0.003s	sys 0.000s
I20260709 13:09:46.723394 27520 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:46.728703 27520 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.606050 27709 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.737094 23628 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:09:46.711895 23625 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:46.699702 27603 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:46.750756 27429 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:46.751389 27429 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.753588 27429 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.750444 27603 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:46.755545 27603 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:46.755450 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.756078 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.757114 23626 raft_consensus.cc:2410] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:09:46.758405 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.759131 23774 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:46.764004 27685 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:46.765421 27685 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:46.765604 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:46.766515 23774 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:46.769575 27709 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:46.771086 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.776865 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.778012 23626 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:46.779471 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.783347 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.780269 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.793231 23623 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:46.797120 23776 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:09:46.784495 23772 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:46.781749 23629 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:46.780323 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.800981 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.802593 24391 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:46.801390 23624 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
W20260709 13:09:46.809098 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 70063.4us
I20260709 13:09:46.812397 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.813989 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.809480 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.818789 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.820025 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.820878 23776 raft_consensus.cc:2410] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:46.816547 23628 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:46.821801 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.824321 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.828507 23773 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:46.854952 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.855183 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.856145 23628 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
W20260709 13:09:46.867045 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 367565us
I20260709 13:09:46.882550 23527 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:46.898834 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.900277 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.905705 23626 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:46.912726 27640 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:46.915366 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.916944 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:46.917168 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.917996 23769 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:46.918882 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.906635 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:46.920661 23667 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:46.920825 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.921537 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:46.922212 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.925688 23778 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:46.926848 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.927559 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.928534 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:46.928949 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.923501 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.933691 23774 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:09:46.937148 23776 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:46.942911 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.934737 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:46.946065 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.946723 23623 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:46.949455 23772 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:46.950783 23778 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:46.943574 23629 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:46.953662 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:46.990461 23622 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:46.994004 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.996524 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:46.998773 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 64125us
I20260709 13:09:46.999533 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:46.998773 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 51371.1us
I20260709 13:09:47.000204 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:46.942708 27434 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:46.935963 27458 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:47.005261 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:46.999590 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:47.018549 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:47.020488 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:47.040686 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:47.041024 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.041791 23622 raft_consensus.cc:2410] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:47.049431 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:47.049957 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 250706us
I20260709 13:09:47.050686 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:47.051988 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:47.056054 23701 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:09:47.056003 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50020.5us
I20260709 13:09:47.055450 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.061583 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.062580 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.007085 27434 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.001595 27006 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:47.080170 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:47.069941 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:47.021936 27549 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:47.022610 27458 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.085647 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.087038 23697 raft_consensus.cc:2410] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:09:47.075429 27732 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
W20260709 13:09:47.074805 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.092211 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:47.075951 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.077535 27434 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.069000 23592 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:47.071352 27731 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:47.080060 23698 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:47.081053 23628 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:09:47.049536 27469 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:47.074057 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:47.089012 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:47.095207 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.107643 23696 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:47.085518 27549 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:47.095806 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.079622 27640 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.097714 27383 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:47.098205 27432 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:47.114902 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.122161 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:47.079041 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.088825 27458 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:47.110042 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 52980.1us
I20260709 13:09:47.111373 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:47.078305 23621 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:47.131475 23701 raft_consensus.cc:2410] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:09:47.135046 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 253490us
I20260709 13:09:47.099912 27161 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:09:47.143579 23667 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:47.105520 27654 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:47.106148 27731 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:47.108917 27469 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:47.112411 27549 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.113528 27603 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:47.148563 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.153591 23592 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:47.153975 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:47.171849 23621 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:47.150599 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.154668 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:47.172094 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 302228us
I20260709 13:09:47.159835 27561 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:47.160516 23622 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:47.173583 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:47.160925 27709 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:47.161358 23628 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:47.176077 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.163226 27737 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:09:47.164135 27735 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:09:47.182211 23742 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:47.164911 27734 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:09:47.100222 27006 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:47.139704 27633 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:47.178550 23592 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:47.178090 24358 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:47.181061 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:47.187899 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:47.183492 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 297255us
I20260709 13:09:47.188841 24358 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:47.189208 23592 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:47.169986 27469 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.170130 27731 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:47.138636 27640 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:47.202527 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:47.198069 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.175313 27561 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:47.205955 23697 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:09:47.184679 27383 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:47.211419 23592 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:47.213732 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:47.189198 27633 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:47.197863 27618 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:47.172143 27654 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:47.198091 27489 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:47.244340 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 301211us
I20260709 13:09:47.245537 23624 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:47.247185 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.247069 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 149767us
I20260709 13:09:47.217147 27495 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:47.250921 27495 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:47.251415 27495 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.251901 27495 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.257804 23624 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:47.209396 27561 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.261016 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:47.261082 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48126.9us
I20260709 13:09:47.210089 27693 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:47.269810 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 87708.4us
I20260709 13:09:47.224915 27633 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.206979 27750 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:47.277696 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:47.263370 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 43946.7us
I20260709 13:09:47.299675 23701 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.209884 27383 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:47.307427 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.305835 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:47.209910 27506 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:09:47.224028 27618 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:47.317605 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:47.304000 27685 consensus_meta.cc:287] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.006s
I20260709 13:09:47.361521 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.366876 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.355814 27705 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:47.318799 27383 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:47.317663 27603 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:47.354305 27743 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:09:47.318158 27618 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:47.319056 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 166097us
I20260709 13:09:47.310220 27709 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:09:47.355506 27693 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:47.382580 24357 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:47.382485 27693 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:47.383337 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:47.384881 27693 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:47.380689 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2407) took 1004 ms. Trace:
I20260709 13:09:47.392979 27692 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:47.393538 27692 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.393941 27692 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:47.393035 27733 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:09:47.390848 24357 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:47.399238 27744 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:09:47.400724 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 183810us
W20260709 13:09:47.396375 27736 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:09:47.373720 27700 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:47.369378 27705 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:47.386508 23700 rpcz_store.cc:276] 0709 13:09:46.376586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.376719 (+   133us) service_pool.cc:224] Handling call
0709 13:09:46.412159 (+ 35440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.421539 (+  9380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.421573 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.439372 (+ 17799us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.814421 (+375049us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:46.838087 (+ 23666us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.838390 (+   303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.895308 (+ 56918us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b540026acd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:46.895354 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.372149 (+476795us) raft_consensus.cc:1685] finished
0709 13:09:47.374954 (+  2805us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.380550 (+  5596us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26984,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":2380,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":11465,"spinlock_wait_cycles":9309568,"thread_start_us":313296,"threads_started":1,"wal-append.queue_time_us":452498}
I20260709 13:09:47.381495 27345 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:47.414461 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 166487us
I20260709 13:09:47.399955 27693 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:47.416756 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 211779us
I20260709 13:09:47.418459 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:47.422168 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:47.380836 27685 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:09:47.380152 27747 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:09:47.413110 27705 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:47.424489 27520 consensus_meta.cc:287] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.003s
W20260709 13:09:47.443408 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 147738us
I20260709 13:09:47.424192 23516 maintenance_manager.cc:419] P 446420ed83784f0ea35de949dc9242f4: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033350
I20260709 13:09:47.435370 23743 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:47.473716 27345 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:09:47.391839 27750 consensus_queue.cc:1059] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:09:47.427359 27506 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:47.481755 27752 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:09:47.480728 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:47.499585 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 193833us
I20260709 13:09:47.506254 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:47.425652 27458 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:47.513943 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:47.516757 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 134726us
I20260709 13:09:47.517413 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:47.519644 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:47.485388 27006 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:47.495488 27654 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:47.472777 27434 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:47.505971 27506 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.497840 27640 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:47.630095 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 135815us
I20260709 13:09:47.480314 27520 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:47.506675 27763 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 13:09:47.644773 23699 raft_consensus.cc:2368] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13.
W20260709 13:09:47.669729 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.671907 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.685020 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 171166us
I20260709 13:09:47.637984 27506 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.693668 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:47.699462 23775 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:47.701442 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.676580 27006 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:47.643405 27764 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:47.676945 27654 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.714414 23704 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:09:47.689330 27744 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:47.673136 27640 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.708225 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:47.703490 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:47.722712 27747 raft_consensus.cc:3055] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:47.722932 27757 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:47.723335 27747 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:09:47.723590 27749 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:09:47.724781 27747 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:47.725767 27758 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:09:47.726774 27747 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.729920 27520 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:47.705684 27345 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:47.711573 27685 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:47.709007 27006 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:47.764809 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 61849.1us
I20260709 13:09:47.693025 27762 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:47.775347 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:47.749723 27753 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
W20260709 13:09:47.755650 27731 consensus_meta.cc:287] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
I20260709 13:09:47.784538 24387 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: [7.8-10.9]
I20260709 13:09:47.826902 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:47.808861 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 182699us
I20260709 13:09:47.749276 27769 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:47.826606 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:47.840282 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:47.844791 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 375348us
I20260709 13:09:47.756194 27489 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:47.850669 23701 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.004s
I20260709 13:09:47.777009 27006 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.845741 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:47.720748 27654 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:47.767387 27345 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:47.846540 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 365917us
I20260709 13:09:47.868353 23701 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:47.771739 27685 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:47.827806 27744 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:09:47.873705 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:47.779088 27762 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.758828 27618 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:47.821390 27764 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:47.711588 27767 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.148s
I20260709 13:09:47.833626 27640 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:47.787132 27766 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:47.723697 27757 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:47.880580 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 51508.3us
I20260709 13:09:47.897079 23697 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:47.821532 27520 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:09:47.828028 27731 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:47.886318 27685 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.882706 27345 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:47.854369 27432 consensus_queue.cc:1059] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:09:47.915184 23702 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:47.916687 27784 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:47.917371 27731 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:47.917810 27778 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:09:47.918330 27692 consensus_meta.cc:287] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.001s
W20260709 13:09:47.937439 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 104442us
W20260709 13:09:47.922468 27495 consensus_meta.cc:287] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 13:09:47.922891 27774 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:47.925508 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 214535us
W20260709 13:09:47.924644 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 284353us
I20260709 13:09:47.881886 27489 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:47.926959 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 407387us
I20260709 13:09:47.897105 27786 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:47.889544 27762 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.923664 27775 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:47.913329 27458 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:47.940874 27685 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:47.943827 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:47.947391 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.926632 27434 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:47.952869 27780 raft_consensus.cc:3055] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:47.903597 27764 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:47.970407 27764 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:47.908701 27766 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:47.964361 27777 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:09:47.964361 27776 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:09:47.965641 27770 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:09:47.966077 27779 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:47.967422 27757 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:47.943172 27692 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:47.943368 27495 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:47.957250 27780 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:47.999912 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:47.986660 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:48.002583 27773 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:48.003319 27790 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:09:48.005089 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 131485us
I20260709 13:09:48.003928 27692 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:47.948877 27786 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:48.057873 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.978886 27520 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:48.066776 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 185675us
I20260709 13:09:48.067975 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:47.984299 27763 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:48.070644 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 70845.6us
I20260709 13:09:48.072184 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.072599 27780 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.073503 27766 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.073565 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.074880 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.075529 27765 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:48.076273 27765 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:48.076714 27765 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:48.077104 27786 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.077256 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.077798 27757 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:48.077571 27765 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.078233 27757 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:48.078420 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.078717 27757 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.079032 27654 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.079835 27161 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.080308 27782 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:48.080590 27161 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:48.080893 27782 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:48.081449 27782 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:48.083308 27495 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.073853 27780 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:47.986033 27624 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:48.070034 23668 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:48.087554 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 127677us
I20260709 13:09:48.085543 27785 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:48.088685 27618 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.089434 27624 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.069582 27520 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:48.092638 27520 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.093201 27506 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.093832 27520 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:48.069103 27383 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.000s
I20260709 13:09:48.078743 27489 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.096702 27383 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.098142 27006 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.098783 27383 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.101925 27778 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.102452 27778 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.091688 27624 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:48.106639 27757 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.116909 27685 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:48.119876 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 133303us
W20260709 13:09:48.122387 27633 consensus_meta.cc:287] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.000s
W20260709 13:09:48.094753 27561 consensus_meta.cc:287] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.816s	user 0.009s	sys 0.000s
W20260709 13:09:48.085660 27469 consensus_meta.cc:287] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.877s	user 0.012s	sys 0.000s
I20260709 13:09:48.132499 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:48.136729 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 47244.5us
I20260709 13:09:48.132424 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:48.140444 27705 consensus_meta.cc:287] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.000s
I20260709 13:09:48.140996 27705 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.095551 27506 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:48.137566 23770 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
W20260709 13:09:48.141558 27549 consensus_meta.cc:287] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.963s	user 0.011s	sys 0.000s
I20260709 13:09:48.145435 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:48.146831 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:48.144397 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 74446.6us
I20260709 13:09:48.145694 23667 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:09:48.154719 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 76366.2us
I20260709 13:09:48.159610 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:48.157122 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 77523.4us
W20260709 13:09:48.175313 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.178895 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2047) took 1273 ms. Trace:
I20260709 13:09:48.143687 27705 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:48.180572 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.148319 27006 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.148279 27759 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:48.187283 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:48.198145 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:48.147075 27624 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:09:48.196465 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:48.230043 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:48.180199 27785 raft_consensus.cc:2764] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:48.147037 27469 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.153427 27790 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:09:48.147893 27561 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.179306 23771 rpcz_store.cc:276] 0709 13:09:46.905179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.905330 (+   151us) service_pool.cc:224] Handling call
0709 13:09:46.939108 (+ 33778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.945773 (+  6665us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:47.031324 (+ 85551us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.946430 (+915106us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800175720. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac23a 00007f2b41316a2a
0709 13:09:48.178545 (+232115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.178592 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:48.178624 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.178721 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.178838 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11092,"prepare.queue_time_us":30143,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":32010,"spinlock_wait_cycles":23892864,"thread_start_us":198488,"threads_started":1}
I20260709 13:09:48.234815 24393 raft_consensus.cc:2368] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9.
I20260709 13:09:48.147387 27633 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.150068 27549 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:48.180413 23593 connection.cc:256] RPC call timeout handler was delayed by -1.043232253000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 13:09:48.227192 27802 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.242738 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.248315 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:48.256732 23698 raft_consensus.cc:2393] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:48.241884 27006 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:48.257251 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.257517 23774 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.258930 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:48.251221 27520 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:09:48.264397 27782 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.266515 27798 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:09:48.267118 27549 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.267745 27798 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:48.267802 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:48.268214 27798 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:48.256683 27778 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.269088 27798 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.269858 27633 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.251866 27797 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:48.270998 27797 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.270478 27798 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.276484 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.277148 23771 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.278921 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.260274 27006 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.275069 27794 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:48.283274 27603 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:48.283648 27782 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:48.285075 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.307035 27603 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:48.308879 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:48.309099 27790 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:48.309867 27790 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:48.310185 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.285878 27776 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:48.291654 27797 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:48.293969 27763 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.295809 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.315340 23621 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:48.305387 23699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1822) took 1293 ms (client timeout 1591 ms). Trace:
W20260709 13:09:48.305991 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 76055.2us
I20260709 13:09:48.312358 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.248746 27766 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:09:48.266518 27520 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:48.317942 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:48.316473 23699 rpcz_store.cc:269] 0709 13:09:47.008656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.029188 (+ 20532us) service_pool.cc:224] Handling call
0709 13:09:48.302025 (+1272837us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400195854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:48.302205 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313193216}
I20260709 13:09:48.328540 23771 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:48.330196 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.333562 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:48.334817 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:48.335702 27757 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.257516 27802 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.340849 27561 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.341104 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1838) took 1185 ms. Trace:
I20260709 13:09:48.310214 27790 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:48.341491 23701 rpcz_store.cc:276] 0709 13:09:47.156027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.156351 (+   324us) service_pool.cc:224] Handling call
0709 13:09:48.340893 (+1184542us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540015e854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:48.341013 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257542912}
I20260709 13:09:48.342087 27790 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.342306 27469 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.304883 27006 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.343122 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1836) took 1228 ms. Trace:
I20260709 13:09:48.343534 23698 rpcz_store.cc:276] 0709 13:09:47.114355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.114502 (+   147us) service_pool.cc:224] Handling call
0709 13:09:48.342919 (+1228417us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400269dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:48.343060 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600246016}
I20260709 13:09:48.348543 27603 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.349387 27746 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:48.349936 27746 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:48.311944 27794 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.332608 27520 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:48.353046 27520 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.354786 27520 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.299117 27345 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.358063 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.359350 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:48.355907 27797 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.362112 23776 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:48.361713 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:48.364212 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.366333 23774 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:09:48.367596 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:48.368875 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 128914us
I20260709 13:09:48.369204 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.372563 23774 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.360481 27624 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:48.351008 27746 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.363583 27794 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:48.362061 27776 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:48.381287 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:48.382129 24394 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:48.383630 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1821) took 1375 ms. Trace:
I20260709 13:09:48.385519 23695 rpcz_store.cc:276] 0709 13:09:47.008296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.029326 (+ 21030us) service_pool.cc:224] Handling call
0709 13:09:47.071892 (+ 42566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.210254 (+138362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.210283 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.217813 (+  7530us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:47.217877 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.383298 (+1165421us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540015de54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:48.383360 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.383543 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306179456}
W20260709 13:09:48.388245 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 70397.3us
I20260709 13:09:48.391420 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:48.332613 27763 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.374609 27603 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.406747 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:48.376520 27624 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.379317 27480 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:48.409714 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.412290 23629 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.384999 27794 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:48.381178 27776 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:48.421413 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:48.410502 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:48.417361 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:48.416666 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:48.423223 24391 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:48.418983 23774 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:48.419814 27771 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.420446 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:48.422158 24390 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:09:48.409484 27624 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.428468 27794 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.435900 27469 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:48.430187 24389 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.437218 27762 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.397085 27802 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.400364 27767 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:09:48.429858 23669 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:48.442328 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.443152 23622 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.443765 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:48.423986 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:48.445343 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:48.446185 27799 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:48.447016 27549 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:48.447803 23777 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:48.450806 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:48.450176 27798 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:48.453595 27792 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:48.453714 27798 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:48.454206 27792 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:48.454456 27798 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.446020 27561 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:48.458102 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:48.460530 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:48.409463 27700 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:48.469972 24389 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:48.416007 27766 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:48.476105 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:48.471360 27773 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:48.475989 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.451689 27549 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.450806 27802 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:48.487563 27802 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.489292 27434 raft_consensus.cc:3055] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:48.489876 27434 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:48.455443 27792 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.490796 27434 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.493073 27434 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.496255 27345 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:48.482051 27633 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:48.456037 27561 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.458909 27807 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:48.459298 27469 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:48.429780 27776 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.502223 23770 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:48.459262 27793 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:48.508427 27763 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.508785 27793 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.477847 27766 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:48.515403 23667 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:48.446064 27790 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.474099 27731 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.511198 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.513604 23629 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:48.514926 24394 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:09:48.458858 27762 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:48.486651 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 167335us
I20260709 13:09:48.527374 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:48.498353 27458 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:48.498946 27549 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.501649 27561 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.522248 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:48.577773 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55654.2us
W20260709 13:09:48.578001 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50782.3us
I20260709 13:09:48.490018 27802 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:48.529256 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:48.530232 27633 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:48.533788 27790 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:48.474615 27700 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.587433 27633 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:48.588533 27633 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.592306 23774 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:48.534152 27624 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.542501 27006 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.546947 27794 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.548779 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 841) took 1147 ms. Trace:
I20260709 13:09:48.548447 27469 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.552281 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.553267 27772 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:48.553460 27773 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:48.553993 27654 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:48.554311 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:48.556202 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.523831 27774 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.518985 27766 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:48.517072 27807 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:48.620685 23593 leader_election.cc:400] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9.
I20260709 13:09:48.563141 23621 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:48.654220 23593 leader_election.cc:403] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:48.564555 23622 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:48.654703 23778 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:48.654981 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 61651.4us
W20260709 13:09:48.567032 27693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.005s	sys 0.004s
I20260709 13:09:48.573437 27798 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.575404 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1911) took 1638 ms. Trace:
I20260709 13:09:48.662441 23624 rpcz_store.cc:276] 0709 13:09:46.936643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.053400 (+116757us) service_pool.cc:224] Handling call
0709 13:09:48.575195 (+1521795us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54002b4654. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:48.575316 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318317440}
W20260709 13:09:48.575881 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 143212us
I20260709 13:09:48.576054 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1830) took 1515 ms. Trace:
I20260709 13:09:48.663825 23702 rpcz_store.cc:276] 0709 13:09:47.061129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.061340 (+   211us) service_pool.cc:224] Handling call
0709 13:09:47.079524 (+ 18184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.926606 (+847082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.575826 (+649220us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b540026a2d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:48.575995 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1921340800}
I20260709 13:09:48.576759 23628 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:09:48.583207 27161 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:48.593355 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.666680 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:48.666980 23774 raft_consensus.cc:2368] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13.
I20260709 13:09:48.593992 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.603868 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:48.669028 23770 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:48.603220 23775 rpcz_store.cc:276] 0709 13:09:47.401786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.401931 (+   145us) service_pool.cc:224] Handling call
0709 13:09:47.409529 (+  7598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.710092 (+300563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.548506 (+838414us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54003fedd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:48.548712 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663244544}
I20260709 13:09:48.646586 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.580724 27793 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.650130 27773 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.673789 24394 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:48.674783 23773 raft_consensus.cc:2393] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:48.612353 27520 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:48.612903 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:48.655745 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:48.662832 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:48.677145 23776 raft_consensus.cc:2410] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:09:48.677321 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.678860 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.679980 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.681051 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:48.681372 23743 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:48.681676 23770 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:48.682538 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:48.683044 23770 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:48.684023 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:48.684697 23774 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:48.685129 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:48.658262 27693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.006s	sys 0.004s
I20260709 13:09:48.690673 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:48.691124 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.647406 27772 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:48.602808 27731 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:09:48.661911 27763 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9.
I20260709 13:09:48.676946 27561 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.690073 27800 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:48.601543 27506 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:48.691474 23624 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:48.695339 27790 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:48.700678 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.701251 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.692950 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.705168 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:48.700410 27161 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:48.708190 27799 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:48.719626 23620 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:48.719806 27790 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:48.720490 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.721190 23620 raft_consensus.cc:2393] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:48.720815 27790 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.721946 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.723104 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:48.723016 27161 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.709957 27798 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.673460 27791 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:48.710806 27561 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:48.705783 27757 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:48.711385 27800 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:48.711784 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.713850 23773 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:48.714592 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.695523 27693 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:48.715410 27429 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:48.718845 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:48.722509 23620 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.727013 23622 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 9: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:48.656795 27654 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:48.732661 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 69912.9us
I20260709 13:09:48.733112 24394 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:09:48.737097 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:48.767946 23623 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:48.717320 27603 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:48.726943 27799 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.702442 27520 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:48.777842 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 112043us
I20260709 13:09:48.783006 24386 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:48.735695 27763 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:48.794137 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:48.795754 23701 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:48.762336 27506 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:48.794824 23697 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:48.782179 27786 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:48.794723 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:48.801491 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:48.801541 23698 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:48.726080 27807 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.808346 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:48.809032 23699 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:48.762095 27791 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.810442 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:48.809942 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:48.785519 27782 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:48.813406 23702 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:48.814857 23626 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:48.815111 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:48.770664 27757 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.789811 27785 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:48.770915 27429 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.817706 27624 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:48.807323 27786 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.816917 23698 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:48.795488 27798 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:48.815034 27817 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:09:48.784097 27603 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.830801 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:48.812418 27480 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.836915 23770 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:48.812748 27345 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:48.847059 23695 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:09:48.851991 23770 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:09:48.862437 27786 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:48.863698 27794 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:48.836012 27785 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.840600 27006 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.868353 23624 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:48.867586 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:48.868302 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:48.870579 23699 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
W20260709 13:09:48.876965 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.877473 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.879500 23620 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:09:48.816460 27776 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.884433 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:48.888480 23701 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:48.885628 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:48.843070 27782 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.862423 27603 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.849843 27800 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:48.925173 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 126936us
I20260709 13:09:48.843488 27802 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:09:48.808933 27772 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.925453 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:48.873423 27785 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:48.933339 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:48.934643 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:48.939101 27746 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.939332 27783 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:48.940114 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:48.953437 23704 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:48.942346 23625 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:48.867993 27345 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.944419 27776 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:48.945866 27757 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:48.959223 27783 raft_consensus.cc:3055] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:48.960242 27345 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:48.981525 27766 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:48.874611 27798 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.928740 27773 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:49.013221 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.960908 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:48.976125 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:49.013944 23704 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.844278 27693 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.927088 27506 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:48.977423 27654 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:48.951812 27763 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:48.980145 23527 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:48.960815 27791 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:49.049753 23696 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:49.050451 23527 catalog_manager.cc:5697] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 5 to 4, leader changed from <none> to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:49.012605 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:49.052712 27763 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.053601 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.054776 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.017160 23695 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:49.018241 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:49.053006 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:49.057649 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:49.058403 23628 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:49.059150 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:49.012743 27793 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:49.018774 23526 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 180) took 20742 ms (client timeout 15000 ms). Trace:
I20260709 13:09:49.039237 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:49.060071 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.040238 27520 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:48.972856 27783 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:49.045782 23704 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:09:48.950763 27549 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:49.060748 23703 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:49.073041 27799 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:49.075060 27798 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:49.004138 27772 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.076012 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:49.079239 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.060024 27793 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.092968 27766 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:49.097500 27782 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:49.100118 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:49.100386 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.104609 23696 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:49.099656 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:49.060101 23526 rpcz_store.cc:269] 0709 13:09:28.237526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.239869 (+  2343us) service_pool.cc:224] Handling call
0709 13:09:48.979504 (+20739635us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:37.523717 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:37.577446 (+ 53729us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:37.577504 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:09:37.577527 (+    23us) tablet.cc:662] Decoding operations
0709 13:09:37.756270 (+178743us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:37.765815 (+  9545us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:37.773854 (+  8039us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:09:37.808313 (+ 34459us) tablet.cc:701] Row locks acquired
0709 13:09:37.808398 (+    85us) write_op.cc:260] PREPARE: finished
0709 13:09:37.808626 (+   228us) write_op.cc:270] Start()
0709 13:09:37.808823 (+   197us) write_op.cc:276] Timestamp: P: 1783602577808539 usec, L: 0
0709 13:09:37.808859 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:09:37.935808 (+126949us) log.cc:844] Serialized 8304 byte log entry
0709 13:09:38.268383 (+332575us) op_driver.cc:464] REPLICATION: finished
0709 13:09:38.402587 (+134204us) write_op.cc:301] APPLY: starting
0709 13:09:38.402704 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:38.403173 (+   469us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:38.403321 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:39.047660 (+644339us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:39.048175 (+   515us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:09:39.048235 (+    60us) write_op.cc:312] APPLY: finished
0709 13:09:39.048810 (+   575us) log.cc:844] Serialized 145 byte log entry
0709 13:09:39.049020 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:39.049237 (+   217us) write_op.cc:454] Released schema lock
0709 13:09:39.049321 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:39.049803 (+   482us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:39.049843 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17361,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":106891,"apply.run_cpu_time_us":12791,"apply.run_wall_time_us":663131,"num_ops":21,"prepare.queue_time_us":235466,"prepare.run_cpu_time_us":36150,"prepare.run_wall_time_us":486777,"raft.queue_time_us":236691,"raft.run_cpu_time_us":7209,"raft.run_wall_time_us":46784,"replication_time_us":459258,"thread_start_us":372872,"threads_started":4,"wal-append.queue_time_us":62355,"wal-append.run_cpu_time_us":41588,"wal-append.run_wall_time_us":2056073}]]}
I20260709 13:09:49.103406 23704 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:49.103295 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.107532 23703 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:49.112527 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.114122 23704 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:09:49.098354 27549 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:09:49.115216 27793 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:49.116340 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.116750 27799 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:49.121675 27783 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.124720 23704 pending_rounds.cc:85] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 8
I20260709 13:09:49.158006 23704 pending_rounds.cc:107] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:09:49.158397 23704 raft_consensus.cc:2889] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.114676 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:49.145943 23774 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:49.159092 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:49.154142 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:49.150049 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:49.163038 23778 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:09:49.175110 23699 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:49.175491 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:49.179975 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.164888 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:49.182293 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:09:49.183440 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 118662us
I20260709 13:09:49.186995 27520 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:49.187573 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:49.188657 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 169341us
I20260709 13:09:49.188823 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.189642 23623 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:49.191215 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.175879 27784 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:49.185829 27799 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:49.213864 27520 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:49.244686 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:49.213155 27784 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:49.217418 27783 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:49.245123 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 173982us
I20260709 13:09:49.246151 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:49.251296 23777 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:49.241201 27799 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:49.241822 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:49.247534 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:49.213006 27794 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:09:49.249017 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:49.254528 24389 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:49.254105 27520 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:49.229944 27750 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.256155 23700 raft_consensus.cc:2368] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
I20260709 13:09:49.255787 24359 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:49.248859 27784 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:49.282871 27830 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:09:49.292662 27834 log.cc:927] Time spent T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:09:49.293203 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:49.293265 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.296227 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.315130 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:49.280012 27750 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.317481 23701 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:49.277767 27746 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:49.319083 27750 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:49.320043 27700 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:49.320456 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:49.296715 23696 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:49.297224 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:49.322708 23697 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.300230 27799 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.305377 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:49.307224 27836 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:09:49.308547 27520 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.324517 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:49.328478 23696 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:09:49.327520 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:49.314791 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:49.333356 23629 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:49.341918 23701 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:09:49.349385 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:49.351202 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:49.353744 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:49.355716 24390 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:49.356679 23775 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 9: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:49.360100 24393 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:49.359594 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:49.362041 23699 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:49.348155 27793 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:49.363059 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:49.364250 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:49.365640 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.366422 23699 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:49.367889 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:49.368175 23699 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:49.368489 23775 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:49.373407 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:49.377998 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:49.382045 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:49.389882 23702 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:49.370841 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:49.391177 23774 raft_consensus.cc:606] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:09:49.391534 23774 raft_consensus.cc:614] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:49.387341 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:49.385072 27794 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:49.394768 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:49.395126 23668 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:49.396215 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:49.398650 27786 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:49.400390 23699 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:49.392748 23775 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:49.393163 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:49.399168 27654 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:49.385273 27656 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:49.399292 27786 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:49.399093 27773 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:49.394522 27838 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:09:49.435673 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.436558 23699 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:49.436609 23697 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:49.419749 27656 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.395130 27794 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.435943 27763 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:49.453822 27480 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:49.456826 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:49.451427 27836 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
I20260709 13:09:49.441422 27656 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.484625 27006 raft_consensus.cc:3055] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:49.485325 27006 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:49.486541 27006 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.498167 27429 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:49.464850 27763 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.502877 27763 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:49.504421 27846 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:49.504585 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:49.507046 27784 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.512240 23592 leader_election.cc:400] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13.
I20260709 13:09:49.512672 23592 leader_election.cc:403] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:09:49.514194 27802 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13.
I20260709 13:09:49.513955 27161 consensus_queue.cc:1059] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:49.520300 27161 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:49.520826 27161 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:49.521934 27161 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:49.522727 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:49.523605 23769 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:49.524881 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:49.527252 27792 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:49.528033 27792 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:09:49.529188 24387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46580 (request call id 607) took 1703 ms (client timeout 1647 ms). Trace:
I20260709 13:09:49.529974 27561 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:49.530408 27561 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:49.531220 27561 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:49.532485 27561 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:49.534358 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 1920) took 1022 ms. Trace:
I20260709 13:09:49.534754 23621 rpcz_store.cc:276] 0709 13:09:48.512334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.690083 (+177749us) service_pool.cc:224] Handling call
0709 13:09:49.534125 (+844042us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54003af554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:49.534263 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793938688}
I20260709 13:09:49.537082 27828 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:49.537761 27828 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:49.538247 27828 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.544080 27798 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:49.548712 24393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:58744
I20260709 13:09:49.549841 24393 raft_consensus.cc:606] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:09:49.550386 24393 raft_consensus.cc:614] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:49.554139 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 1927) took 1036 ms. Trace:
I20260709 13:09:49.556314 27458 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:49.556811 27458 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:49.529805 24387 rpcz_store.cc:269] 0709 13:09:47.826034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.826198 (+   164us) service_pool.cc:224] Handling call
0709 13:09:49.528850 (+1702652us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54004218d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:49.529064 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3258781440}
I20260709 13:09:49.557710 27458 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.558913 27458 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:49.559399 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:49.560477 27780 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:49.561384 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:49.562194 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:49.563145 27802 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:49.563215 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:49.564636 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44895.8us
I20260709 13:09:49.561098 27780 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.554790 23623 rpcz_store.cc:276] 0709 13:09:48.517911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.881633 (+363722us) service_pool.cc:224] Handling call
0709 13:09:48.927413 (+ 45780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.192830 (+265417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.553766 (+360936us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400323cd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:49.554045 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602624384}
I20260709 13:09:49.458842 27480 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:49.581879 24387 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:49.575451 27782 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:49.573516 27763 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:49.599229 27656 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.582312 27774 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:49.590075 27006 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:49.592914 27161 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.587134 27817 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:09:49.600926 27782 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.605516 27763 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.650172 24390 raft_consensus.cc:2368] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10.
I20260709 13:09:49.657617 23626 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:49.662508 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a97c483343c425ea75f1f6632924819"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:49.663321 23769 raft_consensus.cc:606] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:49.664104 23769 raft_consensus.cc:614] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:49.665468 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 103334us
I20260709 13:09:49.667290 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:49.669720 23778 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:49.658946 27782 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.661216 27763 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.681537 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.667299 27700 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:49.682458 23704 raft_consensus.cc:2376] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8. Re-sending same reply.
W20260709 13:09:49.684332 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 104718us
I20260709 13:09:49.689307 23776 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:49.690850 27656 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:49.694968 23771 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:49.695218 23626 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:49.695574 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:49.696050 23776 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.698890 24387 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:49.700672 23770 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:49.702342 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:49.708967 24358 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:49.622087 27480 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:49.686156 27700 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:49.715821 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:49.676225 27841 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:09:49.719384 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:49.725272 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:49.728066 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.728837 27783 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:49.729665 27786 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:09:49.736857 27786 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:49.737320 27786 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:49.731299 27768 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:49.739912 23668 leader_election.cc:400] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10.
I20260709 13:09:49.740211 27700 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:49.741441 27700 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:49.744086 27857 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:49.745049 27849 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:49.740263 23668 leader_election.cc:403] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:49.743811 27852 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:09:49.751987 23776 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
W20260709 13:09:49.755798 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.754535 27480 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.768076 27794 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:49.728680 27561 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 13:09:49.780149 27855 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:09:49.782598 27852 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:49.708223 27802 consensus_queue.cc:1059] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:09:49.745050 27429 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:49.730636 27856 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:49.763477 27345 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.811599 27780 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:49.804780 27856 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:49.623240 27774 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.841883 27774 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:49.744709 27857 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.844794 27857 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:49.845423 27857 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:49.845808 27857 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:09:49.847026 27850 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:09:49.846700 27857 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:49.824417 27345 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:49.839463 27856 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.873189 27784 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:49.864825 27857 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.881986 27763 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:49.889622 27828 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.879868 27864 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:49.892613 27864 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:49.893967 27864 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:49.897720 27345 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:49.894474 27161 raft_consensus.cc:3055] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:49.901324 27786 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:49.903082 27161 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:49.925261 27763 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:49.927794 27828 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:49.923576 27161 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:49.938383 27786 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:49.954469 27429 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:49.984211 27161 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.001884 27856 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:50.008111 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 279928us
I20260709 13:09:49.966355 27782 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:50.019354 27782 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:50.016389 27793 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:09:50.020421 27793 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:50.020861 27793 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:50.022053 27793 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:50.036608 27429 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:50.031665 27856 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:50.056005 23626 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:50.058485 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:50.059265 23629 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:50.131168 27856 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.328495 27856 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:50.329416 27429 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:50.601917 27768 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.362823 27429 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
W20260709 13:09:50.702670 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.626966 27768 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:50.666989 27856 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:50.735752 27856 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.736461 27856 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.046105 27429 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:51.049098 27768 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:51.050240 27768 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:51.051052 27768 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.093842 27768 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:51.097153 23594 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.395s	user 0.037s	sys 0.079s
I20260709 13:09:51.100728 27856 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:51.103255 23594 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.401s	user 0.038s	sys 0.079s
I20260709 13:09:51.105310 27429 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.105948 27429 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:51.107620 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.108314 27429 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:51.108374 27874 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:51.105437 23594 connection.cc:256] RPC call timeout handler was delayed by -1.0539963929999203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:09:51.109270 27874 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.110035 27429 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.110598 27429 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.111704 27874 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.112747 27429 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:51.130432 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.132143 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.135305 23593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.408s	user 0.004s	sys 0.020s
W20260709 13:09:51.135718 23593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.409s	user 0.004s	sys 0.020s
W20260709 13:09:51.136075 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 1.42233e+06us
I20260709 13:09:51.131433 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:51.206614 23593 connection.cc:256] RPC call timeout handler was delayed by -1.4357246659999419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 13:09:51.207412 23593 connection.cc:256] RPC call timeout handler was delayed by -1.428277421999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
W20260709 13:09:51.207937 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.212507 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.212944 23593 connection.cc:256] RPC call timeout handler was delayed by -1.3835246659999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:09:51.214143 23593 connection.cc:256] RPC call timeout handler was delayed by -1.3142246659999728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:09:51.215191 23593 connection.cc:256] RPC call timeout handler was delayed by -1.2860774219999485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 13:09:51.215669 23593 connection.cc:256] RPC call timeout handler was delayed by -1.2008246659999031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 13:09:51.220470 23593 connection.cc:256] RPC call timeout handler was delayed by -1.1936246659998915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 13:09:51.223193 23593 connection.cc:256] RPC call timeout handler was delayed by -1.1795495179999307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 13:09:51.223837 23593 connection.cc:256] RPC call timeout handler was delayed by -1.0757246659999282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 13:09:51.224228 23593 connection.cc:256] RPC call timeout handler was delayed by -1.0685246659999166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
W20260709 13:09:51.224575 23593 connection.cc:256] RPC call timeout handler was delayed by -1.0568246659998977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
I20260709 13:09:51.225587 27874 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.226104 27874 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.228669 27874 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.229573 27874 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:51.272051 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 44590.5us
I20260709 13:09:51.272992 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:51.275153 27881 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:51.275766 27881 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:51.273933 27748 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.276144 27881 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:51.276800 27748 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.279109 27748 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.274250 27852 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:09:51.276100 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:51.282615 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:51.283453 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:51.285697 27884 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.284289 27852 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.288619 27852 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:51.291275 27881 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.301226 27881 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.308897 27884 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.313217 27561 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:51.313855 27561 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.313297 27006 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:51.316394 27006 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.318642 27006 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.319852 27561 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.324955 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:51.326288 23593 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:51.327561 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:51.328395 27884 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:51.328491 27881 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.328819 27884 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:51.329139 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:51.329308 27884 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.330520 27874 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.333024 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:51.334793 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:51.337333 27884 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.340554 27884 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:51.341955 27884 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:51.342449 27884 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:51.342908 27884 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:51.352834 27888 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:51.329319 27881 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:51.356504 27873 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 1.028s	user 0.008s	sys 0.007s
I20260709 13:09:51.335352 27886 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:51.357265 27886 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:51.335175 27874 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:09:51.358464 27886 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.359944 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2086) took 1666 ms. Trace:
I20260709 13:09:51.360332 23777 rpcz_store.cc:276] 0709 13:09:49.693464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.702183 (+  8719us) service_pool.cc:224] Handling call
0709 13:09:49.702526 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.706722 (+  4196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.706759 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:49.713446 (+  6687us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.131421 (+417975us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:50.131466 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.131539 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.355923 (+1224384us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:09:51.359614 (+  3691us) raft_consensus.cc:1685] finished
0709 13:09:51.359634 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.359885 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31089,"raft.queue_time_us":27912,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":13452672,"thread_start_us":66670,"threads_started":2,"wal-append.queue_time_us":599207}
I20260709 13:09:51.364189 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:51.369463 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:51.373944 27886 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:51.374428 27886 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:51.375434 27886 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.377311 27886 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.377100 27884 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.388027 27884 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.389025 24387 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:51.392297 23515 maintenance_manager.cc:643] P 446420ed83784f0ea35de949dc9242f4: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 3.884s	user 0.161s	sys 0.042s Metrics: {"bytes_written":29955,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":19804,"dirs.run_cpu_time_us":466,"dirs.run_wall_time_us":1986,"drs_written":1,"lbm_read_time_us":289,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5191,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":21338,"threads_started":1,"update_count":9}
I20260709 13:09:51.395864 23516 maintenance_manager.cc:419] P 446420ed83784f0ea35de949dc9242f4: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8395 bytes on disk
W20260709 13:09:51.397159 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44068.2us
I20260709 13:09:51.398167 23515 maintenance_manager.cc:643] P 446420ed83784f0ea35de949dc9242f4: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":309,"lbm_reads_lt_1ms":4}
I20260709 13:09:51.399026 27884 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:51.422375 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:51.426321 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:51.432804 27693 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:51.433435 27693 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.436874 27693 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.437105 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:51.437513 27693 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.438098 27693 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.439381 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:51.440203 24389 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:51.443094 27693 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.448889 23593 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:51.450392 27886 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:51.450930 27886 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.451359 27886 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:51.460626 24358 leader_election.cc:336] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.607s (SENT)
I20260709 13:09:51.462618 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:51.427477 27889 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:51.468933 27774 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.470690 27889 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:51.471810 27889 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.484035 27886 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.491549 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:51.492344 24393 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.494524 27774 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:51.495116 27774 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:51.496141 27520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.794s	user 0.010s	sys 0.020s
W20260709 13:09:51.496558 27520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.805s	user 0.010s	sys 0.020s
I20260709 13:09:51.497210 23772 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:51.497241 27874 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:51.497548 27774 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.497809 27874 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:51.499532 27874 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.500730 27874 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:51.502476 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 860) took 2081 ms. Trace:
I20260709 13:09:51.503031 23775 rpcz_store.cc:276] 0709 13:09:49.421364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.426091 (+  4727us) service_pool.cc:224] Handling call
0709 13:09:49.426398 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.465831 (+ 39433us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:49.672174 (+206343us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.708584 (+ 36410us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.708639 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:49.708700 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.502150 (+1793450us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b540016bf54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:51.502218 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.502396 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2921,"prepare.queue_time_us":240033,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":41787,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":14592,"spinlock_wait_cycles":90144000,"thread_start_us":133628,"threads_started":2,"wal-append.queue_time_us":33995,"wal-append.run_cpu_time_us":1493,"wal-append.run_wall_time_us":1057797}
I20260709 13:09:51.522939 27656 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:51.523635 27656 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.528854 24393 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:51.530727 27886 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:51.536828 27656 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:51.543112 27793 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.543640 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2083) took 1855 ms. Trace:
I20260709 13:09:51.544060 23772 rpcz_store.cc:276] 0709 13:09:49.687963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.688139 (+   176us) service_pool.cc:224] Handling call
0709 13:09:49.690539 (+  2400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.497795 (+1807256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.543397 (+ 45602us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54000591d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:09:51.543579 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4154785024}
I20260709 13:09:51.544746 27786 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.545233 27773 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.545903 27798 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.545756 27773 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.546360 27798 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.547983 27773 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.548491 27773 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:51.549589 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.550559 27878 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:51.551052 27878 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.552857 27879 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.553498 27748 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.553375 27879 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.554102 27748 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:51.554854 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 423518us
I20260709 13:09:51.555663 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:51.556643 27789 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:51.557068 27798 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.557135 27789 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.557703 27798 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.558152 27798 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.559381 27789 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:51.560006 27006 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:51.565337 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 1.82547e+06us
I20260709 13:09:51.565702 27006 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.564182 27771 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.568837 27771 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.571662 27006 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.573176 27006 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.574867 27006 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.578408 27006 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:51.562420 27458 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.581000 27458 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.583091 27458 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:51.563643 27878 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.560261 27798 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.545235 27786 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.563298 27807 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:51.555465 27879 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.563220 27769 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:51.588191 27769 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.592836 27769 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:51.594070 27786 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.561851 27561 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:51.548928 27773 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:51.576212 27789 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:51.596060 27789 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:51.598228 27773 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:51.596732 27771 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10.
W20260709 13:09:51.844233 24357 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.3:45959 timed out after 1.811s (SENT) [suppressed 15 similar messages]
W20260709 13:09:52.814159 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 969906us
W20260709 13:09:52.394556 22485 debug-util.cc:398] Leaking SignalData structure 0x7b080000fd80 after lost signal to thread 23743
W20260709 13:09:52.570701 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.816038 22485 kernel_stack_watchdog.cc:198] Thread 23743 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 1336ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 13:09:52.616148 23650 debug-util.cc:398] Leaking SignalData structure 0x7b0800315220 after lost signal to thread 22480
W20260709 13:09:52.818048 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08003122a0 after lost signal to thread 22483
I20260709 13:09:52.819391 27886 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.819978 27886 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:52.822634 27886 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:52.666826 27789 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:52.670019 23593 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:52.824226 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 154272us
I20260709 13:09:52.825917 27852 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.688820 27890 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.826419 27852 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:52.826730 27890 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:52.827930 27429 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:52.828473 27429 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:52.828788 27890 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:52.688843 27889 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.829491 27429 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:52.692183 27748 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:52.767319 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.830286 27889 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:52.836597 27889 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:52.832448 23668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.264s	user 0.011s	sys 0.008s
W20260709 13:09:52.843600 23668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.276s	user 0.012s	sys 0.008s
I20260709 13:09:52.847232 27789 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:52.848038 27789 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:52.850973 27789 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:52.853704 23669 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.297s	user 0.013s	sys 0.007s
W20260709 13:09:52.854743 23669 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.298s	user 0.013s	sys 0.007s
W20260709 13:09:52.855314 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 1.29963e+06us
I20260709 13:09:52.856043 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:52.778949 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.796094 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2060 after lost signal to thread 22483
W20260709 13:09:52.807312 23592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.093s	user 0.049s	sys 0.086s
I20260709 13:09:52.832485 27852 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:52.857805 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2560 after lost signal to thread 23561
W20260709 13:09:52.857697 23592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.144s	user 0.050s	sys 0.086s
W20260709 13:09:52.858387 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 3.15346e+06us
W20260709 13:09:52.859268 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8c40 after lost signal to thread 23653
I20260709 13:09:52.859517 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2088) took 2805 ms. Trace:
I20260709 13:09:52.859834 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:52.859903 23776 rpcz_store.cc:276] 0709 13:09:50.053737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.858751 (+2805014us) service_pool.cc:224] Handling call
0709 13:09:52.859058 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.859225 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.859248 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.859289 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:52.859320 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.859370 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.859461 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:52.861827 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:52.863371 27789 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.864266 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:52.865475 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:52.866194 27771 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.866919 27771 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:52.867090 27886 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:52.868327 27886 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:52.866941 27889 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:52.869401 27890 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:52.870821 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.875784 27890 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:52.876917 27890 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:52.879802 27890 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:52.886324 27889 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:52.887138 27886 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:52.887050 27889 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:52.887964 27886 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:52.891921 27852 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.890038 27889 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:52.893507 27889 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:52.893987 27889 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:52.897393 23799 debug-util.cc:398] Leaking SignalData structure 0x7b0800254ea0 after lost signal to thread 23728
W20260709 13:09:52.897773 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08003542c0 after lost signal to thread 23729
W20260709 13:09:52.898828 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0920 after lost signal to thread 23802
W20260709 13:09:52.900038 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08003777e0 after lost signal to thread 24418
W20260709 13:09:52.900333 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0160 after lost signal to thread 27345
I20260709 13:09:52.891527 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:52.900593 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08001a15c0 after lost signal to thread 27480
W20260709 13:09:52.900955 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08003b81c0 after lost signal to thread 27624
I20260709 13:09:52.892019 27881 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:52.901226 23799 debug-util.cc:398] Leaking SignalData structure 0x7b080038cfa0 after lost signal to thread 27700
W20260709 13:09:52.901422 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08003afac0 after lost signal to thread 27762
W20260709 13:09:52.901567 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08003a75e0 after lost signal to thread 27767
W20260709 13:09:52.901757 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08002bce60 after lost signal to thread 27784
W20260709 13:09:52.901898 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2f20 after lost signal to thread 27791
W20260709 13:09:52.902024 23799 debug-util.cc:398] Leaking SignalData structure 0x7b080012c920 after lost signal to thread 27794
W20260709 13:09:52.902143 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08003dc160 after lost signal to thread 27799
I20260709 13:09:52.902101 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:52.902576 23799 debug-util.cc:398] Leaking SignalData structure 0x7b080038a0a0 after lost signal to thread 27800
W20260709 13:09:52.902877 23799 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb720 after lost signal to thread 27817
I20260709 13:09:52.903467 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:52.903676 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:52.904227 23626 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:52.904831 23799 debug-util.cc:398] Leaking SignalData structure 0x7b0800125f80 after lost signal to thread 27854
I20260709 13:09:52.907066 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:52.907339 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:52.907977 23622 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.908196 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:52.908504 27881 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:52.912110 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:52.912956 23627 raft_consensus.cc:2368] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11.
I20260709 13:09:52.916030 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:52.920133 23626 raft_consensus.cc:2410] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:52.921355 27773 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.922212 27773 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.908164 27771 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:52.924561 27771 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:52.925557 27771 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:52.944917 23622 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:09:52.946971 23626 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:52.931905 27789 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.892560 27852 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:52.954823 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:52.956817 23626 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.958189 27852 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:52.959470 27881 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:52.953685 27789 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:52.960733 27789 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.956179 27886 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:52.964418 23626 raft_consensus.cc:2410] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:09:52.966701 24357 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Timed out: RequestConsensusVote RPC to 127.21.244.3:45959 timed out after 1.507s (SENT)
I20260709 13:09:52.968755 27886 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.969334 27886 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:52.971658 27886 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:52.974476 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:52.975337 23629 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:09:52.976665 23667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.420s	user 0.008s	sys 0.008s
W20260709 13:09:52.977154 23667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.421s	user 0.008s	sys 0.008s
W20260709 13:09:52.977468 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 1.4212e+06us
I20260709 13:09:52.979759 27807 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:52.980347 23593 leader_election.cc:336] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.540s (SENT)
I20260709 13:09:52.980918 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:52.981292 27807 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:52.982090 27807 consensus_queue.cc:1243] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:09:52.982573 27807 raft_consensus.cc:3055] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:52.982606 27886 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:52.982657 23622 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:52.984213 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:52.984587 23626 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:52.985606 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:52.986152 23626 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:52.986991 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:52.981031 27889 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:52.988379 23626 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:52.987566 23620 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:52.983018 27807 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:52.990717 24358 connection.cc:256] RPC call timeout handler was delayed by -1.3185381789999155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260709 13:09:52.991842 27874 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.992381 27874 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:52.993674 24389 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:52.994481 27874 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:53.008612 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.016288 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:53.016933 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 107506us
I20260709 13:09:53.017652 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:53.020620 27773 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:53.021036 27773 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:53.021404 27773 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:52.994752 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08000af920 after lost signal to thread 23561
I20260709 13:09:52.996336 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:53.024317 24390 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
W20260709 13:09:53.025025 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5ec0 after lost signal to thread 23653
W20260709 13:09:53.025367 23650 debug-util.cc:398] Leaking SignalData structure 0x7b0800326900 after lost signal to thread 23654
W20260709 13:09:53.026443 23650 debug-util.cc:398] Leaking SignalData structure 0x7b0800349380 after lost signal to thread 23728
W20260709 13:09:53.026729 23650 debug-util.cc:398] Leaking SignalData structure 0x7b0800227a20 after lost signal to thread 23729
W20260709 13:09:53.027041 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4940 after lost signal to thread 23743
I20260709 13:09:53.028401 24386 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:53.028944 27773 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:52.996449 23624 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:52.997867 27864 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.000787 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:53.001876 23623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 2705) took 2946 ms (client timeout 1920 ms). Trace:
W20260709 13:09:53.030822 23623 rpcz_store.cc:269] 0709 13:09:50.055426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.001643 (+2946217us) service_pool.cc:211] Skipping call since client already timed out
0709 13:09:53.001778 (+   135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:09:53.035848 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08002f26e0 after lost signal to thread 23802
I20260709 13:09:53.002861 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:53.003525 27886 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:53.045553 24387 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:53.003805 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:53.046859 23650 debug-util.cc:398] Leaking SignalData structure 0x7b080035d8c0 after lost signal to thread 23803
I20260709 13:09:53.047431 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:53.048393 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.048221 27904 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:09:53.048939 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.049674 27861 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:53.049978 27789 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.050254 27861 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.051698 27908 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:53.051905 27854 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:53.051965 27859 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.052434 27480 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:53.052502 27854 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.052680 27859 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.053200 27480 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.055222 27859 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.055917 27506 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.056131 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.056470 27506 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.056926 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.057564 23778 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:53.058053 27791 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:53.058349 27865 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:53.055104 27854 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:53.058764 27506 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.058950 27773 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:53.059890 27767 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.058992 27865 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.060612 27767 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.061419 27789 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:53.062031 27865 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.062600 27865 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.050746 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.034725 23523 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 8 to 9, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 9 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:53.064041 23624 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:53.064077 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.059541 27887 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:53.058861 27791 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.065894 27887 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.066885 27861 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.059510 27854 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.063119 27767 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:53.055330 27480 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.068531 27854 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.068539 27887 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:53.070978 27854 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.037892 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:53.071833 23769 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:53.073673 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.073836 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.074182 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:53.074404 23623 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:53.075417 27886 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.075896 27886 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.076006 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.076335 27886 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.076831 23776 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:53.078348 23650 debug-util.cc:398] Leaking SignalData structure 0x7b080038ece0 after lost signal to thread 24418
W20260709 13:09:53.078768 23650 debug-util.cc:398] Leaking SignalData structure 0x7b0800212740 after lost signal to thread 27345
I20260709 13:09:53.078624 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.079006 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.080875 23777 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:53.083877 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 46075us
I20260709 13:09:53.084196 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:53.085183 23776 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.041227 27888 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.087399 27888 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:53.088613 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08003ae520 after lost signal to thread 27480
W20260709 13:09:53.089165 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08003bfb20 after lost signal to thread 27624
W20260709 13:09:53.089566 23650 debug-util.cc:398] Leaking SignalData structure 0x7b0800399260 after lost signal to thread 27700
W20260709 13:09:53.089900 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2d40 after lost signal to thread 27762
W20260709 13:09:53.090209 23650 debug-util.cc:398] Leaking SignalData structure 0x7b0800082c80 after lost signal to thread 27767
I20260709 13:09:53.041885 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:53.047231 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 2.98897e+06us
I20260709 13:09:53.091488 27888 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:53.038465 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.052357 27908 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.114187 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:53.065224 23778 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:53.002228 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:53.115938 24389 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:53.118876 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:53.067891 27791 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:53.083884 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.063104 27865 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.086431 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.137046 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.137427 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.138051 23625 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:53.095322 23769 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:53.137046 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.142315 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:53.143292 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:53.144498 24358 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.507s (SENT)
I20260709 13:09:53.144971 24358 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.006294 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.146471 23620 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:09:52.990327 27807 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.096153 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:53.152396 23771 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:53.096408 23593 leader_election.cc:336] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.645s (SENT)
W20260709 13:09:53.153178 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 56799.1us
W20260709 13:09:53.154903 23593 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.694s (SENT)
I20260709 13:09:53.097441 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:53.098846 23626 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:53.029713 23621 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:53.099849 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:53.039852 23669 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:53.106359 23624 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:53.090672 23650 debug-util.cc:398] Leaking SignalData structure 0x7b0800341440 after lost signal to thread 27784
W20260709 13:09:53.158787 23650 debug-util.cc:398] Leaking SignalData structure 0x7b080035c160 after lost signal to thread 27791
W20260709 13:09:53.159205 23650 debug-util.cc:398] Leaking SignalData structure 0x7b0800380c40 after lost signal to thread 27794
W20260709 13:09:53.159813 23650 debug-util.cc:398] Leaking SignalData structure 0x7b080031ace0 after lost signal to thread 27799
W20260709 13:09:53.160419 23650 debug-util.cc:398] Leaking SignalData structure 0x7b080037eaa0 after lost signal to thread 27800
W20260709 13:09:53.160734 23650 debug-util.cc:398] Leaking SignalData structure 0x7b0800336d20 after lost signal to thread 27817
W20260709 13:09:53.161125 23650 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8800 after lost signal to thread 27854
I20260709 13:09:53.161922 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:53.107141 23743 connection.cc:256] RPC call timeout handler was delayed by -1.326967262999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 13:09:53.163967 23743 connection.cc:256] RPC call timeout handler was delayed by -1.3134672630000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
I20260709 13:09:53.111088 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:53.164191 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:53.111599 27789 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:53.169894 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.113018 27887 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.113469 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.113209 27886 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.175364 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.063864 23775 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:53.174048 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:53.133427 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:53.134017 24386 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:53.173966 23623 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:53.136471 27908 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.169678 27789 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.171555 23776 raft_consensus.cc:2410] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:09:53.172106 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.112565 23629 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:53.172868 27909 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.115100 24394 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:09:53.139933 27854 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.182288 27854 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.184649 27854 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:53.185329 27852 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.185819 27852 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.186179 27852 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.177160 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.188740 23771 raft_consensus.cc:2410] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:09:53.176705 23778 raft_consensus.cc:2376] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10. Re-sending same reply.
W20260709 13:09:53.179008 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 139282us
I20260709 13:09:53.190788 23669 leader_election.cc:400] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11.
I20260709 13:09:53.191108 23669 leader_election.cc:403] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:53.058091 27859 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.195344 23628 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:53.196952 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.201159 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.202415 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.205027 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.206357 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.206971 23771 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:09:53.208329 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.209153 23771 raft_consensus.cc:2393] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:53.213263 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.213501 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.214504 23771 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:53.215508 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:53.216599 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.218009 23771 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:53.219045 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.219682 23771 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:53.213977 23773 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:53.220649 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.220743 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.221043 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.221809 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.222728 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:53.222909 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 81435.7us
I20260709 13:09:53.223932 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.179545 27864 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.228888 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.178385 27783 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.234930 23624 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:53.228982 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.235750 23625 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:53.236058 23776 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:53.174274 27888 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.237351 27888 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.230528 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.238346 23775 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
W20260709 13:09:53.238813 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.230885 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.240054 27888 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:53.232416 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.240248 23773 raft_consensus.cc:2410] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:09:53.232121 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.250699 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.253206 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.258595 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.258868 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:53.260466 23777 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:09:53.220291 27807 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:53.262538 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 90536.5us
W20260709 13:09:53.261893 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 161325us
I20260709 13:09:53.275218 23742 leader_election.cc:400] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
I20260709 13:09:53.236706 27854 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:53.281299 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.282296 23778 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:53.272187 23773 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:53.187994 27887 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.214274 27859 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.288400 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.272176 27773 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:53.309957 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.308756 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:53.288717 24357 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:53.286060 23778 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:53.313438 23771 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:09:53.277838 27905 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.256589 27864 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.319199 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.320494 23778 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:53.092715 23523 catalog_manager.cc:5697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 10 to 11, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 11 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.276264 27865 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:53.322443 23769 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:53.321993 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.327126 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:53.328985 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.323405 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.330905 23776 raft_consensus.cc:2410] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:09:53.333088 23774 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.333266 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.276710 27841 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 13:09:53.345144 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.347064 23593 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.916s (SENT)
W20260709 13:09:53.403406 23527 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52058 (request call id 189) took 28024 ms (client timeout 15000 ms). Trace:
I20260709 13:09:53.333597 23743 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:53.350768 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:53.347118 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:53.404281 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 70754.8us
W20260709 13:09:53.403901 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 56866.8us
I20260709 13:09:53.402149 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:53.410290 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.410975 23776 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
W20260709 13:09:53.413959 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 66944.9us
I20260709 13:09:53.414999 23742 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:53.417178 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 193587us
W20260709 13:09:53.431030 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 240374us
I20260709 13:09:53.431988 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:53.440496 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.437927 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.441908 23771 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:53.343647 27908 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:09:53.451011 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.453832 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 145159us
W20260709 13:09:53.403867 23527 rpcz_store.cc:269] 0709 13:09:25.379165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.379514 (+   349us) service_pool.cc:224] Handling call
0709 13:09:53.403333 (+28023819us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:49.436841 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:49.506356 (+ 69515us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:49.506428 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:09:49.506455 (+    27us) tablet.cc:662] Decoding operations
0709 13:09:49.507927 (+  1472us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:49.508031 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:49.508079 (+    48us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:09:49.509256 (+  1177us) tablet.cc:701] Row locks acquired
0709 13:09:49.509320 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:09:49.509583 (+   263us) write_op.cc:270] Start()
0709 13:09:49.509798 (+   215us) write_op.cc:276] Timestamp: P: 1783602589509471 usec, L: 0
0709 13:09:49.509824 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:09:49.659447 (+149623us) log.cc:844] Serialized 3718 byte log entry
0709 13:09:50.065153 (+405706us) op_driver.cc:464] REPLICATION: finished
0709 13:09:50.361275 (+296122us) write_op.cc:301] APPLY: starting
0709 13:09:50.361434 (+   159us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:50.362510 (+  1076us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:50.362654 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:50.685762 (+323108us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:51.021310 (+335548us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:09:51.041048 (+ 19738us) write_op.cc:312] APPLY: finished
0709 13:09:51.091447 (+ 50399us) log.cc:844] Serialized 71 byte log entry
0709 13:09:51.106964 (+ 15517us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:51.107126 (+   162us) write_op.cc:454] Released schema lock
0709 13:09:51.107205 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:51.416375 (+309170us) spinlock_profiling.cc:243] Waited 58.1 ms on lock 0x7b54000b90d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41307e28 00007f2b44d42581 00007f2b44d41d58 00007f2b44d469f1 00007f2b44d469a9 00007f2b44d46939 00007f2b44d46901 00007f2b44d45b2d 000000000038f354 000000000038f199
0709 13:09:51.416575 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:51.416593 (+    18us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8888939,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":65418,"apply.run_cpu_time_us":13461,"apply.run_wall_time_us":778673,"num_ops":9,"prepare.queue_time_us":153930,"prepare.run_cpu_time_us":80380,"prepare.run_wall_time_us":1996793,"raft.queue_time_us":50021,"raft.run_cpu_time_us":7687,"raft.run_wall_time_us":8429,"replication_time_us":555133,"spinlock_wait_cycles":133694208,"thread_start_us":290449,"threads_started":5,"wal-append.queue_time_us":289146,"wal-append.run_cpu_time_us":24496,"wal-append.run_wall_time_us":2839250}]]}
I20260709 13:09:53.457638 24359 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:53.409296 27865 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.447299 27874 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:53.464913 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "737154dff44a498f96f906fc83416830"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:53.465579 23771 raft_consensus.cc:606] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.465946 23771 raft_consensus.cc:614] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:53.430809 27480 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.431195 27767 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:53.464674 27874 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.334195 27854 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:09:53.469931 23592 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.478513 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:53.439851 27748 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.448071 27791 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:53.470009 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:53.452749 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.441367 27904 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.480351 27930 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:53.484077 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:53.471719 23774 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:53.454615 27790 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.492317 27748 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.446017 27861 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:09:53.512349 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:53.510298 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 57679.9us
I20260709 13:09:53.514850 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.475461 27767 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.497092 27909 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:53.496696 27908 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:53.510969 27748 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:53.521343 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 111968us
I20260709 13:09:53.513029 27886 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.516808 27480 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.522711 27789 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.516844 27767 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:53.517251 27841 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.531893 27917 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:53.533535 27864 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:53.534307 27914 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:53.534888 27915 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.071s	user 0.000s	sys 0.002s
I20260709 13:09:53.519884 27860 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:53.627117 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 100210us
I20260709 13:09:53.668357 27860 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:53.522264 27865 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:53.668916 27860 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.519268 27909 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:53.671284 27909 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:53.672936 27909 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.676687 27914 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:53.677348 27914 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.678155 27860 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.680663 27860 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.683017 27865 consensus_queue.cc:1059] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:09:53.631126 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 141602us
W20260709 13:09:53.626201 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 95958.8us
W20260709 13:09:53.632328 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 153918us
I20260709 13:09:53.620294 27841 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:53.630849 27931 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:09:53.686789 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:53.691928 23771 raft_consensus.cc:606] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.692306 23771 raft_consensus.cc:614] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:53.685070 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.689406 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:53.695806 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:09:53.696105 27345 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:53.696465 23771 raft_consensus.cc:606] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:09:53.696870 23771 raft_consensus.cc:614] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:53.697988 27860 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:53.700284 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:53.699924 27908 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.701236 27923 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.702135 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:53.701797 27923 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:53.709069 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 239110us
I20260709 13:09:53.726068 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:53.627897 27859 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:53.728724 27860 consensus_queue.cc:1059] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:53.728080 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:53.690492 27841 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.735948 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:53.741127 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:53.732625 27789 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:53.704926 27861 consensus_queue.cc:1059] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:09:53.771489 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 312660us
I20260709 13:09:53.725207 27762 consensus_queue.cc:1059] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:09:53.773850 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:53.772828 27913 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:09:53.756779 27887 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:53.777704 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:53.780315 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:53.781312 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 98875.2us
I20260709 13:09:53.770511 27919 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:53.758749 27889 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:53.785274 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:53.756415 27881 raft_consensus.cc:3055] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:53.732347 27912 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:09:53.816258 27881 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:53.816354 27936 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:53.816977 27936 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.817373 27936 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:53.817979 27920 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:09:53.818336 27864 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:53.813325 24359 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:53.520294 23523 catalog_manager.cc:5697] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 5 to 7, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 7 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:53.819559 23592 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:09:53.819623 22485 debug-util.cc:398] Leaking SignalData structure 0x7b080000fda0 after lost signal to thread 23743
I20260709 13:09:53.779179 27790 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:53.824255 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:53.772143 27938 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:09:53.828549 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 143578us
I20260709 13:09:53.821271 24359 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:53.815366 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:53.812516 27860 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:53.835108 24386 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:53.816359 27937 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:53.835144 23592 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:53.841787 23592 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:53.843382 23742 connection.cc:256] RPC call timeout handler was delayed by -2.5446491799999649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260709 13:09:53.844524 23742 connection.cc:256] RPC call timeout handler was delayed by -2.4590348169999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 13:09:53.820169 27861 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.825724 27789 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.828379 27930 raft_consensus.cc:2764] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:53.828953 27799 raft_consensus.cc:3055] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:53.835486 27865 consensus_queue.cc:1243] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:53.833570 27874 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.827085 27790 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:53.853056 27916 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.842013 27886 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.853770 27942 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:53.853518 27933 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:09:53.834184 27919 raft_consensus.cc:697] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:53.873356 27919 consensus_queue.cc:237] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.838760 27860 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.876006 27860 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.877094 27925 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.877629 27925 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.877993 27925 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.859772 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:53.881187 24393 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:53.881479 23523 catalog_manager.cc:5697] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 3 to 7, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 7 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:53.881832 27790 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.825598 27884 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:09:53.847043 27889 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:53.849754 27937 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.870431 27881 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.834525 27912 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:09:53.842824 27748 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.883659 27790 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:53.884258 27927 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.248s	user 0.001s	sys 0.001s
I20260709 13:09:53.883888 27939 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.909193 27939 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:53.909634 27939 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.910380 27913 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.910878 27913 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.889415 27942 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:53.911947 27942 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.912493 27773 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:53.891780 27874 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:53.856320 27799 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:53.888067 27852 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.701s	user 0.007s	sys 0.007s
I20260709 13:09:53.914050 27852 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.914973 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:53.915259 24390 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:53.902753 27908 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:53.899479 27854 raft_consensus.cc:3055] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:53.913126 27773 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.916484 27908 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:53.888618 27767 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.912505 27889 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.918256 27889 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.918546 27767 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:53.918589 24391 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:53.918833 24388 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:53.906301 27923 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:53.919965 27904 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.913153 27874 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.920902 23769 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:53.921183 27874 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:53.921464 27799 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.922166 24387 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:53.886698 27905 consensus_meta.cc:287] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.001s
I20260709 13:09:53.916558 27854 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:53.917367 27908 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:53.925405 27854 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:53.926957 27854 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.928061 27933 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:53.929670 27748 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:53.932471 27908 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:53.924203 27905 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11.
I20260709 13:09:53.945429 27937 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.827795 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:53.963018 24393 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
W20260709 13:09:53.961830 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 131406us
W20260709 13:09:53.972920 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 145252us
I20260709 13:09:53.977219 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:53.977574 23703 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:53.979514 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:53.980347 23701 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:53.981877 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:53.983129 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:53.984905 23696 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:53.980818 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:53.987388 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:53.988044 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:53.988837 23697 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:53.974500 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:53.991035 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.993124 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:53.993867 23697 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:53.994140 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.967655 27799 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:53.988000 23703 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:53.997921 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:53.998088 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:53.998777 23703 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:53.999825 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:53.995838 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:53.996141 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.000576 23698 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:53.999715 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:53.996883 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.002321 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.001513 23695 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:09:54.003787 23624 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:54.002944 23702 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 5.
I20260709 13:09:53.976133 27881 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.004884 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.008586 23702 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:53.974042 27852 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:54.008862 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:54.005206 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.004081 23699 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:09:54.010111 23703 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:54.004251 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.010963 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.011171 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:53.912117 23523 catalog_manager.cc:5697] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 4 to 7, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 7 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:09:54.020299 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.013777 23696 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: [11.6-12.7]
I20260709 13:09:54.020941 23703 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:09:54.021325 23700 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:54.014395 23667 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:54.006368 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.022362 23695 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:53.978008 27938 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:54.022750 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.004335 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.006202 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.023778 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.024153 23622 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:54.004907 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:53.992775 27773 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:54.023473 23704 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:54.006711 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.026935 23698 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.030961 27913 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:54.026369 27923 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:54.031852 27923 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:54.032317 27923 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.032729 23695 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:54.016312 27480 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:54.024171 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:54.037339 27889 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.024392 24388 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:54.025631 23701 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:53.906018 27914 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:54.031904 27936 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.041373 27914 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:54.041456 27936 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:54.041654 27939 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:54.042790 24386 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:54.044319 27859 raft_consensus.cc:3055] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:54.044714 27859 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:54.045475 27859 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.046567 27859 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:54.021787 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.049882 23703 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:54.004015 27945 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:09:54.051007 23625 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:54.023332 23696 raft_consensus.cc:2376] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11. Re-sending same reply.
W20260709 13:09:54.053505 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 184962us
I20260709 13:09:54.020152 27912 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:54.019585 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 177869us
I20260709 13:09:54.060760 23701 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:09:54.057169 27912 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.066890 27789 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:54.056676 23592 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:54.012784 27807 consensus_meta.cc:287] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.730s	user 0.003s	sys 0.008s
I20260709 13:09:54.067337 27912 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:54.068710 27789 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.096305 27789 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.077553 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:54.098268 27913 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:54.050633 27480 raft_consensus.cc:3055] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:54.099215 27480 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:54.100191 27480 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:54.039605 27889 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:54.090689 23668 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:54.055909 27939 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:54.102720 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:54.052578 27938 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:54.104555 27938 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.095005 27936 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:54.107997 27936 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.108500 27936 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:54.109863 27913 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:54.110769 27913 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:54.119293 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.130595 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:54.145344 27905 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:54.145968 27905 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:54.147094 27905 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.149550 27905 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:54.157258 27955 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:09:54.200374 27881 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.201148 27881 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.204536 27881 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:54.296535 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.296799 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.297015 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:54.297120 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.297286 23702 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:54.297447 23701 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:09:54.297659 23622 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:54.069929 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:54.296499 23667 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:54.299038 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:54.299518 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 229663us
I20260709 13:09:54.299718 23697 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:54.300267 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:54.299386 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 196750us
I20260709 13:09:54.301357 23770 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:54.170378 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.302630 23625 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:54.302888 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:54.303663 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:54.304491 23698 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:54.171015 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.307617 23621 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:09:54.308051 23621 pending_rounds.cc:85] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 6
I20260709 13:09:54.308254 23621 pending_rounds.cc:107] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:09:54.308475 23621 raft_consensus.cc:2889] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.311887 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.312963 23697 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:54.313256 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.313901 23698 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:54.315398 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.317108 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:54.317679 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.318250 23701 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:09:54.318543 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.318729 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.319007 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.319103 23699 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.319229 23696 raft_consensus.cc:2376] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10. Re-sending same reply.
I20260709 13:09:54.319657 23701 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.309777 27881 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:54.320550 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.320999 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.321128 23702 raft_consensus.cc:2376] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12. Re-sending same reply.
I20260709 13:09:54.321813 23703 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:54.322676 27771 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:54.322708 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.321269 27889 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:54.376876 23624 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:54.310308 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:54.330875 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.310781 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:54.380715 23625 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:54.343010 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:54.401901 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.402637 23627 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:54.402875 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:54.402997 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 92749us
I20260709 13:09:54.404179 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:54.406440 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.407248 23703 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:09:54.412294 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:54.416211 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.417027 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.420779 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49374.4us
I20260709 13:09:54.323211 27771 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.423491 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.424316 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.478700 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.480032 23698 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:54.422880 27771 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:54.484953 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:54.485790 23777 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:54.309422 27807 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:54.484845 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.094895 23523 catalog_manager.cc:5697] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 3 to 8, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 8 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.484907 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.378912 27480 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.501317 23696 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.496234 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:54.504966 23622 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
W20260709 13:09:54.498445 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 172082us
I20260709 13:09:54.498363 23699 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:54.508633 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:54.509646 23776 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.512123 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:54.517382 23593 leader_election.cc:336] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.505s (SENT)
I20260709 13:09:54.517959 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:54.518028 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.519899 23769 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:54.519578 23593 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.636s (SENT)
I20260709 13:09:54.520617 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:54.521936 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.483928 27950 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:54.525204 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.531414 23701 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:54.559109 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:54.560017 23772 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.565860 23699 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:54.491460 27889 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:54.566831 23776 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:54.569167 23699 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:54.483212 27783 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:09:54.492409 27807 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.579224 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.620617 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:54.580135 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.621727 23703 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:54.621577 24391 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:54.580832 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.622644 23698 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:54.582379 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.621727 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:54.623543 23701 raft_consensus.cc:2376] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10. Re-sending same reply.
W20260709 13:09:54.627115 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 118656us
W20260709 13:09:54.587145 27937 consensus_meta.cc:287] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.003s
I20260709 13:09:54.591004 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.592101 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:54.593351 24390 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:54.576071 27914 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:54.605978 27790 consensus_meta.cc:287] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.699s	user 0.015s	sys 0.010s
W20260709 13:09:54.607419 27925 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.729s	user 0.021s	sys 0.007s
I20260709 13:09:54.527312 27950 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.539661 27952 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
W20260709 13:09:54.613919 27860 consensus_meta.cc:287] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.737s	user 0.016s	sys 0.012s
I20260709 13:09:54.517426 27888 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:54.641754 27799 consensus_meta.cc:287] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.637s	user 0.017s	sys 0.002s
I20260709 13:09:54.634774 23772 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:54.635757 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:54.636533 23702 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:54.636680 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:54.659675 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.661402 23702 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:54.663375 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.664068 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:54.638839 23696 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:54.669157 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.671937 23696 raft_consensus.cc:2376] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10. Re-sending same reply.
I20260709 13:09:54.675935 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.678161 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.685715 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.687021 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.679438 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.620802 27881 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:54.629851 27807 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.688755 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.699102 23701 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:54.640321 27950 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:54.690938 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:54.719326 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 410583us
I20260709 13:09:54.718667 23696 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
W20260709 13:09:54.696365 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.689929 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:54.680755 27942 consensus_meta.cc:287] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.768s	user 0.012s	sys 0.019s
I20260709 13:09:54.707549 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.708323 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:54.638172 27937 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.664996 27914 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:54.711987 27874 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.790s	user 0.003s	sys 0.029s
I20260709 13:09:54.497314 23523 catalog_manager.cc:5697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:54.712873 27923 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.680s	user 0.005s	sys 0.027s
W20260709 13:09:54.713831 27908 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.781s	user 0.020s	sys 0.005s
I20260709 13:09:54.704178 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:54.733729 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.665580 27860 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.793318 27860 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:54.742928 23702 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:54.741677 23703 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:09:54.765614 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.795428 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:54.796664 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:54.797420 23625 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:54.798177 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.799175 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.765867 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.767130 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.801595 23622 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:54.767994 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.802383 23628 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:54.802666 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.803180 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.803887 23628 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:54.804277 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.805138 23622 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:54.801775 23620 raft_consensus.cc:2410] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:09:54.810655 27912 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.715s	user 0.018s	sys 0.018s
I20260709 13:09:54.811219 27912 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.664842 27925 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:54.816401 27925 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:54.818264 27905 consensus_meta.cc:287] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.668s	user 0.004s	sys 0.021s
I20260709 13:09:54.820621 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.821319 23620 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:09:54.701783 27948 consensus_queue.cc:1059] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:09:54.824584 27908 raft_consensus.cc:3055] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:54.824992 27908 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:54.825889 27908 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:54.828460 27953 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.534s	user 0.002s	sys 0.000s
I20260709 13:09:54.833469 27937 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:54.837100 27936 consensus_meta.cc:287] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.728s	user 0.027s	sys 0.007s
I20260709 13:09:54.837685 27936 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:54.841039 27789 consensus_meta.cc:287] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.744s	user 0.017s	sys 0.017s
I20260709 13:09:54.841497 27789 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.842793 23704 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:54.719534 27889 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:54.848417 27854 consensus_meta.cc:287] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.921s	user 0.017s	sys 0.014s
I20260709 13:09:54.768013 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.768785 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.849483 23626 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:09:54.768900 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.849923 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.716789 27881 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:54.789908 27923 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.768241 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.857420 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:54.858142 23626 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.851807 24394 raft_consensus.cc:2368] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
I20260709 13:09:54.681795 27888 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:54.852056 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.852521 23697 raft_consensus.cc:2410] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:09:54.854506 23774 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:09:54.875406 23774 pending_rounds.cc:85] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 8
I20260709 13:09:54.875681 23774 pending_rounds.cc:107] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:09:54.876166 23774 raft_consensus.cc:2889] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.880975 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46580 (request call id 617) took 1050 ms. Trace:
W20260709 13:09:54.856138 27841 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 1.097s	user 0.012s	sys 0.016s
I20260709 13:09:54.884065 23626 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:54.881462 24394 rpcz_store.cc:276] 0709 13:09:53.830852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.959985 (+129133us) service_pool.cc:224] Handling call
0709 13:09:54.874862 (+914877us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54004713d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:54.880902 (+  6040us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009372416}
I20260709 13:09:54.889030 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:54.890275 23695 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:54.893311 23625 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:54.855538 27789 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:54.863924 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 344349us
W20260709 13:09:54.901649 23593 leader_election.cc:336] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.636s (SENT)
I20260709 13:09:54.785553 27942 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:54.893812 27913 consensus_meta.cc:287] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.783s	user 0.020s	sys 0.013s
I20260709 13:09:54.852789 27874 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:54.916834 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:54.895969 27841 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:54.932881 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:54.917594 27789 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.916843 27914 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:54.910285 27912 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:54.968101 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:54.972370 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 70746.2us
I20260709 13:09:54.929421 27936 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:54.977450 23625 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:54.980921 23622 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:09:54.987221 24393 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:54.963616 27854 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:54.965420 27913 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:54.989713 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:54.995253 27860 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:54.982313 27789 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:54.975559 27937 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:54.994802 23592 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:55.005774 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 383116us
I20260709 13:09:55.008069 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:55.028245 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:55.032840 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46566 (request call id 701) took 1057 ms. Trace:
I20260709 13:09:55.034740 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:55.033275 24393 rpcz_store.cc:276] 0709 13:09:53.975525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.997532 (+ 22007us) service_pool.cc:224] Handling call
0709 13:09:55.032617 (+1035085us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54001f1dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:55.032762 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273232256}
I20260709 13:09:55.001009 23592 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:55.038337 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:55.034989 23699 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:54.996526 27942 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:55.036010 27790 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.040149 27884 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:54.992093 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1893) took 1003 ms. Trace:
I20260709 13:09:55.005993 27860 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:55.046196 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:55.053228 23700 rpcz_store.cc:276] 0709 13:09:53.988838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.022296 (+ 33458us) service_pool.cc:224] Handling call
0709 13:09:54.022560 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.022880 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:54.316016 (+293136us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.991475 (+675459us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.991721 (+   246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:54.991787 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:54.991837 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.991911 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.992035 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24115,"prepare.queue_time_us":5765,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":65,"raft.queue_time_us":260068,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":25393,"spinlock_wait_cycles":14359808,"thread_start_us":950056,"threads_started":3,"wal-append.queue_time_us":562482}
I20260709 13:09:55.005790 27949 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:55.064838 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:55.070895 23774 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.997159 27854 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.036134 27945 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:55.074473 27884 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:55.081784 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:55.082585 23769 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.037637 27799 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:55.062971 27860 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.070044 27937 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:55.034415 27950 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.080940 27884 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.078838 27923 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:55.078342 27942 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:55.080956 27888 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:55.091257 23774 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:55.068775 27790 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.091055 27945 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:55.091552 27860 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.092674 27799 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 13:09:55.100179 27771 consensus_meta.cc:287] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.002s
I20260709 13:09:55.078624 27949 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.117386 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:55.099388 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 454700us
W20260709 13:09:55.103826 27859 consensus_meta.cc:287] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.057s	user 0.015s	sys 0.016s
I20260709 13:09:55.123492 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.126972 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.128518 23695 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:55.129122 23697 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
W20260709 13:09:55.112118 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.113572 23700 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:55.131384 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.114293 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:55.132905 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:55.133525 23777 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:55.106681 27937 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:55.089993 27936 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 13:09:55.135859 23775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.021s	sys 0.007s
W20260709 13:09:55.138165 23775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.021s	sys 0.007s
I20260709 13:09:55.139307 23699 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:09:55.112726 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:55.140447 23774 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:55.140638 27949 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:55.151208 23774 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
W20260709 13:09:55.157909 24357 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.004s	sys 0.029s
W20260709 13:09:55.172147 24357 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.004s	sys 0.029s
I20260709 13:09:55.132740 27841 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:55.116705 27771 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:55.164568 27939 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:55.182152 23771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.019s	sys 0.010s
W20260709 13:09:55.182582 23771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.019s	sys 0.010s
W20260709 13:09:55.182928 23743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.032s
W20260709 13:09:55.183274 23743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.000s	sys 0.032s
W20260709 13:09:55.183620 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 554301us
W20260709 13:09:55.184904 24358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.017s	sys 0.014s
W20260709 13:09:55.185266 24358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.017s	sys 0.014s
W20260709 13:09:55.185715 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 519580us
I20260709 13:09:55.186429 23697 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:55.187336 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:55.135548 27859 consensus_queue.cc:1059] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:09:55.174154 27949 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.198181 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.203418 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.204394 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.196377 23592 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:55.148469 27874 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:55.189308 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.200203 23699 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:55.209319 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.210362 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:55.211230 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:55.211674 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:55.212280 23778 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:55.212064 23772 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:09:55.221781 23774 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.180514 27939 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:55.214931 23743 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:55.239408 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:55.242419 23622 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:55.243260 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:55.244875 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 270278us
I20260709 13:09:55.245447 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.198810 27968 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:55.248849 23700 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
W20260709 13:09:55.250057 23593 leader_election.cc:336] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.661s (SENT)
I20260709 13:09:55.250460 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:55.214534 27854 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:55.280117 23774 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:55.207310 27949 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.276507 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.181552 27945 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:55.239140 27948 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:55.285043 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:55.302528 23622 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:55.288475 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.304006 23697 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:55.245405 27789 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:55.306207 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:55.289918 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:55.290366 23667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.011s	sys 0.016s
I20260709 13:09:55.233078 27966 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:55.292179 23670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.015s	sys 0.010s
W20260709 13:09:55.313485 23667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.011s	sys 0.016s
I20260709 13:09:55.313885 23774 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.348976 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.350111 23700 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:55.314772 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.356606 23697 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
W20260709 13:09:55.360270 24358 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.706s (SENT)
I20260709 13:09:55.289423 27950 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:55.236374 27973 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:09:55.365619 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:55.367898 23670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.018s	sys 0.022s
I20260709 13:09:55.368769 23774 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
W20260709 13:09:55.369546 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.295401 27952 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:55.379161 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:55.375485 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:55.213578 27937 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.380173 23777 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:55.374291 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:55.381254 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.384002 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:55.388211 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:55.390992 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.392457 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:55.313337 27968 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:55.384675 23769 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:55.402061 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:55.396165 23774 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:55.405697 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:55.407303 23777 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:55.304963 27852 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 13:09:55.411290 24358 leader_election.cc:336] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.811s (SENT)
I20260709 13:09:55.312991 27888 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:09:55.376674 27881 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:55.366920 27790 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:55.415230 23703 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:55.411921 23777 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:55.415970 24358 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:55.417260 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:55.461833 23769 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:55.419262 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:55.418548 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:55.420256 23696 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:55.462702 23701 raft_consensus.cc:2376] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13. Re-sending same reply.
I20260709 13:09:55.410501 23700 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:55.463930 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:55.432649 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 113844us
I20260709 13:09:55.451309 23704 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:55.385735 27799 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.453147 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:55.469789 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.454655 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:55.455531 27948 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:55.457089 27854 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:55.376355 27789 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:09:55.467540 23626 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:55.473263 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:55.290807 27939 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:55.415195 27908 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:55.415702 27950 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:55.380272 27874 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:09:55.411492 27964 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:55.529388 27942 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:55.512310 27854 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:55.393982 27952 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:55.516500 27771 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:55.528276 27841 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:55.517395 27948 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.371130 27967 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
W20260709 13:09:55.668753 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 199778us
I20260709 13:09:55.555110 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1914) took 1047 ms. Trace:
I20260709 13:09:55.556350 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:55.564293 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:55.564775 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:55.565100 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:55.538105 27975 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:09:55.569269 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:55.535557 27974 raft_consensus.cc:3055] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:55.492614 27790 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:55.634789 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 153418us
I20260709 13:09:55.468770 27799 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.645224 27789 consensus_queue.cc:1243] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:09:55.568094 27971 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
W20260709 13:09:55.567524 27985 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:09:55.491353 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:55.673113 23620 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:55.673254 23699 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:55.673873 23702 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.669494 23770 rpcz_store.cc:276] 0709 13:09:54.507354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.507474 (+   120us) service_pool.cc:224] Handling call
0709 13:09:54.538001 (+ 30527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.978345 (+440344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.978392 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.979009 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.240626 (+261617us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:55.240667 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.240729 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.554797 (+314068us) raft_consensus.cc:1685] finished
0709 13:09:55.554831 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.555025 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93294,"raft.queue_time_us":140611,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10644,"thread_start_us":595441,"threads_started":2,"wal-append.queue_time_us":498443}
W20260709 13:09:55.679276 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 268005us
I20260709 13:09:55.552026 27966 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:09:55.542419 27989 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:09:55.566376 27980 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 13:09:55.547401 27977 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 13:09:55.625885 27950 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:55.652762 27841 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:55.725755 27841 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:55.689154 27974 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:55.708956 27969 consensus_queue.cc:1059] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:09:55.728545 27969 raft_consensus.cc:3055] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:55.687258 27968 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:55.730593 27480 consensus_meta.cc:287] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.212s	user 0.013s	sys 0.002s
I20260709 13:09:55.731693 23776 raft_consensus.cc:2410] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:09:55.713464 23778 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
W20260709 13:09:55.696477 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 127320us
I20260709 13:09:55.675364 27962 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:55.676548 27982 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:55.702003 27986 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.761206 27952 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:55.761459 27986 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:55.762398 27854 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:55.732482 27859 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.728917 27969 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:55.764262 27984 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.288s	user 0.000s	sys 0.000s
I20260709 13:09:55.763970 27859 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:55.764489 27969 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.765594 27969 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.704010 27790 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:55.695699 27923 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.768272 27790 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:55.768131 27923 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:55.769150 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1913) took 1263 ms. Trace:
I20260709 13:09:55.770349 27923 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:09:55.769639 23775 rpcz_store.cc:276] 0709 13:09:54.505949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.506115 (+   166us) service_pool.cc:224] Handling call
0709 13:09:54.506594 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.627097 (+120503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.627126 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.627586 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.143394 (+515808us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:55.143457 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.143553 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.768880 (+625327us) raft_consensus.cc:1685] finished
0709 13:09:55.768902 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.769078 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140410,"raft.queue_time_us":123030,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":44459,"thread_start_us":510723,"threads_started":1,"wal-append.queue_time_us":653803}
I20260709 13:09:55.709585 27949 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:55.691673 27799 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:55.794977 27966 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:55.804216 27807 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.097s	user 0.013s	sys 0.000s
I20260709 13:09:55.804774 27807 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.805485 27913 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:55.806126 27913 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:55.807009 27807 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:55.674504 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.733474 23778 raft_consensus.cc:2410] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:09:55.701948 27940 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:55.807407 27913 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:55.901481 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 190162us
I20260709 13:09:55.838191 27986 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:55.894904 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:55.771844 27962 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:55.896525 23697 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:55.902633 23777 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:55.795418 27950 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:55.941685 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47685us
I20260709 13:09:55.898403 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1915) took 1390 ms. Trace:
I20260709 13:09:55.943356 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:55.900502 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 363484us
W20260709 13:09:55.901074 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.910450 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 430472us
I20260709 13:09:55.907698 24359 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:55.943890 24358 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.184s (SENT)
I20260709 13:09:55.946038 27964 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:55.960655 27964 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.961311 23743 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:55.910415 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:55.963567 24394 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:55.811543 27841 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:55.972144 28029 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:55.974128 24391 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:55.973753 28029 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:55.975404 27961 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:09:55.977566 28028 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.133s	user 0.000s	sys 0.002s
W20260709 13:09:55.985817 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.988175 27841 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:55.994035 23778 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:55.994483 23775 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:55.989951 27962 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:55.945101 23771 rpcz_store.cc:276] 0709 13:09:54.507804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.507925 (+   121us) service_pool.cc:224] Handling call
0709 13:09:54.518705 (+ 10780us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.182965 (+664260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.183009 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.183602 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.377604 (+194002us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:55.478079 (+100475us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.529193 (+ 51114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.532072 (+  2879us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.897608 (+365536us) raft_consensus.cc:1685] finished
0709 13:09:55.897665 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.898041 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157820,"prepare.queue_time_us":275872,"prepare.run_cpu_time_us":1213,"prepare.run_wall_time_us":3142,"raft.queue_time_us":198748,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":12881,"thread_start_us":774702,"threads_started":3,"wal-append.queue_time_us":529422}
W20260709 13:09:56.001261 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 64061.9us
W20260709 13:09:56.005002 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 62018us
I20260709 13:09:56.006805 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:56.009222 24358 leader_election.cc:336] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.857s (SENT)
W20260709 13:09:56.009975 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 102708us
I20260709 13:09:56.010252 27962 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:56.011102 24359 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:56.013046 27961 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:56.014770 28009 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:56.015027 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54074.5us
I20260709 13:09:56.015450 27962 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:56.015698 27874 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:56.015914 28023 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.045109 27925 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:56.045447 27859 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:56.045694 27925 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:56.048015 28004 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.049085 28004 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:56.051404 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.055503 27937 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:56.056075 28009 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.056213 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.047173 27925 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.056447 27974 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.058038 27925 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.021704 27962 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.066943 27962 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:56.068324 28011 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:56.070559 28011 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:56.055528 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1912) took 1552 ms. Trace:
I20260709 13:09:56.074156 27807 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:56.073225 23773 rpcz_store.cc:276] 0709 13:09:54.502597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.502794 (+   197us) service_pool.cc:224] Handling call
0709 13:09:54.503244 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.628034 (+124790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.628064 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.628569 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.182703 (+554134us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:55.182741 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.182804 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.055001 (+872197us) raft_consensus.cc:1685] finished
0709 13:09:56.055041 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.055246 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65520,"raft.queue_time_us":125599,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":41596,"thread_start_us":481447,"threads_started":1,"wal-append.queue_time_us":1310318}
I20260709 13:09:56.014726 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:56.074908 27807 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.080471 24394 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:09:56.010020 24358 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:56.056701 28009 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.078702 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:56.119170 27961 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:56.121481 28031 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:56.122748 28027 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:56.124051 27904 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.124503 28027 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:56.124868 27904 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.126190 28027 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:56.128707 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 114345us
I20260709 13:09:56.129748 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:56.132985 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 108147us
I20260709 13:09:56.131379 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.138751 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:56.056512 27937 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.148633 23773 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:09:56.151981 23770 raft_consensus.cc:2410] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:56.151937 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:56.127540 27904 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:56.115414 27962 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:56.168653 27983 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:56.169564 27983 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.182250 28004 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:56.183600 23702 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
W20260709 13:09:56.188086 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 52661.8us
I20260709 13:09:56.192124 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:56.185245 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:56.196161 27962 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.200425 27940 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:56.201117 27940 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:56.201613 27940 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:56.203761 27859 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.167943 27874 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.204630 27859 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.206919 27874 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:56.201552 23776 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42298 (request call id 885) took 1591 ms (client timeout 1633 ms). Trace:
W20260709 13:09:56.208539 23776 rpcz_store.cc:269] 0709 13:09:54.594267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.635410 (+ 41143us) service_pool.cc:224] Handling call
0709 13:09:56.184836 (+1549426us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003fedd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:56.185167 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457455872}
W20260709 13:09:56.209638 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 202068us
I20260709 13:09:56.213106 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:56.213459 27968 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:56.214572 23623 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:56.215143 27937 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:56.217541 27904 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:56.205313 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 196273us
I20260709 13:09:56.218219 27904 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.220093 27993 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.220675 27904 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:56.222155 28029 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:56.221592 24358 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.954s (SENT)
W20260709 13:09:56.222656 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 71083.6us
I20260709 13:09:56.214609 27968 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:56.179522 27860 consensus_meta.cc:287] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.060s	user 0.008s	sys 0.011s
I20260709 13:09:56.199389 27962 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:56.160493 27964 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:56.211624 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:56.243664 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.244526 23776 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:56.245285 23620 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:09:56.246620 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:56.248049 27961 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:56.248776 27961 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.250067 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:56.250985 23623 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:56.248884 28009 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.254071 27807 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:56.254298 23769 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:56.230170 27859 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:56.254105 28009 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:56.243912 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.250124 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.241361 24358 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:09:56.280717 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 69224.4us
I20260709 13:09:56.282038 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:56.282390 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:56.264421 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.294909 27852 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:56.295014 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:56.296886 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50623.1us
I20260709 13:09:56.295077 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:56.300056 28004 raft_consensus.cc:2764] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:09:56.300868 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:56.301000 28004 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:56.289722 27860 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.303315 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.251612 27961 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:56.304620 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:56.289399 27874 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:56.305954 27874 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:56.306202 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:56.306407 27874 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:56.289726 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:56.312254 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.315184 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:56.316157 24390 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:56.315959 27993 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.317229 27993 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:56.321161 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.317799 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:56.325495 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:56.345068 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:56.352276 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:56.354247 27914 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:56.354725 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:56.359845 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:56.359462 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.359421 27968 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:56.323988 27964 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:56.368611 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:56.323665 28030 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:09:56.372861 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:56.375555 23623 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:56.358443 27904 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:56.377883 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.339599 27961 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:09:56.382493 23624 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
W20260709 13:09:56.385102 28038 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
I20260709 13:09:56.385386 27962 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:56.386224 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:56.401892 23775 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.386444 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:56.387858 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 62276.5us
I20260709 13:09:56.387938 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:56.376763 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:56.389647 27964 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.390448 27993 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:56.397994 23776 raft_consensus.cc:2410] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:09:56.398278 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50032.6us
I20260709 13:09:56.362581 27860 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:56.399554 23620 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
W20260709 13:09:56.404847 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 43486.1us
I20260709 13:09:56.405910 28009 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:56.415827 27973 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:56.416798 27913 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:56.418557 23627 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:56.369161 27874 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.420709 27961 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:56.381372 27914 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:56.421792 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 77272.2us
I20260709 13:09:56.422586 27976 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:09:56.424202 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 202658us
W20260709 13:09:56.429704 27969 consensus_meta.cc:287] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.664s	user 0.015s	sys 0.010s
I20260709 13:09:56.434873 23743 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:56.438972 27939 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.421120 27974 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.444572 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2117) took 1093 ms. Trace:
I20260709 13:09:56.435436 28009 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:56.448531 24358 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.464s (SENT)
I20260709 13:09:56.452327 23777 rpcz_store.cc:276] 0709 13:09:55.351437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.461304 (+109867us) service_pool.cc:224] Handling call
0709 13:09:55.901999 (+440695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.943194 (+ 41195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.441875 (+498681us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540016b550. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:56.444498 (+  2623us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012356608}
I20260709 13:09:56.458359 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:56.459769 27991 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:56.460502 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:56.460551 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:56.436784 27904 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.443503 27961 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:56.464733 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 165204us
I20260709 13:09:56.459465 27964 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:56.457093 28009 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:56.415587 27983 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:56.469522 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:56.470593 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.471792 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 130924us
I20260709 13:09:56.474011 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:56.463284 27904 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.457660 27976 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:56.467002 27973 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:56.475767 23668 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:56.472570 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.466223 28031 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:56.484543 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.489230 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.495105 27945 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:56.495503 23776 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:56.495667 27945 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.496141 27945 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:56.496853 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:56.500573 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:56.501689 23624 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:09:56.502234 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:56.503386 28042 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:09:56.505402 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:09:56.506632 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 53131.1us
I20260709 13:09:56.482122 27973 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.523489 24387 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:56.493777 27969 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:56.532426 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:56.494277 27874 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:56.536276 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:56.509917 27962 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.522354 27973 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.561129 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:56.563068 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 61100.9us
I20260709 13:09:56.563913 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.564579 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:56.569247 28009 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:56.570974 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 90254.1us
I20260709 13:09:56.572468 27966 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.572764 27983 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:56.573236 27966 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.573940 23770 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:56.563287 27938 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:56.579095 23743 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:56.572335 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44945.9us
I20260709 13:09:56.583451 23775 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:56.586066 23743 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:56.584758 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 55395.2us
I20260709 13:09:56.537348 27986 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.531602 27969 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:56.530282 28011 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:09:56.597155 23592 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:56.584380 27938 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:56.605633 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 132366us
I20260709 13:09:56.538846 27940 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.611363 23777 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:09:56.610723 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.612126 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:56.597999 27964 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:56.598415 27969 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:56.618392 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:56.608050 27938 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.542219 28031 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.634125 28020 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:56.634642 28020 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.634976 28020 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:56.637782 27966 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:56.638927 27771 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:56.640398 28043 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:09:56.621953 27852 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:56.641568 28046 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:56.641502 27859 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:56.643497 28048 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:56.644213 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:56.644691 27980 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:56.646353 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:56.646795 27993 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:56.650430 27983 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.652307 27977 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:56.652740 27977 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:56.653858 27977 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.655319 27977 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:56.655865 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 123617us
I20260709 13:09:56.656266 27993 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:56.656370 28044 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:09:56.651188 27983 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.665977 27940 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:56.673038 28041 log.cc:927] Time spent T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:56.617591 27961 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.678653 28009 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:56.614849 27962 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:09:56.684131 27962 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:56.684666 27962 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:56.685922 27962 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.630218 27979 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:09:56.696692 27979 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:56.697192 27979 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:56.698500 27979 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.701875 27976 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.718204 23620 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:56.741604 27852 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:56.743166 27852 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:56.749737 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 146881us
I20260709 13:09:56.711306 27961 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:56.754513 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 190079us
I20260709 13:09:56.767951 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:56.768507 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 144111us
I20260709 13:09:56.757593 27962 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:56.774997 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 130875us
I20260709 13:09:56.764076 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:56.778967 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.768064 28004 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:56.780896 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:56.787276 23667 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:56.787320 23624 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:56.788601 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.784257 27979 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.762657 27986 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:09:56.801622 23623 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:09:56.802114 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 145433us
I20260709 13:09:56.792040 23773 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:56.806068 28056 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:56.806550 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:56.807868 27923 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:56.808223 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:56.786497 27914 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:56.808977 23621 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:56.809144 27983 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:56.809293 27914 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:56.800932 27940 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:56.809911 27914 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:56.816848 27925 consensus_meta.cc:287] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.758s	user 0.000s	sys 0.014s
I20260709 13:09:56.817705 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.818432 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:56.819444 28056 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:56.820487 27904 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.826627 27914 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.827831 28031 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:56.829087 23771 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:09:56.804286 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.802604 28009 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:56.842561 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:56.837630 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:56.845667 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 85059.6us
I20260709 13:09:56.849869 27919 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.849704 28009 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.850575 27919 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.862629 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:56.856071 27860 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:56.863719 27860 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:56.856168 23777 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:56.864737 27860 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.855067 27940 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.868407 27940 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.870671 27940 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:56.870671 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.843617 27948 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:09:56.880134 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 43969us
I20260709 13:09:56.881081 28004 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:56.881913 28004 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:56.884608 27986 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.885223 27986 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:56.888545 27904 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:56.852128 28009 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:56.896253 28057 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:09:56.897439 28057 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:56.897850 28057 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:56.898733 28057 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.853082 27919 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:56.890836 27945 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.900825 23770 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:56.901579 23773 raft_consensus.cc:2368] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9.
I20260709 13:09:56.891909 27968 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:56.905323 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.905467 27945 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:56.881214 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:56.905972 23773 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:56.907282 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:56.907909 27874 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:56.908605 27968 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:56.910542 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:56.907294 24357 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:09:56.891700 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 295469us
I20260709 13:09:56.928313 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:56.920866 27914 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:56.921399 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:56.921978 27968 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:56.900203 27986 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:56.935863 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:56.924649 27973 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:09:56.928275 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:56.928491 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.929761 23620 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.930631 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:56.943657 23627 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:56.931109 23621 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
W20260709 13:09:56.955909 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.956243 27874 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:56.958130 23667 leader_election.cc:400] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9.
I20260709 13:09:56.958613 23667 leader_election.cc:403] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:56.962173 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:56.960495 23773 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:56.960647 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:56.969127 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 43704.6us
I20260709 13:09:56.942528 27939 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:56.970626 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:56.945035 28057 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:56.955982 27986 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:56.956727 27874 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:56.941164 27991 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:09:56.975561 27919 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:56.970629 28009 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:56.966722 27977 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:56.988125 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 142700us
I20260709 13:09:56.976588 27939 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:56.980835 27986 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.985543 27874 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:57.009963 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 48543.7us
I20260709 13:09:56.977936 28004 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:56.991802 27980 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:57.017339 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:57.041837 28055 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:57.042228 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:57.043329 28055 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:57.018309 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 83664.9us
I20260709 13:09:57.043905 28055 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.988174 27938 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.044533 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:57.045213 27969 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.046379 27938 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.036885 27973 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:57.044385 28055 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.045737 27991 raft_consensus.cc:2764] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:09:57.048728 28004 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:57.037302 23627 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:57.010079 28020 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.051263 27841 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:57.051827 28020 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:57.053054 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:57.053422 23743 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:57.053819 23626 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.051868 27841 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.056653 23667 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:57.057049 27841 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:57.057917 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:57.058559 23621 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.059008 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:57.059633 23627 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:57.060021 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:57.060405 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.057610 27977 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.043427 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:57.061453 27977 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.062549 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:57.063365 27973 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:57.063926 27973 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:57.064248 27945 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:57.064555 28020 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:57.064002 27938 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:57.065497 27938 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:57.065647 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 62799us
I20260709 13:09:57.065958 27938 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.066581 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:57.066831 23627 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:09:57.067559 27973 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.069463 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:57.070387 27962 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:56.999969 28009 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:57.071084 27961 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:57.000030 27939 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.072103 28009 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.073601 23743 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:57.074994 27977 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:57.076160 28004 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:57.076807 28004 raft_consensus.cc:697] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:57.077754 28004 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.002439 27986 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.080159 27904 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.080749 27904 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.083310 27904 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:57.084156 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:57.140074 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:57.140210 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:57.140926 23620 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:57.102751 27969 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:57.142714 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45121us
I20260709 13:09:57.165627 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:57.139160 27841 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.174554 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 264147us
I20260709 13:09:57.174775 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:57.177006 23621 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
W20260709 13:09:57.177467 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 108114us
I20260709 13:09:57.178577 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:57.170439 28056 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.182125 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:57.186201 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 123788us
I20260709 13:09:57.178032 28020 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:57.200369 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:57.182341 27945 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:57.249037 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:57.207149 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:57.208437 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:57.209252 24358 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.504s (SENT) [suppressed 29 similar messages]
I20260709 13:09:57.200433 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:57.252171 23699 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.210065 23697 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:57.138945 27962 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.253608 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.270231 23702 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:09:57.272372 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 65388.8us
W20260709 13:09:57.274462 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 346782us
I20260709 13:09:57.182628 27841 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:57.280800 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.264154 28020 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:57.191457 28056 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.269052 27945 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:57.276517 28057 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:57.302403 23626 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:57.281195 27966 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:57.294974 27977 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.266695 27962 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.320958 23770 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:57.321231 23778 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:57.321789 23778 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:09:57.324921 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.309098 28057 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:57.336777 23702 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
W20260709 13:09:57.339404 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 137226us
I20260709 13:09:57.312016 27969 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.357573 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 62083us
I20260709 13:09:57.315791 27938 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.365661 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:57.339951 28057 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.352020 23778 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.339555 27966 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:09:57.396095 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 104301us
I20260709 13:09:57.338361 27976 consensus_queue.cc:1059] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:09:57.430570 23699 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:09:57.362321 27919 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9.
I20260709 13:09:57.355283 27977 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.395960 28004 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:57.363368 27969 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:57.477445 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 268197us
I20260709 13:09:57.477828 23778 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:57.487468 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.500155 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:57.362036 27986 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.503362 24387 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
W20260709 13:09:57.504859 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 123278us
W20260709 13:09:57.505576 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.506778 27986 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.507942 28065 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:57.508864 28065 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.512493 28056 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.514715 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:57.516424 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:57.513543 27841 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:57.507205 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:57.436935 28031 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.440311 27940 raft_consensus.cc:3055] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:57.391677 28055 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.523036 23743 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:09:57.524212 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 169494us
W20260709 13:09:57.528733 28069 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:09:57.535319 23623 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:09:57.538033 23624 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:57.522279 27977 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.542711 23771 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:57.446583 27945 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
W20260709 13:09:57.544766 28067 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:09:57.525398 27940 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:57.556082 27962 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:57.571933 28068 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.230s	user 0.002s	sys 0.000s
I20260709 13:09:57.539294 27904 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:57.580266 27904 raft_consensus.cc:697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:57.581455 27904 consensus_queue.cc:237] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.539355 28031 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.586623 28031 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.587517 28009 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:09:57.563620 28063 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:09:57.553484 27966 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.606482 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:57.607421 23773 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:57.610951 27973 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:09:57.614091 27874 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 13:09:57.614666 27874 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.616220 27771 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.617023 27771 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:57.620139 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 80765.3us
I20260709 13:09:57.620890 27771 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:57.416864 28020 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.621279 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:57.622316 24387 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:57.622462 28009 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:57.624523 27983 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:57.624962 27983 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:57.625118 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:57.625967 27983 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.626592 27938 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.627275 27938 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:57.653288 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:57.658659 23778 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:09:57.659132 23778 pending_rounds.cc:85] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 10
I20260709 13:09:57.662834 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:57.663898 23775 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:57.665477 23623 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:57.669494 27962 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.659499 23778 pending_rounds.cc:107] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:09:57.685395 23778 raft_consensus.cc:2889] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:57.627688 27938 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.628891 28076 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:57.694064 27874 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.696452 27983 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.701098 28009 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.701726 28009 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.655018 27939 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.685388 27977 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.708830 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:57.673038 27973 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:09:57.712318 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 205254us
I20260709 13:09:57.682176 28065 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.704675 27977 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.689654 27938 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.709677 23771 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:09:57.712410 27919 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.756906 27771 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.757575 27771 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.759869 27919 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.762279 27919 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:57.761919 28009 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:57.763090 28009 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:57.775568 27919 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.776247 27919 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.778863 27919 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.780964 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:57.781965 24394 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:57.784724 27977 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.732679 27961 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.785897 27961 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.782975 27940 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.788676 28065 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:57.789268 27940 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.789909 28065 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:57.790308 28065 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:57.791302 28065 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.792829 28065 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.793186 23778 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:57.801231 23668 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:57.818437 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:57.740018 28056 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.822969 24357 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:57.800345 27979 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.837852 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:57.836459 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:57.838941 23624 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:57.839054 23771 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:09:57.840226 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:57.738379 27973 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.847479 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:57.847675 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:57.855285 27961 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.845650 27976 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:57.861745 27976 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.862213 27976 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.832504 27919 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.826056 28056 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:57.852730 27969 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.901979 27969 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.902367 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:57.902565 27969 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:57.884977 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.835686 27841 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:57.905977 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:57.907909 23775 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.842839 27771 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:57.917052 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 247294us
I20260709 13:09:57.901273 27962 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:57.920949 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:57.924345 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:57.884253 27939 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:57.883134 27973 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:57.910120 27841 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.882885 27977 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:57.883248 28055 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:57.934933 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:57.969146 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:57.969399 23771 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:57.846836 27979 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:57.950903 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:57.952608 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:57.955775 23698 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:57.977684 23777 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:57.978200 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.977732 23702 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:09:57.957561 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:57.958036 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:57.961057 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:57.961652 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:57.962630 27914 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:57.945694 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 117374us
I20260709 13:09:57.965912 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:57.956286 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:57.980154 23704 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:57.980716 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:57.981406 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.004280 23627 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:57.979607 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:58.004987 23769 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.980291 23700 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:58.008639 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:58.006079 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.980578 23701 raft_consensus.cc:2376] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10. Re-sending same reply.
I20260709 13:09:58.013677 24387 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:58.013705 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.000355 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:57.963681 27841 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.020747 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.021081 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.023232 27979 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:58.024322 27914 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.026865 27914 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:58.013170 23695 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:09:58.029655 28085 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:58.032482 27969 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:58.035356 28056 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:58.037974 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.038692 23696 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:57.976541 27977 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:58.040171 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.040566 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:58.040906 23700 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:58.041165 23699 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.041852 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:58.042093 27977 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:58.044071 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:58.044448 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:58.019285 23697 raft_consensus.cc:2410] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:09:58.044130 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:09:58.047168 23593 connection.cc:256] RPC call timeout handler was delayed by -1.5737310670000397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2489s for a response
I20260709 13:09:58.047936 28065 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:09:58.006043 28057 consensus_meta.cc:287] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.003s
I20260709 13:09:58.048640 28065 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:58.049113 28057 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:58.049834 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.044083 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:58.051389 23770 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:58.051568 23702 raft_consensus.cc:2376] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10. Re-sending same reply.
W20260709 13:09:58.047677 23593 connection.cc:256] RPC call timeout handler was delayed by -1.22051651400011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
I20260709 13:09:57.913942 27919 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.053942 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:58.109170 24387 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:09:58.054687 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.110368 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:58.060387 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.060647 23702 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:58.069633 23701 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:58.065299 28065 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:58.117782 27919 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:58.115365 27962 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:58.077452 27841 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.118896 27962 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.119321 27962 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:58.121560 28085 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:58.122210 28085 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:58.077947 23771 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:58.125737 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:58.126385 24387 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:09:58.128513 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:58.129334 27961 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:58.129703 27961 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.130033 27961 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:58.081561 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.133176 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.134213 23626 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:58.065611 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.082217 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.084785 23622 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:58.082851 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:58.070338 23593 connection.cc:256] RPC call timeout handler was delayed by -1.0747165140001016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 13:09:58.100864 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 87547.4us
I20260709 13:09:58.056509 24390 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:09:58.137633 23593 connection.cc:256] RPC call timeout handler was delayed by -1.0126165140001149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 13:09:58.055796 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:58.069669 23699 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:58.077790 23698 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:58.091444 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:09:58.085105 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.100550 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:58.107170 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:58.142521 23627 raft_consensus.cc:2368] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9.
I20260709 13:09:58.089442 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:58.143029 23620 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:58.052752 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.143391 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:58.091758 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.115917 23775 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:58.146211 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:58.147320 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:58.147974 23701 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.147665 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:58.149492 23627 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:58.150559 24357 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:09:58.149602 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.153450 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.155840 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.051695 28057 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:58.165818 23769 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:09:58.156762 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:58.167272 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 84505.6us
I20260709 13:09:58.157742 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.090001 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:58.163950 23695 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:58.164126 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:58.170022 23702 raft_consensus.cc:2410] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:09:58.155898 28092 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:58.176957 23667 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:58.178890 23624 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:58.181931 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:58.182310 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.182578 23775 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.184052 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.184384 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.184320 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.188304 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:09:58.190321 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 51653.4us
I20260709 13:09:58.187206 23771 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
W20260709 13:09:58.193310 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 75805us
I20260709 13:09:58.195503 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.197997 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.164474 28056 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:58.169008 27939 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:58.063488 27976 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.198261 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.219336 23702 raft_consensus.cc:2376] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11. Re-sending same reply.
I20260709 13:09:58.205045 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:58.220290 23695 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.184378 27841 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:58.184087 27904 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:58.095863 28091 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:09:58.208019 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.208798 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.223986 23704 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:09:58.209216 23703 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:58.210330 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:58.216709 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.233523 23703 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:09:58.234334 27980 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.236581 23704 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:58.237979 23704 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:58.239167 23704 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:58.059314 27938 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.179791 27991 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:58.243409 23701 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:09:58.246547 23627 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:58.194649 27986 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:58.245723 23667 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:58.123493 28085 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:58.210402 28027 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.211370 28056 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.254503 23702 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:58.223945 27919 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:58.256302 23696 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:58.256569 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.256242 23700 raft_consensus.cc:2368] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11.
W20260709 13:09:58.258138 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 47926.6us
I20260709 13:09:58.239789 28086 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:09:58.261106 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:58.261379 23775 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:58.257474 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:09:58.262378 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 78916.8us
I20260709 13:09:58.252388 27986 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.266837 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:58.260293 28065 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:58.250759 27961 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.268761 28079 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:58.248996 28057 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:09:58.271037 27938 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:58.298552 24357 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:58.259253 28055 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:09:58.271989 27860 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:58.254573 27979 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:58.272351 28085 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:58.267230 28027 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.266892 28092 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:58.280994 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:58.288607 23701 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:58.255564 28056 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.254370 27991 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:58.299402 27939 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.310334 23695 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
W20260709 13:09:58.311915 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 85687.2us
I20260709 13:09:58.323606 27961 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:09:58.324218 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 74006.1us
I20260709 13:09:58.265996 27919 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:58.345233 27919 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:58.346086 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.346899 23622 raft_consensus.cc:2410] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:58.347144 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.347697 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.348074 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:58.348402 23627 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:09:58.348582 23700 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:58.348750 23704 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:58.349426 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.349843 27991 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.350724 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.351346 23628 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:58.351779 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.352502 28031 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.328639 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:58.325076 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:58.297479 27986 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.327755 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.357542 23623 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.357875 23696 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:58.338183 23775 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 9: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:58.299782 27841 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:58.376329 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.344062 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:58.266343 27962 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.326620 27979 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.329022 27914 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:58.343106 27976 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:58.385092 23695 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:58.385821 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.360044 24358 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:58.390259 23697 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 14. Current term is 15.
I20260709 13:09:58.391225 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:58.392393 23695 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:58.393231 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.353065 28031 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.395373 23704 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:09:58.394987 28004 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:58.399571 27860 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:09:58.400403 23523 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 121) took 24884 ms (client timeout 15000 ms). Trace:
I20260709 13:09:58.341674 28092 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:58.429095 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.388046 27938 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:58.408499 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 127771us
W20260709 13:09:58.431519 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 91894.4us
I20260709 13:09:58.376451 27945 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:58.376370 27939 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:58.436379 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 92397us
W20260709 13:09:58.404920 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.385553 27979 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.395118 28096 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:58.442005 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:58.415632 27914 raft_consensus.cc:697] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:58.469015 23702 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:58.457754 28031 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:09:58.427909 23523 rpcz_store.cc:269] 0709 13:09:33.515821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.516371 (+   550us) service_pool.cc:224] Handling call
0709 13:09:58.400076 (+24883705us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:55.671784 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:55.825427 (+153643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:55.827971 (+  2544us) write_op.cc:435] Acquired schema lock
0709 13:09:55.829177 (+  1206us) tablet.cc:662] Decoding operations
0709 13:09:55.832339 (+  3162us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:55.832416 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:55.832462 (+    46us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:09:55.833251 (+   789us) tablet.cc:701] Row locks acquired
0709 13:09:55.833280 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:09:55.833499 (+   219us) write_op.cc:270] Start()
0709 13:09:55.833637 (+   138us) write_op.cc:276] Timestamp: P: 1783602595833442 usec, L: 0
0709 13:09:55.833658 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:09:55.843987 (+ 10329us) log.cc:844] Serialized 2814 byte log entry
0709 13:09:56.061827 (+217840us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b3e2020ac 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b
0709 13:09:56.823915 (+762088us) op_driver.cc:464] REPLICATION: finished
0709 13:09:57.085925 (+262010us) write_op.cc:301] APPLY: starting
0709 13:09:57.086065 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:57.294619 (+208554us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:57.303863 (+  9244us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:57.598388 (+294525us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:57.598683 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:09:57.598754 (+    71us) write_op.cc:312] APPLY: finished
0709 13:09:57.599245 (+   491us) log.cc:844] Serialized 73 byte log entry
0709 13:09:57.678868 (+ 79623us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:57.714627 (+ 35759us) write_op.cc:454] Released schema lock
0709 13:09:57.737990 (+ 23363us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:57.827435 (+ 89445us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:57.831693 (+  4258us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":241,"mutex_wait_us":152707,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":261625,"apply.run_cpu_time_us":20943,"apply.run_wall_time_us":732555,"cfile_cache_hit":26,"cfile_cache_hit_bytes":27209,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":2,"lbm_read_time_us":1402,"lbm_reads_lt_1ms":12,"num_ops":7,"prepare.queue_time_us":419234,"prepare.run_cpu_time_us":25786,"prepare.run_wall_time_us":616791,"raft.queue_time_us":277089,"raft.run_cpu_time_us":27641,"raft.run_wall_time_us":187159,"replication_time_us":953422,"spinlock_wait_cycles":13715328,"thread_start_us":775779,"threads_started":4,"wal-append.queue_time_us":480183}]]}
I20260709 13:09:58.381760 27841 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:58.498086 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 138137us
I20260709 13:09:58.499711 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:09:58.505088 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 72872.1us
I20260709 13:09:58.504981 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:58.511798 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.437625 27938 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:58.493330 28023 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:58.518047 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 129317us
I20260709 13:09:58.461946 27945 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.523204 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:58.518381 28055 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.537914 23704 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:09:58.470795 28096 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.542526 23702 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:09:58.549806 23776 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:58.551671 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.556460 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.513922 28102 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:09:58.565985 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 94570.9us
I20260709 13:09:58.567016 23775 raft_consensus.cc:2393] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:09:58.580053 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 66779.2us
I20260709 13:09:58.581127 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.582150 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:58.585987 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.591259 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.592335 27977 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:58.593042 27977 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.594514 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.600849 23669 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.583621 28111 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:58.584709 28112 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:58.635987 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.603389 28092 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:58.604262 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.586018 27962 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:58.606838 28118 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:58.630698 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.641748 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.644794 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.645711 23775 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:09:58.656574 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:58.603128 28117 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:09:58.550011 28104 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:09:58.595626 27919 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.639706 27977 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.639511 27969 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:58.673734 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 169194us
I20260709 13:09:58.680688 28117 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:58.689292 28096 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:58.691200 28065 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:58.691982 27938 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:58.643113 27961 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:58.667140 28020 raft_consensus.cc:2764] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:09:58.643296 28027 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:58.693033 27977 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:58.669649 28111 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.651252 28118 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:58.651015 28112 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:58.582118 27914 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.663968 28092 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:58.749735 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 93229.3us
I20260709 13:09:58.671336 27976 raft_consensus.cc:2764] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:09:58.771528 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 259835us
I20260709 13:09:58.798769 24358 leader_election.cc:400] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11.
I20260709 13:09:58.799120 24358 leader_election.cc:403] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:09:58.748189 28065 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:58.702433 28117 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:58.794238 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:09:58.800199 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 201247us
I20260709 13:09:58.808019 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:58.775470 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:58.809351 23624 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:58.802470 24390 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:09:58.816359 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 165828us
I20260709 13:09:58.817415 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:58.818248 24387 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.819372 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:58.794203 27939 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:58.791114 28110 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:58.788530 27945 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:58.825918 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:58.832826 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.833071 24394 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:58.788316 28118 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.807268 27841 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:58.796473 28023 raft_consensus.cc:697] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:58.832050 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:58.827273 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.846254 23621 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:58.846470 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.847085 23773 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
W20260709 13:09:58.847890 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49249.2us
I20260709 13:09:58.814824 28009 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:58.849659 24358 leader_election.cc:400] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 14. Current term is 15.
I20260709 13:09:58.850260 23669 leader_election.cc:400] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9.
I20260709 13:09:58.851210 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.843458 23623 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:09:58.864723 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.869227 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:58.869927 23769 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:09:58.872800 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:58.827029 27983 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:58.874974 24359 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:58.879410 23621 raft_consensus.cc:3055] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:58.882280 23621 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:58.889735 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:09:58.896531 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 100550us
I20260709 13:09:58.866093 27976 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:58.907958 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.879050 28057 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.934767 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.881281 27983 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:58.860878 28110 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:58.952571 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 133309us
I20260709 13:09:58.881129 28127 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:58.937764 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 69050.2us
I20260709 13:09:58.946698 24394 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:09:58.898095 28132 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:58.936597 27938 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:58.942273 27969 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:58.939075 28092 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:58.972579 28120 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:09:58.884224 24390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ec1d400f174350acc92722149e02d4"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:58744
I20260709 13:09:58.954521 27983 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:58.963707 28056 consensus_meta.cc:287] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.005s
I20260709 13:09:58.885294 28065 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:58.988224 28133 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 13:09:58.994290 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 119389us
I20260709 13:09:58.982316 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.982705 28023 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:58.999774 27841 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:58.999420 24357 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:09:59.005079 27841 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.005527 27841 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.005870 27841 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.979957 28139 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:59.011690 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:09:59.013326 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 78646.5us
I20260709 13:09:59.015519 28139 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.016088 28139 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.015951 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.896832 28117 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.022332 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:59.024874 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.896503 28112 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.040311 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:58.994117 28056 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.044567 28096 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.048195 24387 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:59.027980 28132 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:59.050143 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:09:59.050978 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:09:59.031625 27977 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.056355 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:59.033638 27969 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.030308 28111 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:59.057155 23625 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:59.060074 23699 raft_consensus.cc:2368] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10.
I20260709 13:09:59.046974 28127 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:59.058475 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:59.063759 28009 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:59.064309 28009 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.069038 23621 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.070133 23621 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:59.076856 23776 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.005s
I20260709 13:09:59.083366 23776 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:09:59.077823 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:59.078235 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:59.086050 23629 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:59.088351 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.089100 23704 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 14. Current term is 15.
I20260709 13:09:59.049752 27980 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11.
I20260709 13:09:59.055342 28096 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:59.084596 23625 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:59.097245 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.096199 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.100347 23698 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:59.101305 28111 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.102165 28136 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:59.112620 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:59.113361 24386 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:59.096473 24358 leader_election.cc:400] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 14. Current term is 15.
I20260709 13:09:59.115998 24358 leader_election.cc:403] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:09:59.116114 28086 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:59.116699 28086 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.118746 28086 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:59.121508 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:59.122375 24387 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:59.128038 27979 consensus_meta.cc:287] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.001s
W20260709 13:09:59.128719 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.116062 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.135957 27969 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.136437 27969 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.136813 27969 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.136876 27979 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.138221 23701 raft_consensus.cc:2368] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:09:59.072153 28142 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.140300 28142 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.141119 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:59.142365 28132 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.143028 28096 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.142822 28132 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.143913 27976 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:59.097705 27986 consensus_meta.cc:287] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.006s
I20260709 13:09:59.145886 27986 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.150223 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:59.152349 23668 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:59.153481 23668 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:09:59.155491 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 111857us
W20260709 13:09:59.132089 28055 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.003s
W20260709 13:09:59.152060 28138 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:09:59.162102 28127 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:59.164196 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:59.165445 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:59.176071 24387 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:09:59.177500 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.159548 27976 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:59.163846 28092 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:59.187849 23742 leader_election.cc:400] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
I20260709 13:09:59.190160 23742 leader_election.cc:403] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:59.164762 28055 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:59.180826 27961 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:59.186153 27986 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:59.205049 23778 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:59.192152 28086 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
I20260709 13:09:59.183328 27939 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 14. Current term is 15.
I20260709 13:09:59.189639 28092 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:59.244510 28092 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.251996 27983 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.254470 27983 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:59.258131 27841 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.262184 28139 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:59.202450 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 152372us
W20260709 13:09:59.232980 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 48736.3us
I20260709 13:09:59.264161 23742 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:59.265352 28118 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.268543 28004 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:59.230139 28085 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.893s	user 0.013s	sys 0.000s
I20260709 13:09:59.274085 28056 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.274886 28056 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.275437 28056 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.278052 28085 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:59.278211 28056 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.278689 28085 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.267485 28118 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:59.284476 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:59.285104 23623 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.288094 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:59.289397 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:59.290017 23627 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:59.290971 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:59.291524 23621 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.282033 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.294260 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.294988 23704 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:09:59.295660 23623 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
W20260709 13:09:59.299873 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 108904us
I20260709 13:09:59.318692 23621 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:59.319785 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.327864 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.329124 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.329965 23698 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:59.332151 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.334239 23628 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:59.336104 23696 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:59.331599 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.337826 23697 raft_consensus.cc:2368] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12.
I20260709 13:09:59.339401 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:59.361258 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:59.341859 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.361490 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:59.362705 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.363790 28091 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:59.334401 28057 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:59.321400 28056 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:59.337214 23703 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:09:59.344467 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.372996 23696 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:59.311480 27976 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:59.342557 24387 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 11. Ops: []
I20260709 13:09:59.375548 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:59.345131 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.350550 23704 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:59.376282 23771 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:09:59.364338 24389 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:59.364286 28091 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.365471 24393 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:59.346144 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.379129 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:59.329737 28055 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:59.346163 27979 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.382458 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:59.382292 28055 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.383318 24393 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15.
I20260709 13:09:59.384327 23772 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:59.384925 28055 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:59.351874 28020 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:59.385708 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:59.385908 28020 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.372623 27841 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.384240 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:59.380631 28091 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:59.374459 27919 consensus_meta.cc:287] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
I20260709 13:09:59.388072 23775 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:59.349525 28132 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.352089 27904 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:09:59.391222 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 108240us
I20260709 13:09:59.374873 27962 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:59.400640 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:09:59.342254 28139 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.386494 24387 raft_consensus.cc:2393] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:59.372014 28056 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.387971 24393 raft_consensus.cc:2368] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12.
I20260709 13:09:59.352067 28110 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:59.405259 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:59.355846 27969 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.358870 28009 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.392546 28085 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:59.403025 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.376844 27961 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:59.398583 28004 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:59.429091 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:59.391345 28127 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:59.374593 28057 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.401525 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:59.431412 28104 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:59.432744 27860 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:59.433574 28079 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:59.434353 28125 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:59.435132 28144 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:59.436378 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.437677 28009 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:59.438511 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:59.439668 28020 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:59.440101 27976 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.441740 28142 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.443002 28092 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.507398 28092 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:59.508102 28092 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.410341 28056 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.400691 27919 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:59.402940 28143 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:59.456586 27991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.011s	sys 0.012s
I20260709 13:09:59.464633 28076 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:59.466547 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:09:59.466826 28145 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:59.433619 27969 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.467535 27961 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.469465 24387 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.483641 28136 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:09:59.518852 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 52395.5us
I20260709 13:09:59.485196 24389 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:59.446177 27962 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:09:59.489275 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 110278us
I20260709 13:09:59.403669 27904 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.493297 23701 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:59.463618 28091 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:09:59.504492 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48815.3us
W20260709 13:09:59.513717 27991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.012s	sys 0.013s
I20260709 13:09:59.516294 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:09:59.532480 24393 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.532583 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:59.532922 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:59.524310 23742 leader_election.cc:400] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12.
I20260709 13:09:59.527999 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:59.541263 23742 leader_election.cc:403] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:09:59.530084 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:59.483834 28111 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:09:59.546274 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:59.540169 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:59.539244 24388 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:59.536247 28153 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.536586 27962 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.508600 28092 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.546351 23702 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:09:59.549005 23775 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:59.525810 28076 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.557066 24387 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:59.551612 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.557727 23701 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:59.552834 23769 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:09:59.518173 28145 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:09:59.548646 28149 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:09:59.562845 28145 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:59.568387 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:09:59.570133 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45967.8us
I20260709 13:09:59.570713 28004 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.573278 28020 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:59.563711 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:59.574359 28141 raft_consensus.cc:3055] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:59.574821 28141 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:09:59.574885 23593 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:09:59.576260 23593 leader_election.cc:400] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:09:59.576586 23593 leader_election.cc:403] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:59.577179 28143 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:59.577713 28143 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:59.578183 27860 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.578634 28143 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.579319 27966 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:59.579828 27966 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:59.580129 27874 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:09:59.580199 27904 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:09:59.583631 28066 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:59.583895 23769 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:59.584198 28066 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:59.578680 27860 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:59.585248 27860 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.548663 28136 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:59.585140 28066 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.586243 28136 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:09:59.586428 28066 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:59.587258 28136 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.591213 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 2175) took 1082 ms. Trace:
I20260709 13:09:59.591624 23776 rpcz_store.cc:276] 0709 13:09:58.509385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.509601 (+   216us) service_pool.cc:224] Handling call
0709 13:09:59.591042 (+1081441us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b5400059bd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:59.591155 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49350528}
I20260709 13:09:59.596342 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.597285 23695 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:09:59.598153 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.598703 23695 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.580765 27966 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.601256 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.602937 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.604012 28091 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.575945 28141 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:09:59.640616 23699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 1944) took 1473 ms (client timeout 1886 ms). Trace:
W20260709 13:09:59.615612 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.641233 28092 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:09:59.643564 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:09:59.632999 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:09:59.551920 28127 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.645879 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.634725 27966 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.636232 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:09:59.637358 27860 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.638118 28057 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:09:59.641042 23699 rpcz_store.cc:269] 0709 13:09:58.167220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.172704 (+  5484us) service_pool.cc:224] Handling call
0709 13:09:59.640405 (+1467701us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b540008a2d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:09:59.640529 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1985949568}
I20260709 13:09:59.660879 23700 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:59.661463 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.661893 24387 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:59.667709 24393 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:09:59.669945 23668 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.560259 28076 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:59.667709 23704 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:09:59.676844 23696 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:09:59.670686 23695 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:09:59.678119 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.558176 28153 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.640658 28141 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.720686 28154 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:59.721345 28154 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:59.722342 28154 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.723266 23592 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:09:59.680104 27919 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:59.724037 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:59.724272 27919 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:09:59.724695 24389 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:09:59.704972 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.705828 23698 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:59.709293 23701 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:09:59.710390 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.727126 23695 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.710505 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.727860 23699 raft_consensus.cc:2368] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
I20260709 13:09:59.729039 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.729619 23701 raft_consensus.cc:2376] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12. Re-sending same reply.
I20260709 13:09:59.710847 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:59.733325 23776 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.712982 27860 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.671674 28020 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:59.713578 28114 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:09:59.680334 28145 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:09:59.717481 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.842338 23700 raft_consensus.cc:2368] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11.
I20260709 13:09:59.715128 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.719934 28156 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:09:59.748003 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:59.764532 23593 leader_election.cc:400] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10.
I20260709 13:09:59.766846 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.845786 23593 leader_election.cc:403] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:59.846154 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 79434.5us
I20260709 13:09:59.846647 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.848191 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.849125 23702 raft_consensus.cc:2376] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9. Re-sending same reply.
I20260709 13:09:59.672829 27991 raft_consensus.cc:2764] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:59.837252 23704 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:09:59.852537 23695 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:09:59.853752 23742 leader_election.cc:400] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10.
I20260709 13:09:59.680812 28076 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.873785 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:59.680389 28057 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:59.856092 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.864508 23742 leader_election.cc:400] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11.
I20260709 13:09:59.878449 23742 leader_election.cc:403] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:59.879575 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:59.813781 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.881070 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.881296 23696 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.871519 23776 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:09:59.877687 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.883138 23695 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:09:59.884485 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:09:59.885247 23695 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:09:59.886471 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.882216 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:09:59.893656 24387 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:59.895119 23625 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:59.895406 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:09:59.896651 23695 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:59.903681 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:09:59.909384 24389 raft_consensus.cc:2368] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11.
I20260709 13:09:59.913257 23699 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:09:59.914588 23699 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:59.916908 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:09:59.917793 23704 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:09:59.838433 27976 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:59.849370 28104 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:59.854588 27904 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:09:59.875594 28086 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:59.895576 28142 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:59.891902 28057 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:59.926748 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:59.939965 23776 raft_consensus.cc:2410] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:09:59.908159 28111 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10.
I20260709 13:09:59.906939 28085 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:59.936342 27976 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.940842 28162 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.872849 27983 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:09:59.919685 28020 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:59.940964 28085 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:59.949087 23696 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:09:59.925563 28104 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:09:59.951539 28128 log.cc:927] Time spent T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:59.953651 28085 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.942467 28057 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.958606 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:09:59.959336 23701 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:09:59.948163 27962 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:09:59.951118 28142 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:09:59.952732 28004 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12.
I20260709 13:09:59.957731 28104 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.876248 28114 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.937589 27904 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.894454 27919 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.984561 28142 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:09:59.987514 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:09:59.988106 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:09:59.999526 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 235206us
I20260709 13:10:00.011049 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:00.001740 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.023692 27969 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:59.997244 28145 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:09:59.979305 27962 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.028465 28150 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:00.009878 28004 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.958810 28134 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:10:00.018860 28157 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:00.008282 27961 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:10:00.066962 23775 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
W20260709 13:10:00.068506 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 149384us
W20260709 13:10:00.069340 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 344415us
W20260709 13:10:00.070791 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.051658 28164 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:00.081894 27976 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:00.083303 27904 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:00.083959 27904 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:00.085103 28171 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:00.066478 28020 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:00.096735 28020 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.106096 23698 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:00.109163 23696 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:10:00.084350 28168 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:10:00.060308 28150 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.068589 28153 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:00.150327 28172 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:00.158510 23698 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:00.119251 28164 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.067524 28157 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.060868 28004 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:00.191001 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.179181 23701 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:00.202313 23698 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:00.151873 28150 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.287876 23698 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:00.180751 28164 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:00.307351 23698 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:00.282359 28153 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.317898 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 307709us
I20260709 13:10:00.291329 27983 consensus_queue.cc:1243] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:10:00.314352 28166 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:10:00.336315 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:00.321587 28076 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.342752 28076 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:00.315820 28004 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:00.333503 28114 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:00.322165 27962 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:00.321311 28153 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.312798 28178 consensus_queue.cc:1059] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:10:00.325775 28185 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:00.396616 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 324720us
I20260709 13:10:00.381486 23697 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:00.384106 27966 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.712s	user 0.007s	sys 0.004s
I20260709 13:10:00.408429 28104 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.388906 28186 raft_consensus.cc:3055] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:00.396168 28185 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.396386 28004 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:00.378504 28153 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:00.386426 28056 consensus_meta.cc:287] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.007s
I20260709 13:10:00.422753 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 1979) took 1859 ms. Trace:
I20260709 13:10:00.419543 27962 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.424710 28177 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.424911 28057 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.421900 28020 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:10:00.373428 28066 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.787s	user 0.012s	sys 0.000s
I20260709 13:10:00.429085 23668 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:00.347409 27914 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:00.515573 24388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 716) took 1579 ms. Trace:
I20260709 13:10:00.442204 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:00.477451 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:00.492520 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:00.528519 24387 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:10:00.528928 23777 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.501492 24389 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:00.529872 28153 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.434918 28164 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.530545 28153 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.531198 28117 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.532696 28164 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:00.532819 28153 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:00.438284 28085 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.501540 28023 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:00.535611 28023 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.539610 28020 consensus_queue.cc:1243] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:10:00.542317 28170 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.488s	user 0.001s	sys 0.006s
I20260709 13:10:00.545095 28188 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.546912 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 117939us
W20260709 13:10:00.499711 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.442508 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:00.549324 23769 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.457222 23742 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:00.550377 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 93316.5us
I20260709 13:10:00.550946 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:00.552109 23628 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:00.554167 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.556391 23770 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:00.527709 24388 rpcz_store.cc:276] 0709 13:09:58.933326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.938940 (+  5614us) service_pool.cc:224] Handling call
0709 13:09:58.963384 (+ 24444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.547461 (+584077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.512267 (+964806us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54005f3554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:00.512513 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323689216}
I20260709 13:10:00.424180 28086 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:00.527231 23778 rpcz_store.cc:276] 0709 13:09:58.563337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.563488 (+   151us) service_pool.cc:224] Handling call
0709 13:09:58.581219 (+ 17731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.213931 (+632712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.422509 (+1208578us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54003ffcd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:00.422692 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434114944}
I20260709 13:10:00.428223 28182 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.545686 28188 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.426834 28186 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:00.560691 24387 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:00.560884 23698 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:00.545565 24385 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.567494 23668 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:00.569967 28185 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:00.571080 27919 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:00.571614 28154 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:00.548381 28056 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.571846 27919 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:00.561769 27962 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.576187 23700 raft_consensus.cc:2368] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:10:00.576411 24394 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:00.567021 28104 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:00.577477 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:00.577369 28186 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.578091 27962 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:00.578519 28186 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.578725 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:00.563511 28182 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.580598 27991 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:00.572523 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:00.548024 28085 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:00.438128 28162 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11.
I20260709 13:10:00.583925 23742 leader_election.cc:400] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15.
I20260709 13:10:00.579547 24394 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:00.585278 23742 leader_election.cc:403] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.575318 28056 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:00.587621 28182 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:00.596222 28189 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:10:00.477802 28004 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.600234 28188 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:00.560701 27914 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.575223 28150 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.607054 28086 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.560542 27969 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:00.611845 23742 leader_election.cc:400] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12.
I20260709 13:10:00.612246 23742 leader_election.cc:403] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.564404 28020 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.622435 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2513) took 1289 ms. Trace:
I20260709 13:10:00.625211 23777 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:10:00.575284 27919 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.624697 23699 rpcz_store.cc:276] 0709 13:09:59.325891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.915310 (+589419us) service_pool.cc:224] Handling call
0709 13:09:59.915617 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:59.925094 (+  9477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.925138 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:59.941767 (+ 16629us) log.cc:844] Serialized 52 byte log entry
0709 13:10:00.241204 (+299437us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:00.525577 (+284373us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.586118 (+ 60541us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.614870 (+ 28752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.614980 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.615039 (+    59us) raft_consensus.cc:1685] finished
0709 13:10:00.615056 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.615236 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59085,"prepare.queue_time_us":318998,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":45861,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":14865,"thread_start_us":527290,"threads_started":2,"wal-append.queue_time_us":392188}
I20260709 13:10:00.636296 23769 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:00.557315 28057 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:00.637926 23742 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:00.610733 27969 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.640918 23776 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:00.619670 27983 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15.
I20260709 13:10:00.650453 23770 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:00.622545 28127 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:00.624820 28004 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:00.539827 28177 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.658068 23699 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:00.659384 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1970) took 1018 ms. Trace:
I20260709 13:10:00.620679 28185 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:10:00.660017 23699 rpcz_store.cc:276] 0709 13:09:59.640875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.657323 (+1016448us) service_pool.cc:224] Handling call
0709 13:10:00.657775 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.659013 (+  1238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.659310 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.649880 28188 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.647468 27969 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.641717 28164 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.651609 27962 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.653455 28136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.017s	sys 0.020s
I20260709 13:10:00.648262 28187 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12.
W20260709 13:10:00.669116 28136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.017s	sys 0.020s
I20260709 13:10:00.691805 28153 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.653923 28162 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:10:00.730603 28157 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:00.700551 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:00.663938 28127 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.732198 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:00.732882 23769 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.733743 24390 raft_consensus.cc:606] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:00.734398 24390 raft_consensus.cc:614] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:00.730326 28153 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.736737 27980 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.736896 28153 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:00.733845 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2805) took 1183 ms. Trace:
I20260709 13:10:00.737306 27980 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.737671 23625 rpcz_store.cc:276] 0709 13:09:59.552190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.552312 (+   122us) service_pool.cc:224] Handling call
0709 13:09:59.552615 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.895554 (+342939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.733537 (+837983us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54002b4154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:00.733737 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787268992}
I20260709 13:10:00.717053 24391 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:00.738889 27961 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:00.705796 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1966) took 1066 ms. Trace:
I20260709 13:10:00.739539 27961 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.739898 23698 rpcz_store.cc:276] 0709 13:09:59.639592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.313340 (+673748us) service_pool.cc:224] Handling call
0709 13:10:00.326636 (+ 13296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.564663 (+238027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.705509 (+140846us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000a0fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:00.705715 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538231040}
I20260709 13:10:00.740747 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:00.741674 23775 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:00.742079 28091 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.742602 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:00.745416 23771 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:00.747668 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 178987us
I20260709 13:10:00.743448 23775 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:00.742702 27961 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:00.746941 23769 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:00.757766 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:00.757901 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:00.758987 23769 raft_consensus.cc:2410] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:00.759807 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:00.762797 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:00.762914 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:00.764231 23775 raft_consensus.cc:2410] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:10:00.765396 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:00.766057 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:00.766955 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:00.767138 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:00.776825 23775 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:00.670830 27962 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.784202 27962 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:00.781926 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:00.784287 28177 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:00.775631 27961 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:00.806631 27961 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:00.807941 27961 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.775307 28141 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:00.810019 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1973) took 1168 ms. Trace:
I20260709 13:10:00.775925 28154 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:00.773862 28162 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:00.810523 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 43636.5us
I20260709 13:10:00.824307 23695 rpcz_store.cc:276] 0709 13:09:59.641647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.732251 (+1090604us) service_pool.cc:224] Handling call
0709 13:10:00.732611 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.743834 (+ 11223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.743897 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.744604 (+   707us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.809588 (+ 64984us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:00.809641 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.809732 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.809784 (+    52us) raft_consensus.cc:1685] finished
0709 13:10:00.809799 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.809958 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10748,"raft.queue_time_us":12205,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":18824,"thread_start_us":64460,"threads_started":1,"wal-append.queue_time_us":61779}
I20260709 13:10:00.742650 28091 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:00.817119 28190 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.241s	user 0.004s	sys 0.000s
W20260709 13:10:00.863265 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.871605 28091 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:00.879122 27919 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.889020 27969 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.849452 28154 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.849319 28162 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:00.898324 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 140371us
I20260709 13:10:00.898857 23695 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:10:00.899675 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1976) took 1224 ms. Trace:
I20260709 13:10:00.899585 24357 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:00.900259 23695 rpcz_store.cc:276] 0709 13:09:59.674874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.896302 (+1221428us) service_pool.cc:224] Handling call
0709 13:10:00.896641 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.899299 (+  2658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.899621 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.901405 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:00.904201 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:00.905208 24392 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:00.902536 28162 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.880770 28127 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:00.901958 28009 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:00.910981 28009 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:00.912225 28206 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:00.912859 28206 raft_consensus.cc:697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:00.913410 28009 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:00.913839 28206 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.915125 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1977) took 1240 ms. Trace:
I20260709 13:10:00.915235 28197 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:00.897388 28154 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:00.916378 28204 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:10:00.915520 23695 rpcz_store.cc:276] 0709 13:09:59.675250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.901068 (+1225818us) service_pool.cc:224] Handling call
0709 13:10:00.901336 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.901526 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.914788 (+ 13262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.914835 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:00.914886 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.914943 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.915069 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.920708 23695 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:00.935714 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1978) took 1248 ms. Trace:
I20260709 13:10:00.936254 23695 rpcz_store.cc:276] 0709 13:09:59.675588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.920250 (+1244662us) service_pool.cc:224] Handling call
0709 13:10:00.920539 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.923313 (+  2774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.923523 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.937793 23695 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:00.938452 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 564) took 1251 ms. Trace:
I20260709 13:10:00.895787 28141 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:00.938812 23695 rpcz_store.cc:276] 0709 13:09:59.687089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.937116 (+1250027us) service_pool.cc:224] Handling call
0709 13:10:00.937477 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.938166 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.938358 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.907550 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:00.941931 23695 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:00.948515 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 565) took 1213 ms. Trace:
I20260709 13:10:00.949005 23695 rpcz_store.cc:276] 0709 13:09:59.735029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.940362 (+1205333us) service_pool.cc:224] Handling call
0709 13:10:00.941525 (+  1163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.948278 (+  6753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.948464 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.939103 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1974) took 1297 ms. Trace:
I20260709 13:10:00.953579 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:00.956264 24392 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:00.954313 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 566) took 1191 ms. Trace:
I20260709 13:10:00.945803 27969 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:00.950680 23698 rpcz_store.cc:276] 0709 13:09:59.641909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.740884 (+1098975us) service_pool.cc:224] Handling call
0709 13:10:00.741266 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.763439 (+ 22173us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:00.785016 (+ 21577us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.937054 (+152038us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.937663 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.937811 (+   148us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:00.938297 (+   486us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.938781 (+   484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.938854 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.938890 (+    36us) raft_consensus.cc:1685] finished
0709 13:10:00.938916 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.939025 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2606,"prepare.queue_time_us":34552,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":415,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":267,"spinlock_wait_cycles":70400,"thread_start_us":151311,"threads_started":1,"wal-append.queue_time_us":151668}
I20260709 13:10:00.958242 23695 rpcz_store.cc:276] 0709 13:09:59.763200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.949777 (+1186577us) service_pool.cc:224] Handling call
0709 13:10:00.953727 (+  3950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.953917 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.953939 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.953977 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:00.954036 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.954099 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.954242 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.951574 28197 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:00.943392 28141 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:01.033187 28214 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:01.036984 28154 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.039494 28197 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:00.950238 28108 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:10:01.065565 24385 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:01.057330 28009 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.073776 27919 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:01.076912 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:01.073182 28009 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.077641 24385 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:01.085271 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.085891 28145 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:01.087973 23621 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:01.089181 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.089336 28125 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:01.089826 28125 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.090449 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.091008 23623 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.091747 24393 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:01.092041 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.092644 23627 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.096274 23701 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:01.097041 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1960) took 1508 ms. Trace:
I20260709 13:10:01.097406 23701 rpcz_store.cc:276] 0709 13:09:59.588594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.205261 (+616667us) service_pool.cc:224] Handling call
0709 13:10:00.292473 (+ 87212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.096091 (+803618us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b54005107a0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41283dc0 00007f2b4130e1c0 00007f2b4130f231 00007f2b4130bd8f 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c
0709 13:10:01.096773 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.096979 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17341184}
W20260709 13:10:01.098848 28203 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:10:01.101593 28141 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:01.102407 27904 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:01.102811 27904 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:01.092507 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 719) took 1295 ms. Trace:
I20260709 13:10:01.101612 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1971) took 1460 ms. Trace:
I20260709 13:10:01.083516 23593 leader_election.cc:400] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11.
W20260709 13:10:01.112593 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.113004 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:01.103468 24393 rpcz_store.cc:276] 0709 13:09:59.797621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.812281 (+ 14660us) service_pool.cc:224] Handling call
0709 13:10:01.091281 (+1279000us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b5800010e98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:10:01.091519 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.092216 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.092438 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37111680}
I20260709 13:10:01.117220 28141 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.117022 28108 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:01.118590 28108 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:01.118942 28108 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:01.119859 28108 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.120249 28141 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:01.120813 24385 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:10:01.121443 28108 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.123703 23623 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
W20260709 13:10:01.124257 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 1.0517e+06us
I20260709 13:10:01.125754 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:01.126173 24392 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:10:01.079571 28009 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:01.129094 28176 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:01.129799 28176 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.131839 28023 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:01.132135 28179 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:01.132669 28179 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:01.133639 28179 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.134686 24390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58744 (request call id 6) took 2286 ms. Trace:
I20260709 13:10:01.135021 28179 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.136173 28137 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:01.136602 23668 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:01.136740 28137 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.136958 28056 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:01.138144 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:01.138548 28056 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.138981 28137 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:01.139977 28175 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:01.139614 28137 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:01.141219 28177 consensus_queue.cc:1059] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:01.145123 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.146061 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.111706 23627 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:10:01.104084 23699 rpcz_store.cc:276] 0709 13:09:59.641155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.661047 (+1019892us) service_pool.cc:224] Handling call
0709 13:10:00.661489 (+   442us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:00.662256 (+   767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.662298 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:00.665653 (+  3355us) log.cc:844] Serialized 52 byte log entry
0709 13:10:00.778984 (+113331us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:00.940384 (+161400us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.944934 (+  4550us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.945187 (+   253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.945297 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.098270 (+152973us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:01.101412 (+  3142us) raft_consensus.cc:1685] finished
0709 13:10:01.101433 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.101556 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44702,"prepare.queue_time_us":81859,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":283,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":9456,"spinlock_wait_cycles":9984384,"thread_start_us":183029,"threads_started":2,"wal-append.queue_time_us":105914}
I20260709 13:10:01.135134 24390 rpcz_store.cc:276] 0709 13:09:58.868154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.877670 (+  9516us) service_pool.cc:224] Handling call
0709 13:10:01.134489 (+2256819us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54002f7454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41306853 00007f2b462d460a 00007f2b3f85a7d4 00007f2b3f85a762 00007f2b3f85a691 00007f2b3f85a60c 00007f2b3f8598c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:01.134617 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4025180032}
I20260709 13:10:01.141463 28137 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.163235 23622 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:01.071938 28162 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.142225 28207 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:01.165205 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.182884 23774 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:01.166797 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:01.165141 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 78964.9us
W20260709 13:10:01.172442 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 47496.1us
I20260709 13:10:01.177312 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:01.145674 28125 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:01.185287 23769 raft_consensus.cc:2368] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:10:01.188532 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:01.188712 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.190925 23625 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:10:01.193933 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:01.194293 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.194964 23621 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:01.196120 23621 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:01.197026 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.186969 28207 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.198992 28207 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:01.201592 28079 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:01.202031 28206 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.202418 28079 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.180689 27904 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.206532 28065 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:01.207468 27904 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:01.209367 23628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 2809) took 1573 ms (client timeout 1538 ms). Trace:
W20260709 13:10:01.209865 23628 rpcz_store.cc:269] 0709 13:09:59.635842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.635976 (+   134us) service_pool.cc:224] Handling call
0709 13:10:01.209112 (+1573136us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540001d6d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:01.209231 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059211136}
I20260709 13:10:01.211596 28150 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:01.155758 28023 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:10:01.215715 27874 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:01.216917 27874 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:01.217901 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 2186) took 1268 ms. Trace:
I20260709 13:10:01.217131 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1969) took 1576 ms. Trace:
I20260709 13:10:01.218344 23776 rpcz_store.cc:276] 0709 13:09:59.949107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.949460 (+   353us) service_pool.cc:224] Handling call
0709 13:10:01.217732 (+1268272us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54003ff7d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:01.217837 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544311040}
I20260709 13:10:01.202592 28206 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.220522 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:01.222698 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.223239 23775 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:01.218096 28066 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:01.224220 23776 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:01.228093 23667 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:01.224218 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.140640 28175 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.236869 23593 leader_election.cc:400] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:10:01.237241 23593 leader_election.cc:403] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:01.237931 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.238536 23627 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.241240 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.242401 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:01.243649 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 104660us
I20260709 13:10:01.248863 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.190459 28134 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:01.252452 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.255148 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:01.185346 28185 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:01.251984 28134 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.257686 28136 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:01.258606 28136 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.255960 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.259093 28136 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.260860 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.261364 28136 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:01.262013 28136 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:01.262401 28136 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:01.262804 28144 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:10:01.263947 27966 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.266811 28076 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:01.218747 23697 rpcz_store.cc:276] 0709 13:09:59.640556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.399518 (+758962us) service_pool.cc:224] Handling call
0709 13:10:00.417845 (+ 18327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:00.418294 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.418328 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:00.418986 (+   658us) log.cc:844] Serialized 52 byte log entry
0709 13:10:00.527360 (+108374us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:00.680787 (+153427us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.681295 (+   508us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.681547 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.681619 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.101598 (+419979us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18000889c0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:10:01.214276 (+112678us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b18000889c0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:10:01.216895 (+  2619us) raft_consensus.cc:1685] finished
0709 13:10:01.216919 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.217073 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33549,"prepare.queue_time_us":83680,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":101,"raft.queue_time_us":266,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":332,"spinlock_wait_cycles":7214720,"thread_start_us":202471,"threads_started":2,"wal-append.queue_time_us":222859}
I20260709 13:10:01.261829 28207 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.251209 23668 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:01.273514 23627 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:01.177922 27860 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:10:01.280216 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.322393 23623 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:01.325063 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 73945.7us
W20260709 13:10:01.325680 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.326184 23668 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:01.328269 23703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 2516) took 2001 ms (client timeout 1931 ms). Trace:
I20260709 13:10:01.333714 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:01.328884 23703 rpcz_store.cc:269] 0709 13:09:59.326865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.393936 (+ 67071us) service_pool.cc:224] Handling call
0709 13:10:01.320230 (+1926294us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b5400357fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:01.328143 (+  7913us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206555008}
I20260709 13:10:01.279913 23776 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:01.233732 28177 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:01.232610 28066 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:01.337786 28177 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.338451 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:01.339457 23776 raft_consensus.cc:2368] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11.
I20260709 13:10:01.338536 28066 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.340305 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.340605 28066 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.340842 28177 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:01.244902 28156 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:01.244000 28176 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:01.245299 28141 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:01.288766 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.189968 28117 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:10:01.285972 28145 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:01.314555 27983 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.349864 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.368216 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.280395 28185 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.361513 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:01.362478 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 120358us
I20260709 13:10:01.377166 23623 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:10:01.343246 28076 raft_consensus.cc:3055] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:01.381230 23623 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:01.381544 23627 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:01.382474 28136 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.445478 23623 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:01.446206 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.446394 28136 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.446275 23623 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.447435 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.447345 23623 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.440742 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.454138 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.382071 27961 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.356887 28146 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:10:01.382234 28156 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:01.494171 28156 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.481141 23623 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:10:01.482645 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.490859 23626 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:10:01.496728 23626 pending_rounds.cc:85] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 9
I20260709 13:10:01.497027 23626 pending_rounds.cc:107] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:10:01.497318 23626 raft_consensus.cc:2889] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.465911 28197 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.492007 28137 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:01.493050 28146 consensus_queue.cc:1243] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:01.441313 28076 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:01.498623 23623 pending_rounds.cc:85] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 9
I20260709 13:10:01.366855 28141 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.516975 23623 pending_rounds.cc:107] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:10:01.378052 28145 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.380851 27983 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.519881 23623 raft_consensus.cc:2889] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.538877 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.540478 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.541728 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.542346 23623 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:01.535529 28224 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:10:01.533551 28206 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:01.534546 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.537232 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.545351 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.510098 28079 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:01.518500 27961 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.523011 23592 leader_election.cc:400] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:10:01.553817 23628 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:01.558838 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.566569 23623 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:01.571781 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.587275 23628 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:01.589049 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:01.589768 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 262372us
I20260709 13:10:01.591508 23668 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:01.589157 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.517897 28197 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.558847 28162 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:01.593166 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.548889 28137 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:10:01.569705 28185 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:01.616842 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 60204.4us
I20260709 13:10:01.623670 23623 raft_consensus.cc:2410] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:10:01.635128 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.636184 23622 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:01.639158 28227 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:10:01.639281 27914 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:01.639703 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.642272 28233 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:01.642724 28233 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:01.645620 28076 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.647003 28076 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.651379 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.652642 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.653224 23777 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:01.653949 23777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:01.654409 23777 raft_consensus.cc:606] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:01.655484 28004 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:01.656330 28004 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:01.657215 28004 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.658190 28004 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:01.661207 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.662101 27914 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:01.662678 27914 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.663228 28242 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.663812 28242 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.664122 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:01.664897 28235 log.cc:927] Time spent T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:01.665341 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:01.666164 28242 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:01.666700 28242 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.667002 24394 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:01.667654 27983 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:01.618670 27860 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:10:01.670662 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2514) took 2344 ms. Trace:
I20260709 13:10:01.670828 23774 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:01.671089 23696 rpcz_store.cc:276] 0709 13:09:59.326224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.952671 (+626447us) service_pool.cc:224] Handling call
0709 13:10:00.108769 (+156098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.109603 (+   834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.670442 (+1560839us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400026050. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:01.670574 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356606208}
I20260709 13:10:01.672484 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:01.673133 24390 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
W20260709 13:10:01.675608 28108 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
W20260709 13:10:01.677111 28201 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.903s	user 0.003s	sys 0.000s
I20260709 13:10:01.679158 27976 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:01.679760 27976 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:01.681416 28145 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:01.681135 27976 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.682721 28207 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:01.633397 28228 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.683979 28228 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.686151 28228 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:01.568636 28229 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:10:01.688731 28217 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:01.689579 23772 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:01.689354 28217 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:01.691046 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1972) took 2049 ms. Trace:
I20260709 13:10:01.629323 28240 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:01.691437 23700 rpcz_store.cc:276] 0709 13:09:59.641406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.697788 (+1056382us) service_pool.cc:224] Handling call
0709 13:10:00.698131 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.698526 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.698562 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.699089 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.776828 (+ 77739us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:00.818584 (+ 41756us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.818797 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.818867 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.141131 (+322264us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4800190158. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:10:01.676397 (+535266us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:01.690841 (+ 14444us) raft_consensus.cc:1685] finished
0709 13:10:01.690865 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.690980 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21170,"prepare.queue_time_us":77075,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2266,"raft.queue_time_us":5842,"raft.run_cpu_time_us":2639,"raft.run_wall_time_us":307351,"spinlock_wait_cycles":39446656,"thread_start_us":77369,"threads_started":1,"wal-append.queue_time_us":73832}
I20260709 13:10:01.686090 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 951) took 1103 ms. Trace:
I20260709 13:10:01.693077 28240 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.694142 23775 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:01.695402 28240 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:01.641019 28221 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:10:01.696120 28141 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:01.696838 28154 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:01.697438 23769 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:01.699120 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:01.693634 23778 rpcz_store.cc:276] 0709 13:10:00.582316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.589030 (+  6714us) service_pool.cc:224] Handling call
0709 13:10:00.589380 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.609863 (+ 20483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.609913 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.609976 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:00.610024 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.685825 (+1075801us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5400345dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:01.685871 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.686001 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46450048}
I20260709 13:10:01.618096 28188 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.640295 28231 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:10:01.703598 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 67665.1us
I20260709 13:10:01.706055 23592 leader_election.cc:400] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11.
I20260709 13:10:01.738458 23592 leader_election.cc:403] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:10:01.654706 23777 raft_consensus.cc:614] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:01.709486 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.716583 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.720304 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.722386 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:01.667110 28242 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:01.746594 28230 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:10:01.746767 28242 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:01.748816 28217 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:01.751528 28175 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:01.724807 28065 consensus_meta.cc:287] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
I20260709 13:10:01.742198 28188 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.753115 23624 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:01.754114 28188 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:01.754851 28149 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.724561 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.730449 28239 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:10:01.731454 28187 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.643558 28233 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.742131 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:01.743939 28197 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:01.715363 24387 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
W20260709 13:10:01.757298 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 51456.6us
I20260709 13:10:01.758610 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:01.758671 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:01.762707 24358 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:01.763531 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:01.767793 23743 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:01.768946 28175 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:01.771301 28175 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.755427 28149 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.771849 28175 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.764906 28145 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11.
I20260709 13:10:01.775236 28233 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.765973 28187 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.766242 28217 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:01.769738 27991 raft_consensus.cc:2764] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:10:01.777881 28187 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:01.780087 27966 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:10:01.780206 28239 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:01.780807 28239 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:01.782124 28239 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:01.811314 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45483.8us
I20260709 13:10:01.817219 23627 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:01.759534 28185 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.826152 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 58526.5us
I20260709 13:10:01.829950 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.831355 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:01.833048 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.835147 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.837810 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.838438 23624 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:01.839373 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:01.840037 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 248609us
I20260709 13:10:01.840322 23622 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:01.841732 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:01.843289 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.842829 23593 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:01.844898 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:01.845602 24391 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:01.826480 28239 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:01.850466 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.827386 28187 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.852747 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:01.853055 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.853562 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:01.854463 23697 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:01.855420 24388 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:01.856204 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:01.828548 28217 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:01.838907 28188 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:01.864962 23699 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:01.857478 28143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.122s	user 0.015s	sys 0.045s
W20260709 13:10:01.857241 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.867183 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.863940 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:01.868471 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.851060 28136 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:01.872493 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.873701 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:01.873881 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 154167us
I20260709 13:10:01.849313 27874 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:01.827584 27966 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:01.826864 28205 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:10:01.836360 28145 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:10:01.891937 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:01.872149 28143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.178s	user 0.016s	sys 0.045s
I20260709 13:10:01.890561 23703 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:01.903429 24391 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:01.930277 23769 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:01.904966 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.907711 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:01.931236 23700 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:01.909715 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:01.910506 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 1975) took 2268 ms. Trace:
I20260709 13:10:01.830482 28185 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:01.910403 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.935820 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.877408 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.938593 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.866611 23699 pending_rounds.cc:85] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 6
I20260709 13:10:01.940030 23699 pending_rounds.cc:107] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:10:01.940490 23699 raft_consensus.cc:2889] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.869161 23695 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:01.943661 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.922567 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.857460 28242 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.912854 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:01.875826 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:01.949476 23770 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:10:01.950002 23770 pending_rounds.cc:85] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 11
I20260709 13:10:01.950264 23770 pending_rounds.cc:107] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:10:01.950534 23770 raft_consensus.cc:2889] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.850733 28023 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:10:01.959838 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.869724 28188 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:01.932492 23702 rpcz_store.cc:276] 0709 13:09:59.642150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.812023 (+1169873us) service_pool.cc:224] Handling call
0709 13:10:00.812534 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.812916 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.812946 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.813518 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.649360 (+835842us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b180034daa0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1
0709 13:10:01.649540 (+   180us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:01.649580 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.649665 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.898014 (+248349us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b180034daa0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:10:01.910282 (+ 12268us) raft_consensus.cc:1685] finished
0709 13:10:01.910305 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.910443 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3390,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":29978,"spinlock_wait_cycles":19766912,"thread_start_us":36648,"threads_started":1,"wal-append.queue_time_us":36535}
I20260709 13:10:01.890244 28187 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:01.953974 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.944576 23695 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:01.984675 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.853654 27991 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:10:01.950456 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:01.962108 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.987859 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:01.975118 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.975466 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.988355 23769 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:01.975008 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.976243 23620 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:01.992906 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.976769 23775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:01.889108 28240 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.869484 27961 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:01.945956 23704 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:01.977303 23777 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:01.981088 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.931595 28245 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.916810 28136 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:01.988700 23697 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:02.012506 28136 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:02.012593 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:02.013365 23701 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.020701 23697 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:10:02.021939 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.022650 23697 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:01.993992 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.023638 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.024097 23695 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:02.024008 28245 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.024828 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.024950 23701 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:02.025161 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:02.025518 23697 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:02.025960 23695 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:02.025885 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.026522 28245 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:01.994508 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 104816us
I20260709 13:10:01.947850 28056 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:01.978185 28188 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:02.027609 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:02.027607 28056 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.030170 28056 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.032593 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.007189 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.034397 23700 raft_consensus.cc:2368] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
I20260709 13:10:02.034891 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.035419 23700 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:01.989689 27874 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.020457 28175 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.026458 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.034178 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:01.983608 28187 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.040184 23698 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:01.996594 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:01.994398 23775 raft_consensus.cc:606] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:01.965193 28242 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.047351 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.050207 23697 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:02.041985 23769 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:02.067705 23697 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:02.068084 23704 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:02.071966 23621 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:02.072118 23697 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:02.090780 27980 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:02.096485 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.044422 28229 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.044665 28186 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.992192 28212 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:10:02.118813 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.051613 27874 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.080024 23776 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:10:02.131254 23697 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:02.081702 28175 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.049358 28157 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:10:02.069763 28065 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:10:02.058472 28187 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:02.067488 28144 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:02.086648 28250 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:10:02.088958 23775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:02.156608 23775 raft_consensus.cc:606] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.157002 23775 raft_consensus.cc:614] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:02.071682 28162 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:02.089701 28004 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:02.003520 28240 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:01.992930 28236 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:10:02.094312 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.004684 27961 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.172640 27961 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.113565 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:02.114619 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:02.114702 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.115619 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.173408 23770 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:02.140877 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 163321us
I20260709 13:10:02.148890 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.051765 28217 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.118487 28243 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:02.160329 23624 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:02.178612 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:02.178874 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63355.5us
W20260709 13:10:02.164891 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.168087 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.103847 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.180606 23704 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:02.118798 28229 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.127054 27983 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:10:02.181891 23629 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 9: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:02.182863 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.126637 28186 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.161207 28056 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.188654 23695 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:02.191250 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.196259 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:02.201975 23702 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:02.202488 23593 leader_election.cc:400] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
I20260709 13:10:02.204068 28066 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:02.204682 28066 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:02.206061 28066 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.208472 28156 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.209194 28156 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.178049 28162 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.197345 28056 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.181695 27980 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:02.219282 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.217396 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.188148 28247 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:02.232300 23775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:02.233079 23775 raft_consensus.cc:606] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.235755 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.248935 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.175959 28004 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.201242 28185 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:02.185164 28209 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 13:10:02.247265 28252 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:10:02.229513 28144 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:02.199764 28243 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:02.281478 28255 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:10:02.281548 23773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 2189) took 2296 ms (client timeout 1798 ms). Trace:
W20260709 13:10:02.258224 28249 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
W20260709 13:10:02.262135 28263 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:10:02.267561 28056 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.262264 28153 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:02.268395 28134 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.275918 28207 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.265880 28185 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:02.276146 28261 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:02.278208 28163 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:02.280293 28186 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:02.280650 28162 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.229393 27914 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.263572 28156 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.286145 24392 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:02.283476 23773 rpcz_store.cc:269] 0709 13:09:59.984871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.987164 (+  2293us) service_pool.cc:224] Handling call
0709 13:10:02.281241 (+2294077us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b5400347454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:02.281410 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102425472}
I20260709 13:10:02.259907 28076 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:02.307209 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:02.311667 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.285517 28242 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.285184 28229 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.283699 28243 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.302529 28104 raft_consensus.cc:3055] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:02.252750 28247 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.331818 28104 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:02.333109 28104 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.334417 28104 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.334476 28136 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.337031 28136 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.337551 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:02.338254 23774 raft_consensus.cc:606] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.319653 28144 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.339318 28144 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.341814 28144 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.343351 28004 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.346000 23623 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:02.347662 28243 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:02.258867 28188 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.348243 28243 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.349795 28188 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:02.319284 27874 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.316370 28056 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:02.360488 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 109889us
I20260709 13:10:02.338658 23774 raft_consensus.cc:614] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:02.322599 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.361622 23775 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:02.357018 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:02.362118 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:02.363145 23592 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:02.359233 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.364038 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.326745 23778 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:10:02.359606 23770 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:02.365334 24390 raft_consensus.cc:2368] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
I20260709 13:10:02.360180 27961 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.367759 27961 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.371932 28243 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.370121 27961 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.366425 28056 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.376806 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:02.378938 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:02.366281 27874 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:02.381289 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:02.381505 27874 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.366479 28229 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:02.382035 27874 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.382640 28229 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:02.383921 28229 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.389452 23743 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:02.390357 28247 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.308490 28187 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.391695 28162 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:02.391891 28261 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:02.392251 28162 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.392639 28162 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.392715 28187 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:02.393728 28187 raft_consensus.cc:993] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:10:02.396054 28179 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:02.396402 23620 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:02.396518 28179 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:02.397658 28179 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.398921 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.399907 23622 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:10:02.400209 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.394359 28240 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:10:02.366109 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:02.338651 28257 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:02.396319 28187 raft_consensus.cc:1081] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:10:02.403509 28134 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:02.409981 28134 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:02.410880 28134 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.375566 28056 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.404978 23774 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:02.412657 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.406440 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:02.407585 23770 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:02.399094 28179 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.426378 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:02.434011 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 69772.4us
I20260709 13:10:02.434129 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.435298 23629 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
W20260709 13:10:02.437083 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 217961us
I20260709 13:10:02.437947 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.439862 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.421993 23623 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:02.403805 28257 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:02.419400 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.441859 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.440553 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:02.443535 23629 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:02.443797 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.440567 23743 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:02.446425 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.437981 28056 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:02.441427 28187 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.402433 28162 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.439693 28261 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.448032 27904 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:02.456970 27904 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:02.457374 27904 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:02.461632 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.436180 27976 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:02.454521 23627 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:02.461864 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.467438 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:02.469776 23625 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:02.449958 28268 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.079s	user 0.000s	sys 0.005s
I20260709 13:10:02.472533 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:02.474813 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.448307 28185 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:02.453092 28187 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:02.455789 28162 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:02.453583 28239 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:02.479635 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.462025 28149 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.484843 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 957) took 1357 ms. Trace:
I20260709 13:10:02.490142 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.447996 28066 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:10:02.487766 23772 rpcz_store.cc:276] 0709 13:10:01.127609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.127752 (+   143us) service_pool.cc:224] Handling call
0709 13:10:01.689212 (+561460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.689940 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.480305 (+790365us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b5400345dd0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:02.484776 (+  4471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290491136}
I20260709 13:10:02.456260 28136 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:10:02.464478 28212 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:10:02.503463 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:02.479225 28270 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:02.485379 28187 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.492165 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.489951 28239 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.538484 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.491577 27976 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:02.494151 28056 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.497723 28188 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:02.540666 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 48697.1us
I20260709 13:10:02.542065 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.503839 28141 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.498148 28162 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:02.495502 28272 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:02.501668 28274 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.532645 28187 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.548826 23625 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:02.548913 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.533447 28269 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:02.536651 28239 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.565573 28269 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:02.566062 28269 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:02.551635 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.541462 28185 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.556325 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:02.557031 23743 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:02.549947 28272 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:02.559428 28261 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.545269 28270 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:02.564224 27976 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.571497 28274 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:02.551488 28056 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.548358 28162 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:02.573372 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.551314 28188 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:02.587647 28135 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:02.549914 28141 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.578881 28004 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:02.580253 28244 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:02.583037 23620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
I20260709 13:10:02.583709 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.575626 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.573144 28272 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.572518 28239 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:02.589664 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.599548 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:02.597038 23620 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.600188 23696 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.600454 23620 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.600481 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:02.586820 28162 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:02.598362 23700 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:02.602459 28164 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.602946 28136 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:02.598093 28056 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.643509 23775 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:02.640719 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 841) took 1478 ms. Trace:
I20260709 13:10:02.607426 23777 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:02.645519 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.594924 28004 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:02.578485 27874 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.595813 28135 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 13:10:02.665956 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 65513.9us
I20260709 13:10:02.659583 23628 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:02.613886 28257 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.616678 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:02.618039 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.619004 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.619506 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:02.677752 23699 raft_consensus.cc:2368] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
W20260709 13:10:02.677505 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45395.7us
I20260709 13:10:02.620057 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.678690 23704 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:02.622031 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:02.680505 28269 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.683743 23701 raft_consensus.cc:1217] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Deduplicated request from leader. Original: 12.11->[13.12-13.12]   Dedup: 13.12->[]
I20260709 13:10:02.684634 23701 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:10:02.687969 23703 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:02.627012 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.660874 28004 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.644829 28261 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:02.661445 27969 raft_consensus.cc:2764] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:02.640450 28244 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:02.648336 28164 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.672204 28056 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.705799 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.634740 23696 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:02.642145 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:02.642709 24359 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.626281 23620 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.727837 23629 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:02.728402 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 85769.8us
I20260709 13:10:02.647107 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2191) took 2306 ms. Trace:
I20260709 13:10:02.729115 23771 rpcz_store.cc:276] 0709 13:10:00.336189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.337892 (+  1703us) service_pool.cc:224] Handling call
0709 13:10:00.745076 (+407184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.745942 (+   866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.641870 (+1895928us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400340dd0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:02.642016 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935504640}
I20260709 13:10:02.729765 24359 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.731037 24359 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.609313 28239 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.699672 23698 raft_consensus.cc:2376] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9. Re-sending same reply.
I20260709 13:10:02.736992 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:02.643502 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 67980.1us
I20260709 13:10:02.737408 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.737844 23629 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:02.738857 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.651417 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.652676 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.741010 23625 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:02.741257 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 116054us
I20260709 13:10:02.653450 23667 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.588140 28188 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:02.750663 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 79351.5us
I20260709 13:10:02.641068 28217 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:02.627840 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.727226 23621 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:02.725328 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.723004 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.731225 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2044) took 1272 ms. Trace:
I20260709 13:10:02.645460 23626 rpcz_store.cc:276] 0709 13:10:01.162703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.167446 (+  4743us) service_pool.cc:224] Handling call
0709 13:10:01.167821 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.497801 (+329980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.640424 (+1142623us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54002b5554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:02.640651 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741893376}
I20260709 13:10:02.742282 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:02.758226 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.702895 28223 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:02.768251 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.748966 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.768415 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:02.749763 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 96449.2us
I20260709 13:10:02.769716 23622 raft_consensus.cc:2410] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:10:02.735188 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:02.754462 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:02.755167 23620 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.758183 23628 rpcz_store.cc:276] 0709 13:10:01.458661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.592677 (+134016us) service_pool.cc:224] Handling call
0709 13:10:02.659035 (+1066358us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:10:02.659320 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.730874 (+ 71554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.731151 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16462592}
I20260709 13:10:02.776062 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.776394 23772 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:02.776793 23625 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:02.777981 24357 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:02.779662 23626 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:02.785555 23629 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:02.722601 28141 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:02.787981 23622 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:02.795225 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:02.796129 23629 raft_consensus.cc:2368] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15.
I20260709 13:10:02.703958 28177 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.647971 28127 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.128s
I20260709 13:10:02.724252 27874 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.748898 27969 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:02.789017 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 53944.1us
I20260709 13:10:02.725509 28056 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.740392 28125 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:02.710870 28164 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.796618 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:02.826769 23772 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.753679 27991 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:02.661665 28086 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:02.803174 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.806833 27904 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.784804 28223 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.808488 28267 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:02.700999 28244 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.783414 28163 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:02.845921 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.699672 28187 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.812830 23625 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:10:02.813882 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.770571 28154 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:02.814795 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:02.782406 28261 raft_consensus.cc:2764] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:02.788533 27914 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:02.832273 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.829113 27991 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:02.721657 28272 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.788424 28205 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:02.783205 28186 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:02.807552 23624 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:02.797945 27983 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:02.824203 28114 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:02.824342 28257 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.783950 28209 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:10:02.782998 28185 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:10:02.808590 23522 catalog_manager.cc:5697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 11, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 11 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.826382 28125 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:02.835938 27969 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:02.886559 27969 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.888458 28269 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.889017 28272 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:02.878799 27983 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:02.833381 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.775830 28217 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.869499 28205 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:02.893688 28205 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.894279 28217 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:02.826264 28157 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:02.875876 28186 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.897874 28186 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:02.899150 28239 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:02.869131 28114 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:02.900782 28114 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:02.866464 27991 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:02.823993 28177 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.857601 28218 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.875316 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.856817 28154 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:02.879717 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.842583 28086 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:02.884325 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 92420.4us
I20260709 13:10:02.873548 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.857911 28004 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.902237 28114 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.924032 23773 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:02.880244 28261 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:02.921275 28156 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:02.858222 28163 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:02.902652 28125 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:02.955053 28186 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:02.959162 28187 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:02.905189 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 90458.3us
I20260709 13:10:02.990221 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:02.981983 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.992156 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:02.985045 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.982090 23777 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:02.936169 28154 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:02.935011 28239 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:02.908140 28091 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:10:02.995146 27904 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:02.995870 28127 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:02.996470 27919 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:02.980376 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:03.009471 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:02.982594 28156 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:03.013041 23742 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:03.014730 23773 raft_consensus.cc:2410] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:03.019867 23669 leader_election.cc:400] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15.
I20260709 13:10:03.019675 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:03.020529 23669 leader_election.cc:403] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:03.021392 23667 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:03.014294 28187 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:03.025846 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:03.005141 28127 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.002265 28239 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:03.038391 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:03.033388 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:03.034572 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:03.037226 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 280303us
I20260709 13:10:03.013182 28273 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.960038 27983 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:03.041610 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:03.011808 27919 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:10:03.029838 27904 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:03.045677 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:03.020753 28156 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.048399 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:02.984431 28261 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:03.051132 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:03.019465 27976 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:03.052609 23772 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:03.058897 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:03.076421 23592 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:03.078436 27919 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.071655 27904 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:03.080221 27904 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.080310 23522 catalog_manager.cc:5697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 7 to 10, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 10 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:03.082455 23522 catalog_manager.cc:5697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.083935 28223 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:03.084656 28086 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:03.085959 28164 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.086544 28164 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:03.040349 28229 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:03.039954 28127 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.087534 28162 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:03.092873 23776 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:03.092454 23522 catalog_manager.cc:5697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.094600 23522 catalog_manager.cc:5697] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 11, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 11 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.096660 28004 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:03.097244 28162 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:03.098115 23770 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:03.031701 28157 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:03.028810 28187 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:03.045081 28212 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:10:03.044860 28246 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:03.023670 28269 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:10:03.074016 28289 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.099675 23776 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:03.072317 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:03.119273 23622 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.111606 23777 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:03.120601 23776 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:03.121246 23777 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:03.115532 23771 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:03.124450 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 346536us
I20260709 13:10:03.128518 23775 raft_consensus.cc:2410] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:10:03.129626 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 89712.9us
I20260709 13:10:03.097015 23522 catalog_manager.cc:5697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 8, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 8 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:03.069854 23773 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:03.135099 23773 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:03.114786 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:03.100939 28187 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.102744 28163 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:03.073396 27976 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:03.075047 28209 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:03.102947 28164 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:03.155849 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 399956us
I20260709 13:10:03.136596 23773 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:03.130136 27860 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:03.171576 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:03.174038 24394 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:03.181034 23778 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:03.182003 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:03.182972 27919 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:03.184442 23773 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.122577 28242 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:10:03.116854 28154 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:03.210512 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:03.137401 28149 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:03.193167 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:03.220920 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:03.222481 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.228488 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 189773us
I20260709 13:10:03.108968 27991 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:03.229404 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 191065us
I20260709 13:10:03.232568 23593 leader_election.cc:400] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
I20260709 13:10:03.239578 23593 leader_election.cc:403] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:03.240659 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:03.242416 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:03.242853 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:03.243584 23703 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:03.244306 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:03.244428 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:03.137401 28076 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:10:03.248615 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:03.249764 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:03.250705 23625 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:03.256134 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:03.288385 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44542.6us
W20260709 13:10:03.294911 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46384.4us
I20260709 13:10:03.142210 28079 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:10:03.255052 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:03.332158 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:02.988940 28142 raft_consensus.cc:2955] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 6 to 9, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:03.220757 28274 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:03.298848 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:03.299944 27976 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:03.300500 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:03.291750 28144 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
I20260709 13:10:03.116498 28289 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:03.254343 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:03.301724 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:03.185119 28130 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:10:03.138831 28239 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:03.150017 28023 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
W20260709 13:10:03.309736 23742 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.4:36767 timed out after 1.669s (SENT) [suppressed 10 similar messages]
I20260709 13:10:03.311257 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:03.211961 27860 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:03.312793 24392 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:03.328413 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:03.332120 23620 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:03.335111 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:03.328279 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:03.191422 28233 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:10:03.249128 28066 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.345541 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:03.184389 28217 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:10:03.256676 28270 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:03.351387 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 171937us
I20260709 13:10:03.239329 28149 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:03.311278 27874 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:03.306377 28229 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.445031 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:03.419198 27976 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.446532 28149 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:03.400838 28274 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:03.448688 27980 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:03.449303 27991 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:03.306200 28232 raft_consensus.cc:2764] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:10:03.329376 28261 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:03.463027 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:03.465379 23703 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:10:03.471207 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.477319 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 142295us
I20260709 13:10:03.514719 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:03.477597 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 149552us
I20260709 13:10:03.363256 28086 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.496511 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.499261 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 171040us
I20260709 13:10:03.392876 28164 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:03.391963 28240 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:03.454711 28066 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.455264 27874 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:03.519915 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 75955us
I20260709 13:10:03.348749 28157 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 13:10:03.521473 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:03.521678 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:03.528628 23743 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:03.593832 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 65307.9us
I20260709 13:10:03.424433 28027 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:10:03.521168 23628 raft_consensus.cc:2955] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 6 to 9, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:10:03.598934 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 75941us
I20260709 13:10:03.595214 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:03.541030 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:03.541975 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 284885us
I20260709 13:10:03.555367 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:03.380669 28125 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:03.560055 24357 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:03.499603 28304 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:03.515587 27919 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:03.463799 28127 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:03.521347 28233 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.599939 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 62387.4us
W20260709 13:10:03.641987 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 331985us
I20260709 13:10:03.658483 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:03.518080 28149 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:03.600718 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:03.650718 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.539676 27969 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:03.534766 28144 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.614689 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:03.667407 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:03.700387 23703 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.601554 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:03.599334 23629 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:03.560334 28066 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.679121 23593 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:03.682533 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.590318 28141 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:03.688743 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 128793us
I20260709 13:10:03.704712 23620 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:03.688899 23626 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:03.640919 28292 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:03.707028 28292 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.646010 28188 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.713997 23593 leader_election.cc:400] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
W20260709 13:10:03.714478 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.589468 28164 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:03.724123 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 578) took 1006 ms. Trace:
I20260709 13:10:03.739578 23695 rpcz_store.cc:276] 0709 13:10:02.717869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.751029 (+ 33160us) service_pool.cc:224] Handling call
0709 13:10:02.751420 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.751804 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.751831 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.752326 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.039009 (+286683us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:03.039056 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.039139 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.723848 (+684709us) raft_consensus.cc:1685] finished
0709 13:10:03.723879 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.724050 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6504,"raft.queue_time_us":82,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":24066,"thread_start_us":211612,"threads_started":1,"wal-append.queue_time_us":658034}
I20260709 13:10:03.741328 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:03.725273 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:03.742719 23702 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:03.540630 28086 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:03.674700 28143 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.592712 28229 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:10:03.786960 28143 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:03.730808 28292 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.801846 28162 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:03.807404 23622 consensus_meta.cc:287] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.684s	user 0.008s	sys 0.000s
I20260709 13:10:03.698875 28076 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.779662 23773 consensus_meta.cc:287] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.004s
I20260709 13:10:03.773528 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:04.117350 23773 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:04.118017 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 2036) took 1070 ms. Trace:
I20260709 13:10:04.118387 23773 rpcz_store.cc:276] 0709 13:10:03.047403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.050658 (+  3255us) service_pool.cc:224] Handling call
0709 13:10:04.117950 (+1067292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:03.944979 23620 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
W20260709 13:10:03.843025 23772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.009s	sys 0.005s
W20260709 13:10:04.124617 23772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.022s	sys 0.010s
I20260709 13:10:03.741566 28164 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:04.036964 28294 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:03.679787 28233 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:03.597546 28240 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:03.745891 28188 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:04.022256 28299 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:10:03.411052 23522 catalog_manager.cc:5697] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 10, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 10 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:03.832918 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:04.149940 23629 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:03.723528 28144 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:04.023128 28297 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:10:03.830430 28162 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:10:03.790869 27904 consensus_meta.cc:287] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.004s
W20260709 13:10:03.830516 28310 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:10:04.155078 23623 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:04.139756 28127 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:03.895773 28157 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:03.744899 28154 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:03.889878 28287 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.579s	user 0.000s	sys 0.002s
I20260709 13:10:04.094249 23702 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:04.160297 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:04.052124 28125 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:04.039677 28315 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.943936 28163 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:03.905632 28306 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
I20260709 13:10:04.044952 28086 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:03.942526 28293 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.543s	user 0.002s	sys 0.000s
W20260709 13:10:04.038836 28205 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 1.145s	user 0.007s	sys 0.004s
I20260709 13:10:03.895684 28143 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:03.665546 27860 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.032236 28322 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:04.095690 28156 consensus_meta.cc:287] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.971s	user 0.007s	sys 0.006s
I20260709 13:10:04.096105 28289 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:03.951236 28274 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:03.724807 27874 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.107575 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2862) took 1080 ms. Trace:
I20260709 13:10:04.192433 23626 rpcz_store.cc:276] 0709 13:10:03.027532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.027750 (+   218us) service_pool.cc:224] Handling call
0709 13:10:03.028095 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.705411 (+677316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.107195 (+401784us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54003250d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:04.107488 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519152512}
I20260709 13:10:03.917680 27980 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
W20260709 13:10:04.022472 28316 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 13:10:04.208297 28257 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.331s	user 0.011s	sys 0.003s
I20260709 13:10:04.208850 28232 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.209426 28232 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:04.094913 28187 consensus_meta.cc:287] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.942s	user 0.012s	sys 0.000s
W20260709 13:10:04.210564 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.210415 28187 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.113390 23622 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:04.211710 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 2866) took 1176 ms. Trace:
I20260709 13:10:04.136804 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2228) took 1298 ms. Trace:
I20260709 13:10:04.107173 28135 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:04.141007 23628 consensus_meta.cc:287] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.003s
I20260709 13:10:04.212690 23772 rpcz_store.cc:276] 0709 13:10:02.838263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.122743 (+284480us) service_pool.cc:224] Handling call
0709 13:10:03.123057 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.123250 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:03.230037 (+106787us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.136430 (+906393us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.136489 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:04.136533 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.136603 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.136739 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10941,"prepare.queue_time_us":390170,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":11101,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2501,"thread_start_us":1001286,"threads_started":2}
I20260709 13:10:04.167047 28272 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:04.154511 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:04.212074 23622 rpcz_store.cc:276] 0709 13:10:03.035668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.041710 (+  6042us) service_pool.cc:224] Handling call
0709 13:10:04.211647 (+1169937us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:04.222828 23620 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:03.706034 27919 consensus_queue.cc:1059] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
W20260709 13:10:04.150523 28246 consensus_meta.cc:287] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.041s	user 0.013s	sys 0.000s
I20260709 13:10:04.149971 28188 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.050194 28175 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.163273 23702 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:04.137869 28076 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.171598 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:04.164458 28114 consensus_meta.cc:287] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.200s	user 0.012s	sys 0.001s
I20260709 13:10:04.151678 28294 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.199899 28156 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.151432 23522 catalog_manager.cc:5697] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:04.156689 27904 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.204777 28144 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:04.204962 28218 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 1.265s	user 0.013s	sys 0.000s
I20260709 13:10:04.266155 23777 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:04.205778 28142 consensus_meta.cc:287] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.000s
I20260709 13:10:04.205940 28240 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:04.207234 28233 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:04.153568 23621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.045s	sys 0.079s
W20260709 13:10:04.280445 23621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.045s	sys 0.080s
W20260709 13:10:04.213824 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44474.6us
I20260709 13:10:04.228474 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2853) took 1812 ms. Trace:
I20260709 13:10:04.225467 23743 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:04.164531 28157 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:04.200150 28318 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:10:04.256870 27919 consensus_queue.cc:1243] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:04.251343 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 581) took 1004 ms. Trace:
I20260709 13:10:04.287273 23702 rpcz_store.cc:276] 0709 13:10:03.246977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.162629 (+915652us) service_pool.cc:224] Handling call
0709 13:10:04.162942 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.250942 (+ 88000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.251249 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:04.222406 28272 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:04.277055 23703 consensus_meta.cc:287] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.006s
I20260709 13:10:04.300696 23703 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:04.301901 23695 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:04.303682 23776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.015s	sys 0.018s
W20260709 13:10:04.304280 23776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.015s	sys 0.018s
W20260709 13:10:04.278733 23667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.000s	sys 0.037s
W20260709 13:10:04.315150 23667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.000s	sys 0.037s
W20260709 13:10:04.279136 23698 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.012s	sys 0.025s
I20260709 13:10:04.232126 28246 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15.
I20260709 13:10:04.253784 27874 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:04.184180 28205 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.184474 28163 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.250144 23629 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:04.281283 23627 rpcz_store.cc:276] 0709 13:10:02.416253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.470301 (+ 54048us) service_pool.cc:224] Handling call
0709 13:10:02.470746 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.471160 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.471190 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.482526 (+ 11336us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.787717 (+305191us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b1800488200. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1 00007f2b412c7a0f
0709 13:10:02.953191 (+165474us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:02.953263 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.953359 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.222269 (+1268910us) raft_consensus.cc:1685] finished
0709 13:10:04.222302 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.228381 (+  6079us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7200,"spinlock_wait_cycles":7062272,"thread_start_us":161046,"threads_started":1,"wal-append.queue_time_us":709963}
W20260709 13:10:04.284937 23744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.005s	sys 0.018s
W20260709 13:10:04.281967 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 56610.5us
I20260709 13:10:04.210017 28292 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.299507 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 577) took 1582 ms. Trace:
I20260709 13:10:04.318488 28205 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:04.320861 28163 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:04.326526 28292 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:04.315719 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 715187us
I20260709 13:10:04.321064 24386 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:04.322438 23629 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:04.328612 23699 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:04.323348 23627 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:04.327656 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:04.331607 23627 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:04.331929 28246 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:04.323540 23744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.006s	sys 0.018s
I20260709 13:10:04.190379 28315 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:04.323835 23698 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.013s	sys 0.025s
I20260709 13:10:04.324539 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:04.278069 28218 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:04.362694 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:04.258225 28175 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:04.364053 24394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.061s	sys 0.078s
I20260709 13:10:04.231822 28289 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:10:04.368141 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:04.226773 28135 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.359843 28163 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.359973 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2558) took 1118 ms. Trace:
I20260709 13:10:04.360677 28291 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:04.364432 24394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.061s	sys 0.078s
I20260709 13:10:04.365814 23773 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:04.367163 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:04.288851 28176 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:04.286743 28162 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:04.324828 23704 rpcz_store.cc:276] 0709 13:10:02.717415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.727787 (+ 10372us) service_pool.cc:224] Handling call
0709 13:10:02.728192 (+   405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:02.744857 (+ 16665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.744909 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:02.755562 (+ 10653us) log.cc:844] Serialized 52 byte log entry
0709 13:10:03.010206 (+254644us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:03.010250 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.010322 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.299183 (+1288861us) raft_consensus.cc:1685] finished
0709 13:10:04.299211 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.299417 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41683,"raft.queue_time_us":16989,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":17169,"thread_start_us":180389,"threads_started":1,"wal-append.queue_time_us":431876}
I20260709 13:10:04.384502 23775 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.380860 23772 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:04.394898 23704 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: [11.6-14.8]
I20260709 13:10:04.383054 23698 rpcz_store.cc:276] 0709 13:10:03.241531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.241729 (+   198us) service_pool.cc:224] Handling call
0709 13:10:03.305279 (+ 63550us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:03.305715 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.305746 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:03.322846 (+ 17100us) log.cc:844] Serialized 52 byte log entry
0709 13:10:03.594532 (+271686us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:03.951914 (+357382us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b180036e260. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f522 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:10:04.354784 (+402870us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.355416 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.355512 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.355578 (+    66us) raft_consensus.cc:1685] finished
0709 13:10:04.359697 (+  4119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.359906 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91574,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":3211,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":20092,"spinlock_wait_cycles":27089664,"thread_start_us":858487,"threads_started":2,"wal-append.queue_time_us":397273}
I20260709 13:10:04.337978 28272 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:04.388422 24357 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.007s	sys 0.041s
I20260709 13:10:04.297624 28233 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:10:04.390169 23593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.003s	sys 0.015s
I20260709 13:10:04.356640 28257 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.399183 24357 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.007s	sys 0.042s
I20260709 13:10:04.400187 23702 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:04.407148 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 702246us
W20260709 13:10:04.389977 28318 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:10:04.387284 28291 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.414948 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:04.415627 23698 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:04.416901 23702 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:04.447988 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:04.463510 23775 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:10:04.453641 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:04.456420 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:04.457491 28342 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.402599 23593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.004s	sys 0.015s
I20260709 13:10:04.400970 28289 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:04.451418 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:04.481041 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:04.482092 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:04.474968 28154 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:04.484304 28154 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.486586 28154 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:04.487423 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:04.488670 24387 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:04.489652 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:04.492167 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:04.493188 23698 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:04.493376 28294 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:04.494870 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:04.495985 28342 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.499230 28342 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:04.420078 28291 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.484385 28332 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:04.390246 28163 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.478307 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:04.574463 24393 raft_consensus.cc:2410] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:10:04.547991 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:04.575529 23742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.010s	sys 0.053s
W20260709 13:10:04.575873 23742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.011s	sys 0.053s
I20260709 13:10:04.414199 28257 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:04.549996 28331 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:10:04.557288 28135 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:04.544687 28179 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.563416 28177 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:04.566286 28066 consensus_meta.cc:287] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.833s	user 0.010s	sys 0.001s
W20260709 13:10:04.566721 28326 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.411s	user 0.000s	sys 0.001s
I20260709 13:10:04.566619 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2044) took 1013 ms. Trace:
I20260709 13:10:04.411990 28233 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.492056 24385 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:04.458866 28187 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:04.580844 28332 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:10:04.576416 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 917966us
I20260709 13:10:04.578110 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2013) took 1045 ms. Trace:
I20260709 13:10:04.604882 23698 rpcz_store.cc:276] 0709 13:10:03.532259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.577143 (+1044884us) service_pool.cc:224] Handling call
0709 13:10:04.577458 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.577683 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.577720 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.577775 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:04.577826 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.577897 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.578043 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:04.605665 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.605924 23592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.005s	sys 0.039s
W20260709 13:10:04.606262 23592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.005s	sys 0.039s
I20260709 13:10:04.606424 23698 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:04.479573 28289 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.583765 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:04.559257 28232 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:04.584739 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:04.587436 23773 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:10:04.614411 23775 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:04.588821 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2238) took 1684 ms. Trace:
I20260709 13:10:04.544888 28114 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:04.568428 28154 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:04.597910 23777 rpcz_store.cc:276] 0709 13:10:03.552804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.554593 (+  1789us) service_pool.cc:224] Handling call
0709 13:10:03.554927 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.266792 (+711865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.566337 (+299545us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54002ca6d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:04.566529 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622818176}
W20260709 13:10:04.573519 28209 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.037s
I20260709 13:10:04.298707 23522 catalog_manager.cc:5697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 8, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 8 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.549026 28125 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.604907 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:04.608707 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 854) took 1095 ms. Trace:
I20260709 13:10:04.595292 27904 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:04.600384 28076 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:04.615914 23770 rpcz_store.cc:276] 0709 13:10:02.904103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.098915 (+194812us) service_pool.cc:224] Handling call
0709 13:10:03.099229 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.099620 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:03.296469 (+196849us) log.cc:844] Serialized 14 byte log entry
0709 13:10:03.542977 (+246508us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.543685 (+   708us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.543913 (+   228us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:03.543964 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.544072 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.588621 (+1044549us) raft_consensus.cc:1685] finished
0709 13:10:04.588642 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.588767 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":350172,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":7552,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":42087,"thread_start_us":334918,"threads_started":2,"wal-append.queue_time_us":615515}
W20260709 13:10:04.602788 27983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.025s	sys 0.026s
I20260709 13:10:04.610548 28332 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:04.644838 23628 rpcz_store.cc:276] 0709 13:10:03.513841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.517364 (+  3523us) service_pool.cc:224] Handling call
0709 13:10:03.520837 (+  3473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.521046 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:04.212981 (+691935us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.608240 (+395259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.608310 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:04.608381 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.608488 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.608634 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3177,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":35192,"thread_start_us":394849,"threads_started":1}
I20260709 13:10:04.598462 28179 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.647467 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:04.650820 23700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.001s	sys 0.009s
I20260709 13:10:04.611310 28218 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.637257 24358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.029s	sys 0.041s
W20260709 13:10:04.664502 24358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.030s	sys 0.042s
I20260709 13:10:04.665308 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:04.643875 28114 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:04.658324 27983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.026s	sys 0.026s
W20260709 13:10:04.636793 28209 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.008s	sys 0.038s
I20260709 13:10:04.676779 27983 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:04.676900 28104 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:04.677320 28104 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:04.677722 27983 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:04.624401 23741 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.009s	sys 0.018s
I20260709 13:10:04.601055 28066 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.678139 28104 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:04.643865 27976 consensus_meta.cc:287] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.165s	user 0.013s	sys 0.000s
I20260709 13:10:04.679271 28104 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.679745 23696 raft_consensus.cc:2410] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:04.679934 28066 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:04.620209 28314 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.024s
W20260709 13:10:04.680647 28314 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.005s	sys 0.024s
I20260709 13:10:04.680805 28146 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:04.681175 28146 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:04.681357 23741 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.010s	sys 0.018s
I20260709 13:10:04.682047 28146 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.683039 28146 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:04.684800 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:04.686470 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.687011 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.692368 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:04.692612 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2011) took 1161 ms. Trace:
I20260709 13:10:04.693305 28322 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:04.692968 23702 rpcz_store.cc:276] 0709 13:10:03.531638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.417906 (+886268us) service_pool.cc:224] Handling call
0709 13:10:04.475049 (+ 57143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.569540 (+ 94491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.569582 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.569640 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:04.569694 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.692390 (+122696us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b54001329d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:04.692439 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.692558 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62762752}
I20260709 13:10:04.694479 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 2073) took 1080 ms. Trace:
I20260709 13:10:04.694900 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:04.694823 23623 rpcz_store.cc:276] 0709 13:10:03.614207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.614357 (+   150us) service_pool.cc:224] Handling call
0709 13:10:04.694314 (+1079957us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54002445d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:04.694426 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046344960}
I20260709 13:10:04.696097 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:04.602842 28336 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:10:04.656872 28125 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.653021 28246 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:10:04.669220 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:04.662973 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:04.672676 24385 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:04.673316 28315 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:04.673637 28285 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:10:04.673842 28335 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:10:04.674217 28337 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:04.674371 28341 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:04.675010 28218 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.675495 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 853) took 1352 ms. Trace:
I20260709 13:10:04.716468 28257 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:04.613149 28289 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.651589 28157 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:04.643683 28154 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.724999 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 775) took 1422 ms. Trace:
I20260709 13:10:04.698386 23702 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:04.730986 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:04.755164 28273 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.768726 24394 rpcz_store.cc:276] 0709 13:10:03.302208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.306795 (+  4587us) service_pool.cc:224] Handling call
0709 13:10:03.307268 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.454978 (+147710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.455038 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.476411 (+ 21373us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.390454 (+914043us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:04.390512 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.390614 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.724682 (+334068us) raft_consensus.cc:1685] finished
0709 13:10:04.724713 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.724916 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":401546,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":23597,"thread_start_us":971821,"threads_started":2,"wal-append.queue_time_us":1082772}
W20260709 13:10:04.667856 23700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.002s	sys 0.010s
I20260709 13:10:04.667378 23742 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:04.645260 28023 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.033s	sys 0.031s
I20260709 13:10:04.749703 24389 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:04.711532 28322 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:10:04.754457 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 362761us
I20260709 13:10:04.713104 28179 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:04.717291 28163 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:04.717615 28086 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:04.700714 28175 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:04.700268 27983 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.792521 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 765) took 1637 ms. Trace:
I20260709 13:10:04.698058 23777 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:04.704887 28233 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:04.749442 28153 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:04.765416 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:04.748906 28320 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.799049 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:04.799671 23628 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.662425 27904 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:04.777640 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:04.750366 28205 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:10:04.780567 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 113246us
I20260709 13:10:04.809620 23628 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:04.776255 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2047) took 1134 ms. Trace:
I20260709 13:10:04.782950 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:04.810844 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:04.811264 23623 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.768792 28315 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:04.759241 23625 rpcz_store.cc:276] 0709 13:10:03.323118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.323918 (+   800us) service_pool.cc:224] Handling call
0709 13:10:03.364130 (+ 40212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.400289 (+ 36159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.400334 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.419252 (+ 18918us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.607166 (+187914us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:03.607227 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.607328 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.675286 (+1067958us) raft_consensus.cc:1685] finished
0709 13:10:04.675307 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.675441 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36224,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":17122,"thread_start_us":126445,"threads_started":1,"wal-append.queue_time_us":650432}
I20260709 13:10:04.756601 28285 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:04.779903 28023 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.034s	sys 0.031s
I20260709 13:10:04.793134 24392 rpcz_store.cc:276] 0709 13:10:03.155534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.155895 (+   361us) service_pool.cc:224] Handling call
0709 13:10:03.211256 (+ 55361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.446633 (+235377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.792241 (+1345608us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400603954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:04.792459 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232838400}
I20260709 13:10:04.825961 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:04.826707 23778 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:04.800033 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:04.792476 27983 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.794159 28163 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.810424 23776 rpcz_store.cc:276] 0709 13:10:03.641654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.678629 (+ 36975us) service_pool.cc:224] Handling call
0709 13:10:03.679230 (+   601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.698781 (+ 19551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.698815 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.699369 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.309167 (+609798us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:04.309216 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.309291 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.775998 (+466707us) raft_consensus.cc:1685] finished
0709 13:10:04.776025 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.776181 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19103,"raft.queue_time_us":28917,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":23443,"thread_start_us":605015,"threads_started":1,"wal-append.queue_time_us":898184}
I20260709 13:10:04.782049 28273 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.832304 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:04.833105 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:04.833787 23776 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:04.834764 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:04.835350 23776 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:04.801497 28153 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.855545 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:04.844354 23778 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:04.835589 23625 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:04.856542 23776 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:04.815030 28246 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:04.803131 27904 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:04.824290 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:04.796525 28086 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.782431 28142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58548 (request call id 0) took 4289 ms. Trace:
I20260709 13:10:04.751629 23522 catalog_manager.cc:5697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.813194 23628 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:04.867947 23623 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:10:04.813787 28315 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:04.870437 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:04.862021 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:04.813575 28157 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:04.888592 23627 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:04.873426 23624 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:10:04.827768 23777 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
W20260709 13:10:04.890300 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 99080.1us
I20260709 13:10:04.891686 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:04.884608 23776 raft_consensus.cc:2368] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:10:04.894858 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:04.895615 23776 raft_consensus.cc:2376] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13. Re-sending same reply.
I20260709 13:10:04.887804 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2079) took 1268 ms. Trace:
I20260709 13:10:04.902225 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:04.854947 28114 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:04.903501 23778 raft_consensus.cc:2410] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:04.869414 28162 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:04.869976 28246 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:04.805994 28320 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:04.894096 28188 consensus_meta.cc:287] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.004s
I20260709 13:10:04.829835 28272 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:04.926316 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:04.902016 23629 rpcz_store.cc:276] 0709 13:10:03.665000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.328794 (+663794us) service_pool.cc:224] Handling call
0709 13:10:04.329232 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.361772 (+ 32540us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:04.362116 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.786907 (+424791us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.787551 (+   644us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.787751 (+   200us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:04.787800 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.787892 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.887519 (+ 99627us) raft_consensus.cc:1685] finished
0709 13:10:04.887546 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.887708 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31899,"prepare.queue_time_us":168,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":34461,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":11944,"spinlock_wait_cycles":135296,"thread_start_us":424228,"threads_started":1,"wal-append.queue_time_us":522890}
I20260709 13:10:04.907096 28330 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:04.962916 23773 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:04.923967 23776 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:04.931988 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:04.977311 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 183720us
W20260709 13:10:04.974084 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.927096 28246 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:04.931528 28092 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.532s	user 0.011s	sys 0.025s
I20260709 13:10:04.928361 28209 raft_consensus.cc:3055] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:05.012931 28320 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:04.934420 28175 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:04.956599 23729 heartbeater.cc:646] Failed to heartbeat to 127.21.244.62:36967 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.21.244.62:36967 timed out after 15.000s (SENT)
W20260709 13:10:05.025734 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 93814.1us
I20260709 13:10:04.929277 28125 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.032210 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:04.906891 28157 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.038429 23592 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:05.039816 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.043147 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:05.044126 23628 raft_consensus.cc:2410] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:05.033762 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:05.049804 23667 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:05.029577 28257 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:05.030179 28209 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:05.051148 28340 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:05.062314 28340 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:05.035144 23522 catalog_manager.cc:5697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.062726 28340 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.063942 23522 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 3 to 5, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 5 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:05.065483 28285 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:05.048902 28355 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.065752 23522 catalog_manager.cc:5697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 13, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 13 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:05.066640 28355 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:05.026798 28092 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.659s	user 0.013s	sys 0.036s
I20260709 13:10:05.061313 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:05.069065 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2007) took 1542 ms. Trace:
I20260709 13:10:04.931543 28233 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:10:05.032367 27860 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:05.071424 23704 rpcz_store.cc:276] 0709 13:10:03.527272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.395928 (+868656us) service_pool.cc:224] Handling call
0709 13:10:04.396235 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.396488 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.396522 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.396979 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.878149 (+481170us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:04.886188 (+  8039us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.888835 (+  2647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.888908 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.068851 (+179943us) raft_consensus.cc:1685] finished
0709 13:10:05.068871 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.069006 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24370,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":93,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":428962,"threads_started":1,"wal-append.queue_time_us":625060}
I20260709 13:10:05.034104 28218 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:05.078686 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.106812 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 68496.1us
I20260709 13:10:05.034312 28175 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:05.050560 28364 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:10:05.115227 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 305321us
I20260709 13:10:05.137565 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:04.962260 28332 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:05.061019 28351 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:05.126138 23592 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:04.933722 28188 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:05.111194 27860 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.107546 28154 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.077346 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:05.157285 23702 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:10:05.008929 28315 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:05.075853 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 182427us
I20260709 13:10:05.150039 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:05.117305 28125 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:05.135105 28175 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.045226 28342 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:10:05.060165 28257 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.165905 23592 leader_election.cc:400] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:10:05.145828 28240 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:05.059687 28289 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.175140 23592 leader_election.cc:403] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.061702 28291 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:05.134784 28092 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:10:05.157143 27860 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.061399 28209 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:05.182958 28289 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:05.159077 28076 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:05.151391 28233 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:05.184296 23592 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:05.194813 23775 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:10:05.156430 28066 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:05.167448 28125 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.168588 27983 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:05.183804 28315 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.067698 23522 catalog_manager.cc:5697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.183624 28086 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:05.138541 28162 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.200482 28076 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.204576 28240 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:05.203570 27904 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:05.208937 28125 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:05.212021 28179 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:05.255270 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.220186 28366 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:05.222662 28348 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.291s	user 0.001s	sys 0.001s
I20260709 13:10:05.215445 28209 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:05.233357 28104 consensus_meta.cc:287] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.004s
W20260709 13:10:05.237161 28367 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:10:05.256246 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 110001us
W20260709 13:10:05.224121 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 173371us
W20260709 13:10:05.272599 28293 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:05.231482 28157 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.206787 28233 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:05.257359 28076 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.290478 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:05.284492 28163 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.320248 23698 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:05.320791 23698 pending_rounds.cc:85] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 5
W20260709 13:10:05.320801 23696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 2562) took 2078 ms (client timeout 1831 ms). Trace:
I20260709 13:10:05.321513 23698 pending_rounds.cc:107] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:05.321913 23698 raft_consensus.cc:2889] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:04.883013 28142 rpcz_store.cc:276] 0709 13:10:00.483972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.501568 (+ 17596us) service_pool.cc:224] Handling call
0709 13:10:00.579418 (+ 77850us) log.cc:844] Serialized 494 byte log entry
0709 13:10:01.081623 (+502205us) spinlock_profiling.cc:243] Waited 9.46 ms on lock 0x7b18003947e0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:10:04.768265 (+3686642us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133,"raft.queue_time_us":24830,"raft.run_cpu_time_us":1219,"raft.run_wall_time_us":1219,"spinlock_wait_cycles":21767424,"thread_start_us":71879,"threads_started":1,"wal-append.queue_time_us":163783,"wal-append.run_cpu_time_us":2244,"wal-append.run_wall_time_us":1053132}
I20260709 13:10:05.220393 28066 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.274976 28179 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:05.301141 28104 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:05.302273 28233 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:05.303382 28146 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.620s	user 0.014s	sys 0.000s
W20260709 13:10:05.304433 28375 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:10:05.304900 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.305143 28240 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.307262 28332 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:05.308977 28360 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:10:05.356220 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:05.222110 28330 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:05.275930 28338 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 6. Current term is 7.
I20260709 13:10:05.274565 28257 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.272858 28291 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:05.239960 28269 consensus_queue.cc:1059] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:10:05.317610 28355 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:05.321839 23696 rpcz_store.cc:269] 0709 13:10:03.242800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.244016 (+  1216us) service_pool.cc:224] Handling call
0709 13:10:05.319531 (+2075515us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540008a2d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:05.320698 (+  1167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3298408832}
I20260709 13:10:05.237573 28373 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:10:05.331319 23777 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:05.273624 28340 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.334820 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:05.315362 28366 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:10:05.350781 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 166538us
I20260709 13:10:05.328543 28179 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.320441 28382 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:05.353894 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.240406 23522 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 11 to 13, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 13 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.335534 28378 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.334046 28163 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:05.335577 28104 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:05.521811 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.362881 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:05.545364 23704 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.545665 28330 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:05.556380 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2576) took 2309 ms. Trace:
I20260709 13:10:05.567451 23700 rpcz_store.cc:276] 0709 13:10:03.246677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.120992 (+874315us) service_pool.cc:224] Handling call
0709 13:10:04.121396 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:04.122164 (+   768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.122201 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:04.122930 (+   729us) log.cc:844] Serialized 52 byte log entry
0709 13:10:04.773810 (+650880us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:05.011589 (+237779us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.210962 (+199373us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.555940 (+344978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.556042 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.556099 (+    57us) raft_consensus.cc:1685] finished
0709 13:10:05.556116 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.556305 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82450,"prepare.queue_time_us":68400,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":3230,"raft.queue_time_us":194572,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":3920,"thread_start_us":1349306,"threads_started":4,"wal-append.queue_time_us":689660}
I20260709 13:10:05.551076 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:05.555537 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:05.566007 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 231276us
I20260709 13:10:05.578214 23772 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:05.577425 27983 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:05.578770 28163 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.586505 28163 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:05.593007 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:05.596407 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.587642 28366 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.440685 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:05.597982 23702 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:05.578712 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:05.599378 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:05.605942 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.609251 28153 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.610100 23512 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5fa82982f53411c84a07a2fb3918888 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:05.610301 23771 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:05.611670 28290 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:05.612144 28066 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.612239 28290 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:05.367467 28188 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:05.617049 23776 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:05.617136 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:05.617763 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:05.620388 28142 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:05.626340 28142 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:05.607503 28127 raft_consensus.cc:3055] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:05.602294 28338 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:05.628198 28127 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:05.628551 28338 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:05.629650 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49518.7us
I20260709 13:10:05.630069 28142 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:05.630983 28338 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:05.607400 28076 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:05.632680 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:05.633704 28076 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:05.638410 28383 log.cc:927] Time spent T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:10:05.596230 28246 consensus_meta.cc:287] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.563s	user 0.012s	sys 0.000s
I20260709 13:10:05.667152 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:05.618990 23771 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:10:05.619159 23592 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:05.649705 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:05.682902 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 63843.6us
W20260709 13:10:05.648540 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.649118 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:05.620898 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:05.607234 28125 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.618626 23704 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:05.695061 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:05.631470 28142 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:05.696092 23704 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:05.697057 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:05.698102 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:05.698215 28156 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:05.698683 23704 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:10:05.639796 23702 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.641181 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:05.699649 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:05.705260 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:05.706008 24394 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 16: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:05.641932 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:05.576190 28382 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:05.621085 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:05.711679 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:05.716693 23629 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:05.712129 24390 raft_consensus.cc:2376] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10. Re-sending same reply.
I20260709 13:10:05.712977 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:05.718924 23627 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:05.717871 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:05.722486 24386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 774) took 2424 ms. Trace:
I20260709 13:10:05.722893 24386 rpcz_store.cc:276] 0709 13:10:03.298482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.306388 (+  7906us) service_pool.cc:224] Handling call
0709 13:10:03.347932 (+ 41544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.327533 (+979601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.722237 (+1394704us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b54001f1dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:05.722400 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2237493120}
I20260709 13:10:05.712235 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:05.724450 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:05.725073 23778 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:05.715257 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.644896 28370 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:05.689410 28188 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.731045 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:05.613317 28290 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.743314 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:05.744715 23704 raft_consensus.cc:2410] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:05.748831 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:05.752245 23702 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:05.753213 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:05.739526 28163 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:05.726539 28335 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:10:05.733573 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 112574us
W20260709 13:10:05.758216 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.758551 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.761543 23742 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:05.719244 28382 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.701653 28338 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:10:05.726178 28393 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:05.602864 28378 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:05.774979 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:10:05.745626 28315 consensus_meta.cc:287] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 13:10:05.739800 28141 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:05.565135 27860 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.797514 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 978) took 1193 ms. Trace:
I20260709 13:10:05.776850 28004 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:05.760653 28290 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:05.798233 27860 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.791343 23778 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:10:05.797931 23775 rpcz_store.cc:276] 0709 13:10:04.604420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.615358 (+ 10938us) service_pool.cc:224] Handling call
0709 13:10:04.615707 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.200859 (+585152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.797260 (+596401us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54002cb0d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:05.797452 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329515392}
I20260709 13:10:05.799671 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.799893 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2048) took 1117 ms. Trace:
I20260709 13:10:05.800109 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.800855 23775 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
W20260709 13:10:05.801198 23699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 2561) took 2558 ms (client timeout 2861 ms). Trace:
I20260709 13:10:05.795235 28141 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:05.801604 23699 rpcz_store.cc:269] 0709 13:10:03.242521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.242633 (+   112us) service_pool.cc:224] Handling call
0709 13:10:05.801010 (+2558377us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400405454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:05.801112 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467715456}
I20260709 13:10:05.801858 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:05.802928 28261 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:05.805300 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2051) took 1121 ms. Trace:
I20260709 13:10:05.805904 28374 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.805653 23777 rpcz_store.cc:276] 0709 13:10:04.684289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.901828 (+217539us) service_pool.cc:224] Handling call
0709 13:10:04.902194 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.577222 (+675028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.805091 (+227869us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b540016bf54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:05.805246 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":985693568}
I20260709 13:10:05.801653 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:05.801623 23700 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:05.808055 23775 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.800290 23778 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:10:05.800233 23770 rpcz_store.cc:276] 0709 13:10:04.682782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.682933 (+   151us) service_pool.cc:224] Handling call
0709 13:10:04.683247 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.903371 (+220124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.903416 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.903487 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:04.903533 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.799664 (+896131us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54003412d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:05.799711 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.799845 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505695488}
W20260709 13:10:05.794623 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.811467 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.811908 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.812050 23592 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:05.813108 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:05.813254 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:05.690969 28246 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.813755 23770 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.806656 28374 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.814368 28269 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:05.820257 28269 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.822245 28269 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.822364 28141 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.822893 28388 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:05.828135 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:05.748242 28188 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.832243 23775 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
W20260709 13:10:05.801236 28396 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:10:05.819502 28374 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.839174 23592 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:05.827167 28209 consensus_meta.cc:287] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.005s
I20260709 13:10:05.716377 28142 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:05.824630 28376 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.888870 23696 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:05.827126 28257 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:05.739948 28104 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.823416 28388 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
W20260709 13:10:05.861336 28175 consensus_meta.cc:287] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.004s
I20260709 13:10:05.809275 28332 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:10:05.861248 28385 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:05.867674 28079 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:05.884374 28066 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:05.895756 23770 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:05.787626 28393 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.825724 27860 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:10:05.902395 24393 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:10:05.903235 28378 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:05.868853 28261 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:05.895234 28257 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:05.912740 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 206156us
I20260709 13:10:05.917416 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:05.921054 23627 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:05.927948 28188 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:05.928242 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2075) took 2310 ms. Trace:
I20260709 13:10:05.895154 28376 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.928777 23622 rpcz_store.cc:276] 0709 13:10:03.618012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.230575 (+612563us) service_pool.cc:224] Handling call
0709 13:10:04.321322 (+ 90747us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.359994 (+ 38672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.360027 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.360633 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.692020 (+331387us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:04.692060 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.692129 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.835820 (+143691us) raft_consensus.cc:1685] finished
0709 13:10:04.835848 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.927867 (+1092019us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b54002b4b50. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:05.928145 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31992,"raft.queue_time_us":39523,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":137308032,"thread_start_us":302280,"threads_started":1,"wal-append.queue_time_us":472939,"wal-append.run_cpu_time_us":1730,"wal-append.run_wall_time_us":1001732}
I20260709 13:10:05.915205 28340 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.934409 28239 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.931363 28376 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.938630 28142 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:05.939687 28142 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:05.940217 28142 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:10:05.941386 28317 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.780s	user 0.009s	sys 0.005s
I20260709 13:10:05.943336 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2557) took 2703 ms. Trace:
I20260709 13:10:05.943812 23697 rpcz_store.cc:276] 0709 13:10:03.240636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.240779 (+   143us) service_pool.cc:224] Handling call
0709 13:10:03.241137 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.252410 (+ 11273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.252460 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.296322 (+ 43862us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.498959 (+202637us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:03.535351 (+ 36392us) log.cc:844] Serialized 14 byte log entry
0709 13:10:03.599573 (+ 64222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.599654 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.691537 (+1091883us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b180018f640. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f522 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:10:05.940689 (+1249152us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:05.943066 (+  2377us) raft_consensus.cc:1685] finished
0709 13:10:05.943096 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.943244 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152933,"prepare.queue_time_us":39533,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":77118,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":62817,"spinlock_wait_cycles":42725376,"thread_start_us":104591,"threads_started":1,"wal-append.queue_time_us":771335}
I20260709 13:10:05.950060 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.950639 23775 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:05.950729 23770 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:10:05.951397 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.951642 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.951815 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.952544 23770 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:05.952399 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.947328 28142 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:05.954313 28142 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.954449 28380 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:05.961211 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 851) took 2653 ms. Trace:
I20260709 13:10:05.960106 27980 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:05.960371 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2012) took 2428 ms. Trace:
I20260709 13:10:05.777784 23522 catalog_manager.cc:5697] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.975412 23701 rpcz_store.cc:276] 0709 13:10:03.531984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.555438 (+1023454us) service_pool.cc:224] Handling call
0709 13:10:04.555918 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.783246 (+227328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.783291 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.783349 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:04.783401 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.960154 (+1176753us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540026bbd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:05.960197 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.960315 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522199936}
I20260709 13:10:05.968473 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.968254 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.969978 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.970285 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.979619 23770 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:05.961632 23621 rpcz_store.cc:276] 0709 13:10:03.307609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.307777 (+   168us) service_pool.cc:224] Handling call
0709 13:10:03.443601 (+135824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.443963 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:03.536829 (+ 92866us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.286094 (+749265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.286183 (+    89us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:04.286237 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.286307 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.961016 (+1674709us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002b3750. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:05.961126 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":588016,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":9322,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":16469,"spinlock_wait_cycles":311369600,"thread_start_us":822382,"threads_started":2,"wal-append.queue_time_us":861932,"wal-append.run_cpu_time_us":1665,"wal-append.run_wall_time_us":1083741}
I20260709 13:10:05.980644 23775 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:05.983373 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.983994 23775 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:05.984762 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.985504 23775 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:05.986297 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:05.987317 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:06.000919 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:06.003613 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:05.913092 28079 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:05.959571 28027 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:05.918992 28257 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.960155 28380 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:05.996488 28149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.207s	user 0.036s	sys 0.019s
I20260709 13:10:05.904537 28175 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.026691 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:06.030803 28330 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.035686 28079 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:06.036955 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.975153 27980 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:05.976842 28340 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:06.023175 28378 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:06.043274 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 350479us
I20260709 13:10:05.909804 28066 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:05.903752 28385 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:06.058728 24359 connection.cc:256] RPC call timeout handler was delayed by -1.0925981429999183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 13:10:06.031649 28125 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:06.041913 28149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.296s	user 0.037s	sys 0.019s
I20260709 13:10:06.034004 28027 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.080709 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:06.089200 24359 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:06.021530 28376 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:10:06.059247 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 248263us
I20260709 13:10:06.113502 28376 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:06.113786 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.113878 28376 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:06.114821 28376 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.062366 28141 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:06.106879 28175 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:06.111871 28232 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:06.116034 28376 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.116182 28232 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:06.117089 28232 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.118237 28232 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.118637 28142 consensus_queue.cc:1059] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:06.112426 28400 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.041669 28153 consensus_queue.cc:1059] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:10:06.060418 28374 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:06.126819 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.133880 28004 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:06.087157 28387 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:06.136142 28387 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:06.136343 28066 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:06.136584 28387 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.137035 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:06.138813 28209 raft_consensus.cc:3055] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:06.139367 28209 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:06.139117 23522 catalog_manager.cc:5697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 9, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 9 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
W20260709 13:10:06.140398 28179 consensus_meta.cc:287] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:10:06.142781 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:06.145349 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:06.162107 23775 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:06.163890 23742 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:06.119619 28142 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:10:06.166603 28188 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:06.167063 28188 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.167438 28188 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.123870 28027 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.146744 28179 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.174760 28179 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:06.176759 28397 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:06.178813 28393 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:06.101346 28149 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:06.180614 28385 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:06.097968 28338 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:06.078325 28340 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.100137 28398 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:06.195612 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2074) took 2579 ms. Trace:
I20260709 13:10:06.141749 28374 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.123639 28125 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:06.194455 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 360626us
I20260709 13:10:06.120752 28380 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:06.199697 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 282359us
W20260709 13:10:06.205732 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.144287 28246 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:06.209427 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45636.1us
I20260709 13:10:06.219396 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.220409 24390 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:06.236202 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:06.237336 24390 raft_consensus.cc:2410] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:06.179557 28027 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.198668 28374 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.249023 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.263280 24394 raft_consensus.cc:2410] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:06.215430 28339 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:06.119896 28400 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.215971 28153 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:06.228876 28330 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:06.197719 28338 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.208249 28398 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.268569 28399 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:06.285913 28399 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:06.288477 28399 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.289033 28400 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:06.294668 28387 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.297034 28387 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:06.302314 28382 consensus_meta.cc:287] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.001s
I20260709 13:10:06.304339 28398 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:06.303567 28382 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.302395 28374 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.336830 23522 catalog_manager.cc:5697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 7, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 7 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:06.341611 23522 catalog_manager.cc:5697] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:06.344336 23522 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:06.346949 23522 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 13, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 13 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:06.354254 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:06.369783 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 246794us
I20260709 13:10:06.367944 23770 raft_consensus.cc:2955] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 6 to 9, VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:10:06.356292 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.197700 23626 rpcz_store.cc:276] 0709 13:10:03.617602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.208190 (+590588us) service_pool.cc:224] Handling call
0709 13:10:04.208594 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.280497 (+ 71903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.280530 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.281184 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.753737 (+472553us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:04.761221 (+  7484us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.765307 (+  4086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.181615 (+1416308us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b540037da54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:06.181665 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.181715 (+    50us) raft_consensus.cc:1685] finished
0709 13:10:06.195139 (+ 13424us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.195543 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24931,"prepare.queue_time_us":6977,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":14795,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":57682,"spinlock_wait_cycles":159826816,"thread_start_us":393071,"threads_started":1,"wal-append.queue_time_us":593907}
I20260709 13:10:06.210453 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:06.363276 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.374694 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:06.375705 23626 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:06.368635 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2579) took 1912 ms. Trace:
W20260709 13:10:06.369843 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 277685us
W20260709 13:10:06.377274 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.377128 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:06.378093 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:06.379428 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.380848 24385 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:10:06.382937 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.383419 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:06.383621 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 165008us
I20260709 13:10:06.391876 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.393388 24390 raft_consensus.cc:2410] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:06.394783 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.395864 24390 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:06.396694 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2573) took 3150 ms. Trace:
I20260709 13:10:06.397065 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:06.397176 23695 rpcz_store.cc:276] 0709 13:10:03.245825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.742186 (+496361us) service_pool.cc:224] Handling call
0709 13:10:04.301621 (+559435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.302460 (+   839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.396265 (+2093805us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b540042b150. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:06.396502 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285920640}
I20260709 13:10:06.373723 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 977) took 1769 ms. Trace:
I20260709 13:10:06.398787 23773 rpcz_store.cc:276] 0709 13:10:04.604143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.613959 (+  9816us) service_pool.cc:224] Handling call
0709 13:10:04.614296 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.963511 (+349215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.373051 (+1409540us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540032f854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:06.373439 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789041536}
I20260709 13:10:06.385545 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2087) took 1694 ms. Trace:
I20260709 13:10:06.260646 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.400635 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2227) took 3562 ms. Trace:
I20260709 13:10:06.402326 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:06.401214 23774 rpcz_store.cc:276] 0709 13:10:02.837897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.033055 (+195158us) service_pool.cc:224] Handling call
0709 13:10:03.115803 (+ 82748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.116251 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.116295 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.117054 (+   759us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.255566 (+138512us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:03.255623 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.255714 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.203404 (+947690us) raft_consensus.cc:1685] finished
0709 13:10:04.203430 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.400020 (+2196590us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b5400059bd0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:06.400424 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1157,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":7180,"spinlock_wait_cycles":143953152,"thread_start_us":103679,"threads_started":1,"wal-append.queue_time_us":260726,"wal-append.run_cpu_time_us":17862,"wal-append.run_wall_time_us":1799524}
I20260709 13:10:06.403324 24386 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.391979 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.390420 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:06.414847 24388 raft_consensus.cc:2410] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:06.416364 28142 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:06.417073 28142 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:06.418759 28142 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.405555 24391 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:06.406994 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.407477 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.421425 24392 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 12: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:06.422016 24394 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:06.212989 28125 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.422484 27860 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.422763 27976 raft_consensus.cc:3055] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:06.424499 27860 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:06.425819 28125 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:06.426535 28125 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.426858 28104 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:06.426541 28027 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:06.429294 28027 consensus_queue.cc:1059] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:06.427379 28125 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.430784 28127 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.400602 23625 rpcz_store.cc:276] 0709 13:10:04.690654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.861650 (+170996us) service_pool.cc:224] Handling call
0709 13:10:04.861982 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.862218 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:04.884162 (+ 21944us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.956735 (+1072573us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b18003ec020. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac23a 00007f2b41316a2a
0709 13:10:06.384680 (+427945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.384827 (+   147us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:06.384949 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.385065 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.385274 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21702,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":3687,"spinlock_wait_cycles":68139776,"thread_start_us":394924,"threads_started":1,"wal-append.queue_time_us":1374117}
I20260709 13:10:06.432698 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:06.433082 28125 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:06.433383 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.180625 28149 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.434446 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:06.436506 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:06.437847 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:06.439123 28153 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.386135 24359 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:06.384876 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.438598 23629 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.474170 24385 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 6.
I20260709 13:10:06.474570 28382 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:06.475713 28153 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:06.476236 28400 raft_consensus.cc:3055] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:06.476886 28400 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:06.476967 23522 catalog_manager.cc:5697] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:10:06.480701 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 89161.9us
I20260709 13:10:06.478587 28400 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.485671 28338 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:06.488533 28290 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.000s
I20260709 13:10:06.490774 28340 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:06.498163 28239 consensus_meta.cc:287] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.563s	user 0.012s	sys 0.000s
I20260709 13:10:06.499550 23772 raft_consensus.cc:2410] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:06.271792 28339 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:06.503698 24390 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:06.504204 28339 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.511152 24386 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:06.518882 28374 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:06.521003 28127 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.522055 28232 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:06.377121 23698 rpcz_store.cc:276] 0709 13:10:04.459835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.607073 (+147238us) service_pool.cc:224] Handling call
0709 13:10:05.319748 (+712675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.322586 (+  2838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.367958 (+1045372us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b540008a2d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:06.368315 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638239488}
I20260709 13:10:06.524314 28409 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:06.513360 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:06.511979 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.423516 27976 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:10:06.532855 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 147014us
I20260709 13:10:06.533807 28405 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:06.534106 24359 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:06.534341 28405 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:06.534977 28405 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.534641 28378 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:06.277298 28330 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.540850 28154 raft_consensus.cc:3055] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:06.541208 28412 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:06.541514 28154 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:10:06.544780 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.545714 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.548008 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 337501us
I20260709 13:10:06.548518 28380 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:06.549167 28380 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:06.549741 28380 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.535173 28289 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.553800 28289 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.533178 28376 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:06.555850 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:10:06.643715 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 109783us
W20260709 13:10:06.562628 28349 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 1.439s	user 0.005s	sys 0.010s
I20260709 13:10:06.655403 23626 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.652266 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:06.654412 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 262493us
I20260709 13:10:06.444096 28104 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
W20260709 13:10:06.660440 23621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.009s	sys 0.017s
W20260709 13:10:06.679185 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.674652 23621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.009s	sys 0.017s
I20260709 13:10:06.683297 24359 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:06.688961 28330 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:06.689347 28187 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.690163 28187 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:06.691020 28301 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 2.511s	user 0.000s	sys 0.010s
I20260709 13:10:06.693903 23769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2223) took 3863 ms. Trace:
I20260709 13:10:06.695423 23629 raft_consensus.cc:2410] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:06.695242 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:06.695858 28142 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:06.696939 28142 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:06.699059 28382 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:06.698467 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:06.699712 28382 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:06.699934 28175 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.700176 23629 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.701025 28187 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:06.701963 28079 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:06.702889 28079 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.700731 28175 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:06.713502 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 54857.4us
I20260709 13:10:06.718752 23629 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:06.725298 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:06.726042 28104 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:06.726845 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:06.727886 23629 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:06.728982 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:06.729072 28257 consensus_meta.cc:287] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.671s	user 0.000s	sys 0.014s
I20260709 13:10:06.729856 28257 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.732446 28257 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:06.733528 23629 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:06.685771 23522 catalog_manager.cc:5697] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.735850 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:06.738835 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:06.738003 23522 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 7, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 7 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:06.740272 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:06.740386 28246 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:06.741407 28246 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.743860 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2071) took 3131 ms. Trace:
I20260709 13:10:06.744642 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:06.754604 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.745291 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2099) took 1024 ms. Trace:
I20260709 13:10:06.752928 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.762959 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:06.763646 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2076) took 3145 ms. Trace:
I20260709 13:10:06.763772 23629 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:06.764838 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.765452 23629 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:06.767351 23629 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:06.760721 23627 rpcz_store.cc:276] 0709 13:10:05.721106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.922259 (+201153us) service_pool.cc:224] Handling call
0709 13:10:05.922682 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.360694 (+438012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.360758 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.362135 (+  1377us) log.cc:844] Serialized 26 byte log entry
0709 13:10:06.631286 (+269151us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:06.631322 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.646317 (+ 14995us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.744823 (+ 98506us) raft_consensus.cc:1685] finished
0709 13:10:06.744844 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.745023 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10233,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":705520,"threads_started":2,"wal-append.queue_time_us":380144}
I20260709 13:10:06.768422 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:06.769212 23627 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:06.769733 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:06.770500 23774 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.772442 23627 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:06.773394 28404 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.516s	user 0.000s	sys 0.001s
I20260709 13:10:06.776531 23776 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
W20260709 13:10:06.777108 28419 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.517s	user 0.001s	sys 0.000s
I20260709 13:10:06.780817 28186 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:06.734170 28175 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:06.748193 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:06.746738 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2888) took 1706 ms. Trace:
I20260709 13:10:06.770344 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:06.744338 23624 rpcz_store.cc:276] 0709 13:10:03.611536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.611749 (+   213us) service_pool.cc:224] Handling call
0709 13:10:03.639937 (+ 28188us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:04.889752 (+1249815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.742189 (+1852437us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000a8a54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:06.742531 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2835820288}
I20260709 13:10:06.781828 23629 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:06.800182 24357 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:06.803154 24359 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:06.803689 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42298 (request call id 979) took 1188 ms. Trace:
I20260709 13:10:06.804157 23772 rpcz_store.cc:276] 0709 13:10:05.615011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.618263 (+  3252us) service_pool.cc:224] Handling call
0709 13:10:06.799179 (+1180916us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b5400347454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:06.803537 (+  4358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1768498432}
I20260709 13:10:06.789147 23623 rpcz_store.cc:276] 0709 13:10:05.040332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.040482 (+   150us) service_pool.cc:224] Handling call
0709 13:10:05.040888 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.207384 (+166496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.207429 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.207487 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:05.207527 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.746240 (+1538713us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540012dc54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:06.746323 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.746524 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382349568}
I20260709 13:10:06.764139 23620 rpcz_store.cc:276] 0709 13:10:03.618337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.252775 (+634438us) service_pool.cc:224] Handling call
0709 13:10:04.275222 (+ 22447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.275777 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.275824 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.276544 (+   720us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.817543 (+540999us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:04.817582 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.817646 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.554644 (+1736998us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:06.763062 (+208418us) raft_consensus.cc:1685] finished
0709 13:10:06.763087 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.763357 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":162,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5887,"spinlock_wait_cycles":17717632,"thread_start_us":460061,"threads_started":1,"wal-append.queue_time_us":671491}
I20260709 13:10:06.758733 28388 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
W20260709 13:10:06.755385 28384 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.976s	user 0.001s	sys 0.000s
I20260709 13:10:06.812902 28273 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:06.813752 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 43600.3us
I20260709 13:10:06.814656 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:06.816609 23624 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:06.817723 28261 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:06.821949 28272 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:06.823633 28323 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:06.824209 28004 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:06.824684 28004 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.825069 28004 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.825632 27980 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.826840 27980 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:06.826875 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 275327us
I20260709 13:10:06.828481 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:06.829622 28336 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:06.829934 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 141734us
I20260709 13:10:06.831046 28261 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:06.832152 28412 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:06.833061 28412 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:06.834287 28336 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:06.839438 28366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.007s	sys 0.027s
W20260709 13:10:06.840116 23622 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.006s	sys 0.011s
W20260709 13:10:06.840674 23622 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.006s	sys 0.011s
I20260709 13:10:06.840045 28154 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.841298 23629 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:06.842001 28430 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:06.842751 28430 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.841578 28154 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.847492 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.849057 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:06.847925 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:06.849802 23770 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.850461 23773 raft_consensus.cc:2393] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:06.848397 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:06.847980 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:06.843449 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2891) took 1797 ms. Trace:
I20260709 13:10:06.854517 23626 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:06.855942 23624 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:06.860118 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:06.864697 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.839967 28366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.008s	sys 0.027s
I20260709 13:10:06.835053 28412 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:06.867100 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:06.870821 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55109.6us
I20260709 13:10:06.872215 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:06.872557 28186 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:06.873034 28186 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:06.873376 28186 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:06.842645 28374 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:06.819172 28405 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.832957 28261 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.887845 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:06.851931 23628 rpcz_store.cc:276] 0709 13:10:05.046244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.049021 (+  2777us) service_pool.cc:224] Handling call
0709 13:10:05.049335 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.135351 (+ 86016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.135391 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:05.135933 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.551570 (+415637us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:05.551626 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.551711 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.754617 (+1202906us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:06.843010 (+ 88393us) raft_consensus.cc:1685] finished
0709 13:10:06.843035 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.843292 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85623,"raft.queue_time_us":86501,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":8692,"spinlock_wait_cycles":11271552,"thread_start_us":379911,"threads_started":1,"wal-append.queue_time_us":569307}
I20260709 13:10:06.694365 23769 rpcz_store.cc:276] 0709 13:10:02.830837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.832089 (+  1252us) service_pool.cc:224] Handling call
0709 13:10:02.832422 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.017021 (+184599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.017081 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.017780 (+   699us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.193822 (+176042us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:03.450482 (+256660us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b4800280758. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:10:05.841916 (+2391434us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b18001918c0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b44d043c7 00007f2b413169a7 00007f2b413260bf
0709 13:10:05.863297 (+ 21381us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.863607 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.863716 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.690016 (+826300us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:06.693421 (+  3405us) raft_consensus.cc:1685] finished
0709 13:10:06.693440 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.693662 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":328226,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":29871,"raft.queue_time_us":89242,"raft.run_cpu_time_us":2480,"raft.run_wall_time_us":546669,"spinlock_wait_cycles":111360384,"thread_start_us":763056,"threads_started":3,"wal-append.queue_time_us":1120594}
I20260709 13:10:06.872246 28406 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.892434 23774 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:06.893746 23743 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:06.875351 28412 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:06.897359 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:06.903071 24386 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:06.907266 23778 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.909301 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:06.701051 28382 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.914212 28405 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:06.915751 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:06.892997 28246 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:06.927305 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:06.937501 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:06.937189 28175 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.944221 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:06.910492 28406 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.961695 28176 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.962512 28176 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:06.963181 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 591) took 1793 ms. Trace:
I20260709 13:10:06.961699 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:06.964372 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:06.965134 23700 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.965586 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:06.965420 27976 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.966266 23775 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.966881 27976 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.967854 28369 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:06.960031 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:06.973539 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:06.975411 23774 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.974784 23776 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:06.963619 23696 rpcz_store.cc:276] 0709 13:10:05.170010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.702968 (+532958us) service_pool.cc:224] Handling call
0709 13:10:05.703273 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.889428 (+186155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.962619 (+1073191us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540015cf54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:06.962996 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426049408}
I20260709 13:10:06.971400 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:06.916445 28374 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:06.972062 28114 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:06.983525 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 50046.1us
I20260709 13:10:06.983769 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:06.993399 27860 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.984853 28114 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:06.998901 24357 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:06.999652 23769 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:07.006819 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:07.013291 23777 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:07.013929 28176 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:07.014361 28428 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:07.015301 28188 consensus_meta.cc:287] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.826s	user 0.005s	sys 0.013s
I20260709 13:10:07.020118 23776 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:10:07.019981 27860 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.021483 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:07.021978 28380 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.022670 27860 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:07.023336 28399 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:07.024201 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:07.024554 28399 raft_consensus.cc:3055] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:07.024989 28399 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:07.025493 28079 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:07.003559 28114 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.026016 28399 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.027318 28399 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.029110 28374 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:07.032146 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:07.037635 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:06.990392 28004 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.022713 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:07.039847 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.047601 23778 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:07.049419 23770 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:06.982982 28339 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:10:07.039534 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.053160 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:06.990288 28175 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.053297 23774 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:07.053776 23629 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.057343 28004 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:07.057897 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.057765 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:07.058246 28315 consensus_queue.cc:1059] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:10:07.058672 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.052700 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:07.089395 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:07.089309 23774 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:07.089242 23620 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:10:07.053375 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:07.091015 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:07.094430 28408 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.836s	user 0.001s	sys 0.002s
I20260709 13:10:07.095034 23699 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:07.110157 23623 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:07.053047 28340 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:07.106343 23695 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:07.106982 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.107106 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:07.112298 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.115475 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:07.117377 28433 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:07.117254 28114 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.108058 23703 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:10:07.111351 23702 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:06.943023 23522 catalog_manager.cc:5697] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 9, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 9 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.123075 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.005038 28412 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:07.129271 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 67965.5us
I20260709 13:10:07.129943 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:07.131590 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:07.133800 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:07.134342 28341 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:07.134848 28341 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.135265 28341 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:07.137375 23704 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:07.138705 23700 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:10:07.111076 28428 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.121915 28186 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.144651 28332 raft_consensus.cc:3055] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:07.048111 28188 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:07.127853 28432 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:10:07.123783 28382 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.251688 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.254608 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.256263 23701 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:07.256896 23701 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:07.257970 23701 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.259358 23701 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.150493 28428 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.151561 28315 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.146034 28153 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:07.152227 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:07.145459 28398 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:10:07.154726 23775 raft_consensus.cc:2410] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:07.120209 28340 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:07.156810 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:07.132081 28380 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:07.263948 28382 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:07.265048 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 256765us
I20260709 13:10:07.265470 28186 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:07.265810 23522 catalog_manager.cc:5697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 9, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 9 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.157359 28114 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:07.291667 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:07.296986 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.298461 28175 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:07.300945 28188 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:07.302685 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.153195 28332 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:07.304888 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:07.305763 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 173741us
I20260709 13:10:07.308615 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.308671 23697 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:07.311859 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 116767us
I20260709 13:10:07.316392 23629 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:07.149603 23770 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:07.324149 23695 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:07.324718 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.359825 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.351272 28428 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:07.325613 28153 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:07.426646 28153 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.428232 28153 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.385178 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.432245 23696 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:07.433377 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.433399 28186 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:07.434139 23696 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:07.388216 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.391968 23627 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:10:07.392284 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:07.400575 28315 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.402940 28382 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:07.403612 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 43743.8us
I20260709 13:10:07.418715 23620 raft_consensus.cc:2368] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13.
I20260709 13:10:07.422981 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:07.423441 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.424975 23629 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:07.424968 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:07.464119 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.449826 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:07.419938 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 128530us
W20260709 13:10:07.487433 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.451133 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.435076 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:07.486948 23699 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.488332 23704 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:07.489733 23696 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.442124 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:07.450398 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:07.440775 23703 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:07.487494 23702 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:07.442526 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:07.434974 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:07.499225 23698 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:07.384299 28340 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:07.508002 23700 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:07.450619 28175 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:07.510955 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.512390 23625 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:07.516204 23695 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
W20260709 13:10:07.512647 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 77647.6us
I20260709 13:10:07.529429 27976 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.530151 27976 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.535924 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:07.533591 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:07.510365 28382 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:07.447288 28341 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.544726 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:07.545373 24386 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
W20260709 13:10:07.547889 28410 log.cc:927] Time spent T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.291s	user 0.010s	sys 0.016s
I20260709 13:10:07.548621 23701 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:07.549887 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:07.551047 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.519160 28261 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:07.557806 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:07.560321 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 110120us
I20260709 13:10:07.525355 28175 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:07.557907 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:07.563635 28209 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.439808 28332 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.567128 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.448268 23522 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:07.570399 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.556306 28176 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:07.575250 23742 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:07.575112 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.577633 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:07.580343 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.582464 28149 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:07.582901 28232 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:07.581037 23704 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:10:07.590310 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:07.590794 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.568867 28261 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:10:07.600709 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.602124 23696 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:07.583694 28076 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.574496 28380 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.587927 28209 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.588774 28332 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:07.609745 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:07.611927 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:07.614882 23697 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:07.618237 28405 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:07.618909 28405 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.619102 28232 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.622450 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.625631 23701 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:07.632589 28149 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.634667 28369 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:07.636922 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 61761us
W20260709 13:10:07.638499 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.631682 28405 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:07.640559 28369 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.643498 23704 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:07.642055 23698 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:07.600405 28188 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:07.623216 28176 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:07.616781 27976 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:07.655844 23701 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:07.661510 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:07.613458 28380 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.650283 28175 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.636196 28352 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:07.662449 23625 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:10:07.672263 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:07.655551 28387 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:07.652148 28232 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:07.615707 28076 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.682797 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:07.673305 28125 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:07.688241 28341 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:07.691888 24385 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
W20260709 13:10:07.695575 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.699855 28352 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.705217 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:07.706449 23699 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:07.674818 23522 catalog_manager.cc:5697] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 8, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 8 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:07.709275 28352 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:07.708907 28149 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:07.715353 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.687326 28125 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:07.656065 28261 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.703794 28387 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:07.702050 28188 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:07.724380 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.744402 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:07.757704 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 97481.5us
I20260709 13:10:07.740222 28125 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:07.720927 28315 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:07.765554 23696 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:07.771093 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:10:07.786609 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 117688us
W20260709 13:10:07.785437 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 195183us
I20260709 13:10:07.791478 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:07.796514 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:07.769340 28188 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.796418 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:07.805225 23699 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
W20260709 13:10:07.811002 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.794598 28186 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:07.822000 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:07.822624 24390 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:07.828190 23592 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:07.828469 24386 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:07.829772 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:07.830030 23592 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:07.830895 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 856) took 1849 ms. Trace:
I20260709 13:10:07.830992 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:07.824524 28175 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:07.832479 28175 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:07.832852 28175 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.833047 28076 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:07.833220 28175 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:07.834630 28076 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:07.821796 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 50834.7us
I20260709 13:10:07.835114 28076 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:07.838853 24387 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:10:07.839236 24387 pending_rounds.cc:85] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Aborting all ops after (but not including) 10
I20260709 13:10:07.815418 28369 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:07.840019 24387 pending_rounds.cc:107] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:10:07.843313 24387 raft_consensus.cc:2889] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:07.842115 28076 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.844632 23592 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:07.838549 28149 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:07.837342 28380 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:07.849104 23695 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:07.831350 23621 rpcz_store.cc:276] 0709 13:10:05.981235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.981621 (+   386us) service_pool.cc:224] Handling call
0709 13:10:05.981920 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.692200 (+710280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.692257 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.692939 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.830312 (+1137373us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b1800498100. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1
0709 13:10:07.830454 (+   142us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:07.830496 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.830581 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:07.830621 (+    40us) raft_consensus.cc:1685] finished
0709 13:10:07.830631 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.830836 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10027,"raft.queue_time_us":156095,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":11596160,"thread_start_us":948701,"threads_started":2,"wal-append.queue_time_us":288385}
W20260709 13:10:07.840505 23668 connection.cc:256] RPC call timeout handler was delayed by -1.0611539000000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22860000000000003s for a response
W20260709 13:10:07.851511 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.851753 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:10:07.852156 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.852629 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:07.856926 23668 connection.cc:256] RPC call timeout handler was delayed by -1.0162196630000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3138s for a response
W20260709 13:10:07.857656 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.780699 23522 catalog_manager.cc:5697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 9, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 9 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:07.863380 28156 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:07.864061 28156 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:07.865083 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.866516 28156 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:07.883211 28332 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.858924 28114 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:07.884017 28332 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.885010 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2083) took 1038 ms. Trace:
I20260709 13:10:07.885391 23777 rpcz_store.cc:276] 0709 13:10:06.846658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.846985 (+   327us) service_pool.cc:224] Handling call
0709 13:10:06.847347 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.013892 (+166545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.884747 (+870855us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54003ff2d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:07.884938 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380822784}
I20260709 13:10:07.886412 28332 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:07.886905 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:07.888238 23773 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:07.888370 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:07.888927 23770 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 5.
I20260709 13:10:07.889235 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:07.889981 23629 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.890311 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:07.890704 28188 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:07.891031 23770 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:07.891871 28289 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:07.892573 23770 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:07.892935 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.893486 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.894817 28413 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 1.639s	user 0.000s	sys 0.009s
I20260709 13:10:07.896790 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 869) took 1111 ms. Trace:
I20260709 13:10:07.897363 23624 rpcz_store.cc:276] 0709 13:10:06.785152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.817496 (+ 32344us) service_pool.cc:224] Handling call
0709 13:10:06.855095 (+ 37599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.863826 (+  8731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.896534 (+1032708us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b54002b3750. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:07.896710 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85745408}
I20260709 13:10:07.822062 28387 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.898082 28332 consensus_queue.cc:1059] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:07.899500 27976 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.900516 27976 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.901306 28412 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:07.904224 23770 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:07.904721 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.905850 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:07.906561 23770 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:07.908792 28400 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.911558 24359 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:07.913383 28445 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.913949 28445 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:07.914460 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.914611 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:07.916313 28417 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:07.916446 27976 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:07.916050 23522 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 9 to 12, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 12 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:07.916970 28417 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:07.917531 28406 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:07.918025 28417 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.918156 23522 catalog_manager.cc:5697] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 9, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 9 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:07.922334 28027 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:07.922976 28027 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.901348 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:07.925714 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2101) took 2204 ms. Trace:
I20260709 13:10:07.927026 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:07.926146 23622 rpcz_store.cc:276] 0709 13:10:05.721608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.982406 (+260798us) service_pool.cc:224] Handling call
0709 13:10:06.031274 (+ 48868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.124516 (+ 93242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:06.841094 (+716578us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.997236 (+156142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:07.001065 (+  3829us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:07.004820 (+  3755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.925467 (+920647us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b54002021d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:07.925517 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.925658 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175485,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":5445,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":174,"spinlock_wait_cycles":213745536,"thread_start_us":858637,"threads_started":2,"wal-append.queue_time_us":172079}
I20260709 13:10:07.929010 23626 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:07.928797 28149 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:07.928988 28430 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:07.929350 28448 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:07.930281 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:07.931406 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 83984.1us
I20260709 13:10:07.932006 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:07.936717 23704 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:07.932793 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:07.928316 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 78604.5us
I20260709 13:10:07.940052 23629 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:07.944005 23773 raft_consensus.cc:2368] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16.
I20260709 13:10:07.943408 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:07.943459 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:07.945716 23624 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:07.949002 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:07.949105 28149 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.950917 24387 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:07.952030 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:07.952751 24385 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:07.954052 28449 raft_consensus.cc:2764] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:10:07.955127 28449 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.956907 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:07.959501 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:07.966225 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:07.955770 28449 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:07.968288 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:07.969220 28449 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:07.969751 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:07.969959 28430 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:07.971251 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:07.969782 28445 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:07.960808 28332 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:10:07.973124 28426 raft_consensus.cc:3055] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:07.973544 28426 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:07.974205 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:07.947301 28413 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260709 13:10:07.942153 27976 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:07.965240 23668 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:07.955869 28153 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.527s	user 0.013s	sys 0.001s
I20260709 13:10:07.984040 28004 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:07.984237 28240 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:07.984830 28240 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:07.984727 28004 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:07.985400 28240 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.976935 23743 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:07.974897 23624 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:07.977476 23620 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:07.947769 28114 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:07.990139 23773 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:07.998677 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.002054 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.004532 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.005434 23772 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:08.007022 28156 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:07.998256 28154 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:08.008512 28154 consensus_queue.cc:1059] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:08.013124 23770 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:08.010784 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:08.016795 24357 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:07.977447 28289 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:08.020556 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:08.032922 24393 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:08.022423 23770 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:08.037221 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.037917 23778 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:08.038105 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:07.989797 28444 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.014405 28369 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.042510 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.040674 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.007572 28156 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:07.974361 28426 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.048180 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:07.986963 28004 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:08.035790 28186 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:08.029965 28332 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:08.057794 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:08.035573 28412 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:08.061793 23772 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:08.041040 28449 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:08.040503 27976 raft_consensus.cc:3055] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:08.068944 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 97796.4us
I20260709 13:10:08.049777 28156 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:08.090284 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.114905 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.060675 28430 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:08.115314 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.064075 28412 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:08.127389 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 184027us
I20260709 13:10:08.136531 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:08.137822 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46580 (request call id 680) took 1012 ms. Trace:
I20260709 13:10:08.139946 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:08.141012 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:08.125245 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.068236 28398 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:08.060766 28186 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:08.045677 28428 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:10:08.072288 27976 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:08.159518 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:08.170042 23626 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:08.138350 24393 rpcz_store.cc:276] 0709 13:10:07.125247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.133493 (+  8246us) service_pool.cc:224] Handling call
0709 13:10:08.137589 (+1004096us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b5400600254. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:08.137752 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1926546688}
I20260709 13:10:08.046211 28444 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.168510 23773 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:08.065563 28289 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.174492 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.141534 28412 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:08.175336 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.173620 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:08.125483 28449 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:08.085676 28406 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:10:08.040642 23522 catalog_manager.cc:5697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:08.184930 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.155019 28209 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:08.166648 28186 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:08.162563 28398 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.194116 23624 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:08.194700 23778 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:10:08.195148 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 253218us
W20260709 13:10:08.186264 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 187393us
I20260709 13:10:08.203265 23770 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:08.207046 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.167637 28332 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:08.204869 23776 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:08.118567 28448 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:10:08.212991 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:08.216406 23775 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:08.214541 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.228278 24387 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:08.236202 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:08.201409 28209 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.213353 28398 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.242185 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:08.246799 24390 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:08.217392 28332 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.243904 24393 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:08.246057 23772 raft_consensus.cc:2368] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13.
I20260709 13:10:08.250319 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:08.206593 28387 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:10:08.264721 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2258) took 2101 ms. Trace:
I20260709 13:10:08.170658 28114 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:08.241310 28209 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.259825 28332 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:08.236896 28406 consensus_queue.cc:1243] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:08.265633 28153 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.265077 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:08.281402 28382 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:08.271909 23771 rpcz_store.cc:276] 0709 13:10:05.970236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.977292 (+  7056us) service_pool.cc:224] Handling call
0709 13:10:05.977614 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.977974 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:06.037711 (+ 59737us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.544735 (+507024us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.545501 (+   766us) log.cc:844] Serialized 26 byte log entry
0709 13:10:06.545705 (+   204us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:06.545748 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.545880 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:07.894169 (+1348289us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:08.057070 (+162901us) raft_consensus.cc:1685] finished
0709 13:10:08.071874 (+ 14804us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.072027 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171886,"prepare.queue_time_us":59728,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":193011,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":3274,"spinlock_wait_cycles":25357696,"thread_start_us":274119,"threads_started":1,"wal-append.queue_time_us":179780}
I20260709 13:10:08.245285 28125 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.322950 28125 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:08.300791 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 87917.2us
W20260709 13:10:08.298895 28340 consensus_meta.cc:287] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.745s	user 0.013s	sys 0.000s
W20260709 13:10:08.328173 23742 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.926s (SENT) [suppressed 21 similar messages]
I20260709 13:10:08.354746 28027 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:08.357348 28458 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:08.357736 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:08.362250 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 187832us
I20260709 13:10:08.364789 28472 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:08.365477 28472 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:08.276412 28261 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:10:08.365998 28472 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:08.313838 28382 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:08.402019 28382 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:08.410351 28332 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.412842 28332 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:08.441620 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 277705us
W20260709 13:10:08.454600 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 160480us
I20260709 13:10:08.282357 27976 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:08.467417 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:08.454116 28175 consensus_meta.cc:287] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.002s
I20260709 13:10:08.428800 28417 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.468652 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 243256us
I20260709 13:10:08.326084 28153 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:08.471643 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 114003us
I20260709 13:10:08.475752 24387 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:08.481746 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:08.456445 28448 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:08.482776 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.346320 28340 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:08.496332 23629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.002s	sys 0.013s
W20260709 13:10:08.497346 23629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.003s	sys 0.013s
I20260709 13:10:08.479449 23593 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:08.493758 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2102) took 1500 ms. Trace:
W20260709 13:10:08.504489 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.475749 28149 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:08.290709 23522 catalog_manager.cc:5697] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 7, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 7 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.520495 28027 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.522468 28004 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.524611 28468 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:10:08.525167 28477 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:08.538744 23668 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:08.532070 28426 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.510380 28289 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:08.510048 28475 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:08.345754 28449 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:08.460218 28156 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:08.540465 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 238401us
I20260709 13:10:08.502700 27976 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:08.558933 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.562733 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 234579us
I20260709 13:10:08.495884 28406 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:10:08.562769 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.497220 28338 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:10:08.570688 24390 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:08.495647 28417 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.574756 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:08.578361 24386 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:08.575089 28153 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:08.500833 28448 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.550472 28475 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.570585 28477 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:08.500721 23628 rpcz_store.cc:276] 0709 13:10:06.993039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.993226 (+   187us) service_pool.cc:224] Handling call
0709 13:10:06.993648 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:07.008774 (+ 15126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.008804 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:07.923316 (+914512us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b2c00058238. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:10:07.943713 (+ 20397us) log.cc:844] Serialized 52 byte log entry
0709 13:10:08.230061 (+286348us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:08.258253 (+ 28192us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.471900 (+213647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.471989 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.472037 (+    48us) raft_consensus.cc:1685] finished
0709 13:10:08.491839 (+ 19802us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.492897 (+  1058us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8988,"prepare.queue_time_us":18194,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":5313,"raft.queue_time_us":127445,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":136,"spinlock_wait_cycles":8093952,"thread_start_us":491860,"threads_started":2,"wal-append.queue_time_us":409362}
W20260709 13:10:08.590581 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 103501us
I20260709 13:10:08.489070 28175 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:08.544764 28027 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.592281 28076 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:10:08.545266 28004 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:08.616140 28486 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:08.617911 28156 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:08.619007 28485 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:08.620860 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.621799 23771 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:08.628993 27976 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.628147 23522 catalog_manager.cc:5697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 7, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 7 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:08.670116 28004 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:08.671037 23622 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:08.632830 23774 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:08.607924 28477 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:08.638108 23778 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:08.638857 28448 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:08.644553 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:08.605501 28240 consensus_meta.cc:287] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.619s	user 0.016s	sys 0.001s
I20260709 13:10:08.545840 28149 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.659916 24387 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:08.636451 28417 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:08.674515 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 104402us
I20260709 13:10:08.608259 28475 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:08.689792 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.692813 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:08.694839 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:08.697491 28496 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:08.697965 28496 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:08.698388 28496 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:08.699110 28494 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:08.702821 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:08.703888 28484 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:08.704393 28484 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:08.704798 28484 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:08.706362 23669 leader_election.cc:400] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13.
I20260709 13:10:08.706751 23669 leader_election.cc:403] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:08.707444 28430 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13.
I20260709 13:10:08.708199 28125 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:08.708459 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:08.708684 28125 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:08.709640 28125 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:08.708346 28430 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:10:08.710809 28125 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.711761 28430 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:08.718981 23627 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:08.719439 23627 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:08.720340 23627 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:08.721575 23627 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:08.718827 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:08.723508 24387 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:08.725128 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:08.741008 28387 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:08.741626 28387 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:08.747027 23628 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:08.747527 23622 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:08.748170 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:08.739456 23627 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:08.742733 28387 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:08.758872 28176 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:10:08.759269 28387 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.663553 28486 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:08.765476 28240 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:08.769368 28114 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:08.769707 28340 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:08.771469 28209 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.634706 28412 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.683687 28398 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.777774 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:08.778406 28175 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:08.780697 28382 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.781080 28027 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:08.792220 23770 raft_consensus.cc:2393] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:08.751652 28475 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.821756 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.798552 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:08.800592 23627 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:08.680065 28477 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.767673 28188 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:08.810415 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 308262us
I20260709 13:10:08.813443 23774 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:08.813616 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:08.816238 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:08.831905 23776 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:08.827906 23777 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:08.824682 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:08.678654 28485 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:08.814664 28352 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:10:08.826292 28027 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.838693 28485 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:08.838554 28027 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.840857 28027 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:08.841359 28466 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:08.841794 28466 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:08.842206 28466 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.792914 28448 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:10:08.843246 23668 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:08.843858 28004 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:08.844365 28004 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:08.833523 28188 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.844821 28004 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:08.845207 28188 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:08.845470 28463 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:10:08.846138 28398 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:08.846720 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2920) took 1257 ms. Trace:
I20260709 13:10:08.847079 23621 rpcz_store.cc:276] 0709 13:10:07.589631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.874920 (+285289us) service_pool.cc:224] Handling call
0709 13:10:07.875295 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.875525 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.875554 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.876133 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.216085 (+339952us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:08.216131 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.216218 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.846519 (+630301us) raft_consensus.cc:1685] finished
0709 13:10:08.846539 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.846668 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":339511,"threads_started":1,"wal-append.queue_time_us":681792}
I20260709 13:10:08.848353 27976 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:10:08.849102 28186 consensus_meta.cc:287] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.627s	user 0.013s	sys 0.000s
I20260709 13:10:08.849354 28153 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:08.849570 28186 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:08.831284 28451 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:08.857126 28445 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:08.857733 28445 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.766842 28472 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.831125 23771 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:10:08.850765 23668 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:08.863698 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:08.864409 23771 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.872431 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.875428 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:08.877146 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:08.851183 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2919) took 1261 ms. Trace:
I20260709 13:10:08.885493 23626 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:08.876392 23622 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:10:08.891275 23627 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:08.878300 23625 rpcz_store.cc:276] 0709 13:10:07.589365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.722740 (+133375us) service_pool.cc:224] Handling call
0709 13:10:07.931491 (+208751us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:08.235699 (+304208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.235751 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:08.248238 (+ 12487us) log.cc:844] Serialized 52 byte log entry
0709 13:10:08.471024 (+222786us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:08.472185 (+  1161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.472282 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.592466 (+120184us) raft_consensus.cc:1685] finished
0709 13:10:08.592490 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.850916 (+258426us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54003255d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:08.851121 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11684,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":6440,"spinlock_wait_cycles":430584704,"thread_start_us":474132,"threads_started":2,"wal-append.queue_time_us":295628}
I20260709 13:10:08.894131 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:08.895223 24390 raft_consensus.cc:2368] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14.
I20260709 13:10:08.884310 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:08.898307 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 61469.8us
I20260709 13:10:08.900826 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:08.901690 23774 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:08.806216 28369 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:10:08.834877 28406 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:08.909385 23593 leader_election.cc:400] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14.
I20260709 13:10:08.909787 23593 leader_election.cc:403] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:08.854240 28240 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:08.906824 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:08.854562 28412 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:08.931712 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:08.853173 28149 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:08.854432 28444 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:08.898195 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:08.915550 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:08.874807 28186 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:08.932446 23627 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:08.905570 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 54895.5us
I20260709 13:10:08.934885 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:08.944146 23624 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:10:08.948460 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.905316 28428 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:08.949214 28428 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.949584 28428 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:08.952509 23776 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:08.890424 28352 consensus_queue.cc:1059] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:10:08.973320 28352 raft_consensus.cc:3055] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:08.973738 28352 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:08.973881 28466 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.974632 28352 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:08.934813 28076 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.936199 28406 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:08.954669 28209 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:08.966635 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:08.968845 28475 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:08.971796 28496 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:08.972368 24357 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:08.980072 23627 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
W20260709 13:10:08.999894 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 164038us
I20260709 13:10:09.000670 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:09.005642 23742 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.831s (SENT)
I20260709 13:10:09.005807 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:08.836445 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 351996us
I20260709 13:10:09.008872 23667 leader_election.cc:400] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16.
I20260709 13:10:08.910090 28500 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:08.910351 28104 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:10:09.009644 23667 leader_election.cc:403] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:08.899833 28176 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:10:08.983484 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47260.7us
I20260709 13:10:08.988232 23774 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:08.993688 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:09.012431 24390 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:08.995872 23622 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
W20260709 13:10:08.981360 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 270183us
I20260709 13:10:09.017287 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:09.018576 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.019965 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:09.020767 23627 raft_consensus.cc:2368] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16.
I20260709 13:10:09.022068 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:09.024065 23627 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:08.983479 28352 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:08.854606 28486 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:09.031971 23667 leader_election.cc:400] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13.
I20260709 13:10:09.032364 23667 leader_election.cc:403] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:09.032429 28497 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:09.033422 28479 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:10:09.033553 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 67041.1us
W20260709 13:10:09.027071 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.027778 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:09.035831 24357 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:09.058995 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.029508 28426 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.071045 24387 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:09.029829 28500 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:09.074779 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:09.038759 28156 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13.
I20260709 13:10:09.081847 23627 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:09.086977 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.087778 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:09.082800 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 70944us
I20260709 13:10:09.083855 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:09.084242 23624 raft_consensus.cc:2410] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:10:09.094527 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 88944.4us
I20260709 13:10:09.095870 23625 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:09.067816 28332 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:09.070915 28426 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.099771 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:09.044981 28154 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:10:09.109097 23627 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:09.105788 23624 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:10:09.114501 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:09.115248 23621 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:09.085876 28486 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:09.057838 28153 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:10:09.094133 28472 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:09.157958 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:09.158639 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:09.161859 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:09.159269 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.122310 23743 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:09.109786 28426 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.162083 23627 raft_consensus.cc:2368] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13.
I20260709 13:10:09.167415 23777 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:09.113997 28332 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:09.128396 28444 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:09.191473 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 69216.2us
W20260709 13:10:09.213371 28505 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:10:09.214012 28004 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:09.243033 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:09.241568 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:09.093129 28406 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:09.249207 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 143772us
W20260709 13:10:09.249774 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 215271us
I20260709 13:10:09.253237 23668 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:09.256229 28004 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:09.206141 28369 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:09.270162 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:09.263772 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.264851 23771 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:09.214987 28076 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14.
I20260709 13:10:09.269284 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:09.268430 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:09.268442 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:09.278792 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:09.280002 23622 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:10:09.222689 28444 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:09.282526 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:09.290875 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:09.292143 23777 raft_consensus.cc:2393] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:09.294045 28510 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:10:09.294572 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:09.294884 28510 consensus_queue.cc:1243] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:09.295547 23622 raft_consensus.cc:2393] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 8: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:09.278139 28466 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:09.286942 28240 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.327674 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.322700 23629 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:09.328510 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.329468 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:09.331228 24359 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:09.332293 23703 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:09.332113 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.334908 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.336390 24359 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:09.335337 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.338327 23703 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:09.336997 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:09.341955 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 90903.9us
I20260709 13:10:09.343828 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:09.344419 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.345245 23704 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:10:09.347420 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.320739 28517 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.437961 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.316282 28496 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:09.440549 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.440696 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.348358 23697 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:09.446794 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.442953 28400 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:09.450901 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.446100 23703 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:09.334931 28027 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:09.452267 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.315078 28188 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:09.336815 28521 raft_consensus.cc:3055] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:09.342607 28412 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.451678 23704 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:09.342461 28209 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.461844 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:09.463395 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 119662us
I20260709 13:10:09.467676 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.468778 23700 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.294057 28444 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:09.332738 28417 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.121s
I20260709 13:10:09.437595 28156 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:09.441380 28369 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:09.273358 28500 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:09.335209 28240 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:09.454648 28503 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.215s	user 0.001s	sys 0.001s
W20260709 13:10:09.462844 28484 consensus_meta.cc:287] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.758s	user 0.006s	sys 0.007s
I20260709 13:10:09.319888 28332 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:09.481499 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.462457 28412 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.459894 28521 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:09.462082 28209 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.454602 28400 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:09.533124 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.512439 23769 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:09.538314 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.489352 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:09.693285 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 440117us
I20260709 13:10:09.694538 23696 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:09.696019 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:09.658422 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 180083us
I20260709 13:10:09.697705 23697 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:09.699146 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.617547 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.699888 23696 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:09.700985 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.459183 28517 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:09.523710 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:09.696241 23704 raft_consensus.cc:2376] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13. Re-sending same reply.
W20260709 13:10:09.539103 28493 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:10:09.709892 23700 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:09.708799 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:10:09.537470 28516 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:10:09.691454 28501 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 13:10:09.599682 28519 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:09.616905 28513 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260709 13:10:09.599699 28530 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:09.692099 28527 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:09.616778 28482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.002s	sys 0.011s
I20260709 13:10:09.704196 28209 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.695341 28510 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.697538 28412 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.487450 28445 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:09.734331 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:09.743667 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.717306 28518 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.463s	user 0.002s	sys 0.000s
I20260709 13:10:09.695062 28485 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:09.763603 24390 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:10:09.539430 28538 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.746932 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.752367 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:09.754698 23703 raft_consensus.cc:2410] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:10:09.791949 23778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.020s	sys 0.035s
W20260709 13:10:09.792881 23778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.021s	sys 0.036s
I20260709 13:10:09.759173 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.760407 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:09.705830 28484 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:09.540066 28534 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.245s
I20260709 13:10:09.806351 24386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 762) took 1088 ms. Trace:
I20260709 13:10:09.832612 24386 rpcz_store.cc:276] 0709 13:10:08.717954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.718080 (+   126us) service_pool.cc:224] Handling call
0709 13:10:08.718469 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.718875 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.718905 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.719407 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.075842 (+356435us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:09.075882 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.075952 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.806117 (+730165us) raft_consensus.cc:1685] finished
0709 13:10:09.806136 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.806266 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1265,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":95,"thread_start_us":286798,"threads_started":1,"wal-append.queue_time_us":485524}
I20260709 13:10:09.806742 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:09.835739 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.836488 23696 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:09.837123 28479 consensus_meta.cc:287] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.001s
I20260709 13:10:09.837335 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.837962 23696 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:09.838888 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.785344 23700 raft_consensus.cc:2376] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13. Re-sending same reply.
I20260709 13:10:09.785786 24387 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:09.559049 28369 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:09.536307 28156 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:09.789764 28512 log.cc:927] Time spent T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
W20260709 13:10:09.750834 28482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.006s	sys 0.014s
I20260709 13:10:09.789860 28445 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:09.800994 28529 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:09.802354 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:09.816731 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:09.820696 28507 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.738s	user 0.003s	sys 0.000s
I20260709 13:10:09.742501 28154 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:10:09.827888 28532 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:10:09.828187 28493 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:09.762403 28527 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:09.872648 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2117) took 1082 ms. Trace:
I20260709 13:10:09.765430 28510 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:09.873113 23773 rpcz_store.cc:276] 0709 13:10:08.790075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.790517 (+   442us) service_pool.cc:224] Handling call
0709 13:10:08.790865 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.801539 (+ 10674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.801593 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.804790 (+  3197us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.955320 (+150530us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:08.955365 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.955435 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.820051 (+864616us) spinlock_profiling.cc:243] Waited 9.37 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:09.872167 (+ 52116us) raft_consensus.cc:1685] finished
0709 13:10:09.872197 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.872505 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1122,"raft.queue_time_us":876,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4592,"spinlock_wait_cycles":21553408,"thread_start_us":113718,"threads_started":1,"wal-append.queue_time_us":188905}
I20260709 13:10:09.762923 28519 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:09.789987 28485 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:09.804160 28524 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:10:09.877111 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.877795 23704 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:09.878787 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.831688 28506 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:09.880489 28506 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:09.883275 28506 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:09.786110 28496 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.884035 28496 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:09.786803 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 52562.4us
I20260709 13:10:09.616669 28382 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:09.841473 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.889211 23695 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:09.807155 28533 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260709 13:10:09.863123 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.891176 23700 raft_consensus.cc:2376] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13. Re-sending same reply.
W20260709 13:10:09.809870 28352 consensus_meta.cc:287] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.000s
I20260709 13:10:09.864069 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:09.806869 28426 consensus_meta.cc:287] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.000s
W20260709 13:10:09.807273 28428 consensus_meta.cc:287] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.857s	user 0.009s	sys 0.000s
I20260709 13:10:09.837544 28479 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16.
I20260709 13:10:09.867897 28445 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:09.868450 28529 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:09.869472 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.934317 23698 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:09.934527 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.875082 28510 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:09.890154 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.904896 23701 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:10:09.938208 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 46881.2us
W20260709 13:10:09.938709 24358 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.021s	sys 0.068s
W20260709 13:10:09.939067 24358 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.021s	sys 0.068s
W20260709 13:10:09.939340 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 625484us
I20260709 13:10:09.910559 24387 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:09.866839 28477 consensus_meta.cc:287] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.005s	user 0.006s	sys 0.006s
I20260709 13:10:09.905066 23772 raft_consensus.cc:2410] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:09.941751 24394 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:09.944582 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.942677 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:09.951845 23623 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:09.945232 23697 raft_consensus.cc:2376] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14. Re-sending same reply.
I20260709 13:10:09.954766 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.955595 23698 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:09.958839 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.961102 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.843776 28521 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:09.935864 28532 raft_consensus.cc:697] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:09.967967 23701 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:09.971899 23697 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:09.916002 28426 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:09.933975 28428 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:09.981222 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.981879 23695 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.970234 28506 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:09.988786 23697 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:09.990746 23701 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:09.991106 23701 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:09.976488 28521 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.001398 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:09.996492 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:10.002789 24387 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:09.949904 28477 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.013624 23701 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.017031 23701 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.017153 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:09.996086 28486 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.867s	user 0.007s	sys 0.005s
I20260709 13:10:10.011906 24386 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:10.016662 23695 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:09.998643 28417 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:10.021289 28417 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.022423 28497 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.990276 28400 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:10.027057 28538 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.027174 28527 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.033258 28412 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.034843 28426 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:10.038069 28541 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:10:10.024669 28500 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:10:10.027994 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:10.064538 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:10.019610 28530 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:10.065363 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2127) took 1086 ms. Trace:
I20260709 13:10:10.024346 28209 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.065770 23778 rpcz_store.cc:276] 0709 13:10:08.978985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.979389 (+   404us) service_pool.cc:224] Handling call
0709 13:10:08.999127 (+ 19738us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.074734 (+ 75607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.074783 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.102304 (+ 27521us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.799846 (+697542us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:09.800014 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.800390 (+   376us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.065142 (+264752us) raft_consensus.cc:1685] finished
0709 13:10:10.065162 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.065307 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45851,"raft.queue_time_us":57138,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":17464,"thread_start_us":598344,"threads_started":1,"wal-append.queue_time_us":781532}
I20260709 13:10:10.067835 28209 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:10.044225 28156 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.044402 28486 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:10.044625 28532 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.046703 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:10.069002 23775 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:10:10.069239 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 867996us
I20260709 13:10:10.037354 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:10.036432 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:10.073186 23774 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.055020 23704 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:10.056165 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:10.074164 23697 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:10.061621 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.076460 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:10.036921 28428 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.042330 23699 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:10.076789 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:10.068876 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:09.998759 28506 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:10.077319 23629 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 7: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:10.055439 28444 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.086107 23704 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:09.977762 28445 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.038081 28188 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:10.089177 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:10.057328 28232 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:10.037415 28485 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.068462 23695 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.116163 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:10.080369 28527 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.096911 28530 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:10.097770 28486 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:10:10.099212 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 293314us
I20260709 13:10:10.038957 28417 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.099413 23629 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.100500 23701 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:10:10.101706 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.101471 23775 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:10:10.102998 23774 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:10.145500 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.092666 28519 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:10.109663 24358 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.641s (SENT)
I20260709 13:10:10.145923 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:10.146306 23701 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:10.146255 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:10.117450 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.070067 28466 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:10.070060 28477 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.119858 24359 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:10.131884 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:10.149036 23624 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:10.133214 28340 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.134426 28551 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:10:10.140722 28486 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:10.151490 23622 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.151481 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:10.168043 23628 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.157455 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.169014 23701 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:10.169925 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.118491 28500 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.175547 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.175779 23701 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:10.176406 23703 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:10.165505 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:10.176841 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.177762 23701 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:10.172899 24357 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:10.179749 28555 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:10.171747 28209 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:10.122776 28530 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:10.183602 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:10.186524 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 76900.4us
I20260709 13:10:10.074191 28538 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.186688 23701 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:10.149696 28534 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:10.192435 24358 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.696s (SENT)
I20260709 13:10:10.105373 28444 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.196028 23697 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:10.196314 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:10.194082 23629 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:10.197005 23624 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:10.195434 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.199291 23695 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:10.197036 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.171305 28466 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.203631 28529 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.183151 28417 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:10.211258 23771 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:10.206166 23697 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:10.151754 28527 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.211848 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:10.166412 28340 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.212977 23697 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:10.214229 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.215281 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.218214 28417 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:10.220299 23626 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:10:10.189522 28209 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:10.222678 23624 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:10.224269 23774 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:10.227504 23701 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:10.227629 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:10.241612 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:10.258507 23625 raft_consensus.cc:2410] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:10.260936 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.261549 23697 raft_consensus.cc:2376] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13. Re-sending same reply.
I20260709 13:10:10.182973 28500 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.268514 23701 raft_consensus.cc:2376] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13. Re-sending same reply.
I20260709 13:10:10.267140 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:10.275913 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.198524 28534 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.279636 23703 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:10.282254 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:10.283140 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:10.284165 23620 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:10:10.287308 28549 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:10:10.287051 28352 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:10.304874 23697 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:10.276309 28209 raft_consensus.cc:697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:10.316290 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:10.316939 23697 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:10.315024 23703 pending_rounds.cc:85] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 5
I20260709 13:10:10.322296 23703 pending_rounds.cc:107] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:10.322654 23703 raft_consensus.cc:2889] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:10.313769 23628 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:10:10.319031 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:10.334647 23697 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:10.221483 28506 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.356128 28412 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:10.356643 28472 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:10:10.358660 28500 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.361585 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2124) took 1248 ms. Trace:
I20260709 13:10:10.260028 28530 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.319661 28340 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:10.259152 28486 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.342361 28339 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:10.319968 28188 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:10.370688 23620 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:10.375715 24387 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:10.380888 23622 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
W20260709 13:10:10.381672 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 216237us
I20260709 13:10:10.420423 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:10:10.355121 28546 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.224s	user 0.001s	sys 0.001s
W20260709 13:10:10.385895 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 215811us
I20260709 13:10:10.421147 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:10.388782 23742 leader_election.cc:336] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.593s (SENT)
I20260709 13:10:10.420061 24359 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:10.423447 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:10.415884 28530 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:10.424309 24359 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:10.398203 23623 rpcz_store.cc:276] 0709 13:10:09.112876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.117449 (+  4573us) service_pool.cc:224] Handling call
0709 13:10:09.117756 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.952355 (+834599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.361354 (+408999us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b540037f354. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:10.361524 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917684608}
I20260709 13:10:10.352802 28417 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.427397 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:10.438400 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49664us
I20260709 13:10:10.445822 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:10.447325 23771 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:10.448897 23620 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:10:10.434275 28557 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.121s	user 0.001s	sys 0.001s
I20260709 13:10:10.448766 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:10.463692 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.436473 28444 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.434648 28426 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:10.436005 28412 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:10.485316 23698 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 6: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:10.438369 28352 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:10.484346 23697 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:10.489217 23742 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.693s (SENT)
I20260709 13:10:10.434285 28500 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:10:10.402830 28209 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.431195 28188 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.445672 28076 raft_consensus.cc:2764] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:10:10.500489 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 80149.1us
I20260709 13:10:10.485002 28482 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:10.459358 28449 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.460479 28527 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.462208 28339 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:10.445979 28466 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.510908 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:10.513792 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 90820.7us
I20260709 13:10:10.533841 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.534750 23700 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:10.505023 28426 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:10.516067 28482 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.527858 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.511906 28412 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:10.547138 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:10.567291 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:10.536921 28521 consensus_meta.cc:287] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.006s
W20260709 13:10:10.573724 28564 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.156s	user 0.001s	sys 0.003s
W20260709 13:10:10.576113 28560 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:10:10.582204 28188 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:10.582746 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.576193 28550 log.cc:927] Time spent T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.436s	user 0.002s	sys 0.001s
I20260709 13:10:10.588127 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:10.589082 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 2952) took 1423 ms. Trace:
I20260709 13:10:10.589548 23627 rpcz_store.cc:276] 0709 13:10:09.165870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.184749 (+ 18879us) service_pool.cc:224] Handling call
0709 13:10:09.185155 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.185613 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.185658 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.829614 (+643956us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b2c00058238. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:10:09.830002 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.996815 (+166813us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:09.996871 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.996975 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.575521 (+578546us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:10.588743 (+ 13222us) raft_consensus.cc:1685] finished
0709 13:10:10.588766 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.588990 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3059,"raft.queue_time_us":110,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6595,"spinlock_wait_cycles":47535104,"thread_start_us":166367,"threads_started":1,"wal-append.queue_time_us":270216}
I20260709 13:10:10.589756 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.599548 23700 raft_consensus.cc:2410] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:10.540467 28340 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:10.602937 28412 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.523502 28449 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.605830 28449 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:10.548164 28561 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:10:10.638115 23702 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:10.618412 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:10.548600 28482 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.565790 28186 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:10.644078 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.616401 28449 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:10.650570 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:10.652874 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45632us
I20260709 13:10:10.654811 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:10.655637 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:10.667378 23622 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:10.667506 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:10.643471 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:10.657002 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:10.658466 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.659685 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:10.655839 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:10.663800 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:10.672111 23669 leader_election.cc:400] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16.
I20260709 13:10:10.669040 23770 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
W20260709 13:10:10.676440 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 116712us
I20260709 13:10:10.639530 28485 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.679400 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:10.679554 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:10.672204 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.682876 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:10.683434 28500 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:10.684314 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:10.659049 28521 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:10.685485 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:10.676235 28186 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.647449 28532 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:10.704367 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:10.685555 28520 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:10.729735 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44315.6us
I20260709 13:10:10.676530 28539 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:10:10.719655 28451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.014s	sys 0.018s
I20260709 13:10:10.718055 28520 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:10.687937 28449 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.698266 28485 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.705981 28529 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:10:10.721804 28472 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:10.678010 28339 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:10.743033 28451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.014s	sys 0.019s
I20260709 13:10:10.728824 28580 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:10.766065 28529 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:10.760387 28369 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:10:10.739022 28352 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:10:10.746718 28520 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.732895 28500 consensus_queue.cc:1059] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:10:10.706749 28426 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:10.772572 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 69211.5us
I20260709 13:10:10.772933 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:10.729137 28532 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:10.777232 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 58350.4us
I20260709 13:10:10.779542 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 2128) took 1799 ms. Trace:
I20260709 13:10:10.779838 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:10.780176 23772 rpcz_store.cc:276] 0709 13:10:08.979790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.979926 (+   136us) service_pool.cc:224] Handling call
0709 13:10:10.779284 (+1799358us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b5400021054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:10.779462 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077923072}
I20260709 13:10:10.781124 28472 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:10.781875 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:10.783598 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:10.785046 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:10.770622 28529 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:10.784555 23773 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:10.787482 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:10.775018 28580 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:10.805768 23669 leader_election.cc:400] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13.
I20260709 13:10:10.806325 23669 leader_election.cc:403] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:10.766464 28579 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:10:10.778846 28500 consensus_queue.cc:1243] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:10.809749 28591 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:10.810797 28500 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:10.813681 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 69751.1us
I20260709 13:10:10.829823 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 604) took 1512 ms. Trace:
I20260709 13:10:10.804109 28580 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:10.830912 23699 rpcz_store.cc:276] 0709 13:10:09.317565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.327631 (+ 10066us) service_pool.cc:224] Handling call
0709 13:10:09.346819 (+ 19188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.082202 (+735383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.829426 (+747224us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400357fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:10.829724 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598737152}
I20260709 13:10:10.804044 28519 raft_consensus.cc:2764] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:10.791038 28588 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:10.834769 28472 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:10.838416 28186 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:10.812731 28500 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13.
W20260709 13:10:10.824311 28582 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:10:10.828433 28497 raft_consensus.cc:3055] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:10.826261 28538 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:10.856993 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 51444us
I20260709 13:10:10.839201 28588 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.859251 28588 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:10.865959 28587 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:10:10.816814 28494 consensus_queue.cc:1059] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:10:10.870079 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.872901 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.875576 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 612) took 1554 ms. Trace:
I20260709 13:10:10.849620 28497 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:10.876047 28580 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.877027 28497 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.826027 28529 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.878757 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.876334 23702 rpcz_store.cc:276] 0709 13:10:09.320933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.321441 (+   508us) service_pool.cc:224] Handling call
0709 13:10:09.336556 (+ 15115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.638819 (+1302263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.875148 (+236329us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000a0fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:10.875492 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2920470912}
I20260709 13:10:10.882480 28529 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:10.878697 28497 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.886036 28486 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:10.887583 28532 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:10.883066 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 800) took 1037 ms. Trace:
I20260709 13:10:10.890467 24394 rpcz_store.cc:276] 0709 13:10:09.846230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.846766 (+   536us) service_pool.cc:224] Handling call
0709 13:10:09.941573 (+ 94807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.944908 (+  3335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.882844 (+937936us) spinlock_profiling.cc:243] Waited 73.5 ms on lock 0x7b54005dd250. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:10.882999 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168981376}
I20260709 13:10:10.891667 28449 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:10.876083 28583 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:10:10.878782 23699 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:10.905005 23696 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:10.913524 28484 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.866500 28589 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.920368 28589 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.922839 28589 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.924790 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.925872 23700 raft_consensus.cc:2376] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13. Re-sending same reply.
I20260709 13:10:10.936228 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.937430 23701 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:10.948161 28240 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:10.948783 28520 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.953208 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:10.953874 28482 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.955314 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:10.958105 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.958961 28588 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:10.959764 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:10.960145 28532 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:10.955925 28579 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:10.960606 28532 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:10.960333 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:10.958978 23700 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:10.961683 23699 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:10.951534 28520 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:10.964764 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:10.971314 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:10.982213 23704 raft_consensus.cc:2410] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:10:10.982686 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:10.983932 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 175469us
I20260709 13:10:10.981233 23702 raft_consensus.cc:2376] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10. Re-sending same reply.
I20260709 13:10:10.962163 28532 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:10.986689 28520 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:10:10.987887 28593 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:10.988190 28486 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.989095 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:10.988951 28486 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:10.990345 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:10.991394 28520 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:10.963485 28449 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:10.991894 28520 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.992342 28520 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:10.997453 23698 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:10.997921 23698 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:10.999934 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:10.991632 28486 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:11.012910 28588 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.004271 28449 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:11.011322 23698 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:11.006742 28537 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:11.010810 23667 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:11.019577 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:11.023777 23698 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.996440 28532 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:11.028578 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2612) took 1009 ms. Trace:
W20260709 13:10:11.023629 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 346108us
I20260709 13:10:11.065865 23695 rpcz_store.cc:276] 0709 13:10:10.019129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.208615 (+189486us) service_pool.cc:224] Handling call
0709 13:10:10.208985 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.305141 (+ 96156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.305171 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:10.310700 (+  5529us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.451926 (+141226us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:10.451989 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.028098 (+576109us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b540008a2d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:11.028155 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.028217 (+    62us) raft_consensus.cc:1685] finished
0709 13:10:11.028233 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.028507 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":512,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6171,"spinlock_wait_cycles":220282752,"thread_start_us":99198,"threads_started":1,"wal-append.queue_time_us":334858}
I20260709 13:10:11.035518 23629 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:11.039767 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.040850 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.044790 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:11.038892 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:11.071066 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:11.073009 23620 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:11.015626 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 504775us
I20260709 13:10:11.074263 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:11.078861 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:11.083564 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 64095.7us
I20260709 13:10:11.084658 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:11.077553 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:11.102488 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.035002 28588 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.106768 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.107385 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:11.025525 28387 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.061359 28240 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:11.108235 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.020290 28482 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.041082 28517 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.035118 28486 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.020043 28568 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:11.035831 28494 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:11.096530 28579 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.107318 28597 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.113183 28387 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:11.097687 28537 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.150151 28387 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.116039 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:11.117441 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:11.143527 28482 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.152678 28482 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.154855 28482 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:11.119900 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.161554 28597 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:11.162796 24358 leader_election.cc:336] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.864s (SENT)
I20260709 13:10:11.163683 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:11.151973 28479 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:11.164275 23697 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:11.164614 28479 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.164896 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:11.165134 28479 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.165509 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:11.165762 23702 raft_consensus.cc:2410] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:10:11.168494 28473 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:11.169013 28473 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:11.139024 28486 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.170020 28473 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.171087 28473 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.171216 28486 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:11.172287 28532 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:11.110771 28186 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.116065 28240 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.044580 28520 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.123088 28567 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:11.185981 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.186802 23624 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:11.111543 28588 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.147059 28595 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:11.138738 28352 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:10:11.173540 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.189721 23622 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:11.173635 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.175889 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.164372 23695 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:11.178001 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:11.106251 28340 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:11.181294 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:11.181722 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 65783us
W20260709 13:10:11.159439 28594 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
I20260709 13:10:11.182886 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.194191 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.183290 24387 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:11.188772 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:11.195822 23703 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.200522 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:11.183916 28240 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.187475 28577 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:11.191365 28567 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:11.214866 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.192907 28340 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:11.201305 28595 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:11.224712 28595 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:11.223630 28340 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.237686 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:11.238672 28232 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.239009 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:11.239876 28232 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:11.245548 28340 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.250090 28485 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.251019 28534 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:11.214768 28577 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:11.255841 28520 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:11.190665 28494 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.222065 28567 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.258324 28588 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:11.295356 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:10:11.296118 28590 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.414s	user 0.003s	sys 0.000s
I20260709 13:10:11.260689 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:11.204869 28597 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.265373 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.297341 23629 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:11.298704 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:11.299873 28232 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:11.266628 23626 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:10:11.268623 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 92658.5us
I20260709 13:10:11.292217 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.275219 23698 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:10:11.277045 23624 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:11.307966 23698 pending_rounds.cc:85] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 3
I20260709 13:10:11.308318 23698 pending_rounds.cc:107] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:10:11.308544 23698 raft_consensus.cc:2889] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:11.308707 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:11.312014 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:11.313458 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 172770us
I20260709 13:10:11.317421 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:11.318352 24387 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:11.280156 23703 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:11.289455 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.284524 28577 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.292171 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:11.276093 28496 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.293186 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.293871 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.296449 28569 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:11.332739 28494 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:11.334816 28340 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:11.286003 28482 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:11.335812 28588 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.317353 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:11.339326 28104 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:11.340745 28530 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:10:11.341362 28537 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.311491 28412 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:11.341675 28444 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:11.343452 28479 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:11.346540 28584 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.540s	user 0.000s	sys 0.002s
I20260709 13:10:11.348098 28387 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:11.455576 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:11.456573 24394 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.350632 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:11.407436 28569 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:11.355702 23623 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:11.411202 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:11.417582 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.422775 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:11.424790 23696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2087) took 1579 ms (client timeout 1525 ms). Trace:
W20260709 13:10:11.459551 23696 rpcz_store.cc:269] 0709 13:10:09.838401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.838641 (+   240us) service_pool.cc:224] Handling call
0709 13:10:11.417426 (+1578785us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540026acd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:11.417555 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2358832000}
I20260709 13:10:11.341570 28555 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:11.428577 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 111276us
I20260709 13:10:11.408461 28572 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:11.446451 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:11.406574 28472 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.351627 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.406373 28473 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:11.435760 28445 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:11.435563 28261 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.474128 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:11.476696 23627 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.479259 23774 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:11.479796 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 129237us
I20260709 13:10:11.460999 28569 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:11.480261 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 128701us
I20260709 13:10:11.485723 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.464265 28572 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:11.437991 28482 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:11.481879 28527 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.020s	sys 0.037s
I20260709 13:10:11.487203 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.467636 28488 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.492480 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:11.495939 23774 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:11.477046 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:11.452145 28412 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.502473 28412 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.503381 28482 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.476886 28352 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:11.498071 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.499673 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.482411 28530 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:11.509948 23774 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:11.510464 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:10:11.496356 28527 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.020s	sys 0.037s
I20260709 13:10:11.471943 28417 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:10:11.471037 28555 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.471691 28472 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.498224 28473 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:11.513737 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.487787 28588 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.515992 28494 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:11.494364 28572 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:11.520016 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:11.545311 23769 raft_consensus.cc:606] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.545877 23769 raft_consensus.cc:614] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:11.528303 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:11.529804 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.479079 28261 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.552489 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:10:11.558815 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 96491.1us
I20260709 13:10:11.569298 23625 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:11.535498 23627 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:11.529058 23592 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:11.540323 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 78383.6us
I20260709 13:10:11.539637 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:11.571100 23774 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.571430 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:11.575390 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45709.4us
I20260709 13:10:11.576378 24390 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:11.539513 28387 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:11.577204 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:11.577564 23669 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.525195 28426 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:10:11.538736 28530 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:11.579043 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.587131 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:11.586376 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.589579 23778 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:11.590520 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.551882 28340 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:11.527959 28517 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:10:11.597380 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44972.2us
I20260709 13:10:11.598438 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:11.600119 28445 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.537243 28352 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.603202 28527 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.592468 28473 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.605669 28352 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:11.606418 28479 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.607093 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:11.607852 24385 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:11.599273 23669 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:11.587013 28412 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:10:11.608858 28488 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.609156 28479 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.586201 28494 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.588313 28387 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:11.616182 28387 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:11.616374 28520 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.619094 28472 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:11.624105 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:11.624825 23629 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:10:11.626219 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.628275 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:11.628545 28555 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.629056 23703 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:11.629242 28555 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:11.629655 24358 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:11.630754 28555 consensus_queue.cc:1059] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:11.631444 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:11.586704 28104 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:10:11.624107 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:11.632503 28104 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:11.546948 28576 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:10:11.632723 23696 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:11.632906 28104 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:11.633288 28576 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:11.633733 28576 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:11.633992 28104 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:11.634653 28576 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:11.635838 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:11.636420 23698 raft_consensus.cc:2376] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12. Re-sending same reply.
I20260709 13:10:11.636955 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:11.637706 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:11.637908 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:11.639078 28568 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:11.639632 28568 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:11.641004 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:11.641623 23698 raft_consensus.cc:2376] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13. Re-sending same reply.
I20260709 13:10:11.642427 28568 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.572861 28570 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:11.644448 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:11.644699 28613 log.cc:927] Time spent T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:10:11.576136 28562 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:11.642652 28521 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:11.623660 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:11.647329 23704 raft_consensus.cc:2376] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15. Re-sending same reply.
I20260709 13:10:11.652335 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:11.653288 23696 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:11.632079 23703 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:11.656179 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:11.660710 23698 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
W20260709 13:10:11.661392 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 66401.3us
I20260709 13:10:11.666803 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.663653 23629 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:11.670456 23774 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
W20260709 13:10:11.673386 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.678539 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:11.646379 28562 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.682283 23704 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:11.647389 28104 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.672485 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:11.603138 28567 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:11.644913 28261 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:11.681242 23698 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:10:11.644917 28576 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.667709 28555 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.682221 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:11.696905 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 98508us
I20260709 13:10:11.717749 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:11.719542 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47152.7us
I20260709 13:10:11.672784 28400 raft_consensus.cc:3055] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:11.720542 28400 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:11.721802 28400 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.667131 28521 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:11.725044 28521 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.727016 28521 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.699106 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:11.728399 23703 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:11.701713 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:11.734225 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:11.735198 23703 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:11.685878 28488 raft_consensus.cc:2764] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:10:11.686846 28562 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.741389 23621 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:11.678198 28444 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:10:11.754940 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:11.736562 28624 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:10:11.741920 28400 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.736474 28472 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.766268 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:11.769991 23703 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:11.686163 28240 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:11.694437 28209 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:11.772152 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 93415.9us
I20260709 13:10:11.766543 28412 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.780835 24358 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:11.806258 24394 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:11.750607 28617 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:10:11.813194 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:11.819159 23698 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.793016 28595 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:11.828624 28240 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.833761 28577 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:11.836504 28569 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:11.840222 28563 raft_consensus.cc:2764] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:11.824079 28188 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:10:11.851328 28618 raft_consensus.cc:3055] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:11.851851 28618 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:11.852691 28618 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:11.648411 28340 consensus_queue.cc:1175] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c885217113574e7489e6c3afb6950f76" responder_term: 13 status { last_received { term: 12 index: 8 } last_committed_idx: 8 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:11.862316 28567 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.880430 28444 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:11.892267 28517 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.893157 28517 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:11.896178 28517 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:11.907078 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:11.825976 23742 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:11.908126 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 82308.4us
I20260709 13:10:11.909019 23777 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:10:11.909421 23777 pending_rounds.cc:85] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 8
I20260709 13:10:11.909633 23777 pending_rounds.cc:107] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:10:11.909873 23777 raft_consensus.cc:2889] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:11.775053 28472 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:11.916296 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 237807us
I20260709 13:10:11.878984 28572 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:11.923604 23698 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:12.045002 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:12.032019 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:12.029681 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:12.077791 23774 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:12.029343 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:11.825380 28209 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:12.028978 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:12.070534 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.083402 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 365733us
I20260709 13:10:12.028842 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:12.084620 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:12.085846 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:12.087028 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:12.086362 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:12.085345 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:11.925154 28188 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:12.119649 23772 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:12.120656 23774 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.121333 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:12.124346 23778 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.928306 28445 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:12.126413 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:11.964001 28629 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.174s
I20260709 13:10:12.128180 28595 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:12.128793 28595 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.122530 23777 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:12.132117 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:12.129782 24393 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:12.133484 24386 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:12.133838 23702 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:12.134181 23776 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:12.135316 23697 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:12.137640 23771 raft_consensus.cc:606] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:12.138116 23771 raft_consensus.cc:614] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:12.139945 28580 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.140956 28618 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.090467 28517 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.144248 28517 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.075826 28568 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:12.146585 28568 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.149173 28568 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:12.132772 23701 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:12.081575 28597 raft_consensus.cc:3055] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:12.165736 23697 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:10:12.056216 28617 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:10:12.153678 23627 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:12.154201 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:12.176589 23624 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.160609 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:12.154775 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:12.155843 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:12.156639 23701 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:12.157706 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:12.151868 23742 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.166275 23697 pending_rounds.cc:85] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 10
I20260709 13:10:12.180101 23697 pending_rounds.cc:107] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:10:12.180447 23627 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:12.180521 23697 raft_consensus.cc:2889] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.167487 23626 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:12.153295 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:12.092868 28209 raft_consensus.cc:697] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:12.185869 28209 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:12.186787 28588 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:12.188318 23774 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:12.090732 28577 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:11.936866 28387 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:12.190754 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 102363us
I20260709 13:10:12.195511 23624 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:12.197224 23593 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.198189 28232 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:12.199338 28232 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:12.199939 28625 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:12.200683 28232 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:12.201526 28625 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.201952 28232 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:12.203564 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:11.996066 24387 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:12.176190 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:11.925190 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:12.122552 28555 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:12.193208 23669 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:12.195000 23626 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:10:12.212752 23626 pending_rounds.cc:85] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 5
I20260709 13:10:12.213223 23626 pending_rounds.cc:107] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:12.213490 23626 raft_consensus.cc:2889] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:12.211299 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 59518.1us
I20260709 13:10:12.214411 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:12.207624 23696 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.215798 23778 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:12.202368 28232 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:12.220999 28232 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.223832 28568 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:10:12.205824 28240 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:12.165336 28597 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:10:12.226991 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 50889.7us
I20260709 13:10:12.235489 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:12.236550 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:12.237088 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:12.202353 28625 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 13:10:12.246590 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.251006 23701 raft_consensus.cc:2376] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16. Re-sending same reply.
I20260709 13:10:12.257236 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:12.245569 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:10:12.259660 24360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.023s	sys 0.088s
W20260709 13:10:12.260138 24360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.023s	sys 0.089s
I20260709 13:10:12.226477 28540 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.265946 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:12.269138 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.212220 28188 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:12.191658 28562 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.247977 28485 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:12.271394 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:12.281610 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:12.253391 28588 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.249562 28519 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.247012 28577 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:12.272923 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:12.324116 23701 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:12.254681 28608 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:12.257357 28488 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.286082 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:12.314585 28261 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:12.315307 28352 consensus_queue.cc:1059] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:12.317629 28387 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:12.263371 28240 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:12.320634 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:12.270538 28570 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.375751 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:12.377382 23696 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:12.408150 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:12.409314 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:12.410000 23696 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.280428 28485 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.266485 28449 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:12.384171 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.321748 28232 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:12.385933 24358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.028s	sys 0.029s
I20260709 13:10:12.384320 23771 raft_consensus.cc:606] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.392818 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:12.410799 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 90305.8us
I20260709 13:10:12.419004 23626 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:12.419317 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:10:12.415417 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 79303.2us
I20260709 13:10:12.325121 28517 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:12.328662 28608 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:12.387714 28521 consensus_meta.cc:287] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.646s	user 0.013s	sys 0.004s
I20260709 13:10:12.423144 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:12.374908 28539 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:10:12.424551 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.385154 28261 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:12.385205 28577 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:12.420011 24358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.029s	sys 0.029s
I20260709 13:10:12.339191 28588 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:12.438148 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:12.439077 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:12.433156 23699 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:12.439675 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:12.435400 28539 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:12.436483 28642 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:12.441933 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:12.435540 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.417296 28485 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:12.424153 28352 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:12.407071 28004 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:12.443205 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:12.442586 23701 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:12.388402 28488 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.418076 28625 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:12.447108 28352 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:12.418810 28188 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:12.436666 28569 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:12.451063 28589 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:12.473529 28352 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.465234 28004 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:12.476269 28004 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:12.476856 28004 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:12.477335 28004 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:12.478295 28004 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.482693 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:12.441045 28572 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:12.446215 28539 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:12.449347 28555 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.426749 28608 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.464329 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.375456 28597 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:12.446230 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:12.431651 28449 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:12.438351 28261 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.449469 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:12.505512 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:12.483843 23696 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:10:12.460896 28521 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.486416 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2146) took 1007 ms. Trace:
I20260709 13:10:12.486552 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:12.491657 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:12.497623 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 406430us
I20260709 13:10:12.487749 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2143) took 1013 ms. Trace:
W20260709 13:10:12.505865 23594 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.001s	sys 0.031s
I20260709 13:10:12.473735 28472 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:12.485023 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.511922 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.511154 24387 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
W20260709 13:10:12.519361 23594 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.001s	sys 0.034s
I20260709 13:10:12.476874 28562 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:12.489908 28538 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:12.521411 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:12.521514 23626 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:12.523425 23668 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:12.534576 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:12.534946 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.515839 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 69725.5us
W20260709 13:10:12.525192 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.535637 23699 pending_rounds.cc:85] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 6
I20260709 13:10:12.536239 23699 pending_rounds.cc:107] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:10:12.536589 23699 raft_consensus.cc:2889] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.537039 23699 pending_rounds.cc:107] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:10:12.537364 23699 raft_consensus.cc:2889] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.511255 23775 rpcz_store.cc:276] 0709 13:10:11.474236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.476528 (+  2292us) service_pool.cc:224] Handling call
0709 13:10:11.485580 (+  9052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.485738 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:11.676411 (+190673us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.485618 (+809207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.485674 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:12.485724 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.485794 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.487644 (+  1850us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27869,"prepare.queue_time_us":34324,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":7897,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":52,"thread_start_us":962556,"threads_started":3,"wal-append.queue_time_us":598711}
I20260709 13:10:12.510635 23773 rpcz_store.cc:276] 0709 13:10:11.478532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.478809 (+   277us) service_pool.cc:224] Handling call
0709 13:10:11.484107 (+  5298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.484330 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:11.681708 (+197378us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.486089 (+804381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.486144 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:12.486195 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.486261 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.486363 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20139,"prepare.queue_time_us":35503,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":41899,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":942790,"threads_started":3,"wal-append.queue_time_us":583502}
I20260709 13:10:12.560103 23626 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:12.557791 23592 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.564289 23626 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:12.493140 28004 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.499065 28625 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.566265 24359 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:12.567998 28629 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:12.569952 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:12.570569 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:12.572166 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:12.575289 28445 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:12.563668 28562 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:12.554291 28568 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:12.516557 28572 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.578913 28488 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:12.580797 28636 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:10:12.495244 28532 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:12.506824 28517 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:10:12.583695 23696 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:12.584342 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 907) took 1012 ms. Trace:
I20260709 13:10:12.596614 23696 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:12.554738 28104 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.854s	user 0.008s	sys 0.004s
I20260709 13:10:12.584767 23623 rpcz_store.cc:276] 0709 13:10:11.572387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.572514 (+   127us) service_pool.cc:224] Handling call
0709 13:10:11.591411 (+ 18897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.774057 (+182646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.774091 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.774640 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.125065 (+350425us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:12.125123 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.125222 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.584121 (+458899us) raft_consensus.cc:1685] finished
0709 13:10:12.584144 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.584284 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":295,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":528654,"threads_started":2,"wal-append.queue_time_us":623216}
I20260709 13:10:12.519477 28400 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.600857 24386 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:12.607896 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:12.496111 28539 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.532126 28472 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:12.613943 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:12.493252 28240 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.506465 28555 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:12.641844 28555 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:12.618423 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:12.647888 28449 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.651786 28539 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.632424 24387 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:10:12.655004 23770 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:12.522193 28521 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:12.623654 24393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c"
dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:58744
I20260709 13:10:12.677477 24393 raft_consensus.cc:606] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.623378 28472 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:12.628783 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.628815 28640 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:10:12.565400 28577 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.597533 28417 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:10:12.584786 28482 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:10:12.636767 28595 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.002s
I20260709 13:10:12.619524 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:12.676367 24394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.021s	sys 0.029s
W20260709 13:10:12.730654 24394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.021s	sys 0.029s
I20260709 13:10:12.659184 28539 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:12.568162 28630 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 13:10:12.597491 28538 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:12.749218 28629 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:12.749604 28538 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:12.750236 28538 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.720402 28625 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:12.751466 28625 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.753943 28625 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:12.755997 28588 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:12.757130 28588 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:12.757529 28588 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.757899 28588 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.760713 28538 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.720247 28352 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:12.768477 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 150647us
I20260709 13:10:12.772866 23769 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:12.804224 28517 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.804905 28517 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.807386 28517 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:12.773113 28595 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:12.795508 28352 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:12.763289 28538 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:12.791587 28638 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:12.843705 23777 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:12.847980 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 314654us
I20260709 13:10:12.855232 28538 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:12.855845 28589 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:12.857050 28589 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:12.859567 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 416489us
I20260709 13:10:12.799754 28488 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:10:12.861831 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:12.865389 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:12.845574 28332 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:12.844556 28517 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.816556 28608 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.879498 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:12.889953 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:12.880903 23771 raft_consensus.cc:606] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
W20260709 13:10:12.899245 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 362792us
I20260709 13:10:12.858626 28538 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:10:12.909334 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:12.892501 28580 consensus_meta.cc:287] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.752s	user 0.004s	sys 0.007s
I20260709 13:10:12.918179 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:12.919482 23629 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:12.877342 28004 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:12.873485 28332 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:12.922641 23628 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:12.926326 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:12.926975 28580 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.927578 28580 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:12.929936 28580 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:12.905615 28638 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:12.930861 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:12.924064 23622 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:12.933822 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:12.934263 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:12.934670 23620 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:10:12.924883 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2663) took 1226 ms. Trace:
I20260709 13:10:12.914717 28625 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:12.939185 23769 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:12.936514 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:12.971009 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:12.937633 23704 rpcz_store.cc:276] 0709 13:10:11.698150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.698303 (+   153us) service_pool.cc:224] Handling call
0709 13:10:11.729563 (+ 31260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.729963 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.729997 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.730515 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.060872 (+330357us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:12.489361 (+428489us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.924574 (+435213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.924651 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.924698 (+    47us) raft_consensus.cc:1685] finished
0709 13:10:12.924711 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.924828 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25138,"prepare.queue_time_us":766713,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2045,"raft.queue_time_us":268303,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"thread_start_us":1147929,"threads_started":3,"wal-append.queue_time_us":336522}
I20260709 13:10:12.971442 23769 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:12.924206 28563 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:12.963510 23772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.013s	sys 0.027s
I20260709 13:10:12.882117 28517 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:12.983566 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:12.984426 24393 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:10:12.983373 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:12.986245 28517 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:12.986941 23772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.013s	sys 0.027s
W20260709 13:10:12.992506 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.010448 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.010890 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:13.014384 23668 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:13.017055 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:13.016952 28488 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:13.017944 23629 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:13.019785 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:13.018076 28488 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:12.943456 28540 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.000s
I20260709 13:10:13.044538 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:13.044421 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:13.046171 23625 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:10:12.949004 28638 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:12.980155 28595 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:12.980392 28521 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:12.939539 28387 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:10:12.987196 28472 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:13.086338 28232 consensus_meta.cc:287] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.659s	user 0.004s	sys 0.006s
I20260709 13:10:13.044339 28104 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.048465 28540 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:13.114251 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.139367 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.099117 28209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.014s	sys 0.022s
I20260709 13:10:13.098217 28472 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.206354 23774 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:13.161442 28538 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:13.166674 28519 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:13.197830 28532 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:13.219048 23777 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:13.320147 23775 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:13.094972 28188 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 13:10:13.146471 28517 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:13.205070 28209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.014s	sys 0.022s
W20260709 13:10:13.154065 28449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.005s	sys 0.017s
I20260709 13:10:13.228147 28539 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.221928 28538 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:13.383157 23777 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:13.320551 28532 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:13.227409 28519 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.326407 28608 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:13.379906 28648 raft_consensus.cc:993] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
W20260709 13:10:13.400100 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 457153us
I20260709 13:10:13.381493 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:13.381016 28449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.015s	sys 0.029s
W20260709 13:10:13.380110 28636 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:10:13.326005 28521 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.378937 28572 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:13.394291 28650 log.cc:927] Time spent T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.436s	user 0.001s	sys 0.001s
W20260709 13:10:13.394114 28649 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:10:13.380056 28662 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.379762 28656 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.379281 28659 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:13.406556 28519 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:13.473441 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 530454us
I20260709 13:10:13.377624 28517 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:13.475445 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 461192us
W20260709 13:10:13.476886 23700 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.000s	sys 0.035s
W20260709 13:10:13.480733 23700 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.000s	sys 0.036s
I20260709 13:10:13.476358 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:13.412034 28387 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:13.396430 28539 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:13.513759 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.524689 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2678) took 1407 ms. Trace:
I20260709 13:10:13.525301 23698 rpcz_store.cc:276] 0709 13:10:12.117565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.119537 (+  1972us) service_pool.cc:224] Handling call
0709 13:10:12.174616 (+ 55079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.185787 (+ 11171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.185818 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.186256 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.608538 (+422282us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:12.608606 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.608705 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.524346 (+915641us) raft_consensus.cc:1685] finished
0709 13:10:13.524380 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.524600 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8314,"raft.queue_time_us":13268,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":6040,"thread_start_us":421888,"threads_started":1,"wal-append.queue_time_us":643640}
I20260709 13:10:13.545007 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:13.546553 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:13.483378 23667 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:13.476054 28646 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.504s	user 0.000s	sys 0.001s
W20260709 13:10:13.492549 28261 consensus_meta.cc:287] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.971s	user 0.006s	sys 0.006s
W20260709 13:10:13.559860 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.389446 28638 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:13.482709 28520 raft_consensus.cc:1081] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:13.427145 28521 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:13.477977 28659 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:13.452042 28617 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
W20260709 13:10:13.554571 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 71272.5us
I20260709 13:10:13.588711 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:13.431694 28572 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:13.529294 28240 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:13.499243 28417 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:10:13.497936 28488 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:13.493186 28653 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:13.478933 28540 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
W20260709 13:10:13.599920 28666 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:13.451858 28656 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:13.451946 28662 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:13.605427 28654 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.457s	user 0.000s	sys 0.001s
I20260709 13:10:13.580076 28668 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.227252 28472 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:13.604151 23667 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:13.620112 23695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.012s	sys 0.011s
I20260709 13:10:13.539012 28387 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:13.577399 28661 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:13.622855 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:13.626266 23629 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:13.604925 28644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.009s	sys 0.054s
I20260709 13:10:13.639834 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 703) took 1730 ms. Trace:
I20260709 13:10:13.605417 28240 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.591692 28261 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:13.649593 23695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.012s	sys 0.011s
I20260709 13:10:13.500069 28538 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:13.633227 28488 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:13.657750 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.661473 24394 rpcz_store.cc:276] 0709 13:10:11.909498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.016684 (+107186us) service_pool.cc:224] Handling call
0709 13:10:12.041773 (+ 25089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.042304 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.042346 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.080220 (+ 37874us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.731193 (+650973us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:12.731250 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.731377 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.639509 (+908132us) raft_consensus.cc:1685] finished
0709 13:10:13.639549 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.639749 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"raft.queue_time_us":119,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"thread_start_us":608320,"threads_started":1,"wal-append.queue_time_us":823584}
W20260709 13:10:13.660660 28663 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:10:13.668336 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:13.650018 28685 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:13.681782 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 276360us
W20260709 13:10:13.664875 28660 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.435s	user 0.000s	sys 0.001s
I20260709 13:10:13.679715 23775 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:10:13.675769 23702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.002s	sys 0.028s
W20260709 13:10:13.690661 23702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.002s	sys 0.028s
I20260709 13:10:13.668898 28240 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.662371 28671 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:13.707935 23773 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:13.713039 23669 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.044s	sys 0.072s
W20260709 13:10:13.714532 23669 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.045s	sys 0.072s
I20260709 13:10:13.675390 28332 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:13.649598 28668 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:13.762223 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 287948us
W20260709 13:10:13.733783 28664 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:10:13.664587 28661 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:13.732722 28682 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:10:13.745942 28104 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:13.745115 28673 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:10:13.739811 28655 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:13.744431 28672 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:10:13.763855 28537 raft_consensus.cc:3055] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:13.700413 28209 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:13.681134 28488 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:13.826741 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 916) took 1248 ms. Trace:
W20260709 13:10:13.841221 28485 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.394s	user 0.006s	sys 0.009s
I20260709 13:10:13.740374 28449 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:13.757296 28686 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.848655 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:13.694124 28685 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:13.809007 28658 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:13.876463 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 917) took 1294 ms. Trace:
I20260709 13:10:13.854935 23624 rpcz_store.cc:276] 0709 13:10:12.578779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.578912 (+   133us) service_pool.cc:224] Handling call
0709 13:10:12.579282 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.579638 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.579669 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.580235 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.899345 (+319110us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:12.899402 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.899504 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.826449 (+926945us) raft_consensus.cc:1685] finished
0709 13:10:13.826484 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.826666 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":408,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":301351,"threads_started":1,"wal-append.queue_time_us":522077}
I20260709 13:10:13.829523 28517 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:13.736531 28671 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:13.817728 28332 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:13.846470 28537 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:13.913414 23627 rpcz_store.cc:276] 0709 13:10:12.582418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.583539 (+  1121us) service_pool.cc:224] Handling call
0709 13:10:12.583905 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.584393 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:12.584435 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.584996 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.042466 (+457470us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:13.042577 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.042722 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.876207 (+833485us) raft_consensus.cc:1685] finished
0709 13:10:13.876228 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.876386 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1091,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9733,"thread_start_us":452359,"threads_started":1,"wal-append.queue_time_us":743916}
I20260709 13:10:13.843035 28104 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:13.938690 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 334617us
I20260709 13:10:13.693672 28659 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:13.890175 28485 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:13.913391 28695 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:10:13.858072 28539 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:13.933575 28684 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:10:13.883637 28597 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:13.945559 23667 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:13.909461 28521 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:13.846571 28655 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:13.970608 23696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.011s	sys 0.010s
W20260709 13:10:13.971019 23696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.011s	sys 0.010s
I20260709 13:10:13.971144 23701 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:13.877246 28209 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:13.922377 28449 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:14.013759 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 311656us
W20260709 13:10:14.014000 23593 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.501s (SENT) [suppressed 33 similar messages]
W20260709 13:10:14.014249 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 68792.8us
I20260709 13:10:14.014670 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:14.016563 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 470868us
I20260709 13:10:13.981844 28656 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:14.017644 23621 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.003s	sys 0.011s
W20260709 13:10:14.017455 23699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.004s	sys 0.010s
W20260709 13:10:14.022145 23621 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.003s	sys 0.012s
W20260709 13:10:14.022365 23699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.004s	sys 0.010s
I20260709 13:10:13.992846 28261 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:13.968926 28686 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:14.024518 23743 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:14.024751 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2094) took 1790 ms. Trace:
I20260709 13:10:14.015084 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:13.992518 28472 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:14.013253 28667 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.314s	user 0.001s	sys 0.001s
I20260709 13:10:13.941427 28658 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:14.021839 28352 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.005s	sys 0.027s
I20260709 13:10:14.028956 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:14.013918 28692 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:14.045914 24387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 772) took 1031 ms. Trace:
I20260709 13:10:14.024387 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 912) took 1470 ms. Trace:
I20260709 13:10:14.048360 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:14.055053 23698 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:14.013823 28517 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:14.040578 28588 consensus_meta.cc:287] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.275s	user 0.015s	sys 0.001s
I20260709 13:10:14.045843 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:14.051896 24387 rpcz_store.cc:276] 0709 13:10:13.014191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.014342 (+   151us) service_pool.cc:224] Handling call
0709 13:10:13.014729 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:13.015464 (+   735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.015494 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:13.016105 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 13:10:13.475167 (+459062us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:13.475213 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.475287 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.045662 (+570375us) raft_consensus.cc:1685] finished
0709 13:10:14.045683 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.045851 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93,"thread_start_us":458651,"threads_started":1,"wal-append.queue_time_us":655502}
I20260709 13:10:14.039934 23699 rpcz_store.cc:276] 0709 13:10:12.233904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.534929 (+301025us) service_pool.cc:224] Handling call
0709 13:10:12.535384 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.561602 (+ 26218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.561656 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.562212 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.971826 (+409614us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:13.075620 (+103794us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.023258 (+947638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.023345 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.023400 (+    55us) raft_consensus.cc:1685] finished
0709 13:10:14.023413 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.024686 (+  1273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5978,"prepare.queue_time_us":72299,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":127478,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"thread_start_us":1294382,"threads_started":2,"wal-append.queue_time_us":779636}
I20260709 13:10:14.038908 28521 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:14.056118 23621 rpcz_store.cc:276] 0709 13:10:12.554481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.554638 (+   157us) service_pool.cc:224] Handling call
0709 13:10:12.555047 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:12.555585 (+   538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.555637 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:12.561592 (+  5955us) log.cc:844] Serialized 52 byte log entry
0709 13:10:12.973517 (+411925us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:14.023759 (+1050242us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.024033 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.024140 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.024184 (+    44us) raft_consensus.cc:1685] finished
0709 13:10:14.024196 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.024322 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17609,"prepare.queue_time_us":623284,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":802,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4942,"thread_start_us":1320996,"threads_started":2,"wal-append.queue_time_us":713304}
I20260709 13:10:14.075546 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:14.077137 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63163.5us
I20260709 13:10:14.078027 23771 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
W20260709 13:10:14.052142 28352 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.005s	sys 0.031s
I20260709 13:10:14.042325 28656 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:14.040928 28708 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:14.086040 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:14.103824 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55271.4us
I20260709 13:10:14.046707 28705 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:14.053045 28699 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:14.109021 23698 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:14.016808 28537 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.111137 23699 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:14.133162 23621 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:14.133360 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.134418 23699 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:14.120406 28701 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:14.120637 28688 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.253s	user 0.002s	sys 0.000s
W20260709 13:10:14.128507 28694 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:14.110468 28704 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:14.154322 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:14.116092 28699 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.109534 28708 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.085248 28668 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:14.146903 28683 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.295s	user 0.000s	sys 0.002s
I20260709 13:10:14.114778 28712 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.115861 28705 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:14.112918 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:14.121169 28661 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.083449 28588 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.091708 28521 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.169260 23698 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:14.085553 28517 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.061434 28692 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.155274 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.125814 28261 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:10:14.193922 23621 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:14.204113 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 175887us
I20260709 13:10:14.206768 23698 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:14.160629 28104 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.170991 28485 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:14.171518 28668 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:14.171783 28705 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.227749 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2112) took 1805 ms. Trace:
I20260709 13:10:14.217382 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:14.164748 28699 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.172676 28209 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.193619 28661 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.193101 28671 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:10:14.173358 28714 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:14.171056 28685 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.231067 23698 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:14.214581 28712 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:14.247810 23622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3016) took 1304 ms. Trace:
I20260709 13:10:14.248360 23622 rpcz_store.cc:276] 0709 13:10:12.971832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.987451 (+ 15619us) service_pool.cc:224] Handling call
0709 13:10:12.987837 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.013815 (+ 25978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.013852 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.014419 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.477065 (+462646us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:13.477113 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.477204 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.247517 (+770313us) raft_consensus.cc:1685] finished
0709 13:10:14.247545 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.247718 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25521,"raft.queue_time_us":27074,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":67,"thread_start_us":462261,"threads_started":1,"wal-append.queue_time_us":700017}
I20260709 13:10:14.221316 28638 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.222833 28655 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.218385 28695 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:14.163218 28701 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.242075 23702 rpcz_store.cc:276] 0709 13:10:12.422631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.103675 (+681044us) service_pool.cc:224] Handling call
0709 13:10:13.104159 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.104576 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.104618 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.105222 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.691200 (+585978us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:13.732161 (+ 40961us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.227395 (+495234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.227470 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.227515 (+    45us) raft_consensus.cc:1685] finished
0709 13:10:14.227527 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.227667 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36980,"prepare.queue_time_us":46489,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":355873,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":4733,"thread_start_us":1026824,"threads_started":2,"wal-append.queue_time_us":747731}
W20260709 13:10:14.243599 28532 consensus_meta.cc:287] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.819s	user 0.012s	sys 0.004s
I20260709 13:10:14.255507 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2107) took 2010 ms. Trace:
W20260709 13:10:14.271375 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63708.3us
W20260709 13:10:14.272449 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55152.7us
I20260709 13:10:14.167022 28704 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.274574 23703 rpcz_store.cc:276] 0709 13:10:12.245468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.756820 (+511352us) service_pool.cc:224] Handling call
0709 13:10:12.757158 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.757528 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:13.159215 (+401687us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.035997 (+876782us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.043777 (+  7780us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.044093 (+   316us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:14.049581 (+  5488us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.083246 (+ 33665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.083330 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.255275 (+171945us) raft_consensus.cc:1685] finished
0709 13:10:14.255296 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.255444 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46056,"prepare.queue_time_us":120020,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":71,"raft.queue_time_us":705039,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":17086,"spinlock_wait_cycles":27213184,"thread_start_us":1003050,"threads_started":3,"wal-append.queue_time_us":477021}
I20260709 13:10:14.285844 23703 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:14.253953 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 208154us
I20260709 13:10:14.280117 28655 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:14.288192 28655 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:14.288342 28709 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.153s	user 0.001s	sys 0.001s
I20260709 13:10:14.288578 28655 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:14.288885 28658 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:14.289058 28697 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:10:14.266690 28104 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.289747 28104 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.290251 28724 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:14.290947 28690 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:10:14.283831 28532 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.292490 28572 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.292716 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2110) took 1969 ms. Trace:
I20260709 13:10:14.293926 28532 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:14.293114 23704 rpcz_store.cc:276] 0709 13:10:12.323278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.978544 (+655266us) service_pool.cc:224] Handling call
0709 13:10:13.043329 (+ 64785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.081312 (+ 37983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.081363 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.096774 (+ 15411us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.614100 (+517326us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:13.643390 (+ 29290us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.643635 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.643756 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.292484 (+648728us) raft_consensus.cc:1685] finished
0709 13:10:14.292505 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.292652 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67346,"prepare.queue_time_us":30705,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2506,"raft.queue_time_us":468854,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":13414,"thread_start_us":407841,"threads_started":1,"wal-append.queue_time_us":740122}
I20260709 13:10:14.255478 28714 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.237646 28668 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.239195 28261 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:10:14.289990 28569 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:14.297438 28569 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:14.298451 28569 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.300100 28569 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.302697 28662 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:14.283767 28722 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:10:14.254349 28728 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:14.309083 28728 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.255824 28449 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:14.312294 28707 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:10:14.267325 28638 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.281466 28695 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.325203 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2106) took 2080 ms. Trace:
I20260709 13:10:14.325433 28719 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:14.326496 28652 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.937s	user 0.000s	sys 0.003s
I20260709 13:10:14.325745 23696 rpcz_store.cc:276] 0709 13:10:12.244743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.656386 (+411643us) service_pool.cc:224] Handling call
0709 13:10:12.656843 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.930805 (+273962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.930835 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.982328 (+ 51493us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.971446 (+989118us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:13.992205 (+ 20759us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.018834 (+ 26629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.018955 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.324943 (+305988us) raft_consensus.cc:1685] finished
0709 13:10:14.324964 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.325134 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30034,"prepare.queue_time_us":24290,"raft.queue_time_us":209455,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":9470,"spinlock_wait_cycles":15374720,"thread_start_us":1156457,"threads_started":2,"wal-append.queue_time_us":1281352}
I20260709 13:10:14.329821 28718 consensus_queue.cc:1059] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:14.331133 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2163) took 1883 ms. Trace:
I20260709 13:10:14.331547 23770 rpcz_store.cc:276] 0709 13:10:12.447687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.447976 (+   289us) service_pool.cc:224] Handling call
0709 13:10:12.463365 (+ 15389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.655416 (+192051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.330898 (+1675482us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54001cb954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:14.331072 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440340480}
I20260709 13:10:14.295766 28702 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:14.332815 28702 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.244329 28517 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:14.296926 28717 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:10:14.347074 23667 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:14.363336 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:14.358953 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1036) took 2214 ms. Trace:
I20260709 13:10:14.365840 23772 rpcz_store.cc:276] 0709 13:10:12.144450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.144657 (+   207us) service_pool.cc:224] Handling call
0709 13:10:12.145643 (+   986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.147029 (+  1386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.147151 (+   122us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.148857 (+  1706us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.987772 (+838915us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:12.987818 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.987887 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.325798 (+1337911us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:14.342327 (+ 16529us) raft_consensus.cc:1685] finished
0709 13:10:14.342348 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.358869 (+ 16521us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":194,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":16428416,"thread_start_us":837809,"threads_started":1,"wal-append.queue_time_us":1006582}
I20260709 13:10:14.382143 23667 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:14.253769 28661 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.342743 28724 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:14.360167 28232 raft_consensus.cc:3055] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:14.386371 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:14.401861 23772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:14.369110 28104 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:14.403891 23772 raft_consensus.cc:606] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:14.367945 28532 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:14.370231 28658 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:14.405875 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 134630us
I20260709 13:10:14.419353 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:14.423717 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:14.427491 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:14.430732 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:14.391422 28517 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:14.431988 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:14.326248 28719 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.445417 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:14.395851 28232 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:14.460215 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:14.434324 28209 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:14.450906 28651 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.299s	user 0.000s	sys 0.002s
I20260709 13:10:14.432662 28485 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:14.483990 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:14.444563 28728 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.450055 28706 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.463846 28638 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.432811 28532 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.462774 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:14.470968 28719 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:14.472020 28232 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.475878 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:14.478452 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 201974us
I20260709 13:10:14.478754 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:14.459096 28692 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:14.504739 28735 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:14.505450 28736 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:10:14.564639 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:14.514585 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1038) took 1327 ms. Trace:
I20260709 13:10:14.481302 28656 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:14.568492 23778 rpcz_store.cc:276] 0709 13:10:13.186832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.210628 (+ 23796us) service_pool.cc:224] Handling call
0709 13:10:13.318905 (+108277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.377325 (+ 58420us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:13.689056 (+311731us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.026298 (+337242us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.026766 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.026899 (+   133us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:14.026931 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.026994 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.514323 (+487329us) raft_consensus.cc:1685] finished
0709 13:10:14.514350 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.514530 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67740,"prepare.queue_time_us":225068,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":70627,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":19185,"spinlock_wait_cycles":32128,"thread_start_us":599773,"threads_started":2,"wal-append.queue_time_us":421632}
I20260709 13:10:14.479169 28521 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.520282 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:14.448730 28671 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:14.438882 28658 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.514037 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:14.478101 28686 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.519248 23702 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:14.509387 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:14.579236 23698 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:14.500914 28695 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:14.572073 23696 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.510056 28630 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:14.515134 28638 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:10:14.573858 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 164723us
I20260709 13:10:14.509821 28714 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:14.574018 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.021s	sys 0.037s
I20260709 13:10:14.581467 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:14.572765 23593 leader_election.cc:336] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.147s (SENT)
W20260709 13:10:14.584643 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 66327.1us
I20260709 13:10:14.483534 28209 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.615464 23593 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:14.611717 28630 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:14.638259 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 73693.1us
I20260709 13:10:14.624343 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:14.595991 28686 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:14.614739 28519 consensus_meta.cc:287] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.122s	user 0.010s	sys 0.005s
I20260709 13:10:14.644927 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:14.645725 23696 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:14.644579 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 635) took 2484 ms. Trace:
I20260709 13:10:14.647977 24386 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:10:14.648590 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:14.624640 28597 consensus_meta.cc:287] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.650s	user 0.013s	sys 0.000s
I20260709 13:10:14.649250 24387 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:14.569795 28713 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:10:14.623445 28655 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.574839 28656 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.624311 28638 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.640350 28630 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.657930 28739 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.146s
W20260709 13:10:14.660137 28734 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:10:14.660386 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2095) took 2426 ms. Trace:
I20260709 13:10:14.660828 23701 rpcz_store.cc:276] 0709 13:10:12.234158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.563804 (+329646us) service_pool.cc:224] Handling call
0709 13:10:12.564162 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.978493 (+1414331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.660147 (+681654us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540008a7d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:14.660327 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3235002624}
W20260709 13:10:14.661934 28730 log.cc:927] Time spent T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:10:14.663250 23701 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:14.647544 28659 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:14.663898 23704 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.664150 28659 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.664541 28659 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:14.659566 23697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2092) took 2426 ms (client timeout 2147 ms). Trace:
I20260709 13:10:14.665344 28704 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:14.665490 23697 rpcz_store.cc:269] 0709 13:10:12.233372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.236840 (+  3468us) service_pool.cc:224] Handling call
0709 13:10:14.659307 (+2422467us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400269dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:14.659451 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467910528}
I20260709 13:10:14.667258 23697 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:14.519968 28724 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.671461 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2108) took 2425 ms. Trace:
I20260709 13:10:14.672114 23695 rpcz_store.cc:276] 0709 13:10:12.246251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.931134 (+684883us) service_pool.cc:224] Handling call
0709 13:10:12.938599 (+  7465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.938980 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.939011 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.941849 (+  2838us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.669573 (+727724us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:13.696224 (+ 26651us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.670738 (+974514us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b18000d1740. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287
0709 13:10:14.670866 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.670971 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.671025 (+    54us) raft_consensus.cc:1685] finished
0709 13:10:14.671138 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.671360 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5808,"prepare.queue_time_us":38470,"prepare.run_cpu_time_us":409,"prepare.run_wall_time_us":24620,"raft.queue_time_us":426335,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":22010,"spinlock_wait_cycles":5669632,"thread_start_us":904925,"threads_started":2,"wal-append.queue_time_us":798939}
W20260709 13:10:14.618474 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.022s	sys 0.037s
I20260709 13:10:14.615446 28662 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:14.611994 28521 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:14.619746 28736 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:14.647557 24385 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:14.692217 28745 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.715893 28741 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:10:14.648007 23700 rpcz_store.cc:276] 0709 13:10:12.160335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.180181 (+ 19846us) service_pool.cc:224] Handling call
0709 13:10:12.180468 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.193735 (+ 13267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.193764 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.194208 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.662971 (+468763us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:13.481143 (+818172us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.482388 (+  1245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.482514 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.333286 (+850772us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:14.637483 (+304197us) raft_consensus.cc:1685] finished
0709 13:10:14.644293 (+  6810us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.644473 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13894,"prepare.queue_time_us":184748,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1793,"raft.queue_time_us":26139,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":74179,"spinlock_wait_cycles":11400576,"thread_start_us":1220168,"threads_started":2,"wal-append.queue_time_us":711687}
I20260709 13:10:14.725605 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:14.657477 28732 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.651654 28702 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:14.693804 28472 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.695935 23696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:10:14.742256 23696 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.742753 23696 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:14.743176 23704 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:14.744901 28725 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.745458 28725 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.745872 28638 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:14.746544 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.747555 28725 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:14.750576 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 177790us
I20260709 13:10:14.584895 28735 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.720042 28701 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.720165 28648 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.758953 28725 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:14.759358 28656 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.726543 28712 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:14.733507 28240 consensus_meta.cc:287] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.999s	user 0.007s	sys 0.006s
I20260709 13:10:14.653048 28519 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.726769 28736 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:14.721261 28719 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:10:14.750480 28745 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.775262 28240 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.776381 28719 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:14.776782 28719 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:14.723505 28572 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:14.777630 28745 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:14.775621 28736 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.778730 28736 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.780169 28658 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:14.781307 28658 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:14.782171 28719 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.783622 28719 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.771298 28648 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.784965 28735 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:14.754745 28661 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:14.759011 28754 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.786304 28648 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:14.790334 28699 consensus_meta.cc:287] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.534s	user 0.019s	sys 0.001s
I20260709 13:10:14.727057 28521 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.796816 28209 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:14.800102 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:14.801466 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:14.802484 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.803108 23621 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:10:14.723326 28662 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.803548 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:14.804612 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:14.807430 23696 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.814196 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.808185 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:14.805711 23699 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:10:14.817129 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 165135us
I20260709 13:10:14.818053 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:14.820983 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.822392 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:14.770083 28655 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.829667 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.831384 23621 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:14.770433 28725 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:14.809885 28332 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.845188 28725 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.845705 28332 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.846522 28725 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:14.768854 28732 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.770380 28743 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:14.834986 23620 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 7.
I20260709 13:10:14.836050 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:14.836891 28703 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:14.839576 28662 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.840166 28532 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:14.861251 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:14.842264 28519 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:14.842533 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2166) took 2381 ms. Trace:
I20260709 13:10:14.843022 28754 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:14.790839 28699 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:14.843751 28569 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.012s
I20260709 13:10:14.832605 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:14.805081 28739 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.850174 23696 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.813664 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:14.850731 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.872310 23622 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:10:14.851689 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.849684 24385 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:10:14.852349 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:14.853000 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.848737 28240 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:14.751925 28472 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.813259 28693 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:14.834025 28736 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:14.864619 23624 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:14.883746 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.864416 23774 rpcz_store.cc:276] 0709 13:10:12.461518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.603643 (+142125us) service_pool.cc:224] Handling call
0709 13:10:12.604048 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.207016 (+602968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.842275 (+1635259us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b540016bf54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:14.842468 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384417152}
I20260709 13:10:14.868148 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:14.868146 28332 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:14.872728 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.870575 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:14.877051 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.884482 23626 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:14.886206 24359 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:14.886282 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:14.896138 23627 raft_consensus.cc:2410] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:10:14.892899 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.867180 28186 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.902756 28186 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.903470 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:14.904066 24388 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:14.900043 28741 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.905156 28741 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.867003 28754 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:14.884513 28693 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:14.909508 28693 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:14.911131 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 97601.4us
I20260709 13:10:14.911903 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:14.914590 23627 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:14.916010 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:14.918066 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.918886 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.919308 23774 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:14.919503 23772 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 6.
I20260709 13:10:14.920480 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.921092 23776 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:14.925935 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.926576 23772 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:14.926770 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.928006 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.930014 23776 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:14.933050 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.933300 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.934068 23774 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:14.939280 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.942358 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.884047 28736 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:14.943922 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.947918 23774 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:10:14.948894 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.954635 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.900915 28735 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:14.906435 28719 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.922153 28332 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:14.863195 28743 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:14.964164 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 346592us
I20260709 13:10:14.961004 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.910885 28754 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:14.923966 28261 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:14.936903 28569 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:14.952212 28736 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:14.981377 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.986037 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:14.987541 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:14.979099 24388 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:10:14.993127 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.993422 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:14.951814 28753 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.882584 28739 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:14.972597 28332 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.975769 28741 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.076637 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.072955 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.056947 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.065718 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.089947 23770 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:15.091926 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.097534 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.101781 24393 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:14.974503 28719 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:14.974663 28735 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.075584 28332 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.122596 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.123261 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.123927 23774 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 7.
I20260709 13:10:15.124341 23769 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:15.124879 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.125488 23772 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:15.078218 28662 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:15.127085 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:14.984571 28747 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:14.996809 28569 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.130439 23774 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:14.988931 28104 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 13:10:15.120512 28741 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.105314 28765 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:15.127254 28742 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.133980 28634 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.148149 28732 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.136222 28662 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.175072 28732 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:15.152252 28699 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:15.147655 28765 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.180513 28732 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.182516 28732 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.182619 28765 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.179275 28743 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.204797 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.206097 23624 raft_consensus.cc:2410] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:15.208214 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.145280 28741 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.209944 23629 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:15.208956 23626 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:15.211197 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.212431 23628 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:15.214330 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.214470 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.216842 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.218279 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:15.219982 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.222868 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.225260 23628 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:15.228287 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.230348 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.231007 28569 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:15.240357 28761 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:10:15.231045 23622 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:15.241664 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.242340 23622 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:15.243287 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.243487 28739 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:15.244200 28773 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.242468 28763 log.cc:927] Time spent T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:10:15.247437 23629 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:15.151607 28747 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.249153 23622 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:15.202272 28765 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:15.174924 28634 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.225006 28760 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:15.268167 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.269073 23622 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:15.264123 23628 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:15.170457 28742 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.260900 28569 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.244769 28773 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.257819 28589 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.272334 28760 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:15.285277 28630 consensus_meta.cc:287] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.628s	user 0.005s	sys 0.019s
I20260709 13:10:15.289019 28630 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.290273 28760 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.291714 28741 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.296720 24390 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:15.285761 28589 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.300647 28736 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.302470 28589 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.303474 28736 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.310140 28773 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.311604 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.312363 23628 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:15.262496 28765 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.281250 28735 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.284380 28719 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:15.308421 28659 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.642s	user 0.018s	sys 0.000s
I20260709 13:10:15.291476 28630 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.280587 28569 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:15.304853 28693 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:15.328991 28678 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 1.665s	user 0.006s	sys 0.006s
I20260709 13:10:15.333954 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.334699 23628 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:15.339442 23620 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:15.343690 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:15.322393 28659 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.350742 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 920) took 2487 ms. Trace:
I20260709 13:10:15.351707 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.352463 23623 rpcz_store.cc:276] 0709 13:10:12.863871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.864399 (+   528us) service_pool.cc:224] Handling call
0709 13:10:12.864771 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.865202 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.865285 (+    83us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.874943 (+  9658us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.379893 (+504950us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:13.379931 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.380002 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.287193 (+1907191us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:15.349462 (+ 62269us) raft_consensus.cc:1685] finished
0709 13:10:15.349487 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.350666 (+  1179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1521,"raft.queue_time_us":7516,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3644,"spinlock_wait_cycles":9941248,"thread_start_us":487559,"threads_started":1,"wal-append.queue_time_us":729206}
I20260709 13:10:15.363142 28634 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:15.365787 23777 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:15.356854 28775 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:15.360714 28705 consensus_meta.cc:287] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.114s	user 0.011s	sys 0.004s
W20260709 13:10:15.373486 28776 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:10:15.359388 28662 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.377050 28747 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.367823 28775 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:15.382261 28775 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:15.382923 28537 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.383694 28765 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.359576 28773 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:10:15.387418 28773 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:15.387809 28773 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:15.388401 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 636) took 1354 ms. Trace:
I20260709 13:10:15.388592 28773 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.388813 23699 rpcz_store.cc:276] 0709 13:10:14.034361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.135348 (+100987us) service_pool.cc:224] Handling call
0709 13:10:14.135720 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.816686 (+680966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.388089 (+571403us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b5400404f54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:15.388288 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1475239680}
I20260709 13:10:15.392910 28186 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:15.394835 28729 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.952s	user 0.002s	sys 0.001s
I20260709 13:10:15.376129 28705 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.386708 28569 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:15.379218 28742 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.405205 28754 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.410631 28705 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.418519 28750 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:15.419026 28750 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:10:15.406423 28725 consensus_meta.cc:287] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.002s
I20260709 13:10:15.412187 28708 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.415385 28659 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:15.415926 28693 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.433564 28588 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.434338 23776 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:15.422012 28754 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.408314 28775 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.423981 28332 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.445806 28332 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:15.449002 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.419874 28750 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.459658 28750 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:15.460959 23628 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:15.457930 28608 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.461652 28608 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.463366 23628 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:15.458209 28668 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.466338 28608 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:15.466746 28702 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:15.468710 28702 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:15.469986 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:15.470749 23628 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.467171 23622 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:15.486496 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:15.487228 28387 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.487839 28775 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.487352 23622 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:15.501659 28540 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:15.502272 28540 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.469888 28702 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.505808 23743 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:15.510102 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:15.511315 23622 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:15.514530 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.515643 23622 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:15.517513 23622 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:15.506655 28725 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:10:15.512640 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:15.512290 28668 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:10:15.512418 28705 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:15.526821 23628 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:15.530540 23622 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:15.519090 28588 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:15.527035 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:15.527290 28708 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:15.556560 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:15.559114 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2170) took 2975 ms. Trace:
I20260709 13:10:15.560850 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:15.560750 23773 rpcz_store.cc:276] 0709 13:10:12.584085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.643341 (+ 59256us) service_pool.cc:224] Handling call
0709 13:10:12.643747 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.710157 (+1066410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.558903 (+1848746us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400346a54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:15.559058 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428821888}
I20260709 13:10:15.544747 23628 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:15.529497 28705 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.538125 28188 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:10:15.540033 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:15.518962 28745 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.008s	sys 0.027s
I20260709 13:10:15.538664 28186 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:10:15.558109 28488 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.563274 28708 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.564301 28597 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:15.576308 28708 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:15.565984 28712 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:15.566083 28472 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.563347 28705 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.539642 28588 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.588002 28588 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:15.566946 28540 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.549602 28747 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:10:15.568883 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.592043 23778 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:15.534312 28608 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.592185 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.593492 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:15.594259 23622 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:15.571305 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:15.571774 23743 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:15.551258 28668 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:10:15.574388 28186 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:15.574484 28580 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:15.575210 28449 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:15.549125 28781 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:15.529940 28725 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:10:15.578665 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:15.580483 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:15.576373 28597 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:15.604001 23628 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:10:15.572731 28745 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.008s	sys 0.027s
I20260709 13:10:15.599269 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.601611 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:15.603531 28781 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.606612 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:15.607566 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.608181 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:15.608701 23622 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:10:15.608803 23628 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.600345 28186 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:15.591367 28488 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:10:15.612250 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:15.599117 28472 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.600503 28580 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:15.627836 28580 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:15.629156 28580 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.604591 28597 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.632678 28186 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.633951 28186 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:15.635193 28521 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.606446 28712 raft_consensus.cc:2764] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:15.610689 28747 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:15.636106 28472 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.609826 28781 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:15.638448 28472 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.601903 28449 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:15.626189 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:15.640604 23627 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:15.599390 28608 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.635599 28539 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:15.602317 28662 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:10:15.616772 28188 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:15.648480 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:15.643108 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.616528 28540 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:15.644361 28668 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:15.643833 28634 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.656338 28540 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.643024 28618 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:15.652746 28747 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:15.657887 28618 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.658481 28747 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.659391 28608 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:15.659602 28725 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:15.660758 28520 raft_consensus.cc:993] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:15.661190 28520 raft_consensus.cc:1081] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:15.661794 28449 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.644661 28589 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:15.664315 28589 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.664690 28589 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:15.664793 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:15.665390 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.667301 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.668164 23775 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 12: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:15.668978 28733 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:15.669222 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.669507 28733 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.669953 23775 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 6.
I20260709 13:10:15.670679 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:15.670885 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.657377 28634 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.653551 28539 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:15.668077 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:15.615422 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.622967 28705 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.625174 23628 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:10:15.611035 28750 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:10:15.668116 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.693253 23773 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:15.696301 24385 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:15.681357 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.679610 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:15.685070 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.685818 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:15.686933 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44869.5us
I20260709 13:10:15.698316 24387 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.687781 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.702028 23628 raft_consensus.cc:2410] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:15.702937 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.703575 23628 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:10:15.706665 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.714416 23772 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:10:15.719266 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.721153 23743 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:15.722113 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:15.723924 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 117393us
I20260709 13:10:15.671677 28733 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.725479 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:15.726603 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 155372us
I20260709 13:10:15.714181 28775 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:15.672176 28724 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:15.684770 28736 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:15.674225 28634 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:15.729513 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:15.729933 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.734984 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.673388 28597 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.770553 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:15.713907 28725 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:10:15.747543 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:15.732095 28188 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:15.753479 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:15.757292 28705 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:15.674911 28539 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.758993 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:15.762391 28618 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.763553 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:15.731124 28773 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.766564 23628 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:15.767089 23627 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:15.813678 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.814917 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:15.744707 28775 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.779834 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:15.749830 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:15.781122 28781 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.782647 28597 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.789474 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 2695) took 1355 ms. Trace:
I20260709 13:10:15.780723 24357 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:10:15.821527 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 71785.5us
I20260709 13:10:15.821552 23704 rpcz_store.cc:276] 0709 13:10:14.434538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.567591 (+133053us) service_pool.cc:224] Handling call
0709 13:10:15.789275 (+1221684us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b540026bbd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:15.789407 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111647488}
I20260709 13:10:15.791219 28538 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:15.825904 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:15.825675 28577 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:15.826680 28577 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.827093 28577 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.771838 28724 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.833823 28724 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:15.834430 23769 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:15.794688 28686 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:15.796505 24387 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:15.798095 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.801754 23775 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:15.839787 23625 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:15.728379 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:15.804291 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:15.840721 23629 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.807919 24385 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 6.
I20260709 13:10:15.749212 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:15.808816 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.809526 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:15.713778 28708 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:15.811597 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:15.817546 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.586311 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.845811 23628 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
W20260709 13:10:15.849423 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.819907 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.731997 28488 consensus_queue.cc:1059] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:10:15.851641 28488 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:15.792760 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:15.853286 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.854875 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.757972 28588 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:15.825680 28240 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:15.844455 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 116158us
I20260709 13:10:15.844275 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:15.811556 28188 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.850452 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:15.837463 28618 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:15.824677 28775 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.860936 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:15.848477 28686 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:15.863139 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.871914 24386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46566 (request call id 775) took 1240 ms. Trace:
I20260709 13:10:15.890975 24386 rpcz_store.cc:276] 0709 13:10:14.623984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.624109 (+   125us) service_pool.cc:224] Handling call
0709 13:10:15.864077 (+1239968us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b54001a4fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:15.864206 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19162880}
I20260709 13:10:15.892272 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:15.861974 23625 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:15.872315 28188 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.884742 24390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46594 (request call id 831) took 1049 ms. Trace:
I20260709 13:10:15.885641 24394 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:15.893826 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:15.897130 24390 rpcz_store.cc:276] 0709 13:10:14.835671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.835823 (+   152us) service_pool.cc:224] Handling call
0709 13:10:15.884365 (+1048542us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54005dd254. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:15.884641 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019625344}
I20260709 13:10:15.892999 23777 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:15.899279 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:15.852092 28488 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:15.874814 28232 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.904175 23592 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:15.908718 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.872551 28618 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:15.882458 28724 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:15.899312 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:15.905218 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:15.916942 23629 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:15.932307 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:15.937717 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:15.906143 28597 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:15.900098 28785 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:15.913882 28724 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.946023 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:15.900344 28240 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:15.907927 28662 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:15.914465 28618 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.949283 28668 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.943120 28786 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:15.970722 28747 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:15.935874 28765 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:15.930647 28686 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:15.942847 28725 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:15.964385 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:16.005987 23777 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.944132 28472 raft_consensus.cc:2764] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:10:15.947131 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:10:15.994590 28701 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.196s	user 0.068s	sys 0.107s
I20260709 13:10:15.962932 28724 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:15.976599 28786 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.951097 28712 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:10:15.969065 28662 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:16.005170 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 181482us
W20260709 13:10:16.010429 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 63437.2us
I20260709 13:10:16.003484 28765 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.024962 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:16.021425 23593 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.501s (SENT)
I20260709 13:10:16.032382 23593 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:16.026747 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:16.011330 28701 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.228s	user 0.068s	sys 0.107s
I20260709 13:10:16.002759 28747 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:16.005383 28725 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:16.086495 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 65081.7us
I20260709 13:10:16.017212 28785 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:16.083436 28748 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:15.963798 28488 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.018213 28786 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:16.030055 28662 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:16.091540 28788 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:10:16.005203 28589 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.120406 28589 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:16.036464 28765 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:16.095069 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 70175.4us
I20260709 13:10:16.122007 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:16.123327 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:16.124586 28712 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.125178 28712 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:16.093070 28692 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.115870 28597 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:16.126338 28597 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:16.126950 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:16.115437 28472 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.128123 28472 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.128623 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:16.129733 28521 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:16.130522 28472 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:16.130614 28521 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:16.131281 28521 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.131814 28521 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:16.139227 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:16.144397 28521 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:16.145963 28597 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:16.148044 28712 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:16.149783 28732 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:16.150298 28732 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:16.152184 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:16.151374 28732 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.153676 28732 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.154071 28736 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:16.154482 28736 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:16.155272 23625 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:16.156579 23624 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:16.157845 23771 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:16.151494 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:16.089938 28781 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:16.097306 28240 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:16.095829 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 69194.3us
I20260709 13:10:16.161177 24357 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:16.167418 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:16.169246 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:16.149780 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:16.009310 28686 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:16.172396 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.090814 28725 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.159193 23743 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:16.174261 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:16.178077 23772 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:16.158438 28580 consensus_meta.cc:287] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.000s
I20260709 13:10:16.147619 28521 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:16.181038 23770 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:16.174938 28630 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:16.176800 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:16.182879 28521 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:16.183064 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:16.183442 28521 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.184019 28521 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.184113 28589 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:16.184746 28589 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:16.185745 28589 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:16.175393 28752 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:16.188127 28752 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:16.189152 28752 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:16.190258 28752 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:16.182435 28747 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.191784 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:16.181921 28630 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.192652 28630 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.192811 28597 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:16.192181 28747 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.091922 28785 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:16.154873 28736 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.205648 23624 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:16.208565 28789 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:10:16.208858 28186 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:16.165671 28004 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.222641 28004 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.225382 28686 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:16.232769 28702 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.200135 28781 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:16.201925 28708 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:16.221565 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:16.241864 23774 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.238519 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:16.243180 23696 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:16.239645 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:16.240262 23701 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:16.237792 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:16.244903 23699 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:16.233201 28577 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.254400 23777 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:16.262404 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:16.263466 23698 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:16.264664 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:16.269171 23772 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:16.304513 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3039) took 1449 ms. Trace:
I20260709 13:10:16.299968 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:16.300851 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.301014 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.315253 23620 rpcz_store.cc:276] 0709 13:10:14.854681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.854827 (+   146us) service_pool.cc:224] Handling call
0709 13:10:14.855159 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.345394 (+490235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.304106 (+958712us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54003246d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:16.304408 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113243008}
I20260709 13:10:16.319090 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:16.320279 23696 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 13: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:16.297538 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.357395 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 52155.2us
W20260709 13:10:16.360409 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.217523 28724 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.315624 23699 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:16.373543 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:16.374470 23699 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:16.375298 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:16.376025 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:16.376567 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 2337) took 1429 ms. Trace:
I20260709 13:10:16.376034 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:16.272938 23695 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:16.378502 23698 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:16.269838 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:16.379554 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:16.379844 23704 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:16.370791 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:16.242022 28186 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:16.383771 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:16.366662 23701 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:16.377244 23771 rpcz_store.cc:276] 0709 13:10:14.947595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.948566 (+   971us) service_pool.cc:224] Handling call
0709 13:10:16.376362 (+1427796us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000596d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:16.376493 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778213760}
I20260709 13:10:16.381774 23699 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.376986 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:16.202214 28785 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:16.266840 28781 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:16.392612 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:16.396683 28781 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:16.382495 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:16.383917 23774 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:16.386376 23625 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:10:16.376329 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:16.410634 23696 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:16.401369 28708 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:16.416303 28708 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:16.417800 23699 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:16.401536 28240 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:16.420364 28240 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:16.421228 28240 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.422391 28686 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:16.423125 28686 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:10:16.382210 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 420852us
I20260709 13:10:16.402992 23772 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:10:16.426524 23772 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:16.385577 28595 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:10:16.424324 28686 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.428545 28186 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.385779 28261 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:10:16.432329 28261 raft_consensus.cc:3055] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:16.432947 28261 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:16.434144 28261 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:16.432343 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:16.436816 28261 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:16.436338 28765 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.438354 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:16.436425 23629 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:16.439021 23695 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:16.444201 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:16.430685 23772 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:16.400506 23777 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:16.468685 23701 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:16.482893 23774 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 13:10:16.490020 23621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58448 (request call id 926) took 1648 ms (client timeout 2051 ms). Trace:
W20260709 13:10:16.490658 23621 rpcz_store.cc:269] 0709 13:10:14.820503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.820704 (+   201us) service_pool.cc:224] Handling call
0709 13:10:16.469014 (+1648310us) spinlock_profiling.cc:243] Waited 9.67 ms on lock 0x7b54000dc0d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:16.469142 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22240000}
I20260709 13:10:16.491453 28577 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:16.467630 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.269665 28352 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.181s
W20260709 13:10:16.564625 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 469194us
W20260709 13:10:16.551591 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 55167.6us
W20260709 13:10:16.587679 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.537216 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:16.589115 23699 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
W20260709 13:10:16.578293 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.543558 23775 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:16.603006 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:16.655776 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:16.657366 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:16.659122 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 56250.9us
I20260709 13:10:16.681612 23621 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:16.692466 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:16.693540 23775 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.593530 28472 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:16.682709 28692 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:16.449524 23696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:10:16.726014 23695 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:16.721839 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:16.729964 23629 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
W20260709 13:10:16.737916 28773 consensus_meta.cc:287] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.917s	user 0.013s	sys 0.010s
W20260709 13:10:16.712491 28589 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.001s	sys 0.021s
W20260709 13:10:16.747076 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.774809 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.776041 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:16.682961 28638 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:10:16.700558 28708 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:16.778260 28589 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.001s	sys 0.025s
W20260709 13:10:16.778995 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 57297.9us
I20260709 13:10:16.694940 28634 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:10:16.781481 28695 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:16.801151 28725 consensus_meta.cc:287] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.598s	user 0.027s	sys 0.027s
W20260709 13:10:16.741792 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 155081us
W20260709 13:10:16.816495 23702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.026s	sys 0.040s
W20260709 13:10:16.781744 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 311695us
I20260709 13:10:16.729318 28472 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:16.786739 23695 raft_consensus.cc:2376] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13. Re-sending same reply.
I20260709 13:10:16.823791 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:16.782986 24389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 716) took 1030 ms. Trace:
W20260709 13:10:16.821377 23593 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.013s	sys 0.054s
W20260709 13:10:16.819720 23702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.026s	sys 0.040s
W20260709 13:10:16.829799 23593 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.013s	sys 0.054s
W20260709 13:10:16.831283 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 572693us
I20260709 13:10:16.833814 23775 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:16.835191 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:16.836032 23775 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:16.832003 23667 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:16.858721 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.862551 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:16.825249 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:16.865180 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:16.882438 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.815169 28352 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:16.860157 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.898185 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:16.859316 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.826690 28634 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:16.828478 24389 rpcz_store.cc:276] 0709 13:10:15.752366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.754409 (+  2043us) service_pool.cc:224] Handling call
0709 13:10:15.754748 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.755053 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:16.020235 (+265182us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.782602 (+762367us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.782665 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:16.782722 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.782793 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.782923 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":417632,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1682,"raft.queue_time_us":230402,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":49192,"thread_start_us":1022851,"threads_started":3,"wal-append.queue_time_us":672927}
W20260709 13:10:16.845374 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.849032 28662 consensus_meta.cc:287] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.011s
I20260709 13:10:16.818132 28725 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:16.942385 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:16.849288 28521 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.013s
I20260709 13:10:16.900581 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.937706 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.813244 28804 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:10:16.951685 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.952099 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.952673 24385 raft_consensus.cc:2410] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:16.952874 24388 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:16.953349 24393 raft_consensus.cc:2393] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:16.890348 28595 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:16.964083 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.898869 28765 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:16.871614 28519 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:16.968187 24392 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:16.967031 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:16.962081 28758 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.883s	user 0.009s	sys 0.006s
I20260709 13:10:16.890105 28517 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:16.841073 28724 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:16.961319 28795 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.282s	user 0.001s	sys 0.001s
I20260709 13:10:16.978185 24391 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:16.967033 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:16.984406 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:16.985948 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:16.958832 28572 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.959582 28816 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.997570 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.957120 28532 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.002013 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:16.968365 28595 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.005057 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:16.982786 28799 log.cc:927] Time spent T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 13:10:16.987537 28188 consensus_meta.cc:287] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.076s	user 0.011s	sys 0.046s
I20260709 13:10:16.960646 28521 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:16.945546 28662 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:16.992380 28732 consensus_meta.cc:287] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.838s	user 0.008s	sys 0.015s
I20260709 13:10:16.966365 28692 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:16.945291 28634 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:17.007043 28801 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.233s	user 0.001s	sys 0.001s
W20260709 13:10:16.988574 28785 consensus_meta.cc:287] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.011s
I20260709 13:10:17.028451 28595 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:17.025981 28517 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:17.033296 28796 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:17.042266 28798 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
W20260709 13:10:17.043430 28802 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:10:17.023378 28572 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.028620 28532 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.054961 28796 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:17.066399 28630 consensus_meta.cc:287] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.873s	user 0.021s	sys 0.005s
I20260709 13:10:17.067126 28532 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:17.056816 28806 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:10:17.038357 28785 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.026841 28816 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:17.065526 28786 consensus_meta.cc:287] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.892s	user 0.000s	sys 0.011s
I20260709 13:10:17.069608 28796 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.036536 28811 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:10:17.061852 28634 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:17.073266 28811 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:17.073689 28811 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:17.074544 28811 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:17.075048 28816 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:17.075523 28618 consensus_meta.cc:287] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 1.097s	user 0.016s	sys 0.008s
I20260709 13:10:17.064548 28572 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.076048 28618 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:17.077080 28692 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:17.079046 28618 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:17.062217 28775 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.168s	user 0.011s	sys 0.002s
I20260709 13:10:17.081845 28775 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.075893 28786 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.086320 28786 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.088413 28775 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.093380 28662 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.103799 28588 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:17.104090 28765 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:17.104714 28765 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:17.105983 28752 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.915s	user 0.010s	sys 0.005s
I20260709 13:10:17.105783 28765 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:17.108868 28736 consensus_meta.cc:287] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.881s	user 0.007s	sys 0.004s
I20260709 13:10:17.109421 28736 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:17.110822 28805 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.280s	user 0.001s	sys 0.001s
I20260709 13:10:17.112023 28725 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:17.114709 28785 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.107402 28765 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.115774 28811 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:17.122018 28790 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.676s	user 0.001s	sys 0.000s
I20260709 13:10:17.122949 28773 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:17.123369 28773 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:17.124189 28773 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.125512 28773 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:17.063324 28668 consensus_meta.cc:287] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.091s	user 0.006s	sys 0.006s
W20260709 13:10:17.138818 28791 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 1.046s	user 0.000s	sys 0.003s
W20260709 13:10:17.144927 28747 consensus_meta.cc:287] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.951s	user 0.009s	sys 0.002s
I20260709 13:10:17.147435 28736 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:17.203783 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.206295 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3068) took 1438 ms. Trace:
I20260709 13:10:17.208709 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3066) took 1507 ms. Trace:
I20260709 13:10:17.209378 23701 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:17.209720 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 336972us
I20260709 13:10:17.211396 23700 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:17.212478 23696 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.213286 23696 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:17.213120 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:17.213519 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:17.214470 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.214648 23626 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:17.215123 23702 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:17.216502 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.206974 23623 rpcz_store.cc:276] 0709 13:10:15.767933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.902328 (+134395us) service_pool.cc:224] Handling call
0709 13:10:15.902724 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.909760 (+  7036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.909807 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.910372 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:10:16.250665 (+340293us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:16.250714 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.250794 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.205621 (+954827us) raft_consensus.cc:1685] finished
0709 13:10:17.205697 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.206080 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8271,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":17275,"thread_start_us":339944,"threads_started":1,"wal-append.queue_time_us":628458}
I20260709 13:10:17.000411 24385 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:17.237169 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:17.238281 24389 raft_consensus.cc:2376] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12. Re-sending same reply.
I20260709 13:10:17.240383 24390 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:17.241768 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:17.038946 28188 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.248589 23773 raft_consensus.cc:2368] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10.
I20260709 13:10:17.248991 28472 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:17.249243 28517 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.253513 28188 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:17.254374 28521 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.254781 28188 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:17.218302 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.219707 23703 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:17.233992 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 229615us
I20260709 13:10:17.219630 23704 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:17.209326 23628 rpcz_store.cc:276] 0709 13:10:15.700965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.848022 (+147057us) service_pool.cc:224] Handling call
0709 13:10:15.848443 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:15.849022 (+   579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.849065 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:15.856916 (+  7851us) log.cc:844] Serialized 52 byte log entry
0709 13:10:16.250069 (+393153us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:16.250139 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.250243 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.207990 (+957747us) raft_consensus.cc:1685] finished
0709 13:10:17.208036 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.208451 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":633,"raft.run_wall_time_us":9732,"thread_start_us":340381,"threads_started":1,"wal-append.queue_time_us":665345}
I20260709 13:10:17.066901 28630 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:17.308139 24393 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:17.309494 28630 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:17.310606 28597 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.117s	user 0.026s	sys 0.002s
I20260709 13:10:17.311266 28597 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:17.314155 28702 consensus_meta.cc:287] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.081s	user 0.015s	sys 0.010s
I20260709 13:10:17.318671 24359 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:17.332976 23624 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:17.340179 28773 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:17.341080 28773 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:17.340364 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.350129 23626 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:17.256022 28188 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:17.343532 28773 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:17.369199 23623 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:10:17.374013 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55617.2us
I20260709 13:10:17.142539 28668 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.383174 28736 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.384325 28736 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:17.386214 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.386531 28765 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:17.344386 23593 leader_election.cc:336] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.591s (SENT)
I20260709 13:10:17.403498 28532 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.404470 28532 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.405973 28811 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:17.406529 28811 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.406940 28811 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.407694 23697 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:17.409197 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 65334.8us
I20260709 13:10:17.407042 28752 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.412708 28752 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:17.417380 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.417677 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.418010 28702 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.418732 28702 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.416918 28752 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.387686 28736 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:17.420794 23702 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:17.421201 28702 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.387579 28765 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.424939 28765 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.429297 23696 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.429659 28695 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:17.434223 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 2711) took 1195 ms. Trace:
I20260709 13:10:17.434702 23700 rpcz_store.cc:276] 0709 13:10:16.239268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.239393 (+   125us) service_pool.cc:224] Handling call
0709 13:10:17.433954 (+1194561us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400357ad4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:17.434137 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2221430528}
I20260709 13:10:17.435824 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:17.436932 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:17.437438 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 97817.4us
I20260709 13:10:17.439105 28580 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:17.440721 28742 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:17.406945 28532 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:17.441870 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:17.443003 28762 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.443871 28762 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.446508 28762 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:17.443557 28742 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:17.448374 28773 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.449316 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2349) took 1703 ms. Trace:
I20260709 13:10:17.449477 28773 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:17.449855 23774 rpcz_store.cc:276] 0709 13:10:15.745595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.410597 (+665002us) service_pool.cc:224] Handling call
0709 13:10:16.410975 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.483928 (+ 72953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.448628 (+964700us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b54001cb454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:17.449052 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164600704}
I20260709 13:10:17.451176 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1063) took 1279 ms. Trace:
I20260709 13:10:17.449719 28742 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.451632 23778 rpcz_store.cc:276] 0709 13:10:16.171299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.995469 (+824170us) service_pool.cc:224] Handling call
0709 13:10:17.224625 (+229156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.225342 (+   717us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:17.226014 (+   672us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.447770 (+221756us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.450656 (+  2886us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:17.450708 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.450785 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.450910 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71023,"prepare.queue_time_us":50816,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":13688,"thread_start_us":146716,"threads_started":1}
W20260709 13:10:17.453672 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 452879us
I20260709 13:10:17.455142 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 715) took 1703 ms. Trace:
I20260709 13:10:17.455621 24394 rpcz_store.cc:276] 0709 13:10:15.751973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.753900 (+  1927us) service_pool.cc:224] Handling call
0709 13:10:15.885324 (+131424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.898339 (+ 13015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.454640 (+1556301us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54005dd250. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:17.454907 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301282688}
I20260709 13:10:17.462726 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:17.443558 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:17.467180 28232 consensus_meta.cc:287] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.552s	user 0.014s	sys 0.008s
I20260709 13:10:17.468017 23622 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:17.468833 28718 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.469573 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:17.467986 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:17.469348 28718 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.463843 23668 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:17.443063 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:17.480165 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:17.481199 23621 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:17.481413 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:17.451716 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:17.483170 23774 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:17.469348 28188 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:17.485242 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:17.486424 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:17.487982 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:17.489176 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.489248 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:17.489923 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.490495 28589 consensus_queue.cc:1059] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:17.491171 23623 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:10:17.487612 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:17.483438 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:17.498020 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:17.471902 23778 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:17.493546 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:17.494308 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:17.491972 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:17.513115 23698 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.006s	sys 0.007s
W20260709 13:10:17.513656 23698 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.006s	sys 0.007s
W20260709 13:10:17.513787 24391 consensus_meta.cc:287] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.007s
I20260709 13:10:17.514401 24391 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:17.491716 28589 raft_consensus.cc:3055] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:17.511547 23624 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:17.606453 28188 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.606909 28352 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.518791 28765 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:17.522485 23775 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:17.607494 28188 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:17.607816 28352 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.609097 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:17.609942 28352 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:17.528851 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 65267us
I20260709 13:10:17.523238 23623 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:17.601418 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:17.529891 23699 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.012s	sys 0.024s
W20260709 13:10:17.528779 23772 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.004s	sys 0.008s
I20260709 13:10:17.492071 28580 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.598255 28261 consensus_meta.cc:287] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.161s	user 0.020s	sys 0.016s
I20260709 13:10:17.612425 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:17.624755 23772 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.009s	sys 0.009s
W20260709 13:10:17.623853 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 180961us
I20260709 13:10:17.610812 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:17.620479 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.618018 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:17.618099 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2710) took 1379 ms. Trace:
I20260709 13:10:17.613615 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:17.633157 23628 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:17.659667 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:17.635866 23703 rpcz_store.cc:276] 0709 13:10:16.238962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.239066 (+   104us) service_pool.cc:224] Handling call
0709 13:10:16.239330 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.291939 (+1052609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.617790 (+325851us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b540015e854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:17.618014 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2252527360}
I20260709 13:10:17.659436 23620 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.671515 24386 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:17.672340 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2730) took 1233 ms. Trace:
I20260709 13:10:17.674093 28708 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:17.674220 28811 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:17.676093 28595 consensus_meta.cc:287] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.622s	user 0.018s	sys 0.007s
I20260709 13:10:17.676587 28595 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:17.678889 28595 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:17.680325 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:17.681324 23629 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 8: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:17.682471 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:17.683401 23629 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:17.684120 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:17.685002 23778 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:17.685978 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:17.687206 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:17.688663 28846 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:17.688561 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:17.689589 23628 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:17.688364 28532 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:10:17.690331 28732 raft_consensus.cc:2764] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:17.690562 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:17.691540 23628 raft_consensus.cc:2410] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:10:17.691255 28580 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.693205 28532 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.695245 28799 log.cc:927] Time spent T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.112s	user 0.006s	sys 0.007s
I20260709 13:10:17.728577 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:17.696131 23774 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:17.729689 28668 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.735112 28580 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:17.697376 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2706) took 1459 ms. Trace:
I20260709 13:10:17.698206 28765 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:17.701213 23627 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:10:17.702806 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:17.703763 28702 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.704321 28232 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.704457 24385 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:17.616832 28589 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:17.705713 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:17.706295 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.706622 23769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 2189) took 2039 ms (client timeout 1844 ms). Trace:
W20260709 13:10:17.707958 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 94524.7us
I20260709 13:10:17.709740 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.710785 23777 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:17.712608 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.713223 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:17.754954 24392 raft_consensus.cc:2410] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:17.713795 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.611689 28188 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:17.610289 28517 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.724216 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:17.756943 23623 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:17.724915 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:17.740612 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 82154.3us
I20260709 13:10:17.736123 23697 rpcz_store.cc:276] 0709 13:10:16.237700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.238421 (+   721us) service_pool.cc:224] Handling call
0709 13:10:16.238765 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.408296 (+1169531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.696884 (+288588us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003b3154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:17.697304 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2642260352}
I20260709 13:10:17.744140 23743 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:17.752028 23775 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:17.759600 23702 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:17.753211 23769 rpcz_store.cc:269] 0709 13:10:15.666858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.680329 (+ 13471us) service_pool.cc:224] Handling call
0709 13:10:17.706250 (+2025921us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54002cb0d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:17.706410 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313635712}
I20260709 13:10:17.760710 23620 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:17.764067 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2121) took 1016 ms. Trace:
I20260709 13:10:17.765396 23743 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:17.764487 23702 rpcz_store.cc:276] 0709 13:10:16.747511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.709404 (+961893us) service_pool.cc:224] Handling call
0709 13:10:17.764004 (+ 54600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.771284 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:17.775398 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 72810.4us
I20260709 13:10:17.777760 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:17.782064 23592 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:17.785029 28811 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:17.785837 28004 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:17.786772 23667 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:17.787283 28732 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:17.787837 28732 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.788303 28732 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:17.789426 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2350) took 2042 ms. Trace:
I20260709 13:10:17.791154 28488 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.789851 23771 rpcz_store.cc:276] 0709 13:10:15.746643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.420715 (+674072us) service_pool.cc:224] Handling call
0709 13:10:16.421078 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:16.826957 (+405879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.827000 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:17.444799 (+617799us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b2c0012bcd8. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:10:17.445555 (+   756us) log.cc:844] Serialized 52 byte log entry
0709 13:10:17.654505 (+208950us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:17.662616 (+  8111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.720262 (+ 57646us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.788860 (+ 68598us) raft_consensus.cc:1685] finished
0709 13:10:17.788885 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.789233 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8993,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":8128896,"thread_start_us":586525,"threads_started":2,"wal-append.queue_time_us":315880}
I20260709 13:10:17.792193 28765 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.795608 28744 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.795924 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:17.796213 28517 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:17.796775 28517 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:17.796424 28744 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:17.797188 28517 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:17.797482 28563 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.798310 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.799254 23701 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:17.800433 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.801262 23701 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:17.801997 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2127) took 1052 ms. Trace:
I20260709 13:10:17.802383 23701 rpcz_store.cc:276] 0709 13:10:16.749444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.800001 (+1050557us) service_pool.cc:224] Handling call
0709 13:10:17.801944 (+  1943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.804144 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.803877 28232 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:17.805083 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2131) took 1054 ms. Trace:
I20260709 13:10:17.788501 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:17.796978 23702 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:17.805569 23697 rpcz_store.cc:276] 0709 13:10:16.750688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.777241 (+1026553us) service_pool.cc:224] Handling call
0709 13:10:17.804993 (+ 27752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.789781 28747 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:17.806761 28747 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.768245 28742 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:17.807277 28232 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:17.819766 28520 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:17.810209 28744 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:17.808197 28781 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.808293 28589 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.809273 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:17.809428 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:17.788126 23700 raft_consensus.cc:2368] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:10:17.788192 23592 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:17.813113 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:17.816028 23622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 2187) took 2233 ms (client timeout 2245 ms). Trace:
I20260709 13:10:17.816915 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2206) took 1276 ms. Trace:
I20260709 13:10:17.777077 28702 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.818801 28718 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.820334 28520 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:10:17.821456 23773 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 2197) took 2089 ms (client timeout 1707 ms). Trace:
I20260709 13:10:17.807524 28742 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:17.852240 23773 rpcz_store.cc:269] 0709 13:10:15.731621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.732194 (+   573us) service_pool.cc:224] Handling call
0709 13:10:17.821196 (+2089002us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540014f854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:17.821383 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3232635264}
I20260709 13:10:17.854243 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2120) took 1103 ms. Trace:
W20260709 13:10:17.848989 23622 rpcz_store.cc:269] 0709 13:10:15.582859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.706240 (+123381us) service_pool.cc:224] Handling call
0709 13:10:17.815759 (+2109519us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54000654d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:17.815932 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3954318208}
I20260709 13:10:17.854907 23700 rpcz_store.cc:276] 0709 13:10:16.747163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.712214 (+965051us) service_pool.cc:224] Handling call
0709 13:10:17.850305 (+138091us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.803638 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.823170 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:17.806509 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.806596 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.857139 23697 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:17.763398 28532 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.762120 28580 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:10:17.832932 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44831.7us
I20260709 13:10:17.832686 23703 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:17.859669 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:17.860846 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2119) took 1114 ms. Trace:
I20260709 13:10:17.830094 28708 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:17.850778 23774 rpcz_store.cc:276] 0709 13:10:16.540720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.815313 (+1274593us) service_pool.cc:224] Handling call
0709 13:10:17.815961 (+   648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.816449 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.816482 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.816541 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:17.816605 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.816682 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.816830 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.853485 28589 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:17.850107 28232 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:17.807320 28747 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:17.859177 23702 raft_consensus.cc:2368] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
I20260709 13:10:17.856518 24385 raft_consensus.cc:2376] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15. Re-sending same reply.
I20260709 13:10:17.865767 28232 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.869012 28232 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.871830 23769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1066) took 1019 ms. Trace:
I20260709 13:10:17.872406 23769 rpcz_store.cc:276] 0709 13:10:16.844472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.859623 (+1015151us) service_pool.cc:224] Handling call
0709 13:10:17.860125 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.863833 (+  3708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.863867 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.863910 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:17.863940 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.863997 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.864117 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.874732 23769 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:10:17.876194 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.861382 23703 rpcz_store.cc:276] 0709 13:10:16.746875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.724542 (+977667us) service_pool.cc:224] Handling call
0709 13:10:17.860785 (+136243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.843622 28540 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:17.807178 28472 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:17.866252 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 148506us
I20260709 13:10:17.864179 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2720) took 1540 ms. Trace:
I20260709 13:10:17.767002 28521 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:17.877429 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.857213 28742 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:17.895264 23700 raft_consensus.cc:2368] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:10:17.878831 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2122) took 1131 ms. Trace:
I20260709 13:10:17.895955 23702 rpcz_store.cc:276] 0709 13:10:16.747845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.806150 (+1058305us) service_pool.cc:224] Handling call
0709 13:10:17.878771 (+ 72621us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.832214 28668 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.867053 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:17.884774 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.886214 28332 raft_consensus.cc:3055] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:17.880442 23698 rpcz_store.cc:276] 0709 13:10:16.319879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.380508 (+ 60629us) service_pool.cc:224] Handling call
0709 13:10:16.380771 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.380968 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:17.514247 (+1133279us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.776045 (+261798us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.783563 (+  7518us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:17.822976 (+ 39413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.844217 (+ 21241us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.860486 (+ 16269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6010,"prepare.queue_time_us":586670,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":6838,"raft.queue_time_us":13881,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":9818,"spinlock_wait_cycles":52164992,"thread_start_us":1293248,"threads_started":2,"wal-append.queue_time_us":268590}
I20260709 13:10:17.892724 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1064) took 1072 ms. Trace:
I20260709 13:10:17.893666 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:17.894310 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.907604 23696 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.906929 23703 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:17.909533 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:17.911204 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:17.906924 23778 rpcz_store.cc:276] 0709 13:10:16.820825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.864576 (+1043751us) service_pool.cc:224] Handling call
0709 13:10:17.880597 (+ 16021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.892199 (+ 11602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.892242 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.892322 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:17.892376 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.892476 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.892621 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225536}
I20260709 13:10:17.913707 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:17.913933 28240 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.917776 23778 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:17.916674 28240 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.880095 28472 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:17.843444 28781 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:17.917192 23703 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:17.923930 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.926797 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:17.929512 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:17.860167 28520 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.930519 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:17.938182 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.906605 28332 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:17.941761 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.927078 28472 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:17.945809 28668 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.946435 28532 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:17.948436 28668 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:17.952109 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 99734.4us
I20260709 13:10:17.953109 23742 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:17.955821 23775 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:17.957137 28702 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:17.958010 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.958921 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2133) took 1207 ms. Trace:
I20260709 13:10:17.959286 23698 rpcz_store.cc:276] 0709 13:10:16.751315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.936824 (+1185509us) service_pool.cc:224] Handling call
0709 13:10:17.958856 (+ 22032us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.960515 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.961517 23698 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:17.962037 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2124) took 1213 ms. Trace:
I20260709 13:10:17.962416 23698 rpcz_store.cc:276] 0709 13:10:16.748532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.960026 (+1211494us) service_pool.cc:224] Handling call
0709 13:10:17.961963 (+  1937us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.932387 28521 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:17.937595 28775 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.672912 23699 rpcz_store.cc:276] 0709 13:10:16.438801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.591499 (+152698us) service_pool.cc:224] Handling call
0709 13:10:16.591877 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.592117 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:16.873381 (+281264us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.671749 (+798368us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.671864 (+   115us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:17.671982 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.672061 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.672266 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":435891,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":28146,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":206,"thread_start_us":824727,"threads_started":2,"wal-append.queue_time_us":590128}
I20260709 13:10:17.957235 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:17.966447 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 67765.6us
I20260709 13:10:17.968350 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45072 (request call id 2725) took 1493 ms. Trace:
I20260709 13:10:17.978860 23696 rpcz_store.cc:276] 0709 13:10:16.437151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.443891 (+  6740us) service_pool.cc:224] Handling call
0709 13:10:17.886112 (+1442221us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54000898d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41303a3d 00007f2b462d3cd0 00007f2b3f858254 00007f2b3f8581e2 00007f2b3f858111 00007f2b3f85808c 00007f2b3f857342 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:17.930976 (+ 44864us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120886656}
I20260709 13:10:17.963703 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.975322 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:17.973955 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:18.009325 23698 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:18.012615 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2126) took 1263 ms. Trace:
I20260709 13:10:18.013083 23698 rpcz_store.cc:276] 0709 13:10:16.749136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.963330 (+1214194us) service_pool.cc:224] Handling call
0709 13:10:18.012545 (+ 49215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.012141 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2135) took 1119 ms. Trace:
I20260709 13:10:18.011642 23701 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:18.015766 23702 rpcz_store.cc:276] 0709 13:10:16.892589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.896648 (+1004059us) service_pool.cc:224] Handling call
0709 13:10:18.012070 (+115422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.017356 23778 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:18.019480 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.016630 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2139) took 1067 ms. Trace:
I20260709 13:10:18.021018 23699 rpcz_store.cc:276] 0709 13:10:16.948982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.974987 (+1026005us) service_pool.cc:224] Handling call
0709 13:10:18.016557 (+ 41570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.024225 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:18.025801 23593 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:17.969990 28744 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:17.965735 28781 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:18.028263 28744 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.028765 28781 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:17.976032 28813 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.030918 28781 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:17.966998 28521 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.028792 28744 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.028007 28702 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:18.022174 23769 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:18.039506 23700 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.034909 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:17.970955 28692 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.028009 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:18.043157 28733 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.044435 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:18.045135 24394 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:18.046614 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 649) took 1311 ms. Trace:
I20260709 13:10:18.047003 23700 rpcz_store.cc:276] 0709 13:10:16.746042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.942963 (+1196921us) service_pool.cc:224] Handling call
0709 13:10:18.046557 (+103594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.052320 24387 raft_consensus.cc:2410] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:10:17.968583 28472 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:18.063112 23696 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:18.031579 28781 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.101182 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:18.101085 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2731) took 1637 ms. Trace:
I20260709 13:10:18.104215 23696 rpcz_store.cc:276] 0709 13:10:16.439096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.018799 (+1579703us) service_pool.cc:224] Handling call
0709 13:10:18.052484 (+ 33685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.076466 (+ 23982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.076733 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.031790 28232 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:17.955840 28332 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:18.111285 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:17.982075 28775 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.140322 28332 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.113322 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:18.118525 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1062) took 1948 ms. Trace:
I20260709 13:10:18.119177 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 646) took 1679 ms. Trace:
I20260709 13:10:18.126502 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:18.144409 23774 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 7: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:18.144063 23772 rpcz_store.cc:276] 0709 13:10:16.170558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.540874 (+370316us) service_pool.cc:224] Handling call
0709 13:10:16.542401 (+  1527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.542805 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:17.715254 (+1172449us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.110904 (+395650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.110993 (+    89us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:18.111091 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.111215 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.118443 (+  7228us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":434040,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":22,"raft.queue_time_us":16009,"thread_start_us":1288791,"threads_started":2}
I20260709 13:10:18.145675 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.146437 23774 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
W20260709 13:10:18.146059 28701 consensus_queue.cc:1175] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" responder_term: 14 status { last_received { term: 13 index: 12 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:18.148415 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.144167 23701 rpcz_store.cc:276] 0709 13:10:16.439690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.034348 (+1594658us) service_pool.cc:224] Handling call
0709 13:10:18.102062 (+ 67714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.118773 (+ 16711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.118801 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.118854 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:18.118899 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.118972 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.119109 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.151290 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2132) took 1400 ms. Trace:
I20260709 13:10:18.128295 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:18.152658 28580 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.153209 28580 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:18.153651 28781 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:18.156291 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.055433 28488 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:18.173626 28793 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:18.143546 28775 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:18.115556 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 141766us
I20260709 13:10:18.174381 28793 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:18.177098 28847 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:10:18.158421 23700 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:18.178892 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2125) took 1430 ms. Trace:
I20260709 13:10:18.179317 23700 rpcz_store.cc:276] 0709 13:10:16.748827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.047834 (+1299007us) service_pool.cc:224] Handling call
0709 13:10:18.158241 (+110407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.178647 (+ 20406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.178835 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.155431 28580 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:18.151678 23701 rpcz_store.cc:276] 0709 13:10:16.750996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.150181 (+1399185us) service_pool.cc:224] Handling call
0709 13:10:18.150601 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.150891 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.150917 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.150959 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:18.150992 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.151060 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.151203 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.184602 23769 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8.
I20260709 13:10:18.189234 23700 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:18.189069 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:18.190510 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.194120 28472 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:18.194931 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:18.195966 23592 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:18.201529 24387 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:18.202821 28858 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:18.203540 28858 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.205960 28858 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.197044 28488 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:18.207067 28488 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:18.212375 23701 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:18.216045 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:18.217986 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.218640 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.201529 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.218325 24394 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:18.226709 23700 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:10:18.229223 23696 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:18.230193 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2130) took 1479 ms. Trace:
I20260709 13:10:18.230614 23696 rpcz_store.cc:276] 0709 13:10:16.750372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.118159 (+1367787us) service_pool.cc:224] Handling call
0709 13:10:18.200834 (+ 82675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.229868 (+ 29034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.230118 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.216109 28240 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.209761 28488 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:18.158073 28517 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.248433 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:18.250032 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:18.251401 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:18.251602 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 392061us
I20260709 13:10:18.195047 28702 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:10:18.260629 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.259856 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 647) took 1688 ms. Trace:
I20260709 13:10:18.264876 23697 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:18.262399 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:18.262495 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.267354 23774 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:18.264055 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.267771 23774 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:18.273183 23774 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.274435 23774 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.275712 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:18.259402 28597 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:18.262535 23702 rpcz_store.cc:276] 0709 13:10:16.565580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.027451 (+1461871us) service_pool.cc:224] Handling call
0709 13:10:18.027887 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.028170 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:18.028483 (+   313us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.253521 (+225038us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.253584 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:18.253633 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.253735 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.253846 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3654,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":4518,"raft.queue_time_us":7059,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":4872,"thread_start_us":216997,"threads_started":1}
I20260709 13:10:18.265798 28793 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.284333 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.251351 28747 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.283938 23772 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:10:18.286940 28638 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:18.287034 28449 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.290594 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.294965 28352 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:18.302430 23667 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:18.295666 28638 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.305382 28862 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:18.308084 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 190819us
I20260709 13:10:18.279992 28589 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:10:18.305699 28638 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.312197 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.312249 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.314662 23701 raft_consensus.cc:2410] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:10:18.316164 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:18.309435 28232 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:18.311036 28668 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:18.324620 23700 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:18.327152 23696 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:18.315526 28862 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:18.331528 24393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46594 (request call id 842) took 1330 ms (client timeout 1760 ms). Trace:
W20260709 13:10:18.332073 24393 rpcz_store.cc:269] 0709 13:10:17.001350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.001650 (+   300us) service_pool.cc:224] Handling call
0709 13:10:18.331254 (+1329604us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540035e154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:18.331448 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650012032}
I20260709 13:10:18.332762 28862 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.320592 28352 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:18.300671 28597 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.339392 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.340750 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.340173 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.342839 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.343333 23700 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:18.327099 28668 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.341527 23778 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
W20260709 13:10:18.338909 28732 consensus_meta.cc:287] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.007s
I20260709 13:10:18.348425 28813 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.349103 28813 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.347559 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:18.356875 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.351454 28813 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:18.359077 23700 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.360059 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.347261 28668 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.362005 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.360888 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:18.362690 28539 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:18.358549 28517 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.369899 23696 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.370050 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:18.373255 28352 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:18.379372 23703 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:18.383904 23700 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:18.373241 28861 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.089s	user 0.001s	sys 0.001s
W20260709 13:10:18.387061 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 49272.1us
I20260709 13:10:18.355062 28732 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.389856 28829 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:10:18.382447 28793 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:18.393415 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1061) took 2223 ms. Trace:
I20260709 13:10:18.395109 23742 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:18.394850 23777 rpcz_store.cc:276] 0709 13:10:16.170206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.455299 (+285093us) service_pool.cc:224] Handling call
0709 13:10:17.710298 (+1254999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.766398 (+ 56100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.393209 (+626811us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002cb0d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:18.393355 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2885099904}
I20260709 13:10:18.399050 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.399142 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.399431 28597 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.400039 23695 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.401451 28701 consensus_queue.cc:1059] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:10:18.407227 28701 raft_consensus.cc:3055] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:18.396588 28747 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:18.407589 28701 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:18.408890 28701 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:18.410157 28701 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.413587 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.414155 28668 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.414762 23695 raft_consensus.cc:2376] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12. Re-sending same reply.
I20260709 13:10:18.415549 23701 raft_consensus.cc:2368] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11.
I20260709 13:10:18.415777 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.417025 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.417397 28668 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.417654 23695 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:18.418947 24386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 834) took 1474 ms. Trace:
I20260709 13:10:18.419373 24386 rpcz_store.cc:276] 0709 13:10:16.944356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.945992 (+  1636us) service_pool.cc:224] Handling call
0709 13:10:17.528102 (+582110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.672122 (+144020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.418685 (+746563us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b540089dad0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:18.418881 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269614848}
I20260709 13:10:18.421432 28744 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:18.422827 23775 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:18.409345 28520 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.424222 28829 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:18.405611 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.394749 28793 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:18.426766 23700 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.430541 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:18.429283 28232 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:18.434245 28232 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.437013 23623 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:10:18.439213 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.440904 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.441598 23700 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:18.442533 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:18.444365 23770 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 2198) took 2711 ms (client timeout 1912 ms). Trace:
I20260709 13:10:18.445101 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:18.448959 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:18.450331 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 57600.7us
I20260709 13:10:18.451498 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:18.454556 23742 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:18.448329 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.456101 28829 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:10:18.444821 23770 rpcz_store.cc:269] 0709 13:10:15.732767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.819647 (+ 86880us) service_pool.cc:224] Handling call
0709 13:10:18.444018 (+2624371us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b540016b054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:18.444180 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760918272}
I20260709 13:10:18.478075 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.432139 28793 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.462813 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.480973 23700 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.465521 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:18.481590 23623 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:18.472482 23620 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:18.486168 23695 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.474833 23696 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:18.460813 28732 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.479560 23774 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
W20260709 13:10:18.480672 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.490414 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:18.493974 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:18.494773 23770 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.479260 28829 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.480250 28695 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:18.496775 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:18.498600 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.497822 23624 raft_consensus.cc:2368] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13.
I20260709 13:10:18.500185 23700 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:18.499393 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:18.500464 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.503356 23620 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.499449 28695 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.504508 28695 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.508086 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:18.508754 24393 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.502115 23695 raft_consensus.cc:2376] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12. Re-sending same reply.
I20260709 13:10:18.509868 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:18.512269 28742 consensus_meta.cc:287] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.004s
I20260709 13:10:18.516979 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:18.518361 28733 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.518640 23775 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:18.525027 28744 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:18.526533 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1053) took 2859 ms. Trace:
I20260709 13:10:18.527092 23770 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:18.528821 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.529923 23701 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.529928 28648 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:18.531234 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:18.533949 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.537631 23777 raft_consensus.cc:2410] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:18.540272 23623 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:18.541837 24393 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:18.543951 28742 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.609747 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:18.610462 24386 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.611361 28695 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:18.499600 28829 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:18.544219 28638 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:18.492558 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.578114 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.626612 23771 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:10:18.582599 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.627146 23696 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.544250 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:18.602946 28869 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.067s	user 0.000s	sys 0.009s
I20260709 13:10:18.631455 23695 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.615520 28695 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:18.551415 23701 raft_consensus.cc:2376] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10. Re-sending same reply.
I20260709 13:10:18.618970 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:18.625521 23778 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:18.526988 23776 rpcz_store.cc:276] 0709 13:10:15.666554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.668613 (+  2059us) service_pool.cc:224] Handling call
0709 13:10:15.668933 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:15.669310 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.669338 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:17.452218 (+1782880us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b2c0012bcd8. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:10:17.453110 (+   892us) log.cc:844] Serialized 52 byte log entry
0709 13:10:17.625554 (+172444us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:17.738994 (+113440us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.525389 (+786395us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b18002932c0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b3e221a40 00007f2b3e21c4e4 00007f2b3e21c455 00007f2b44d043c7 00007f2b413169a7 00007f2b413260bf 00007f2b41326038
0709 13:10:18.525645 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.525906 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.526037 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.526087 (+    50us) raft_consensus.cc:1685] finished
0709 13:10:18.526104 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.526264 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":768209,"prepare.queue_time_us":873605,"prepare.run_cpu_time_us":227,"prepare.run_wall_time_us":6835,"raft.queue_time_us":16506,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":15716,"spinlock_wait_cycles":38214656,"thread_start_us":170659,"threads_started":1,"wal-append.queue_time_us":471695}
W20260709 13:10:18.601471 28861 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.067s	user 0.005s	sys 0.001s
W20260709 13:10:18.631037 23697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2136) took 1730 ms (client timeout 2254 ms). Trace:
I20260709 13:10:18.601310 23620 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:10:18.633364 23700 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:10:18.630820 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:18.634567 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:18.664011 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.611436 28742 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:18.641566 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2723) took 2197 ms. Trace:
I20260709 13:10:18.641852 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.642916 28638 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.643271 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:18.648429 24392 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:18.653123 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.633702 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:18.655738 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.661006 23697 rpcz_store.cc:269] 0709 13:10:16.893069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.861945 (+968876us) service_pool.cc:224] Handling call
0709 13:10:18.623055 (+761110us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400131ad4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:18.623181 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820288256}
I20260709 13:10:18.661676 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:18.654853 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:18.668993 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.669934 23704 rpcz_store.cc:276] 0709 13:10:16.436371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.437895 (+  1524us) service_pool.cc:224] Handling call
0709 13:10:16.438341 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.316869 (+878528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.622915 (+1306046us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b5400405454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:18.633287 (+ 10372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1794868352}
I20260709 13:10:18.672246 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.676286 23700 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:18.683854 23625 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:18.684502 23696 raft_consensus.cc:2376] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14. Re-sending same reply.
I20260709 13:10:18.687500 23622 raft_consensus.cc:2393] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:18.685395 23621 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:18.687443 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1065) took 1864 ms. Trace:
I20260709 13:10:18.688964 23628 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:18.692287 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.692363 23627 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:18.696025 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.696689 23697 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.697201 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:18.697239 23696 raft_consensus.cc:2410] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:18.697927 23702 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 7: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.635795 28352 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:10:18.699812 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.702814 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.710762 24386 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:18.713018 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:18.722823 23668 leader_election.cc:336] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Timed out: RequestConsensusVote RPC to 127.21.244.4:36767 timed out after 1.760s (SENT)
I20260709 13:10:18.724478 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.725391 23700 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:18.689216 28232 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.744369 23700 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:10:18.744923 23700 pending_rounds.cc:85] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 6
I20260709 13:10:18.744699 23701 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:18.778185 23621 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:18.745882 23704 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:18.747802 28851 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.080s	user 0.000s	sys 0.006s
I20260709 13:10:18.748790 23628 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
W20260709 13:10:18.749676 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49455.7us
W20260709 13:10:18.753794 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.754371 23743 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:18.754707 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:18.744477 23627 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:18.756228 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:18.757218 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:18.711606 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.758618 28781 consensus_queue.cc:1059] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:18.758700 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:18.761951 28829 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:18.763092 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:18.722916 28868 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:10:18.767181 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.725327 28449 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:18.775159 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:18.830462 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 76182.4us
I20260709 13:10:18.831041 23626 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
W20260709 13:10:18.831910 23626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 3093) took 1363 ms (client timeout 1724 ms). Trace:
I20260709 13:10:18.759552 24359 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:18.688979 23773 rpcz_store.cc:276] 0709 13:10:16.822790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.861852 (+1039062us) service_pool.cc:224] Handling call
0709 13:10:17.878373 (+ 16521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.936539 (+ 58166us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:18.530545 (+594006us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.686316 (+155771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.686379 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:18.687272 (+   893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.687314 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.687399 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":590010,"prepare.queue_time_us":590846,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":11474,"spinlock_wait_cycles":69888,"thread_start_us":144401,"threads_started":1}
W20260709 13:10:18.785218 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.802779 24392 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:18.822387 23628 pending_rounds.cc:85] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 8
I20260709 13:10:18.837244 23628 pending_rounds.cc:107] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:10:18.823415 23622 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.826776 23702 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:18.837736 23628 raft_consensus.cc:2889] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:18.829453 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.776832 23700 pending_rounds.cc:107] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:10:18.843003 23700 raft_consensus.cc:2889] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:18.822862 23623 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
W20260709 13:10:18.832403 23626 rpcz_store.cc:269] 0709 13:10:17.468522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.774754 (+1306232us) service_pool.cc:224] Handling call
0709 13:10:18.831829 (+ 57075us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:18.826541 28859 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.496s	user 0.006s	sys 0.000s
I20260709 13:10:18.847091 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 2213) took 1345 ms. Trace:
I20260709 13:10:18.861678 23771 rpcz_store.cc:276] 0709 13:10:17.493719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.812772 (+319053us) service_pool.cc:224] Handling call
0709 13:10:18.839417 (+1026645us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b540014f354. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:18.839551 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766542592}
W20260709 13:10:18.855288 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.863385 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.869701 23743 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:18.868139 28332 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:18.841096 28449 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:18.843802 28648 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:18.777057 28793 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:18.889364 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:18.890878 23627 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:10:18.872933 28872 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:10:18.892727 23742 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.612s (SENT)
I20260709 13:10:18.901309 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:18.940249 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 180860us
W20260709 13:10:19.068327 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 179078us
W20260709 13:10:19.068893 28874 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.203s	user 0.003s	sys 0.002s
I20260709 13:10:19.070641 28733 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:19.071667 28733 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:19.072053 28733 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.072481 28733 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:19.069998 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:19.077431 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:19.078953 28520 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:19.080003 28744 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:19.080526 28744 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.080912 28744 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.083879 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:19.084993 23627 raft_consensus.cc:2410] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:10:19.086892 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:19.086912 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:19.089659 23620 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:10:19.095986 28332 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.096755 28332 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.097163 28449 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.098268 28449 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:19.099231 28332 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:18.910851 23625 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:10:18.920065 28745 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:19.102437 23770 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:19.087244 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:19.096114 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 224774us
I20260709 13:10:19.103103 23621 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.064817 24393 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.108291 28765 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.108493 28232 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:19.108942 28765 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:19.110208 28332 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.110452 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:19.111099 23771 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.110773 28332 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.111270 28765 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:19.108955 28862 raft_consensus.cc:3055] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:19.112249 28862 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:19.113433 28332 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:19.113257 28862 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.114430 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:19.114833 28862 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:19.118903 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:19.120754 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:19.121573 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 388265us
I20260709 13:10:19.121706 23628 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:19.062134 23622 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:19.108395 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:19.124922 23742 leader_election.cc:336] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.715s (SENT)
I20260709 13:10:19.125483 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:19.129205 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.129592 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.102612 28745 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.133852 23626 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:19.134210 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:19.134729 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.134745 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:19.136180 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 645) took 2696 ms. Trace:
I20260709 13:10:19.140691 23620 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:19.144198 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:19.125454 28692 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:19.145901 28692 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.148032 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:19.149112 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44758.5us
W20260709 13:10:19.149880 23742 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.724s (SENT) [suppressed 49 similar messages]
I20260709 13:10:19.150034 23771 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:19.151309 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:19.153192 28793 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:19.154783 28793 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:19.155210 28793 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:19.067183 28648 raft_consensus.cc:697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:19.154932 28520 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:19.155268 24392 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:19.156761 28648 consensus_queue.cc:237] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:19.157778 28762 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:19.148998 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:19.139640 23698 rpcz_store.cc:276] 0709 13:10:16.439411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.030747 (+1591336us) service_pool.cc:224] Handling call
0709 13:10:18.031129 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.032009 (+   880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.032039 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.035402 (+  3363us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.418311 (+382909us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b18003bcc80. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1 00007f2b412c7a0f
0709 13:10:18.478217 (+ 59906us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:18.478260 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.478346 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.124377 (+646031us) raft_consensus.cc:1685] finished
0709 13:10:19.124397 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.136107 (+ 11710us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17486,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":23256,"spinlock_wait_cycles":7379200,"thread_start_us":59689,"threads_started":1,"wal-append.queue_time_us":451472}
I20260709 13:10:19.158281 28829 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:19.160169 28745 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.130404 28352 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:19.196902 28352 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:19.197023 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:19.198055 28765 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:19.197809 28352 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:19.198598 28765 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:19.198870 28352 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.161142 23624 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:19.161746 23625 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:19.199599 28765 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:19.164567 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:19.200747 23778 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:19.164919 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:19.167833 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:19.175004 24393 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:19.180931 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:19.202240 23770 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.202454 23775 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:19.172390 28793 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:19.183840 28240 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.204082 28240 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.184335 28692 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:19.209862 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:19.186085 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:19.210618 23623 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.164346 23769 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:19.188150 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:19.206648 23621 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:19.205492 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 648) took 2638 ms. Trace:
I20260709 13:10:19.211604 23699 rpcz_store.cc:276] 0709 13:10:16.734601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.021735 (+1287134us) service_pool.cc:224] Handling call
0709 13:10:18.077238 (+ 55503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.185594 (+108356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.185634 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.741293 (+555659us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b2c00001418. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:10:18.741833 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:10:19.115907 (+374074us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:19.115942 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.116006 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.205206 (+ 89200us) raft_consensus.cc:1685] finished
0709 13:10:19.205230 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.205435 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5122944,"thread_start_us":373681,"threads_started":1,"wal-append.queue_time_us":461339}
I20260709 13:10:19.207955 28232 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:19.209005 28240 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:19.209810 24357 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:19.206022 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 57115.3us
I20260709 13:10:19.217700 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:19.213294 23777 raft_consensus.cc:2368] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13.
I20260709 13:10:19.218982 23770 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:19.216964 24357 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:19.244501 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:19.246562 28555 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:19.247083 28555 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.224501 23592 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:19.247432 28555 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:19.257869 23669 connection.cc:256] RPC call timeout handler was delayed by -1.0297809820000339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
I20260709 13:10:19.261809 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.261866 28862 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:19.262646 23704 raft_consensus.cc:2368] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
I20260709 13:10:19.262595 28862 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:19.263492 28744 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:19.264199 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.264282 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.264999 23698 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:19.265221 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.265404 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:19.265601 28744 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:19.265823 23702 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:19.250716 28775 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:19.266264 24357 leader_election.cc:400] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13.
I20260709 13:10:19.266669 24357 leader_election.cc:403] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:19.266580 28775 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:19.265843 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.267692 23698 raft_consensus.cc:2368] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10.
I20260709 13:10:19.268056 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.268544 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.269284 23698 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:19.269207 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.270125 23697 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:19.267709 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.264232 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.271013 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.271283 23700 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:19.271584 23703 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:19.263626 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.266168 23699 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:19.266853 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.262005 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.273141 23702 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:19.275839 28862 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:19.267719 28775 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.272805 23704 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:19.273564 23701 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
W20260709 13:10:19.280666 24358 leader_election.cc:336] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.506s (SENT)
I20260709 13:10:19.284614 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.285485 23703 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:19.285771 23669 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:19.285941 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:19.286556 23702 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.286629 28862 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:19.242533 28692 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
W20260709 13:10:19.289542 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.289855 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:19.293146 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:19.295113 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.296373 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:19.297250 28862 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:19.303174 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:19.305629 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.315585 23702 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
W20260709 13:10:19.321869 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 193205us
W20260709 13:10:19.320896 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 169700us
W20260709 13:10:19.329279 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 179413us
W20260709 13:10:19.330184 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 56064.8us
I20260709 13:10:19.352510 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:19.367566 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:19.377784 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 81489.3us
I20260709 13:10:19.329140 28733 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:19.382794 28733 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:19.383985 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:19.385697 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:19.388021 28862 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:19.388768 28862 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:19.389290 28862 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.388068 28686 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:19.390230 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 161424us
I20260709 13:10:19.371627 28638 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:19.423368 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 198936us
I20260709 13:10:19.440294 23743 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:19.443676 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 53813.8us
I20260709 13:10:19.444850 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:19.445230 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.445602 23621 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.448354 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2763) took 1001 ms. Trace:
W20260709 13:10:19.453419 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.457435 23621 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:19.458031 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:19.458464 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:19.459091 23621 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:19.414906 28884 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:19.467106 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:19.460944 23777 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:10:19.462369 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 43543.1us
I20260709 13:10:19.463810 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:19.465466 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:19.438110 28520 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:19.468410 23622 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.464840 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:19.473309 23624 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.448908 23695 rpcz_store.cc:276] 0709 13:10:18.447099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.737536 (+290437us) service_pool.cc:224] Handling call
0709 13:10:18.737983 (+   447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:18.738492 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.738529 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:18.739289 (+   760us) log.cc:844] Serialized 52 byte log entry
0709 13:10:19.209788 (+470499us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:19.436902 (+227114us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.437472 (+   570us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.447999 (+ 10527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.448083 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.448142 (+    59us) raft_consensus.cc:1685] finished
0709 13:10:19.448154 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.448291 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2247,"raft.queue_time_us":18045,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":102,"spinlock_wait_cycles":12433664,"thread_start_us":651161,"threads_started":2,"wal-append.queue_time_us":560401}
I20260709 13:10:19.471683 23769 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:19.425369 28829 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:10:19.476999 23629 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:19.479203 23626 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:19.446511 28744 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:19.483328 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:19.480814 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:19.488854 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:19.489480 23620 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.466660 28884 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.426203 28762 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:10:19.497548 23770 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:19.512878 23622 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:19.516417 23621 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:19.446677 28188 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:10:19.472321 28520 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:19.544333 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63594us
I20260709 13:10:19.462055 28232 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:10:19.555558 23593 leader_election.cc:400] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:10:19.556069 23593 leader_election.cc:403] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:19.491681 28744 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:19.469142 28521 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:10:19.584115 28902 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.561676 28765 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:10:19.562743 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.563090 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:19.563886 28881 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:10:19.572391 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.551952 28692 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:19.499703 28887 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13.
W20260709 13:10:19.574589 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 103448us
I20260709 13:10:19.575637 23743 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:19.576231 23522 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 181) took 26465 ms (client timeout 15000 ms). Trace:
W20260709 13:10:19.577201 28886 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:19.551441 28520 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:19.579260 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 161272us
I20260709 13:10:19.531422 28686 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:19.591179 23623 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:19.591367 23777 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:19.591692 23620 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:19.532588 28884 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.594525 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:19.577061 28745 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:19.599651 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 247230us
I20260709 13:10:19.600121 28004 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:10:19.549711 28891 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:19.615221 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.584779 28902 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:19.605437 23743 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:19.584791 28765 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:19.622444 28004 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:19.622664 24359 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:19.622630 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:19.549120 28555 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.611833 28232 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
W20260709 13:10:19.637534 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 211933us
W20260709 13:10:19.654075 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.616300 28449 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:19.613598 28733 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:19.657570 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.658643 28896 raft_consensus.cc:2764] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:19.658926 28887 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.659053 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:19.659595 28887 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.662081 28887 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:19.665237 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 52041.7us
W20260709 13:10:19.671382 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.673678 28887 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:19.675084 28896 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:19.675500 28896 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:19.676409 28896 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:19.679942 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 131540us
W20260709 13:10:19.680632 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 117594us
I20260709 13:10:19.604980 28762 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:10:19.624490 28638 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:19.686266 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 222566us
I20260709 13:10:19.601303 28692 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.671329 28449 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:19.706060 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 90040.3us
I20260709 13:10:19.614889 28332 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:10:19.713488 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:19.706506 23667 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:19.721547 24359 leader_election.cc:400] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13.
I20260709 13:10:19.722638 24359 leader_election.cc:403] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:19.706192 24390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 735) took 1223 ms. Trace:
I20260709 13:10:19.677819 28896 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.723414 23667 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:19.684141 28686 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:19.728485 28232 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.731927 28555 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:19.732896 28765 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.733053 28638 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:19.706813 28701 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:19.734378 28887 raft_consensus.cc:3055] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:19.735422 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 54615.1us
W20260709 13:10:19.735906 28888 log.cc:927] Time spent T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:10:19.594018 23522 rpcz_store.cc:269] 0709 13:09:53.110859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.113490 (+  2631us) service_pool.cc:224] Handling call
0709 13:10:19.575944 (+26462454us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:10.096420 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:10.097137 (+   717us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:10.097189 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:10:10.097216 (+    27us) tablet.cc:662] Decoding operations
0709 13:10:10.564872 (+467656us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:10.564955 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:10.564987 (+    32us) tablet.cc:685] Acquiring locks for 34 operations
0709 13:10:10.574449 (+  9462us) tablet.cc:701] Row locks acquired
0709 13:10:10.574504 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:10:10.574698 (+   194us) write_op.cc:270] Start()
0709 13:10:10.649827 (+ 75129us) write_op.cc:276] Timestamp: P: 1783602610574625 usec, L: 0
0709 13:10:10.654568 (+  4741us) op_driver.cc:348] REPLICATION: starting
0709 13:10:10.739804 (+ 85236us) log.cc:844] Serialized 13356 byte log entry
0709 13:10:11.156867 (+417063us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:11.507507 (+350640us) op_driver.cc:464] REPLICATION: finished
0709 13:10:11.731669 (+224162us) write_op.cc:301] APPLY: starting
0709 13:10:11.754827 (+ 23158us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:12.645212 (+890385us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:12.645261 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:15.237163 (+2591902us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:15.237916 (+   753us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=68,mrs_lookups=0
0709 13:10:15.237994 (+    78us) write_op.cc:312] APPLY: finished
0709 13:10:15.238980 (+   986us) log.cc:844] Serialized 292 byte log entry
0709 13:10:15.324230 (+ 85250us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:15.346015 (+ 21785us) write_op.cc:454] Released schema lock
0709 13:10:15.358792 (+ 12777us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:15.369016 (+ 10224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:15.369047 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":165285,"apply.run_cpu_time_us":94177,"apply.run_wall_time_us":3671449,"cfile_cache_hit":138,"cfile_cache_hit_bytes":146451,"num_ops":34,"prepare.queue_time_us":549761,"prepare.run_cpu_time_us":20624,"prepare.run_wall_time_us":692231,"raft.queue_time_us":238316,"raft.run_cpu_time_us":9432,"raft.run_wall_time_us":119373,"replication_time_us":830630,"spinlock_wait_cycles":4028288,"thread_start_us":731296,"threads_started":5,"wal-append.queue_time_us":149795,"wal-append.run_cpu_time_us":18922,"wal-append.run_wall_time_us":2673322}]]}
I20260709 13:10:19.720827 28648 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:19.742283 23624 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:19.685508 28903 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.751904 23669 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:10:19.833725 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.803884 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:19.806140 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 90663.8us
I20260709 13:10:19.810132 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:19.928525 23770 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.926525 23772 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:19.900235 28004 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:10:19.948292 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 325730us
I20260709 13:10:19.804885 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:19.952018 23777 raft_consensus.cc:2393] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:10:19.743268 28793 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.001s
W20260709 13:10:19.952076 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.950078 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:19.969693 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.006186 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 53263.7us
I20260709 13:10:19.762822 28240 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:19.747797 28745 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:19.772976 28232 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:19.983641 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 260389us
I20260709 13:10:19.725364 24390 rpcz_store.cc:276] 0709 13:10:18.482318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.482485 (+   167us) service_pool.cc:224] Handling call
0709 13:10:18.490446 (+  7961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.490675 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:18.873488 (+382813us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.705626 (+832138us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.705831 (+   205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.705888 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:19.705943 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.706011 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.706132 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":776611,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":243752,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":21823,"thread_start_us":1196876,"threads_started":4,"wal-append.queue_time_us":455789}
I20260709 13:10:19.792282 28692 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:19.898511 28733 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:19.755520 28862 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.011968 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:10:19.955219 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 56805.8us
W20260709 13:10:19.747972 28893 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:10:19.772595 28352 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.751955 28332 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13.
I20260709 13:10:20.040804 28917 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:10:20.041283 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 113889us
I20260709 13:10:20.051980 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:20.055395 28232 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:20.055998 28520 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.056666 28232 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:20.058158 28520 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:20.059348 28904 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:19.929019 28887 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:19.955479 28891 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.019579 28762 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:10:20.021849 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:19.947434 28903 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:19.739804 28744 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.014626 28890 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:19.745744 28686 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.011770 28521 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:20.026139 28862 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.034863 23770 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:19.749276 28902 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:20.011022 28648 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:20.063587 28733 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:20.112367 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 396158us
I20260709 13:10:20.065275 28905 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.794319 28765 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:20.069777 23777 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:20.016390 28004 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.072184 24357 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:20.047855 23524 catalog_manager.cc:5697] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 5 to 8, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 8 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.804096 28884 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:20.093427 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 71690.7us
I20260709 13:10:20.004997 28793 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.067772 28904 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:20.080042 28520 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:20.068197 28352 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.150341 24359 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:20.154932 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 116604us
W20260709 13:10:20.151827 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 223867us
W20260709 13:10:20.152603 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 80513.3us
I20260709 13:10:20.154079 23770 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:20.156809 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:20.157904 28745 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:20.158514 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:20.159880 28745 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:20.092576 28907 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:20.154714 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:20.165411 24357 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:20.101114 28912 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:20.172369 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:20.172806 28648 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.098845 28762 consensus_queue.cc:1243] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:20.148535 28911 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:20.189126 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:20.183353 23621 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:20.187351 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:20.148761 28240 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:10:20.190673 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.183785 28890 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:10:20.195745 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:20.196691 24393 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:20.195878 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:20.197233 23622 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:20.192019 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:20.132130 28521 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:20.162489 28894 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:20.080435 28891 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.198060 23627 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:20.175283 28332 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:20.175246 28897 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:20.169135 28907 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:20.199604 28894 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.192191 28912 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:20.181401 28745 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:20.178459 28686 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.209625 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:20.239743 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:20.217429 23622 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:20.264948 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:20.233629 23772 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:20.266839 23772 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:10:20.267017 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.225283 23742 leader_election.cc:400] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11.
I20260709 13:10:20.267912 23742 leader_election.cc:403] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:10:20.265944 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:20.147976 28905 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.223295 24385 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:20.324800 24388 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:20.328192 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:20.298671 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:20.224145 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:20.323486 23777 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.222426 23593 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:20.235869 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:20.210738 24391 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:20.328824 23628 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:20.328881 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:20.332581 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 591581us
I20260709 13:10:20.238636 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:20.186369 28917 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:20.229331 28862 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.219909 28903 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.220043 28918 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:20.333877 23772 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.379532 23772 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.380273 23626 raft_consensus.cc:2368] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13.
I20260709 13:10:20.210063 28894 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:20.374701 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:20.386117 23620 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:20.224133 28638 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:20.219622 28884 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:20.370086 23629 raft_consensus.cc:2376] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 8. Re-sending same reply.
I20260709 13:10:20.175084 28887 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.329110 28890 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.397214 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 161493us
W20260709 13:10:20.397697 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.398233 23668 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:20.266528 28332 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:20.238830 28907 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:20.326323 28897 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:20.209585 28919 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.206208 28910 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.331282 28829 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:20.218365 28352 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:20.217110 28793 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:20.430950 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 205789us
I20260709 13:10:20.373122 28449 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:20.440605 23622 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:10:20.209335 28521 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:20.443431 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 73995us
I20260709 13:10:20.197137 28911 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.211185 28904 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.213905 28912 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:20.444787 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:20.214390 28240 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.397042 28686 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:20.405088 28882 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11.
I20260709 13:10:20.401084 28555 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:10:20.404309 28903 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:10:20.398708 28638 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.389520 28862 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.449764 24392 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:20.432171 28919 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.466517 28232 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:20.466197 28686 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.439925 28918 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.511533 28918 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.511691 28686 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:20.447803 28902 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:20.467240 28332 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.470860 28882 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.516032 28882 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.517894 28904 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.518476 28882 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:20.450409 28897 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.473047 28911 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:20.444518 28829 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.475893 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:20.521924 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46109.7us
I20260709 13:10:20.522729 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:20.523214 28916 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:10:20.524137 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:20.525269 28905 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.525429 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:20.525902 28905 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:20.527092 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:20.477443 28899 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:20.484880 23627 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:20.501470 28638 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:20.505393 28919 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.508430 28920 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.522842 28829 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.477890 28898 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.495704 28862 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.533414 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:20.535284 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 235907us
I20260709 13:10:20.536942 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:20.557766 28745 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:20.448436 28449 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:20.552798 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.564075 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 233670us
I20260709 13:10:20.444868 28910 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:20.599608 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 200460us
I20260709 13:10:20.633795 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:20.537753 28686 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:20.641589 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 108281us
I20260709 13:10:20.539018 28902 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:20.618089 23769 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:20.410964 28890 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:20.620908 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 84047.9us
I20260709 13:10:20.534606 28899 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:20.629419 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.632448 23777 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:20.662622 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:20.663494 23777 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:20.638860 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:20.634502 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:20.643062 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:20.555509 28919 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:10:20.665620 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:20.622074 28695 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:10:20.621248 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 398880us
I20260709 13:10:20.669070 28004 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:10:20.685153 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.667464 24357 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:20.670437 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:20.682276 28004 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:20.690639 24359 leader_election.cc:400] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13.
W20260709 13:10:20.692219 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49244.8us
W20260709 13:10:20.692678 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 58238us
I20260709 13:10:20.693318 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:20.655979 28521 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:20.534520 28917 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.640825 28862 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:10:20.671046 28686 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.715696 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:20.716915 28648 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:20.717159 28895 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:10:20.717891 23743 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:20.634722 28898 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.730384 28240 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:20.657366 28692 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:10:20.735080 28745 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.674815 28935 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:20.736123 28898 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.736538 28935 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:20.695780 28887 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:20.738215 28935 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:20.738672 28935 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.739028 28935 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.739097 28449 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.712978 28004 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.741909 28899 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:20.739506 23772 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:10:20.744534 23772 pending_rounds.cc:85] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 9
I20260709 13:10:20.745057 23772 pending_rounds.cc:107] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:10:20.745585 23772 raft_consensus.cc:2889] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:20.745646 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:20.746372 23769 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:20.750320 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:20.751209 23627 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:20.705183 28793 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:20.767967 28793 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:20.769136 28793 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.769877 28910 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:20.770599 28924 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:20.723874 28902 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:20.684254 28765 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.712771 28930 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:20.713311 28884 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:20.683916 28905 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:20.742820 28918 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:20.668088 28891 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:20.675174 28933 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
W20260709 13:10:20.797071 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 82575.6us
W20260709 13:10:20.771118 28909 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:10:20.732367 28648 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.824764 24390 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:20.806074 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.766251 28352 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:20.818027 23593 leader_election.cc:336] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.611s (SENT)
I20260709 13:10:20.833734 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:10:20.819489 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 113664us
I20260709 13:10:20.835225 23592 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:20.835273 24359 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:20.838162 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:20.731650 28521 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.841384 28521 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.799019 28902 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.842474 28902 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:20.842854 28890 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.843607 28937 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.844177 28937 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.846835 28937 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:20.811200 28765 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.851248 28765 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:20.807252 28884 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:20.857837 28884 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:20.861353 23769 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:20.863435 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45437.8us
W20260709 13:10:20.864715 23593 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.702s (SENT)
I20260709 13:10:20.865204 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:20.836788 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:20.874586 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:20.876462 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:20.878495 23667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.017s	sys 0.017s
W20260709 13:10:20.879004 23667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.017s	sys 0.017s
W20260709 13:10:20.879297 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 671688us
W20260709 13:10:20.882437 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47319us
W20260709 13:10:20.712647 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 62150.4us
I20260709 13:10:20.833938 28648 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.885303 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:20.765206 28686 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:20.885344 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:20.868189 28332 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:20.892515 23742 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.958s (SENT)
I20260709 13:10:20.893443 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:20.905449 24391 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:10:20.893689 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:20.891316 28890 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:20.867434 28352 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:20.907526 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:20.910344 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:20.912645 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:20.915814 23769 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:20.888159 28891 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:20.923985 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:20.926097 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:20.891966 28928 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:20.921828 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:20.970110 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 105425us
W20260709 13:10:20.970853 23593 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.707s (SENT)
I20260709 13:10:20.971342 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:20.888353 28937 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:20.897370 28911 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.878476 28916 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
W20260709 13:10:20.974629 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50713.9us
W20260709 13:10:20.975565 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 51568.2us
W20260709 13:10:20.977384 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 55677.7us
I20260709 13:10:20.917383 28890 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.989774 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:20.990837 23626 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 7.
I20260709 13:10:20.894829 28765 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:10:20.926657 28332 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:10:20.997274 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 281668us
I20260709 13:10:20.932729 28921 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.016360 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:21.023697 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 131610us
W20260709 13:10:21.002662 23593 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.912s (SENT)
I20260709 13:10:21.026513 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:20.913584 28862 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:10:21.012456 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:21.013717 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:21.014016 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:21.025748 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:21.025216 23742 leader_election.cc:336] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.047s (SENT)
I20260709 13:10:21.028635 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:21.032887 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:20.985949 28898 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:21.032024 23771 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:21.033443 23774 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:10:20.993268 28890 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:20.988780 28521 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:21.042698 23769 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
W20260709 13:10:21.056283 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 53587.3us
I20260709 13:10:21.021778 28917 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:10:21.042227 28921 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.080533 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:21.081393 24388 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:10:21.029270 28934 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:21.047109 28918 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:21.051926 28912 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:21.045856 28521 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.992583 28911 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:21.093911 24359 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:21.042465 28898 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.124428 23627 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:10:21.108239 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 187456us
W20260709 13:10:21.140094 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 67010.5us
W20260709 13:10:21.141436 23593 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.096s (SENT)
I20260709 13:10:21.141963 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:21.144464 24358 leader_election.cc:336] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.881s (SENT)
W20260709 13:10:21.090620 28904 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.004s
I20260709 13:10:21.151268 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:21.145357 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 105945us
W20260709 13:10:21.084450 28907 consensus_meta.cc:287] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
I20260709 13:10:21.108044 28521 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:21.083715 28920 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:21.094570 28921 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:21.151067 28917 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.143329 28899 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:21.146493 28898 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:21.146142 28884 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:21.160254 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 135070us
I20260709 13:10:21.172955 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:21.182981 24386 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:21.183370 28934 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:21.185195 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:21.186470 24390 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
W20260709 13:10:21.195755 23742 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.212s (SENT)
W20260709 13:10:21.227767 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 76587.6us
I20260709 13:10:21.229035 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:21.229629 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.159435 28911 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:21.243875 28904 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.244657 28904 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:21.245684 28935 consensus_meta.cc:287] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.506s	user 0.000s	sys 0.011s
I20260709 13:10:21.246205 28935 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:21.088186 28332 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.247201 28904 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:21.248440 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:21.252671 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2241) took 1028 ms. Trace:
I20260709 13:10:21.253223 23770 rpcz_store.cc:276] 0709 13:10:20.224465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.268187 (+ 43722us) service_pool.cc:224] Handling call
0709 13:10:20.306543 (+ 38356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.619099 (+312556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.619129 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:20.658526 (+ 39397us) log.cc:844] Serialized 26 byte log entry
0709 13:10:21.005996 (+347470us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:21.006034 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.006098 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:21.252418 (+246320us) raft_consensus.cc:1685] finished
0709 13:10:21.252445 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.252600 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67676,"raft.queue_time_us":94053,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":8862,"thread_start_us":540871,"threads_started":2,"wal-append.queue_time_us":545602}
I20260709 13:10:21.256111 28686 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:21.258311 28904 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.258826 28648 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:21.199134 28919 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:10:21.148561 28352 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:21.162439 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:21.282697 23778 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:21.258886 28904 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:21.198087 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:21.289003 23769 raft_consensus.cc:606] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:21.157861 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:21.288175 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 59228.7us
I20260709 13:10:21.235569 28920 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:21.186717 23593 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.237s (SENT)
I20260709 13:10:21.293357 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:21.293666 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:21.296049 23778 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:21.199450 28917 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.160575 28907 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:21.301331 23625 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:21.154664 28930 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 13:10:21.320171 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.324700 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:21.325397 23771 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:10:21.326861 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:21.327135 23629 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
W20260709 13:10:21.330624 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 175692us
I20260709 13:10:21.297674 28936 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:21.335896 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 140371us
I20260709 13:10:21.300110 28946 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.339918 23773 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:21.310119 28686 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.286275 28928 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:21.319020 28899 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:21.349519 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 162962us
I20260709 13:10:21.342957 23625 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:21.319758 28911 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:21.343403 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:21.326460 28919 consensus_queue.cc:1243] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer b1e32a12daf44ebbbd71cc3ce41d7d8e log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:21.309429 28916 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:10:21.336241 28862 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:21.364326 23593 leader_election.cc:336] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.927s (SENT)
I20260709 13:10:21.375639 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:21.329305 28935 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:21.367071 28449 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:21.340696 28952 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:21.352769 28733 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:10:21.387501 28765 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:21.420519 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63070.5us
W20260709 13:10:21.421572 23593 leader_election.cc:336] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.166s (SENT)
I20260709 13:10:21.340972 28964 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
W20260709 13:10:21.409405 28902 consensus_meta.cc:287] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.002s
I20260709 13:10:21.363618 28911 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.409615 28449 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.436885 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.441087 23702 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:21.431978 28973 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.434034 28902 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.385224 28862 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:21.442188 28928 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.447517 28862 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:21.439023 23593 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.196s (SENT)
I20260709 13:10:21.445019 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:21.465313 24358 leader_election.cc:336] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.933s (SENT)
W20260709 13:10:21.443048 28966 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:10:21.471933 23701 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.472700 23629 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:21.442389 28449 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:21.469439 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:21.450235 28894 consensus_meta.cc:287] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 1.038s	user 0.014s	sys 0.001s
I20260709 13:10:21.442620 28967 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.475407 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:21.480515 28907 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:21.485301 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:21.484403 28648 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:21.493254 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:21.493727 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:21.489892 24358 leader_election.cc:336] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 3.169s (SENT)
I20260709 13:10:21.496439 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:21.482366 28916 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:21.492550 28904 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:21.478871 28884 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:10:21.502075 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:21.507066 23695 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.507513 23704 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:10:21.509089 28959 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:10:21.496644 28934 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:21.512563 23703 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:21.481490 28894 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.451992 28973 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:21.520066 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 81062.4us
W20260709 13:10:21.526247 24358 leader_election.cc:336] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.859s (SENT)
I20260709 13:10:21.527056 24358 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:21.530943 23593 leader_election.cc:336] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.220s (SENT)
I20260709 13:10:21.532682 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:21.533334 23703 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:21.533671 28963 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:10:21.535149 28932 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.557s	user 0.004s	sys 0.004s
W20260709 13:10:21.535976 28970 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:10:21.536743 28240 raft_consensus.cc:3055] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:21.537150 28240 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:21.538030 28240 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.539819 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3144) took 1362 ms. Trace:
I20260709 13:10:21.540187 23623 rpcz_store.cc:276] 0709 13:10:20.177359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.178790 (+  1431us) service_pool.cc:224] Handling call
0709 13:10:20.179099 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.194449 (+ 15350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.194471 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:20.208234 (+ 13763us) log.cc:844] Serialized 26 byte log entry
0709 13:10:20.492583 (+284349us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:20.492626 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.492711 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:21.534476 (+1041765us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:21.539546 (+  5070us) raft_consensus.cc:1685] finished
0709 13:10:21.539568 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.539761 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5034,"raft.queue_time_us":17665,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":13151,"spinlock_wait_cycles":10683648,"thread_start_us":158949,"threads_started":1,"wal-append.queue_time_us":589178}
W20260709 13:10:21.542717 28962 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:10:21.542734 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:21.543498 24390 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:21.539837 28902 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:21.483525 28967 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.564312 28967 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:21.564568 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.565325 23697 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:21.566164 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.566717 23697 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:21.568315 28911 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:21.568885 28911 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.569375 28911 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:21.570907 28948 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:21.571209 28973 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:21.571346 28948 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:21.571916 28911 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:21.569337 24390 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:21.572402 28948 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.578019 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.579934 24391 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:21.567454 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:21.584889 23701 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:21.579020 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:21.587503 23699 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:21.561147 23703 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:21.561566 24388 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:21.588953 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.562119 24394 raft_consensus.cc:2368] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
I20260709 13:10:21.561939 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:21.591670 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.589818 23700 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:21.594280 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.594372 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:21.595307 23698 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.595841 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:21.574057 28948 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:21.596689 23703 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:21.601832 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:21.597462 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 71252.3us
I20260709 13:10:21.562006 28744 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.598518 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.598685 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.621686 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:21.621765 23623 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:21.561961 28972 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:21.602435 23697 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
W20260709 13:10:21.610930 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 88449.2us
W20260709 13:10:21.627305 23593 leader_election.cc:336] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.254s (SENT)
I20260709 13:10:21.627878 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:21.633818 23703 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:21.635150 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:21.636385 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:21.638936 24358 leader_election.cc:336] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.958s (SENT)
I20260709 13:10:21.639501 24358 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:21.591473 28905 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:21.640650 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.641882 23704 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:10:21.642268 23700 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:21.640873 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.641021 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:21.645004 23697 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:21.640372 23703 raft_consensus.cc:2376] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13. Re-sending same reply.
I20260709 13:10:21.646977 23703 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:10:21.638090 28890 consensus_meta.cc:287] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.005s
I20260709 13:10:21.662567 23700 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:21.664151 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.665006 23699 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:21.663113 23700 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:21.667490 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.668118 23699 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:21.650329 28934 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:21.655604 28884 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:21.669368 23700 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:21.687660 28894 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:21.688023 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.703393 23623 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:10:21.692035 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 64757.4us
I20260709 13:10:21.705657 23695 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:21.693493 28352 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:21.636047 28744 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.720184 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.720911 23622 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:21.722749 23695 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:10:21.723248 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.663447 28890 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:21.700858 28977 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:10:21.686236 28936 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:10:21.701619 24394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46566 (request call id 804) took 1479 ms. Trace:
I20260709 13:10:21.740768 24394 rpcz_store.cc:276] 0709 13:10:20.221904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.223867 (+  1963us) service_pool.cc:224] Handling call
0709 13:10:21.701404 (+1477537us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400654854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:21.701552 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2809126656}
W20260709 13:10:21.711680 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.713227 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.715152 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:21.656912 28905 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:21.747031 28905 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.715847 23697 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
W20260709 13:10:21.717927 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46772.7us
I20260709 13:10:21.718125 23699 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:21.753497 24358 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.851s (SENT)
I20260709 13:10:21.719520 23703 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:10:21.719190 28521 consensus_meta.cc:287] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.010s
I20260709 13:10:21.729852 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:21.731463 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.669827 28946 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:21.720801 28962 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:21.743760 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.716462 28449 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.754693 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:21.754801 28520 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:21.755646 28898 consensus_meta.cc:287] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 13:10:21.757268 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:21.758174 28890 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:21.760121 28744 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:21.762907 28686 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:21.719761 28937 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.752529 28912 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:21.784518 28953 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:21.728021 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.774859 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.828099 28520 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:21.786516 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 56775us
I20260709 13:10:21.837746 28520 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:21.838251 28520 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:21.840044 23773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:21.840822 23773 raft_consensus.cc:606] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:21.841244 23773 raft_consensus.cc:614] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:21.802060 28898 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.846083 28898 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:21.846715 28898 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.854038 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:21.859231 28449 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:21.794960 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.869408 23695 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
W20260709 13:10:21.800953 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46360.2us
I20260709 13:10:21.872790 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:21.765200 28904 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:21.718677 23698 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:21.784771 28907 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:21.833714 23699 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:21.775202 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.835954 28944 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:21.904846 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:21.860340 28929 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:21.860441 28917 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:21.866317 23624 raft_consensus.cc:2393] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:21.791150 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:21.867131 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 138499us
I20260709 13:10:21.874698 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.906821 23702 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:21.907182 23699 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:21.877853 23701 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:21.847209 28898 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:21.910210 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.904342 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.784050 28521 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.909258 28352 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:21.830107 28912 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:21.833474 28937 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:21.913486 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:21.913661 28744 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:21.911258 23697 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:21.916069 23698 raft_consensus.cc:2376] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15. Re-sending same reply.
I20260709 13:10:21.918015 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:21.925420 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.927165 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:10:21.926806 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 169610us
I20260709 13:10:21.928435 23593 leader_election.cc:400] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
I20260709 13:10:21.928737 23593 leader_election.cc:403] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:21.904910 28944 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.908367 28929 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.937386 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:21.934305 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.938215 23622 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 7.
I20260709 13:10:21.940217 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:21.940995 23772 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:10:21.909122 28765 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:21.945784 28004 raft_consensus.cc:2764] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:21.942394 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:21.947712 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.948575 23622 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:21.922972 28744 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:21.866212 28953 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:21.952840 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:21.956701 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:21.956828 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:21.933732 28936 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:22.022368 28004 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:21.957332 28648 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:10:22.024353 28909 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:22.026360 28937 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:22.026505 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.925988 28449 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:10:22.030997 28898 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:21.956806 28765 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:22.034149 28765 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:22.034773 28765 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.909744 28904 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:22.039212 23773 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:22.036623 23775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:22.037446 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:21.940858 28929 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:21.940281 28944 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.046974 28521 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:22.054314 28944 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:22.055863 28997 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:10:22.044555 28745 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:22.057200 28745 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.057647 28745 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:22.061564 28953 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:21.909622 28907 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:22.066059 28907 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:22.031519 28981 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:10:22.038133 23702 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:22.020753 28744 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:22.068346 28937 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:22.069125 24358 leader_election.cc:336] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.100s (SENT)
I20260709 13:10:22.068292 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.069944 23702 raft_consensus.cc:2376] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15. Re-sending same reply.
I20260709 13:10:22.070870 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.038582 23772 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:22.044790 23775 raft_consensus.cc:606] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:22.072067 28912 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:22.044849 23622 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:10:22.074496 23775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:22.087153 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:22.088277 24386 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.088277 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:22.089100 23622 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:22.067536 28520 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:22.100844 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 163515us
I20260709 13:10:22.104357 23772 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:22.106328 23775 raft_consensus.cc:606] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:22.106870 23775 raft_consensus.cc:614] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:22.111618 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:22.113891 23593 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.491s (SENT)
I20260709 13:10:22.114410 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:22.117249 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:22.129602 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:22.130633 24385 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:22.132638 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:22.134475 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 112433us
I20260709 13:10:22.126425 24357 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:22.139978 23628 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:22.142493 23622 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:22.142688 24386 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:22.119344 28994 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:22.149377 28944 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:22.156978 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44079.1us
I20260709 13:10:22.137013 28948 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:22.174166 23622 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:22.151652 28972 raft_consensus.cc:2764] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:22.182717 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:22.178611 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:22.183485 24391 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:22.183959 23629 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:22.182353 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:22.186872 23628 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:10:22.193257 28520 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:22.197048 24390 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:22.169675 28948 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.198014 28948 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:22.198832 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:22.199754 24387 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.202814 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:22.162320 28894 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:22.205863 23625 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:22.217396 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.217998 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.219177 23699 raft_consensus.cc:2368] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9.
I20260709 13:10:22.219059 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.220438 23703 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:22.221673 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.222718 23703 raft_consensus.cc:2368] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 7. Current term is 8.
I20260709 13:10:22.232502 28352 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:22.240105 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:22.248993 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.250033 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.251192 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.256965 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.257709 23699 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:22.258599 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.260942 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:22.261552 23778 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.261794 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.264518 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:22.265167 23772 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:22.267051 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:22.267586 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.268457 23703 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:22.270566 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.270907 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:22.271274 23698 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:22.272423 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:22.273394 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.274019 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:22.275858 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:22.276572 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.277868 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.279450 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:22.281102 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.281744 23699 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:22.281076 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 127918us
I20260709 13:10:22.283457 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.284657 23703 raft_consensus.cc:2376] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15. Re-sending same reply.
I20260709 13:10:22.285789 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.213287 28744 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:22.286572 23703 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:22.258849 28894 raft_consensus.cc:697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:22.289350 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.291184 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.298360 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:22.299053 23620 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.300339 23703 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:22.304989 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.290840 28994 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:22.314431 28994 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.314946 28994 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:22.316035 28894 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:22.323836 29004 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:22.325225 28744 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:22.326582 28904 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:22.328408 28929 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:22.330659 28929 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:22.331602 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.332814 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.333833 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.334345 23698 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 8.
I20260709 13:10:22.335070 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:22.335867 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.336930 28332 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.337456 28332 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:22.339661 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3166) took 1377 ms. Trace:
I20260709 13:10:22.339983 23622 raft_consensus.cc:2368] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16.
I20260709 13:10:22.340049 23626 rpcz_store.cc:276] 0709 13:10:20.962182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.043570 (+ 81388us) service_pool.cc:224] Handling call
0709 13:10:21.071894 (+ 28324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.115401 (+ 43507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.115445 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.700096 (+584651us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b2c00058238. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:10:21.700558 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:10:21.786056 (+ 85498us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:21.786112 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.339354 (+553242us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b54000dbbd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:22.339406 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.339461 (+    55us) raft_consensus.cc:1685] finished
0709 13:10:22.339474 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.339602 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":933,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":24501,"spinlock_wait_cycles":101632640,"thread_start_us":85098,"threads_started":1,"wal-append.queue_time_us":229345}
I20260709 13:10:22.341444 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:22.342784 23622 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:22.343830 23700 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:22.348394 23620 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:22.348757 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.349404 23703 raft_consensus.cc:2376] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14. Re-sending same reply.
I20260709 13:10:22.350183 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.351116 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.339572 28332 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:22.354771 23699 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:22.354897 28929 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.358330 28929 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:22.359701 28745 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:22.361567 28929 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:22.362623 23622 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:22.362869 28948 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:22.362622 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.364391 23699 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:22.367440 23699 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:22.357550 28765 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
I20260709 13:10:22.357266 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.402014 23703 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:22.368292 28745 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:22.372368 24387 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:22.373183 23777 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:22.371516 28994 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:22.313594 23778 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:22.385706 23697 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:22.387445 28948 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:22.388130 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:22.393187 23700 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:10:22.409693 23700 pending_rounds.cc:85] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 9
I20260709 13:10:22.409823 23699 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:22.410079 23700 pending_rounds.cc:107] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:10:22.410259 23697 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:22.410490 23700 raft_consensus.cc:2889] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:22.415001 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:22.414883 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:22.415905 24388 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:22.416714 28745 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:22.419871 28762 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:22.420361 28762 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.420727 28762 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:22.421902 28979 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.631s	user 0.002s	sys 0.000s
I20260709 13:10:22.414940 23700 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:22.416726 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:22.447602 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:22.448684 24387 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 9: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:22.518828 28929 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.522202 28929 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:22.524449 28994 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:22.526186 23593 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 3.119s (SENT)
I20260709 13:10:22.528697 23700 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:22.600855 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 74687.3us
I20260709 13:10:22.600993 24388 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:10:22.519263 28890 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.621307 28994 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:22.621954 28994 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:22.641294 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 393936us
I20260709 13:10:22.642853 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:22.643857 28004 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:22.644351 28004 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.644768 28004 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:22.647866 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.628644 28890 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:22.656442 28912 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:22.694375 28929 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:22.702696 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 59990.7us
I20260709 13:10:22.709779 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:22.711320 28765 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:22.711933 28765 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:22.712972 28745 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:22.712857 28765 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:22.724908 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.727423 23773 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:22.729482 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 748) took 1280 ms. Trace:
I20260709 13:10:22.729925 24392 rpcz_store.cc:276] 0709 13:10:21.448631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.448755 (+   124us) service_pool.cc:224] Handling call
0709 13:10:21.449116 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.480944 (+ 31828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.480983 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.481457 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.728702 (+1247245us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b1800019600. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1
0709 13:10:22.729033 (+   331us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:22.729074 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.729148 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.729191 (+    43us) raft_consensus.cc:1685] finished
0709 13:10:22.729204 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.729421 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30080,"raft.queue_time_us":24711,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4078,"spinlock_wait_cycles":20445440,"thread_start_us":143315,"threads_started":1,"wal-append.queue_time_us":145225}
I20260709 13:10:22.731781 28449 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.732333 28449 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:22.733131 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2780) took 1169 ms. Trace:
I20260709 13:10:22.735886 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:22.736502 23778 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:22.737458 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:22.738745 23669 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:22.739058 28240 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.739946 28521 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:22.740057 28953 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:22.741426 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2776) took 1179 ms. Trace:
I20260709 13:10:22.741364 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:22.742520 28944 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:22.742774 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 566859us
I20260709 13:10:22.743260 28944 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:22.733534 23704 rpcz_store.cc:276] 0709 13:10:21.563451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.642689 (+ 79238us) service_pool.cc:224] Handling call
0709 13:10:21.658798 (+ 16109us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:21.670052 (+ 11254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.670086 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:21.670638 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 13:10:21.874372 (+203734us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:21.925128 (+ 50756us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.380136 (+455008us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b180046b6a0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:10:22.732201 (+352065us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b180046b6a0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b3e221a40 00007f2b3e21c4e4 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287 00007f2b41327208
0709 13:10:22.732603 (+   402us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.732806 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.732889 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.732932 (+    43us) raft_consensus.cc:1685] finished
0709 13:10:22.732943 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.733077 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282,"prepare.queue_time_us":52503,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3166,"raft.queue_time_us":3856,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":16193,"spinlock_wait_cycles":169033344,"thread_start_us":129325,"threads_started":1,"wal-append.queue_time_us":234684}
I20260709 13:10:22.741951 23696 rpcz_store.cc:276] 0709 13:10:21.562199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.575918 (+ 13719us) service_pool.cc:224] Handling call
0709 13:10:21.576370 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.576871 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.576918 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.577495 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:10:21.923698 (+346203us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:22.080030 (+156332us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.741101 (+661071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.741183 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.741224 (+    41us) raft_consensus.cc:1685] finished
0709 13:10:22.741244 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.741370 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":662379,"prepare.queue_time_us":34613,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":665971,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":5604,"thread_start_us":480828,"threads_started":2,"wal-append.queue_time_us":371794}
I20260709 13:10:22.745610 28903 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.745868 23743 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:22.746093 28903 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:22.746537 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.748209 28903 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:22.750401 24388 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:10:22.751323 29002 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.446s	user 0.001s	sys 0.009s
I20260709 13:10:22.751653 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:22.752301 23773 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:22.752630 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:22.754431 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:22.754773 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:22.755627 28521 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:22.756135 28521 raft_consensus.cc:697] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:22.757046 28521 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:22.757357 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:22.759001 28998 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:22.759776 23773 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:22.759850 28998 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:22.760305 28998 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:22.761686 28733 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:22.755641 23775 raft_consensus.cc:2410] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:22.761148 28998 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:22.759910 28918 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:10:22.763120 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:22.763515 28998 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:22.742789 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:22.766433 28733 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:22.766634 28953 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:22.766875 28733 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.767316 28733 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:22.768252 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:22.769053 28953 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:22.770386 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:22.770769 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:22.771173 28953 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:22.772557 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:22.775172 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.777279 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:22.780226 23778 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:22.776196 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:22.784145 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:22.784299 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:22.786772 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:22.790247 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:22.785043 23626 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:22.790150 23622 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:10:22.773841 29005 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:10:22.793638 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:22.798718 23669 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:22.844185 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:22.845111 23703 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:22.847229 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:22.847391 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.848105 23699 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:22.864394 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.857362 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.788237 28929 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:22.796027 28934 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:22.794051 28930 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:22.961902 24393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 810) took 1472 ms. Trace:
I20260709 13:10:22.972028 24393 rpcz_store.cc:276] 0709 13:10:21.489480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.489611 (+   131us) service_pool.cc:224] Handling call
0709 13:10:21.495965 (+  6354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.389369 (+893404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.389404 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.389441 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:22.389470 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.961663 (+572193us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b5400603954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:22.961709 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.961844 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054180736}
I20260709 13:10:22.796383 28944 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:22.849424 28862 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:22.851655 28911 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.991647 23628 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:22.995538 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:22.996357 23695 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:22.835598 28909 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.175s
I20260709 13:10:22.999519 23624 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:10:23.004799 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 375429us
I20260709 13:10:22.834612 28905 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 13:10:22.946784 28952 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:10:22.943897 28921 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 13:10:23.003526 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:23.008139 23699 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:22.981703 28944 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.982076 28994 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:22.998494 28648 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.002744 28762 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260709 13:10:22.989534 28929 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:23.026829 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2235) took 1103 ms. Trace:
I20260709 13:10:23.020022 28004 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:22.950780 28745 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:10:23.031680 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:23.001987 28862 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:23.040532 23621 rpcz_store.cc:276] 0709 13:10:21.923461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.923698 (+   237us) service_pool.cc:224] Handling call
0709 13:10:21.924055 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.931358 (+  7303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.931390 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.931908 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.394827 (+462919us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:22.394864 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.394926 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.026565 (+631639us) raft_consensus.cc:1685] finished
0709 13:10:23.026593 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.026761 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18525,"raft.queue_time_us":107552,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":18680,"thread_start_us":315376,"threads_started":1,"wal-append.queue_time_us":616979}
W20260709 13:10:23.050424 29014 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:10:23.050911 29012 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:10:23.051453 29015 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:23.040584 28733 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:23.054085 29000 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.752s	user 0.004s	sys 0.007s
I20260709 13:10:23.054179 28733 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:23.055917 28890 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:23.030478 28944 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:23.044471 23699 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:23.060909 23695 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:23.068914 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:23.032737 28928 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:23.030922 28930 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.064467 28004 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:23.030423 28937 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:23.007514 28911 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.071620 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2234) took 1155 ms. Trace:
I20260709 13:10:23.041256 28921 raft_consensus.cc:476] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:23.072516 28903 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:23.042860 28648 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.043047 28762 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.043020 28899 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:23.079984 23702 raft_consensus.cc:2410] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:10:23.077417 23699 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:23.130782 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:23.133733 23593 leader_election.cc:336] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 3.312s (SENT)
I20260709 13:10:23.133903 28934 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:23.134701 23593 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 3.324s (SENT)
I20260709 13:10:23.135097 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:23.073271 23695 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:23.137144 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:23.137691 23695 raft_consensus.cc:2376] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12. Re-sending same reply.
I20260709 13:10:23.032616 28887 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:10:23.103209 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 255644us
I20260709 13:10:23.095394 23627 rpcz_store.cc:276] 0709 13:10:21.915947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.916436 (+   489us) service_pool.cc:224] Handling call
0709 13:10:21.916778 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.917201 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.917241 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.925885 (+  8644us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.125376 (+199491us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:22.145745 (+ 20369us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.151637 (+  5892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.151780 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.053472 (+901692us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:23.062500 (+  9028us) raft_consensus.cc:1685] finished
0709 13:10:23.071388 (+  8888us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.071548 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19799,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":34,"raft.queue_time_us":35005,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":95948,"spinlock_wait_cycles":62315264,"thread_start_us":168157,"threads_started":1,"wal-append.queue_time_us":320350}
I20260709 13:10:23.131626 23699 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
W20260709 13:10:23.145901 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 150094us
I20260709 13:10:23.145968 28921 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:23.147066 24358 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.597s (SENT)
I20260709 13:10:23.146785 28921 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:23.147596 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:23.149432 28921 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:23.150084 28004 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:23.135350 28934 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.138499 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:23.155576 23699 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:23.157320 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:23.160385 23695 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:23.166108 28994 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:23.167083 28994 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:23.085564 28953 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:23.099864 28894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.015s	sys 0.028s
I20260709 13:10:23.076393 28928 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:23.178642 28521 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:23.183388 28521 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:23.184340 28648 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:23.185834 28521 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:23.193179 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.145120 28952 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.200377 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:23.180827 28894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.015s	sys 0.028s
I20260709 13:10:23.203030 24385 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 8: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:23.176185 28904 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.182058 28928 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.099663 28937 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.211045 28937 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:23.098058 28930 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:23.196231 28912 consensus_meta.cc:287] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 13:10:23.178776 28953 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:23.177497 23593 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:23.198099 28967 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:23.199010 28449 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:23.216713 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 69671.3us
I20260709 13:10:23.078107 28929 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.225600 23769 raft_consensus.cc:606] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:23.279045 23769 raft_consensus.cc:614] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:23.226931 23695 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:23.239197 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.213750 28904 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.241808 28930 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:23.250142 28953 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:23.252699 28762 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:23.252974 29033 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.121s	user 0.000s	sys 0.002s
I20260709 13:10:23.253321 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2183) took 1415 ms. Trace:
I20260709 13:10:23.261148 28928 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.264529 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:23.207656 28862 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:23.178552 28899 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:23.266120 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:23.266794 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:23.203933 28952 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:23.272594 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.307319 28953 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.327068 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:23.328227 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:23.329144 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:23.332257 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:23.332790 28912 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:23.332659 28944 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.333591 28912 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:23.278169 28887 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
W20260709 13:10:23.281051 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 107607us
I20260709 13:10:23.320787 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:23.335137 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:23.270905 29037 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.296343 23702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 678) took 1517 ms (client timeout 1851 ms). Trace:
I20260709 13:10:23.273741 29035 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:23.297758 23697 rpcz_store.cc:276] 0709 13:10:21.837457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.411211 (+573754us) service_pool.cc:224] Handling call
0709 13:10:22.411624 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:22.748956 (+337332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.748986 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:22.749521 (+   535us) log.cc:844] Serialized 52 byte log entry
0709 13:10:23.024404 (+274883us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:23.043455 (+ 19051us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.068236 (+ 24781us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.072064 (+  3828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.072141 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.253105 (+180964us) raft_consensus.cc:1685] finished
0709 13:10:23.253125 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.253265 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":342397,"prepare.queue_time_us":23199,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":396101,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":243,"thread_start_us":274449,"threads_started":1,"wal-append.queue_time_us":497513}
I20260709 13:10:23.305817 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:23.338549 23627 raft_consensus.cc:1813] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Handling vote request from an unknown peer c885217113574e7489e6c3afb6950f76
I20260709 13:10:23.339073 23627 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 9: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:23.308226 23698 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:10:23.339406 23698 pending_rounds.cc:85] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 9
I20260709 13:10:23.339665 23698 pending_rounds.cc:107] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:10:23.340014 23698 raft_consensus.cc:2889] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:23.308964 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:23.342610 23622 raft_consensus.cc:2410] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:23.343997 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:23.279242 29034 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:23.332990 24393 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:23.335784 23624 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 9: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:10:23.336090 23702 rpcz_store.cc:269] 0709 13:10:21.778646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.070579 (+291933us) service_pool.cc:224] Handling call
0709 13:10:23.296042 (+1225463us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540040db54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:23.296263 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2318469504}
I20260709 13:10:23.348002 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:23.278543 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 426477us
I20260709 13:10:23.292035 28890 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:23.349653 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:23.306989 23621 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:10:23.280170 28910 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:10:23.346014 24386 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:23.349135 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:23.285444 28994 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:23.296558 28896 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:23.345077 23628 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:23.352809 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:23.358554 23743 leader_election.cc:400] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16.
I20260709 13:10:23.362659 23743 leader_election.cc:403] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:23.364705 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:23.358718 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.359230 28004 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:23.368971 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:23.332264 28762 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:23.361395 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:23.378096 28004 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16.
I20260709 13:10:23.379323 23743 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:23.319401 28765 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:23.321048 28911 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:23.337743 28903 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:23.394836 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:23.393280 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:23.348711 28829 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:23.386220 23628 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:23.386960 28004 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:10:23.389122 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.356122 28890 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.408730 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:23.403029 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:23.388207 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:23.404924 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:23.405877 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:23.406685 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:23.410187 23624 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:23.412072 23778 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:23.411478 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:23.412271 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:23.419210 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:23.420234 24386 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:23.422768 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:23.423905 23769 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:23.393754 29007 raft_consensus.cc:993] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:10:23.428009 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:23.431865 24393 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:23.439095 23770 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:23.443387 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:23.467702 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:23.468843 23701 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:23.470610 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:23.471257 24391 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:23.471819 28004 raft_consensus.cc:697] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:23.475240 23769 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:10:23.479084 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:23.479946 23769 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:23.356400 28733 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:10:23.352317 29037 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:23.491446 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 69208.6us
I20260709 13:10:23.503548 23778 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:23.334586 28912 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:23.514552 24391 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:23.414028 28890 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:23.535145 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:23.538034 24358 leader_election.cc:336] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.795s (SENT)
I20260709 13:10:23.539024 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:23.546612 23702 raft_consensus.cc:2410] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:23.409096 29038 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:23.546445 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 181839us
I20260709 13:10:23.551337 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:23.559617 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:23.553068 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 222362us
I20260709 13:10:23.371997 28896 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.372357 28994 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:23.352174 29035 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:23.564205 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:23.466020 28762 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:23.566468 23702 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:23.555917 28004 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.488611 29028 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.591159 24358 leader_election.cc:336] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.918s (SENT)
I20260709 13:10:23.607630 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:23.490875 28907 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.532527 28918 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.409114 28765 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:23.598140 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 686) took 1812 ms. Trace:
I20260709 13:10:23.612727 23698 rpcz_store.cc:276] 0709 13:10:21.785390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.367879 (+582489us) service_pool.cc:224] Handling call
0709 13:10:23.297210 (+929331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.340866 (+ 43656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.407368 (+ 66502us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b540040db54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:23.597887 (+190519us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b540040db50. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:23.598061 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2160626432}
I20260709 13:10:23.599495 23701 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:23.384820 29013 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 13:10:23.553973 28929 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:23.601585 23769 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:10:23.355757 29034 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:23.604580 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 93607.9us
I20260709 13:10:23.414417 28903 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:23.602876 23622 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 8.
I20260709 13:10:23.548296 29032 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.608342 23702 raft_consensus.cc:2376] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13. Re-sending same reply.
I20260709 13:10:23.628352 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:23.629053 23702 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:23.615795 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:23.616523 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:23.629765 23621 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.616894 23695 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:23.617401 23701 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:23.554700 28829 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:23.618448 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:23.558017 29038 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:23.634881 29038 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.638248 28934 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:23.643801 29038 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.646970 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:23.628590 29018 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.358s	user 0.001s	sys 0.001s
I20260709 13:10:23.669209 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:23.646363 28520 raft_consensus.cc:1081] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:10:23.670154 28762 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:23.677407 28829 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:23.680833 29043 log.cc:927] Time spent T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:23.681438 28929 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:23.683102 29035 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:23.653807 29025 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:10:23.709287 23621 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
W20260709 13:10:23.712815 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.773206 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.625887 28907 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:23.624963 28918 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:23.786731 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:23.783981 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:23.689639 28928 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:23.701077 28936 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:23.804623 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:23.804147 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 244752us
I20260709 13:10:23.619995 29028 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:23.796965 29045 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.119s	user 0.000s	sys 0.002s
I20260709 13:10:23.771004 29036 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:23.816223 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 114762us
I20260709 13:10:23.770767 29063 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:23.817895 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 461285us
W20260709 13:10:23.820482 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 275754us
W20260709 13:10:23.984906 24358 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 3.116s (SENT)
I20260709 13:10:23.985028 23778 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:23.985529 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:23.825569 28918 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:23.826598 29048 log.cc:927] Time spent T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:10:23.815094 28899 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:23.830538 29031 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:23.648635 29032 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:23.862547 23629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.001s	sys 0.010s
I20260709 13:10:23.973272 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:23.833397 28907 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:23.974419 28884 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:23.785811 28929 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.016860 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:24.019032 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.018359 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:24.021684 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 48501.9us
I20260709 13:10:24.022107 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:24.022563 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.023350 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:24.011392 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2810) took 1157 ms. Trace:
I20260709 13:10:24.024135 23593 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:23.818984 28952 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:23.819406 28936 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:24.025075 23593 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.026265 23773 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:24.009981 23669 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:24.027343 23772 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:10:24.020671 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 247784us
I20260709 13:10:24.031100 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.024425 23703 rpcz_store.cc:276] 0709 13:10:22.853872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.858013 (+  4141us) service_pool.cc:224] Handling call
0709 13:10:22.858402 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.144451 (+286049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.144481 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.145089 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.356689 (+211600us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:23.356732 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.356815 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.011097 (+654282us) raft_consensus.cc:1685] finished
0709 13:10:24.011128 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.011314 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85907,"raft.queue_time_us":184564,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":15858,"thread_start_us":410799,"threads_started":2,"wal-append.queue_time_us":396734}
W20260709 13:10:24.044075 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.044349 23775 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:24.044514 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:24.045143 23626 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:24.027797 28998 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.077626 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.011963 29082 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:24.048285 28884 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:24.070569 28953 consensus_meta.cc:287] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.748s	user 0.018s	sys 0.002s
I20260709 13:10:24.062057 28994 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:24.091993 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 66949.7us
I20260709 13:10:24.116674 23593 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.117288 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2807) took 1273 ms. Trace:
I20260709 13:10:24.118439 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:24.121011 23704 raft_consensus.cc:2410] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:10:24.087371 29057 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:24.117873 23700 rpcz_store.cc:276] 0709 13:10:22.843591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.849792 (+  6201us) service_pool.cc:224] Handling call
0709 13:10:22.964414 (+114622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.216050 (+251636us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:23.229032 (+ 12982us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.540584 (+311552us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.603310 (+ 62726us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.604153 (+   843us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:23.604190 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.604250 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.117002 (+512752us) raft_consensus.cc:1685] finished
0709 13:10:24.117033 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.117209 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72895,"prepare.queue_time_us":164,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":179980,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":25613,"thread_start_us":466086,"threads_started":2,"wal-append.queue_time_us":364724}
I20260709 13:10:24.088111 29037 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:24.139349 29046 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.360s	user 0.000s	sys 0.000s
I20260709 13:10:24.139823 29037 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.085436 29066 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:24.020628 29031 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.098201 28896 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.134840 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.136292 28903 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.000378 29063 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.137427 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.138031 28936 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:24.137456 29053 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
W20260709 13:10:24.140664 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 112864us
I20260709 13:10:24.144285 29037 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:24.166667 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.167523 23775 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
W20260709 13:10:24.168337 29056 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:10:24.169318 29063 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.170053 29063 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:24.119683 28899 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:24.138535 28929 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.176697 29085 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:24.132253 28994 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:24.192198 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 57818.1us
I20260709 13:10:24.152571 29034 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.095163 28998 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.152957 29038 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.213529 23775 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:24.171166 29052 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:24.201941 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:24.161621 28884 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:10:24.223691 23667 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.3:45959 timed out after 1.917s (SENT) [suppressed 39 similar messages]
I20260709 13:10:24.164912 28972 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:10:24.192490 28994 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:24.227501 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.202894 28929 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.240653 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.188570 29082 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:24.187541 29085 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:24.198328 29037 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:24.232304 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:24.236994 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.229895 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.250036 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:24.262567 29071 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:10:24.263132 29049 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 13:10:24.263880 23626 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:24.267074 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:24.203270 29057 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:10:24.270130 29031 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.206205 28899 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:10:24.274662 29037 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:24.275166 29037 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:24.275553 29037 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:24.245479 28994 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.246208 29038 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:24.281787 29038 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:24.282385 29038 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:24.282838 29038 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:24.212062 29034 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:10:24.257033 29077 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:24.284757 29047 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.595s	user 0.000s	sys 0.004s
I20260709 13:10:24.284533 29077 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.285356 29034 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:24.286100 29034 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.286808 29077 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.287885 29032 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.254988 28929 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.288893 29028 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.157502 29066 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.289470 28944 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.289944 28929 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.290978 29066 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.267659 23626 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.299053 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.299548 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.301177 28904 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.303947 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2821) took 1441 ms. Trace:
I20260709 13:10:24.304399 23699 rpcz_store.cc:276] 0709 13:10:22.862710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.227893 (+365183us) service_pool.cc:224] Handling call
0709 13:10:23.228210 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.246720 (+ 18510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.246754 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.247322 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.410458 (+163136us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:23.410499 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.410568 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.284030 (+873462us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:24.292363 (+  8333us) raft_consensus.cc:1685] finished
0709 13:10:24.292388 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.303871 (+ 11483us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15369,"raft.queue_time_us":17858,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"spinlock_wait_cycles":74687872,"thread_start_us":162762,"threads_started":1,"wal-append.queue_time_us":374611}
I20260709 13:10:24.308954 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:24.316824 23624 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:24.314949 29037 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.324931 23626 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:24.259476 29085 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.340247 23774 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:24.338225 23628 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:10:24.337508 23623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58448 (request call id 973) took 1541 ms (client timeout 1583 ms). Trace:
W20260709 13:10:24.348549 23623 rpcz_store.cc:269] 0709 13:10:22.796438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.796627 (+   189us) service_pool.cc:224] Handling call
0709 13:10:24.337252 (+1540625us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b5400098154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:24.337408 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1815725312}
W20260709 13:10:24.334649 29076 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:24.338919 29034 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:24.399596 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 167074us
I20260709 13:10:24.400512 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.412678 29034 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:24.383852 29058 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:24.446241 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45808.1us
W20260709 13:10:24.414151 24359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.009s	sys 0.008s
W20260709 13:10:24.451959 24359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.009s	sys 0.009s
W20260709 13:10:24.452316 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 668406us
W20260709 13:10:24.412021 28890 consensus_meta.cc:287] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.845s	user 0.010s	sys 0.001s
I20260709 13:10:24.450093 28912 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:24.449107 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.456487 24359 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:24.459285 29092 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:24.413806 29082 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.462014 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 976) took 1181 ms. Trace:
I20260709 13:10:24.462442 23629 rpcz_store.cc:276] 0709 13:10:23.281082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.281633 (+   551us) service_pool.cc:224] Handling call
0709 13:10:23.281992 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.295657 (+ 13665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.295689 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.301182 (+  5493us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.994838 (+693656us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:23.994893 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.994986 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.461797 (+466811us) raft_consensus.cc:1685] finished
0709 13:10:24.461816 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.461959 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2675,"raft.queue_time_us":13974,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6369,"thread_start_us":638622,"threads_started":1,"wal-append.queue_time_us":1123182}
I20260709 13:10:24.466221 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:24.465036 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.472924 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:24.473016 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.456705 28909 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:24.479195 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 411717us
I20260709 13:10:24.484745 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:24.488220 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:24.489507 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:24.490097 23628 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:24.495360 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.458716 28890 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.508234 29072 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.497264 28909 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.508644 29065 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:24.510753 28948 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:24.512128 28948 raft_consensus.cc:3055] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:24.512565 28948 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:24.513760 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2254) took 1174 ms. Trace:
I20260709 13:10:24.514086 23621 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:24.516635 23621 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:24.466216 28912 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.514245 23627 rpcz_store.cc:276] 0709 13:10:23.339326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.357199 (+ 17873us) service_pool.cc:224] Handling call
0709 13:10:23.357628 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.553778 (+196150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.553823 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.554329 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:10:24.099764 (+545435us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:24.099827 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.099926 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.513538 (+413612us) raft_consensus.cc:1685] finished
0709 13:10:24.513557 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.513695 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9121,"raft.queue_time_us":186363,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":8366,"thread_start_us":670967,"threads_started":2,"wal-append.queue_time_us":870348}
I20260709 13:10:24.517968 28948 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.519585 28948 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.519786 28912 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.522037 23627 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:24.524443 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.525844 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:24.526484 29062 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:24.532766 28994 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.455651 29058 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.523919 23621 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:24.538699 29058 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.527715 29062 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:24.545099 29062 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:24.545267 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.545753 28994 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.547482 28829 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:24.546212 29062 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.550313 29062 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.552562 28894 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:24.552842 29010 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:24.546219 28449 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:10:24.555260 29084 raft_consensus.cc:3055] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:24.555686 29084 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:24.557053 29058 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:24.556736 29084 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.557581 29058 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.558081 29084 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.558332 29085 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.555699 29068 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:24.560230 29037 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.560451 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.560235 29068 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.559826 29058 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.561949 24385 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:24.563025 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:24.563695 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:24.563441 29068 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:24.565083 29058 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:24.566620 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.567406 24393 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:24.568250 23626 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:10:24.571817 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:24.560994 29037 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.580085 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:24.600873 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:24.574281 23743 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.569437 28890 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.591554 29065 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:24.504309 29066 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:24.552199 28648 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:24.609174 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:24.594480 28829 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:24.594847 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.612202 24391 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:24.602774 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.606151 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.594275 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:24.614192 24393 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:10:24.618398 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:24.620090 28004 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:24.622721 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.622877 24357 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:24.629696 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.630097 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:24.603041 29034 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:24.633324 28004 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:24.622269 28449 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:24.608911 28899 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:24.605580 29084 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.639335 28899 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:24.642200 29099 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:10:24.646029 23772 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:24.602174 29038 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.605376 29037 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.622308 28994 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:10:24.692335 29085 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.694494 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:24.694011 28884 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:24.697729 24393 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:24.649442 29094 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:24.700133 23629 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:24.635649 28352 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:10:24.657471 28899 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.624500 28648 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.703715 28884 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:24.708420 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:24.709160 28884 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.710067 28648 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.710867 23623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
I20260709 13:10:24.717519 28998 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.718631 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.719507 24393 raft_consensus.cc:2410] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:24.719658 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 977) took 1385 ms. Trace:
I20260709 13:10:24.720417 29037 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.707975 29038 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.711575 23623 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.727344 23623 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.720113 23620 rpcz_store.cc:276] 0709 13:10:23.333990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.335309 (+  1319us) service_pool.cc:224] Handling call
0709 13:10:23.352196 (+ 16887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.352403 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:23.588815 (+236412us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.702492 (+113677us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.702551 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:23.702596 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.702664 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.719455 (+1016791us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5400323cd0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:24.719592 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9101,"prepare.queue_time_us":183772,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":11625,"raft.queue_time_us":49422,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":38077696,"thread_start_us":315216,"threads_started":2}
I20260709 13:10:24.736447 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.741539 28762 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:10:24.756263 28765 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:24.770430 23623 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.784099 23623 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.788049 28352 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:24.829100 23620 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:24.818660 28882 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.011s	sys 0.006s
I20260709 13:10:24.825060 28695 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.823709 28352 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.842000 28695 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.845717 28972 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:24.849400 24391 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:24.852114 28765 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:24.851933 29001 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:24.852788 28765 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.855335 28765 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.868216 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:24.877359 28882 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.011s	sys 0.006s
I20260709 13:10:24.878062 28899 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.893653 28899 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.896478 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:24.897189 28352 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:24.896478 24385 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:24.907047 29038 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:24.907851 29038 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.910145 28352 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:24.911053 28352 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:24.911521 28352 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:24.912801 28352 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.914140 28352 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:24.915582 29007 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:24.916743 29007 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:24.917110 29007 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:24.918108 24390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 758) took 1588 ms. Trace:
I20260709 13:10:24.918540 24390 rpcz_store.cc:276] 0709 13:10:23.329734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.331877 (+  2143us) service_pool.cc:224] Handling call
0709 13:10:23.332211 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.607692 (+275481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.607741 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.607783 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:23.607829 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.917867 (+1310038us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54009849d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:24.917913 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.918049 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633105664}
I20260709 13:10:24.920125 29069 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:24.921286 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.923233 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.923938 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.920681 29069 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.927603 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.927785 28899 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:24.929633 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.927626 29069 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:24.912328 29038 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:24.934011 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.927954 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.938736 28695 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:24.938349 29007 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:24.939468 29007 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:24.934500 23622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 2258) took 1593 ms (client timeout 1608 ms). Trace:
W20260709 13:10:24.940424 23622 rpcz_store.cc:269] 0709 13:10:23.340756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.343606 (+  2850us) service_pool.cc:224] Handling call
0709 13:10:24.934333 (+1590727us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54002454d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:24.934447 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593259264}
I20260709 13:10:24.946436 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.947365 24388 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:24.959972 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2803) took 2117 ms. Trace:
W20260709 13:10:24.961815 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.960451 23696 rpcz_store.cc:276] 0709 13:10:22.842389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.846077 (+  3688us) service_pool.cc:224] Handling call
0709 13:10:22.846507 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.102463 (+255956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.102511 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.174934 (+ 72423us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.541825 (+366891us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:23.606930 (+ 65105us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.860141 (+1253211us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b1800192fa0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f522 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:10:24.959342 (+ 99201us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b1800192fa0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b3e221a40 00007f2b3e21c4e4 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287 00007f2b41327208
0709 13:10:24.959549 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.959621 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.959672 (+    51us) raft_consensus.cc:1685] finished
0709 13:10:24.959684 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.959911 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12060,"prepare.queue_time_us":71203,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":3173,"raft.queue_time_us":142444,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8356,"spinlock_wait_cycles":25540736,"thread_start_us":558560,"threads_started":2,"wal-append.queue_time_us":441606}
W20260709 13:10:24.962455 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.962711 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.963680 24387 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:24.964260 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:24.950556 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:24.972347 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:24.973646 24390 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:24.977586 29038 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:24.978371 29038 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:24.979435 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:24.986711 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.988214 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:24.991285 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:24.992863 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2833) took 1304 ms. Trace:
I20260709 13:10:24.993350 23695 rpcz_store.cc:276] 0709 13:10:23.688138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.733466 (+ 45328us) service_pool.cc:224] Handling call
0709 13:10:23.771300 (+ 37834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.771560 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:24.027919 (+256359us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.992483 (+964564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.992538 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:24.992589 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.992659 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.992793 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":963725,"prepare.queue_time_us":413239,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"thread_start_us":226520,"threads_started":1}
I20260709 13:10:24.976898 29075 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:24.980150 29026 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:25.047978 29026 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:24.998293 28952 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:25.051337 28952 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:25.054113 28952 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:25.054802 28903 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:25.056442 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:25.060752 23593 leader_election.cc:336] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.914s (SENT)
I20260709 13:10:24.978957 29029 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.013151 29038 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:25.021574 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:25.021873 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.022220 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.022833 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.067023 23592 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:25.067821 23771 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:25.023048 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:25.029668 29094 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:10:25.040417 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 771320us
I20260709 13:10:25.040781 29028 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:25.044533 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2834) took 1356 ms. Trace:
I20260709 13:10:25.068367 23774 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:25.068758 23774 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:25.063028 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:25.069585 23774 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.070530 23774 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.067090 23772 raft_consensus.cc:2410] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:25.070583 23769 raft_consensus.cc:2410] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:10:25.071749 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.068600 23703 rpcz_store.cc:276] 0709 13:10:23.688402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.039347 (+350945us) service_pool.cc:224] Handling call
0709 13:10:24.039699 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.041921 (+  2222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:24.363413 (+321492us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.044004 (+680591us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:25.044082 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:25.044155 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.044238 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.044412 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":444301,"prepare.queue_time_us":185616,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":63,"raft.queue_time_us":445563,"spinlock_wait_cycles":32973440,"thread_start_us":530994,"threads_started":2,"wal-append.queue_time_us":269960}
I20260709 13:10:25.078259 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:25.080525 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:25.081612 23772 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:25.082595 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:25.085561 24389 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:10:25.099112 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.100471 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.102335 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.112775 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.114219 23772 raft_consensus.cc:2410] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:10:25.123366 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.125770 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:25.011543 29075 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:25.129014 29099 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:25.132566 29087 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.673s	user 0.003s	sys 0.000s
I20260709 13:10:25.078292 29026 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:25.139159 23774 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:25.142521 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:25.122171 29120 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:10:25.102969 29007 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:25.146605 29037 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:10:25.103161 28899 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:25.154256 29007 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.145393 29075 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:25.077823 29029 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:25.180178 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 1.1702e+06us
I20260709 13:10:25.183373 23669 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:25.121527 29094 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:25.190184 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:25.221020 23629 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:25.211319 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:25.231683 23622 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:25.232237 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:25.232875 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:25.233603 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:25.237555 23622 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:25.243960 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:25.249320 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.252169 29123 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:10:25.234550 29061 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 1.416s	user 0.005s	sys 0.000s
I20260709 13:10:25.234018 28953 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:25.191133 29026 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:25.252873 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2418) took 1448 ms. Trace:
I20260709 13:10:25.330542 23777 rpcz_store.cc:276] 0709 13:10:23.804569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.804684 (+   115us) service_pool.cc:224] Handling call
0709 13:10:23.805058 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.815538 (+ 10480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.815571 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.835209 (+ 19638us) log.cc:844] Serialized 26 byte log entry
0709 13:10:24.367744 (+532535us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:24.367801 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.367894 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.096858 (+728964us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:25.241062 (+144204us) raft_consensus.cc:1685] finished
0709 13:10:25.241096 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.252808 (+ 11712us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7236,"raft.queue_time_us":196573,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":21111,"spinlock_wait_cycles":12741888,"thread_start_us":339163,"threads_started":1,"wal-append.queue_time_us":421122}
I20260709 13:10:25.235042 28907 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:25.242125 29028 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:25.252368 29121 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:10:25.325695 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:25.329797 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 229955us
I20260709 13:10:25.244678 28903 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:25.306734 28953 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:10:25.403385 29122 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:10:25.403707 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:25.404633 29130 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:25.405519 29126 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:10:25.405355 29130 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:25.407428 29125 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:10:25.288851 28882 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:10:25.338655 28907 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.380064 29028 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:25.408034 29044 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:25.383606 28909 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:25.382985 28903 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:25.423765 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:25.428505 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:25.429593 23699 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:10:25.437613 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:25.439388 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:25.440228 23699 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:25.442555 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2256) took 2102 ms. Trace:
W20260709 13:10:25.442950 29127 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:10:25.415381 28907 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:25.417042 29028 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:25.444082 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:25.453732 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 174417us
I20260709 13:10:25.417078 28930 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:25.458495 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:25.459496 23699 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:25.423012 28903 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:25.443037 23625 rpcz_store.cc:276] 0709 13:10:23.340087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.367829 (+ 27742us) service_pool.cc:224] Handling call
0709 13:10:23.402506 (+ 34677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.413004 (+ 10498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.413037 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.419232 (+  6195us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.618828 (+199596us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:23.618885 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.618977 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.158319 (+1539342us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:25.436241 (+277922us) raft_consensus.cc:1685] finished
0709 13:10:25.436276 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.442475 (+  6199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":190837,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3304,"spinlock_wait_cycles":36403072,"thread_start_us":199103,"threads_started":1,"wal-append.queue_time_us":265411}
I20260709 13:10:25.422613 28904 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:25.427623 28944 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:25.464178 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:25.416584 28918 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:10:25.471200 23668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.003s	sys 0.039s
W20260709 13:10:25.492473 23668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.003s	sys 0.039s
I20260709 13:10:25.505554 23776 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:25.457067 29063 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:25.462333 29130 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:25.515798 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45507.8us
I20260709 13:10:25.521386 29136 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.524036 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:25.525892 29027 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:25.469664 28899 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:25.534029 23625 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:25.514638 28918 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:25.465704 28930 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.532538 29130 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:25.499630 28904 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.531303 29007 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:25.561796 28904 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:25.503611 28352 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:10:25.456673 28953 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.559427 29130 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:25.564298 28953 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:25.564851 29130 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.566287 29130 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.502254 28944 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:25.573685 28944 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:25.577370 28884 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:25.580463 29128 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:25.582136 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:25.583245 23625 raft_consensus.cc:2410] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:10:25.584265 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:25.533915 28899 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.597436 23703 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:25.552534 29029 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:25.601295 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2830) took 1914 ms. Trace:
I20260709 13:10:25.604547 23702 rpcz_store.cc:276] 0709 13:10:23.687259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.687872 (+   613us) service_pool.cc:224] Handling call
0709 13:10:23.688186 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.984942 (+1296756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.984973 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:24.985588 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.174249 (+188661us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:25.174325 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.569788 (+395463us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400131ad4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:25.569846 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.589486 (+ 19640us) raft_consensus.cc:1685] finished
0709 13:10:25.589513 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.601210 (+ 11697us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1200940,"raft.queue_time_us":1168796,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":5655,"spinlock_wait_cycles":306062592,"thread_start_us":188290,"threads_started":1,"wal-append.queue_time_us":455455}
I20260709 13:10:25.606199 24385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46566 (request call id 822) took 1042 ms. Trace:
I20260709 13:10:25.518963 29063 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:25.534420 29027 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.606663 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:25.613214 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 209576us
I20260709 13:10:25.614094 23702 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:25.606637 24385 rpcz_store.cc:276] 0709 13:10:24.563327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.563449 (+   122us) service_pool.cc:224] Handling call
0709 13:10:25.605975 (+1042526us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54001f1dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:25.606108 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420487040}
I20260709 13:10:25.422425 29044 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.617710 23667 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:25.620759 29029 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:25.624287 29029 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:25.626101 23667 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:25.626916 29026 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:25.630127 29075 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:25.632150 29029 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:25.619093 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:25.634804 23702 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.534108 29136 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.609393 28862 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:25.645330 29138 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:10:25.646590 23667 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:25.650491 23699 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:25.651800 29029 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:10:25.663741 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:25.665722 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:25.666006 23592 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:25.673238 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.673532 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:25.675865 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:25.653911 29129 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:25.680758 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.696077 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:25.677863 29131 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:25.704556 29111 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.000s	user 0.004s	sys 0.004s
I20260709 13:10:25.706490 29136 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:25.708578 29139 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:25.716029 29145 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:25.717808 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:25.720523 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:25.724278 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.724813 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.728367 28695 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.652139 28862 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:25.731720 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3205) took 1365 ms. Trace:
I20260709 13:10:25.732199 23628 rpcz_store.cc:276] 0709 13:10:24.366627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.494604 (+127977us) service_pool.cc:224] Handling call
0709 13:10:24.935002 (+440398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.935152 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.935171 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.935206 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:24.935235 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.935279 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.731545 (+796266us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002454d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:25.731662 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011775232}
I20260709 13:10:25.733625 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:25.678102 29057 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:25.738035 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.740726 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:25.742331 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.744395 23778 raft_consensus.cc:2376] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17. Re-sending same reply.
I20260709 13:10:25.744519 23776 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:25.747788 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.735208 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:25.744431 23702 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:25.767553 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:25.768469 23702 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:25.769619 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:25.770426 23702 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.731189 29026 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:25.734280 29136 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:25.751355 28695 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.696587 28903 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.830077 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:25.840405 23699 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.841777 24358 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:25.843648 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:25.846112 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:25.850965 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:25.852985 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.798622 28921 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:25.863289 23704 raft_consensus.cc:2393] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 9: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:25.849697 29142 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:25.863575 28921 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.876387 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.852409 29092 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:25.881340 23702 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:25.853128 28930 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:25.905063 28695 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:25.908628 29134 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:10:25.879310 29131 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.912096 29027 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:25.913509 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.947661 23775 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:25.914314 28903 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:25.870863 28648 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:25.915385 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:25.863056 29129 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:25.920210 29145 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.922255 28862 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:10:25.924451 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:25.928799 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2824) took 2638 ms. Trace:
I20260709 13:10:25.932590 28910 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:10:25.933333 29135 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:25.875329 29136 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:25.942085 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:25.943451 23699 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:25.875023 29026 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:25.863646 29063 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:25.873998 29044 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:25.949620 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:26.059223 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 117269us
I20260709 13:10:25.887939 29075 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:25.888180 29092 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:25.956624 23698 rpcz_store.cc:276] 0709 13:10:23.290252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.614267 (+324015us) service_pool.cc:224] Handling call
0709 13:10:23.614697 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.990558 (+1375861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.990591 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:24.993727 (+  3136us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.458123 (+464396us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:25.458187 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.928246 (+470059us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400025654. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:25.928292 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.928339 (+    47us) raft_consensus.cc:1685] finished
0709 13:10:25.928352 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.928729 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":977324,"raft.queue_time_us":995430,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":36541,"spinlock_wait_cycles":915361152,"thread_start_us":443786,"threads_started":1,"wal-append.queue_time_us":508069}
I20260709 13:10:26.062688 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:25.942333 29029 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:26.060410 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:26.099160 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.069079 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:26.109197 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.109951 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.113730 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:26.114403 23703 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:26.115248 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:26.116429 23773 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:26.117440 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:26.118060 23622 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:26.118634 23593 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:26.119293 23622 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:26.120756 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:26.121536 23704 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:26.122287 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:26.113798 23628 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:10:26.071893 29130 consensus_meta.cc:287] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
W20260709 13:10:26.060424 28907 consensus_meta.cc:287] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.002s
I20260709 13:10:26.094411 28882 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:26.075809 29026 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:26.080147 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:25.952735 29131 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:25.963131 28944 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:10:26.127270 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:26.128736 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:25.956586 28648 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:26.093267 29092 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:26.133214 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 463254us
I20260709 13:10:26.157770 23592 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:26.123556 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:26.136003 23702 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:26.136865 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2831) took 2449 ms. Trace:
I20260709 13:10:26.159291 23701 rpcz_store.cc:276] 0709 13:10:23.687548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.687686 (+   138us) service_pool.cc:224] Handling call
0709 13:10:23.688063 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.467389 (+1779326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.467471 (+    82us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.468579 (+  1108us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.584856 (+116277us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b4800190158. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:10:25.868730 (+283874us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:25.868785 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.135437 (+266652us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540040e054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:26.135497 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.135544 (+    47us) raft_consensus.cc:1685] finished
0709 13:10:26.135562 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.135715 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":958075,"raft.queue_time_us":1003117,"raft.run_cpu_time_us":10757,"raft.run_wall_time_us":544933,"spinlock_wait_cycles":847612672,"thread_start_us":809483,"threads_started":2,"wal-append.queue_time_us":547191}
I20260709 13:10:26.162559 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:26.096361 28695 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:26.071486 29028 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.000s
I20260709 13:10:26.152125 23698 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:26.177119 23703 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:26.178331 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:26.179131 23698 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:25.960501 29145 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:26.188057 23695 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.007s	sys 0.009s
I20260709 13:10:26.164776 23704 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:26.165495 23701 raft_consensus.cc:2410] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:10:26.162575 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.056291 28910 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:26.188473 23695 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.007s	sys 0.009s
I20260709 13:10:26.227150 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2835) took 2238 ms. Trace:
I20260709 13:10:26.230033 23700 rpcz_store.cc:276] 0709 13:10:23.989087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.133019 (+143932us) service_pool.cc:224] Handling call
0709 13:10:24.139203 (+  6184us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:25.008912 (+869709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.008958 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:25.060134 (+ 51176us) log.cc:844] Serialized 52 byte log entry
0709 13:10:25.133725 (+ 73591us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4800190158. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:10:25.413820 (+280095us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:25.798202 (+384382us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.798438 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.798545 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.177069 (+378524us) raft_consensus.cc:1685] finished
0709 13:10:26.226775 (+ 49706us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.227050 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":882605,"prepare.queue_time_us":457186,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":5456,"raft.queue_time_us":907987,"raft.run_cpu_time_us":2663,"raft.run_wall_time_us":112355,"spinlock_wait_cycles":23339904,"thread_start_us":622350,"threads_started":2,"wal-append.queue_time_us":558231}
I20260709 13:10:26.098583 29029 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:26.135102 28907 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:26.262907 23697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.023s
W20260709 13:10:26.265825 23697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.000s	sys 0.023s
I20260709 13:10:26.261274 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3235) took 1033 ms. Trace:
I20260709 13:10:26.267385 23627 rpcz_store.cc:276] 0709 13:10:25.228241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.840140 (+611899us) service_pool.cc:224] Handling call
0709 13:10:25.858971 (+ 18831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.859171 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:25.875451 (+ 16280us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.260758 (+385307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.260835 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:26.260902 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.260999 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.261180 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47022,"prepare.queue_time_us":15822,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"thread_start_us":333441,"threads_started":1}
W20260709 13:10:26.265028 23620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.000s	sys 0.014s
W20260709 13:10:26.272913 23620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.000s	sys 0.014s
I20260709 13:10:26.275534 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:26.276712 23703 raft_consensus.cc:2393] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:26.193208 28953 consensus_meta.cc:287] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.628s	user 0.013s	sys 0.000s
I20260709 13:10:26.277515 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:26.277784 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:26.278579 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:26.264204 29087 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:10:26.281301 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.279628 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:26.358201 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:26.381237 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3228) took 1157 ms. Trace:
I20260709 13:10:26.424853 24386 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:26.190215 29028 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:26.187352 29082 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.139s
I20260709 13:10:26.329483 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:26.326929 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:26.282014 23699 raft_consensus.cc:2410] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:26.352798 28884 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:26.349586 28972 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.325815 23668 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:26.252136 29142 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.367287 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:26.278543 23704 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.266043 28862 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:26.360299 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:26.277709 29086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.008s	sys 0.007s
I20260709 13:10:26.424889 23629 rpcz_store.cc:276] 0709 13:10:25.223668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.229296 (+  5628us) service_pool.cc:224] Handling call
0709 13:10:25.229770 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.230083 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:25.603072 (+372989us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.380860 (+777788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.380918 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:26.380972 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.381044 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.381174 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17425,"prepare.queue_time_us":296264,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":450535,"thread_start_us":1072920,"threads_started":3,"wal-append.queue_time_us":663460}
W20260709 13:10:26.434312 24358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.020s	sys 0.043s
I20260709 13:10:26.437318 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2214) took 1006 ms. Trace:
I20260709 13:10:26.452843 24394 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:26.453068 23703 rpcz_store.cc:276] 0709 13:10:25.430793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.279402 (+848609us) service_pool.cc:224] Handling call
0709 13:10:26.437221 (+157819us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:26.439354 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 113634us
I20260709 13:10:26.454082 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:26.454102 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:26.455017 24358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.020s	sys 0.043s
W20260709 13:10:26.455308 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 605995us
I20260709 13:10:26.455663 23668 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:26.456861 23668 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:26.460196 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:26.460877 23703 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:10:26.461880 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:26.463933 23703 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 17. Current term is 18. Ops: [16.13-17.14]
I20260709 13:10:26.482522 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:26.487469 29154 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:10:26.491539 29028 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:26.501928 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 705) took 1076 ms. Trace:
I20260709 13:10:26.502657 23698 rpcz_store.cc:276] 0709 13:10:25.425970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.501006 (+1075036us) service_pool.cc:224] Handling call
0709 13:10:26.501358 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.501562 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.501586 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.501644 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:26.501680 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.501735 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.501863 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.451977 28894 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:26.465026 29160 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:26.492450 28648 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:26.493650 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 704) took 1059 ms. Trace:
I20260709 13:10:26.465358 29026 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:26.484392 28953 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:26.464460 29148 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.459838 29156 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:26.441300 29130 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.448285 28972 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:26.550447 23703 rpcz_store.cc:276] 0709 13:10:25.425636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.463236 (+1037600us) service_pool.cc:224] Handling call
0709 13:10:26.463628 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:26.484678 (+ 21050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.484923 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.513790 28648 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:26.527215 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 419389us
I20260709 13:10:26.447439 28884 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:26.460108 28862 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:26.513935 29131 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:26.513134 29160 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:26.560951 29028 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:26.516093 28904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.014s	sys 0.049s
W20260709 13:10:26.588514 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.563695 29155 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:10:26.573498 23698 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:26.569731 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2227) took 1103 ms. Trace:
W20260709 13:10:26.573915 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 455331us
I20260709 13:10:26.552003 28953 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.536108 28910 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:26.517561 29145 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:26.462759 28944 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:26.520147 28894 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:26.496927 29142 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:26.526034 29038 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:26.600590 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:26.600253 23703 rpcz_store.cc:276] 0709 13:10:25.466813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.568732 (+1101919us) service_pool.cc:224] Handling call
0709 13:10:26.569206 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.569396 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.569420 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.569461 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:26.569496 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.569548 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.569667 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.571986 29086 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:26.691572 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2233) took 1008 ms. Trace:
W20260709 13:10:26.572584 29057 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.012s	sys 0.012s
I20260709 13:10:26.692121 23703 rpcz_store.cc:276] 0709 13:10:25.683306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.689912 (+1006606us) service_pool.cc:224] Handling call
0709 13:10:26.691013 (+  1101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.691205 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.691232 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.691278 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:26.691318 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.691389 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.691515 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.580597 28648 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:26.580085 28907 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:26.571676 29167 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:26.588524 28904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.015s	sys 0.050s
W20260709 13:10:26.625285 28911 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.010s	sys 0.017s
I20260709 13:10:26.607064 28953 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.568362 29156 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:26.696650 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 421668us
I20260709 13:10:26.627441 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3224) took 1410 ms. Trace:
W20260709 13:10:26.687448 29157 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
W20260709 13:10:26.727885 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 127370us
I20260709 13:10:26.687762 29038 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:26.592605 29028 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:26.684805 29163 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:26.726632 29086 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:26.695979 29057 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.012s	sys 0.012s
I20260709 13:10:26.752172 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:26.754498 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:26.729609 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2837) took 1044 ms. Trace:
I20260709 13:10:26.752291 23624 rpcz_store.cc:276] 0709 13:10:25.216720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.219106 (+  2386us) service_pool.cc:224] Handling call
0709 13:10:25.253210 (+ 34104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.253479 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:25.762317 (+508838us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.626941 (+864624us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.627021 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:26.627091 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.627179 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.627346 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136937,"prepare.queue_time_us":334524,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":409261,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":34658,"thread_start_us":1211032,"threads_started":3,"wal-append.queue_time_us":722306}
I20260709 13:10:26.773708 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:26.775596 24386 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.775229 23703 rpcz_store.cc:276] 0709 13:10:25.684967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.700284 (+1015317us) service_pool.cc:224] Handling call
0709 13:10:26.700922 (+   638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.701204 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.701247 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.701311 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:26.701391 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.701471 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.701641 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.787642 23704 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:26.788611 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2234) took 1105 ms. Trace:
I20260709 13:10:26.789122 23704 rpcz_store.cc:276] 0709 13:10:25.683644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.275253 (+591609us) service_pool.cc:224] Handling call
0709 13:10:26.788532 (+513279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.791070 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2839) took 1105 ms. Trace:
I20260709 13:10:26.791590 23704 rpcz_store.cc:276] 0709 13:10:25.685629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.790059 (+1104430us) service_pool.cc:224] Handling call
0709 13:10:26.790451 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.790672 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.790706 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.790760 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:26.790813 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.790881 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.791007 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.793614 23593 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:26.754827 29029 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:26.756239 29174 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.765167 29038 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:26.771883 29164 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:10:26.795902 23703 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:26.804605 29161 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:10:26.769515 29095 raft_consensus.cc:3055] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:26.785616 29057 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:26.772687 29036 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.825174 24386 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:26.806018 29084 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:26.844363 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2838) took 1159 ms. Trace:
I20260709 13:10:26.860368 23703 rpcz_store.cc:276] 0709 13:10:25.685294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.777788 (+1092494us) service_pool.cc:224] Handling call
0709 13:10:26.778154 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.844002 (+ 65848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.844284 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.848572 23704 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:26.861769 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:26.862568 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2842) took 1176 ms. Trace:
I20260709 13:10:26.807058 29179 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.861933 23703 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:26.869127 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2843) took 1182 ms. Trace:
I20260709 13:10:26.862941 23704 rpcz_store.cc:276] 0709 13:10:25.686594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.839906 (+1153312us) service_pool.cc:224] Handling call
0709 13:10:26.840261 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.862279 (+ 22018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.862510 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.864356 29057 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:26.869488 23703 rpcz_store.cc:276] 0709 13:10:25.686897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.861356 (+1174459us) service_pool.cc:224] Handling call
0709 13:10:26.861725 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.868821 (+  7096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.869065 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.876474 23703 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:26.877306 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2846) took 1189 ms. Trace:
I20260709 13:10:26.877840 23703 rpcz_store.cc:276] 0709 13:10:25.690425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.875675 (+1185250us) service_pool.cc:224] Handling call
0709 13:10:26.876127 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.876979 (+   852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.877229 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:26.869457 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 75947us
W20260709 13:10:26.794332 29030 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.362s	user 0.013s	sys 0.013s
I20260709 13:10:26.881055 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:26.884796 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:26.773861 29163 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:26.882364 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2847) took 1186 ms. Trace:
I20260709 13:10:26.892022 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:26.846823 29095 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:26.929332 29095 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:26.930728 29095 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.866235 29029 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.932086 29029 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:26.934865 29029 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:26.867481 29177 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.892716 29179 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:26.917871 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 699) took 1493 ms. Trace:
I20260709 13:10:26.937394 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2442) took 1196 ms. Trace:
I20260709 13:10:26.922134 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 2443) took 1175 ms. Trace:
I20260709 13:10:26.941691 23776 rpcz_store.cc:276] 0709 13:10:25.746848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.746997 (+   149us) service_pool.cc:224] Handling call
0709 13:10:25.771138 (+ 24141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.771564 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.771593 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.792546 (+ 20953us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.172956 (+380410us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:26.173016 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.173111 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.921908 (+748797us) raft_consensus.cc:1685] finished
0709 13:10:26.921936 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.922071 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17137,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9547,"thread_start_us":310575,"threads_started":1,"wal-append.queue_time_us":554997}
I20260709 13:10:26.941479 23777 rpcz_store.cc:276] 0709 13:10:25.741139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.746385 (+  5246us) service_pool.cc:224] Handling call
0709 13:10:25.750298 (+  3913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.750758 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.750797 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.760223 (+  9426us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.192031 (+431808us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:26.216284 (+ 24253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.216392 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.937065 (+720673us) raft_consensus.cc:1685] finished
0709 13:10:26.937099 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.937298 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":1873,"spinlock_wait_cycles":1662208,"thread_start_us":431376,"threads_started":1,"wal-append.queue_time_us":800641}
I20260709 13:10:26.941226 23696 rpcz_store.cc:276] 0709 13:10:25.423949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.424971 (+  1022us) service_pool.cc:224] Handling call
0709 13:10:25.661966 (+236995us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:25.662511 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.662562 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:25.663255 (+   693us) log.cc:844] Serialized 52 byte log entry
0709 13:10:25.952365 (+289110us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:26.055028 (+102663us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.058480 (+  3452us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.099183 (+ 40703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.099293 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.917584 (+818291us) raft_consensus.cc:1685] finished
0709 13:10:26.917614 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.917794 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91169,"prepare.queue_time_us":53800,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":83,"raft.queue_time_us":46338,"raft.run_cpu_time_us":450,"raft.run_wall_time_us":58028,"spinlock_wait_cycles":1300352,"thread_start_us":236231,"threads_started":1,"wal-append.queue_time_us":494321}
I20260709 13:10:26.948887 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2848) took 1251 ms. Trace:
I20260709 13:10:26.949396 23696 rpcz_store.cc:276] 0709 13:10:25.697319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.947485 (+1250166us) service_pool.cc:224] Handling call
0709 13:10:26.948173 (+   688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.948444 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.948482 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.948539 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:26.948581 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.948654 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.948808 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.951207 23696 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:26.882717 29030 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.459s	user 0.013s	sys 0.013s
I20260709 13:10:26.888244 29175 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:26.953797 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3230) took 1727 ms. Trace:
I20260709 13:10:26.966439 23620 rpcz_store.cc:276] 0709 13:10:25.226423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.226551 (+   128us) service_pool.cc:224] Handling call
0709 13:10:25.245110 (+ 18559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.245603 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:25.617486 (+371883us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.701875 (+1084389us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.702596 (+   721us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.702777 (+   181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:26.702818 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.702906 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.953477 (+250571us) raft_consensus.cc:1685] finished
0709 13:10:26.953510 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.953714 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70696,"prepare.queue_time_us":342127,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":362391,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":47850,"thread_start_us":1269033,"threads_started":3,"wal-append.queue_time_us":819598}
I20260709 13:10:26.875851 29084 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:26.885689 29080 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:26.881727 29176 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:26.890084 23703 rpcz_store.cc:276] 0709 13:10:25.695983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.878884 (+1182901us) service_pool.cc:224] Handling call
0709 13:10:26.879241 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.879471 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.879510 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.879566 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:26.879619 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.879683 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.882292 (+  2609us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:26.938752 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46795.1us
W20260709 13:10:26.922966 23592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.016s	sys 0.010s
I20260709 13:10:26.871604 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2844) took 1184 ms. Trace:
I20260709 13:10:26.961823 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2849) took 1264 ms. Trace:
I20260709 13:10:26.845157 29174 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:26.988719 23592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.016s	sys 0.011s
I20260709 13:10:26.894511 28862 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:26.989385 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 831653us
I20260709 13:10:26.958031 28972 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:26.919835 29160 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:26.952672 28967 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:26.954819 29075 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:26.987753 23696 rpcz_store.cc:276] 0709 13:10:25.697643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.950612 (+1252969us) service_pool.cc:224] Handling call
0709 13:10:26.950981 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.961528 (+ 10547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.961762 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:27.040318 28967 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.041615 23696 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:27.042337 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2851) took 1317 ms. Trace:
I20260709 13:10:27.042897 28967 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.042752 23696 rpcz_store.cc:276] 0709 13:10:25.725220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.040847 (+1315627us) service_pool.cc:224] Handling call
0709 13:10:27.041268 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.042076 (+   808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.042269 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.939569 29186 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:27.044476 23696 raft_consensus.cc:1240] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:26.987759 23704 rpcz_store.cc:276] 0709 13:10:25.687199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.870819 (+1183620us) service_pool.cc:224] Handling call
0709 13:10:26.871102 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.871271 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.871293 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.871339 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:26.871371 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.871421 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.871539 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:27.020916 23593 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:27.022316 23703 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:27.045687 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2850) took 1320 ms. Trace:
I20260709 13:10:27.046103 23703 rpcz_store.cc:276] 0709 13:10:25.724906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.988597 (+1263691us) service_pool.cc:224] Handling call
0709 13:10:27.021909 (+ 33312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.045384 (+ 23475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.045626 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:27.046797 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2853) took 1321 ms. Trace:
I20260709 13:10:27.047199 23696 rpcz_store.cc:276] 0709 13:10:25.725738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.043966 (+1318228us) service_pool.cc:224] Handling call
0709 13:10:27.044278 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.046535 (+  2257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.046737 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.983444 29175 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.048044 29175 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:27.048758 29185 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:10:26.941011 29179 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:27.027567 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45086 (request call id 2222) took 1572 ms. Trace:
I20260709 13:10:27.056077 23699 rpcz_store.cc:276] 0709 13:10:25.455193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.057219 (+602026us) service_pool.cc:224] Handling call
0709 13:10:27.027315 (+970096us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400131fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:27.027496 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336326400}
W20260709 13:10:27.023626 29137 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 1.404s	user 0.004s	sys 0.001s
I20260709 13:10:27.034281 29191 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:27.036613 29181 log.cc:927] Time spent T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 13:10:27.048072 29173 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:10:27.044039 29186 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:26.961997 28884 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.078347 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2858) took 1268 ms. Trace:
W20260709 13:10:27.078711 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 57902us
I20260709 13:10:26.877759 29036 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:26.984987 28911 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:26.957077 29177 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.079519 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:26.893548 29086 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.061856 29156 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.015515 29142 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:27.014478 28648 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:27.018114 29176 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:27.066776 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.078034 29190 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.076795 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.049928 29188 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.078730 23699 rpcz_store.cc:276] 0709 13:10:25.810293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.056971 (+1246678us) service_pool.cc:224] Handling call
0709 13:10:27.077831 (+ 20860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.078020 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.078045 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:27.078091 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:27.078130 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.078183 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.078292 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:27.085930 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.062496 29179 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:27.060271 29084 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:27.096355 23624 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:27.073997 29075 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:27.074308 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.189231 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.189894 23629 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:27.079960 29028 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:26.993604 29080 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.090253 29171 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:27.087261 29187 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:27.137347 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.140465 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:27.141963 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.225731 23777 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:10:27.151300 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.161811 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.086339 28911 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.187515 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.232136 23776 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:27.188479 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.192121 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:27.234223 24390 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:27.192065 24389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 775) took 1063 ms. Trace:
I20260709 13:10:27.098260 29156 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:27.223026 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:27.243979 23771 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:27.226233 23777 pending_rounds.cc:85] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 7
I20260709 13:10:27.229154 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2859) took 1400 ms. Trace:
I20260709 13:10:27.244951 23777 pending_rounds.cc:107] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:10:27.245322 23777 raft_consensus.cc:2889] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.244994 23699 rpcz_store.cc:276] 0709 13:10:25.830796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.102954 (+1272158us) service_pool.cc:224] Handling call
0709 13:10:27.228526 (+125572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.228764 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.228805 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:27.228870 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:27.228921 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.228994 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.229098 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:27.230796 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.241046 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.233449 23775 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:27.248759 23699 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:27.249325 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2860) took 1322 ms. Trace:
I20260709 13:10:27.249693 23699 rpcz_store.cc:276] 0709 13:10:25.926821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.246323 (+1319502us) service_pool.cc:224] Handling call
0709 13:10:27.248439 (+  2116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.249106 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.249276 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:27.115945 29142 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:27.255520 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 59133.2us
I20260709 13:10:27.238927 24389 rpcz_store.cc:276] 0709 13:10:26.128692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.128993 (+   301us) service_pool.cc:224] Handling call
0709 13:10:26.129294 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.129585 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:26.585845 (+456260us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.191580 (+605735us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:27.191673 (+    93us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:27.191757 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.191845 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.192011 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":441689,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":32,"raft.queue_time_us":180074,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":1054393,"threads_started":3,"wal-append.queue_time_us":450336}
I20260709 13:10:27.075863 29191 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.223963 29171 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:27.267388 23771 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:27.271834 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2862) took 1336 ms. Trace:
I20260709 13:10:27.272352 23699 rpcz_store.cc:276] 0709 13:10:25.935249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.250555 (+1315306us) service_pool.cc:224] Handling call
0709 13:10:27.271148 (+ 20593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.271370 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.271408 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:27.271480 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:27.271525 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.271595 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.271764 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:27.279914 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 259603us
I20260709 13:10:27.257104 29201 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.290874 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.108186 29188 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.285941 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:27.293413 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2863) took 1357 ms. Trace:
I20260709 13:10:27.294507 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.294031 23699 rpcz_store.cc:276] 0709 13:10:25.935619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.273492 (+1337873us) service_pool.cc:224] Handling call
0709 13:10:27.292701 (+ 19209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.292975 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.293016 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:27.293073 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:27.293120 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.293196 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.293339 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:27.301606 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.270048 29171 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:27.308048 29136 consensus_meta.cc:287] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.249s	user 0.011s	sys 0.005s
I20260709 13:10:27.309764 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.315407 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.241475 29187 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:27.322149 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 242677us
I20260709 13:10:27.324970 23593 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:27.106979 29190 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.262401 29142 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.326354 23593 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:27.314255 29136 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:27.322908 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 130270us
W20260709 13:10:27.319770 29189 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:10:27.337792 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.315909 29094 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.345489 23620 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:27.331452 29037 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:27.351636 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.352173 29037 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:27.353415 29092 consensus_meta.cc:287] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 1.162s	user 0.013s	sys 0.000s
I20260709 13:10:27.353897 29092 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.354641 29037 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:27.355218 29037 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:27.310155 29075 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.355808 28899 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.332571 29198 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:27.304253 29201 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.331108 29160 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:27.335407 29069 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.339282 28648 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:27.358664 28899 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:27.365202 29172 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:27.341495 29174 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:27.356949 29037 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.329605 29196 consensus_queue.cc:1059] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:10:27.383047 29193 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:10:27.347064 29163 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.360771 29029 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.407521 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2855) took 1677 ms. Trace:
I20260709 13:10:27.294804 29176 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.371872 29216 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.417322 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:27.428007 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 142165us
I20260709 13:10:27.406318 29036 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:27.445608 29214 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:27.389042 29160 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.399991 29069 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.476287 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.477087 23772 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:10:27.410849 29172 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.421324 29186 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.410434 28899 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.483289 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:27.463790 29092 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:27.435649 29029 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.476887 29080 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.501828 28911 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:27.660960 28921 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:27.605729 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 279154us
W20260709 13:10:27.608484 23594 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.564s	user 0.017s	sys 0.010s
W20260709 13:10:27.668038 23594 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.624s	user 0.018s	sys 0.011s
I20260709 13:10:27.668730 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.610759 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.677366 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.677585 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:27.679116 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.613415 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.681671 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.681720 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.682736 23629 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:27.612850 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.623751 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:27.624863 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 183229us
I20260709 13:10:27.633987 23628 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:27.424816 23703 rpcz_store.cc:276] 0709 13:10:25.729888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.046943 (+1317055us) service_pool.cc:224] Handling call
0709 13:10:27.047234 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.047453 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:27.245137 (+197684us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.401999 (+156862us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:27.402064 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:27.402119 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.402207 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.407396 (+  5189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9526,"prepare.queue_time_us":34329,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2606,"raft.queue_time_us":20102,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":5957,"thread_start_us":341686,"threads_started":2}
I20260709 13:10:27.646689 23622 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:27.649371 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.658520 28899 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:27.612823 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2218) took 2180 ms. Trace:
I20260709 13:10:27.690670 23700 rpcz_store.cc:276] 0709 13:10:25.432527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.505075 (+1072548us) service_pool.cc:224] Handling call
0709 13:10:26.516744 (+ 11669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.517409 (+   665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.517437 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.517876 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.870206 (+352330us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:26.914644 (+ 44438us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.914882 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.914971 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.612042 (+697071us) raft_consensus.cc:1685] finished
0709 13:10:27.612119 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.612515 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46501,"raft.queue_time_us":402,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":20822,"spinlock_wait_cycles":9676032,"thread_start_us":297630,"threads_started":1,"wal-append.queue_time_us":463004}
I20260709 13:10:27.687346 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:27.696336 28882 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:27.696894 28882 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:27.697643 28882 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:27.701512 28899 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:27.683331 28765 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:27.555245 29168 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.729s	user 0.005s	sys 0.003s
I20260709 13:10:27.565992 29171 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.739818 29037 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:27.740738 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:27.741393 29171 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.547406 29172 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:27.571834 29175 consensus_meta.cc:287] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.002s
I20260709 13:10:27.763163 29175 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.764592 29069 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:27.765556 29142 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.766242 29175 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.766496 29080 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:27.766865 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.507974 29186 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:27.771574 29186 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:27.772377 29186 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.773729 29160 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.528431 29188 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:27.556207 29190 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.549108 29191 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:27.558255 29195 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
W20260709 13:10:27.554211 29200 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.335s	user 0.000s	sys 0.004s
I20260709 13:10:27.541628 29201 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:27.550544 29207 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:10:27.556818 29209 raft_consensus.cc:3055] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:27.784243 29209 raft_consensus.cc:740] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:10:27.547220 29215 log.cc:927] Time spent T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:10:27.478338 29216 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.790149 29216 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:27.790814 29214 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.540795 29095 consensus_meta.cc:287] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.610s	user 0.015s	sys 0.000s
I20260709 13:10:27.793398 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2219) took 2351 ms. Trace:
I20260709 13:10:27.793967 23702 rpcz_store.cc:276] 0709 13:10:25.441922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.515569 (+1073647us) service_pool.cc:224] Handling call
0709 13:10:26.537421 (+ 21852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.551157 (+ 13736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.551314 (+   157us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.562694 (+ 11380us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.919023 (+356329us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:26.958723 (+ 39700us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.958969 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.959045 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.557654 (+598609us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:27.792757 (+235103us) raft_consensus.cc:1685] finished
0709 13:10:27.792913 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.793192 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13272,"prepare.queue_time_us":44207,"prepare.run_cpu_time_us":4203,"prepare.run_wall_time_us":23375,"raft.queue_time_us":17196,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":25310,"spinlock_wait_cycles":6573824,"thread_start_us":330735,"threads_started":1,"wal-append.queue_time_us":713493}
I20260709 13:10:27.798552 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.800256 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.734809 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2854) took 2008 ms. Trace:
I20260709 13:10:27.735755 24388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 885) took 1386 ms. Trace:
I20260709 13:10:27.735599 28765 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:27.758363 23696 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.018s	sys 0.008s
I20260709 13:10:27.559572 29177 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:27.770565 29029 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:27.542555 29187 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:27.807076 29179 consensus_meta.cc:287] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.005s
I20260709 13:10:27.807961 29214 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.809263 29179 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.808614 29209 consensus_queue.cc:260] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.801759 24388 rpcz_store.cc:276] 0709 13:10:26.350240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.350376 (+   136us) service_pool.cc:224] Handling call
0709 13:10:26.350717 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.604226 (+253509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.604274 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.604785 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.913578 (+308793us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:26.913618 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.703246 (+789628us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b540035e154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:27.703353 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.703503 (+   150us) raft_consensus.cc:1685] finished
0709 13:10:27.703530 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.735478 (+ 31948us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157427,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":12033,"spinlock_wait_cycles":547762432,"thread_start_us":275610,"threads_started":1,"wal-append.queue_time_us":396565}
I20260709 13:10:27.807708 28765 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.767741 29080 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.812639 23623 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:27.811933 29214 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:27.817049 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:27.822751 29080 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.823935 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:27.825276 24388 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:27.827621 29175 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:27.828704 29175 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.834615 29175 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.831842 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.818785 23624 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:27.837772 23627 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
W20260709 13:10:27.824462 29156 consensus_meta.cc:287] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.006s
I20260709 13:10:27.801234 23621 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
W20260709 13:10:27.842442 23696 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.018s	sys 0.009s
I20260709 13:10:27.819954 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:27.802551 23593 connection.cc:256] RPC call timeout handler was delayed by -1.2849480759999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
I20260709 13:10:27.852281 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:27.854115 29156 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:27.855263 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 706) took 2428 ms. Trace:
I20260709 13:10:27.855847 23698 rpcz_store.cc:276] 0709 13:10:25.426304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.505022 (+1078718us) service_pool.cc:224] Handling call
0709 13:10:26.505341 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.590634 (+ 85293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.854621 (+1263987us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b54003b3b54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:27.855046 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156112640}
I20260709 13:10:27.835445 29209 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:27.845731 23593 connection.cc:256] RPC call timeout handler was delayed by -1.0961430449999625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260709 13:10:27.863479 23593 connection.cc:256] RPC call timeout handler was delayed by -1.0826435199999196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:10:27.864279 23593 connection.cc:256] RPC call timeout handler was delayed by -1.0733504349999521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
I20260709 13:10:27.836807 28899 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:27.616493 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:27.874181 29030 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.880600 29156 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:27.880256 29030 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.801625 23704 rpcz_store.cc:276] 0709 13:10:25.726007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.045170 (+1319163us) service_pool.cc:224] Handling call
0709 13:10:27.045463 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.045663 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:27.045965 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.733718 (+687753us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:27.733889 (+   171us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:27.734069 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.734202 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.734539 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3356,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":3606,"raft.queue_time_us":4703,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":10023,"thread_start_us":687106,"threads_started":2,"wal-append.queue_time_us":303513}
W20260709 13:10:27.882750 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 469030us
W20260709 13:10:27.891630 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 142007us
W20260709 13:10:27.896644 29159 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.266s	user 0.009s	sys 0.002s
W20260709 13:10:27.897454 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.899422 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 700) took 2475 ms. Trace:
I20260709 13:10:27.899866 28894 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.898593 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:27.881376 29156 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.904034 23626 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 9.
I20260709 13:10:27.905257 23621 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:27.908464 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:27.910061 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.911229 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.913216 29030 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.914606 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.915390 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.915993 28882 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.915521 23620 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:10:27.904253 29179 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.922991 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:27.924511 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.899931 23697 rpcz_store.cc:276] 0709 13:10:25.424298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.425064 (+   766us) service_pool.cc:224] Handling call
0709 13:10:25.425483 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.425962 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:25.561736 (+135774us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b4800190158. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:10:25.681397 (+119661us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.266328 (+584931us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.276473 (+ 10145us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.276614 (+   141us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:26.276852 (+   238us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.277117 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.277195 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.895533 (+1618338us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:27.898885 (+  3352us) raft_consensus.cc:1685] finished
0709 13:10:27.898907 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.899213 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33647,"prepare.queue_time_us":490002,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":41951,"raft.queue_time_us":78367,"raft.run_cpu_time_us":1313,"raft.run_wall_time_us":64533,"spinlock_wait_cycles":76579840,"thread_start_us":676699,"threads_started":2,"wal-append.queue_time_us":844391}
I20260709 13:10:27.927812 29052 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:27.930482 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:27.933879 29038 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.077s	user 0.010s	sys 0.014s
I20260709 13:10:27.934471 29038 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:27.941114 29156 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:27.944306 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:27.945338 23620 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:27.945369 24385 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:27.947309 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:27.947177 28899 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.954644 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:27.959467 24385 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:27.963313 24393 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
W20260709 13:10:27.964419 28953 consensus_meta.cc:287] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.198s	user 0.018s	sys 0.004s
I20260709 13:10:27.965106 28953 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:27.965758 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 67501.4us
I20260709 13:10:27.966079 29167 raft_consensus.cc:2764] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:27.966804 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:27.967908 28894 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:27.968132 28953 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:27.973222 29038 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:27.980090 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 72862.3us
I20260709 13:10:27.986594 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:27.987427 24393 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:27.989918 29186 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:27.992887 24359 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:10:27.994549 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.000301 29209 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:28.002468 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:28.012759 28882 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:28.012874 29077 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:28.017045 29077 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:28.013487 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:28.013797 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:28.014693 29094 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:28.024879 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.017659 29077 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:28.029422 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.030203 23626 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:28.032047 28882 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:28.032774 28882 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:28.033417 28882 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:28.034667 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:28.035991 29216 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:28.038302 23519 catalog_manager.cc:5697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:28.042196 29084 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:28.042706 29084 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.043984 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:28.043118 29084 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:28.045357 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:28.049654 29052 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:28.053046 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.040576 23519 catalog_manager.cc:5697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:28.057544 23519 catalog_manager.cc:5697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.020262 29094 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:28.060248 29094 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.050346 29052 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.066150 29052 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:28.070349 28953 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:28.071120 28953 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:28.074175 28953 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:28.077764 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:28.078449 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:28.078678 24389 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:28.081138 28894 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:28.082823 24359 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:28.084981 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.085611 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:28.085850 23621 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:28.086481 23620 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:28.087105 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:28.093421 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.094475 23778 raft_consensus.cc:2368] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:10:28.096333 23519 catalog_manager.cc:5697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:28.105670 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 144094us
I20260709 13:10:28.112066 28953 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:28.114168 28953 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.115901 23626 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:28.120016 28953 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:28.121841 23524 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 218) took 76559 ms (client timeout 15000 ms). Trace:
I20260709 13:10:28.125023 29186 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:28.128715 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:28.129604 23771 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.125298 23519 catalog_manager.cc:5697] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:28.132411 23519 catalog_manager.cc:5697] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 15, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 15 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:28.135979 23743 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:28.138746 28352 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:28.139320 28352 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.139775 28352 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:28.141762 29209 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:28.134464 23519 catalog_manager.cc:5697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.146333 29236 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:28.146885 29236 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:28.145095 23519 catalog_manager.cc:5697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.147912 29236 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:28.148824 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.149492 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.149755 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.151227 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.152453 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:28.153672 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:28.154585 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.159600 23626 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
W20260709 13:10:28.159235 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49219.5us
W20260709 13:10:28.162801 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 80098.6us
I20260709 13:10:28.165045 23771 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:28.160759 23775 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:28.164780 28967 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:28.169734 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.164130 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2857) took 2421 ms. Trace:
I20260709 13:10:28.180016 23620 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:28.181708 24389 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:28.189873 29206 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:28.190893 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.190003 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.190822 29238 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:28.191789 23778 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:28.191959 29238 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.192401 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.192812 23778 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:28.194099 23776 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:28.194612 29238 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:28.194962 28953 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:28.195588 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:28.195603 28953 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.200596 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:28.202562 29136 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:28.191032 23777 raft_consensus.cc:2410] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:10:28.203428 29136 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:28.194154 23778 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:28.206207 29136 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:28.202447 28953 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:28.214047 28967 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:28.214937 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.183799 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:28.177539 23696 rpcz_store.cc:276] 0709 13:10:25.742372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.048063 (+1305691us) service_pool.cc:224] Handling call
0709 13:10:27.048478 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.048701 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:27.886382 (+837681us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.005020 (+118638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.020769 (+ 15749us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:28.107510 (+ 86741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.113253 (+  5743us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.164041 (+ 50788us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":61435,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":2398,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8471,"thread_start_us":829402,"threads_started":2,"wal-append.queue_time_us":168495}
W20260709 13:10:28.228348 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44673.2us
I20260709 13:10:28.229724 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:28.231379 28967 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:28.223708 29236 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:28.241348 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:28.246460 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:28.249873 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:28.250573 24392 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:28.247982 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:28.242564 29206 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:28.258854 24393 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 8.
I20260709 13:10:28.252684 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:28.213076 28352 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:28.188982 29077 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.251987 28967 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:28.265763 29208 consensus_queue.cc:1059] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:10:28.266021 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:28.274695 24391 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
W20260709 13:10:28.122339 23524 rpcz_store.cc:269] 0709 13:09:11.562219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.589110 (+ 26891us) service_pool.cc:224] Handling call
0709 13:10:28.121550 (+76532440us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:21.074622 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:21.075455 (+   833us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:21.075501 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:10:21.075513 (+    12us) tablet.cc:662] Decoding operations
0709 13:10:21.075951 (+   438us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:21.076035 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:21.076061 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:21.076373 (+   312us) tablet.cc:701] Row locks acquired
0709 13:10:21.076420 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:10:21.076576 (+   156us) write_op.cc:270] Start()
0709 13:10:21.076712 (+   136us) write_op.cc:276] Timestamp: P: 1783602621076511 usec, L: 0
0709 13:10:21.076754 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:10:21.077492 (+   738us) log.cc:844] Serialized 538 byte log entry
0709 13:10:21.763789 (+686297us) op_driver.cc:464] REPLICATION: finished
0709 13:10:22.073488 (+309699us) write_op.cc:301] APPLY: starting
0709 13:10:22.073631 (+   143us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:22.079535 (+  5904us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:22.085053 (+  5518us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:22.195406 (+110353us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:22.195689 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:10:22.195762 (+    73us) write_op.cc:312] APPLY: finished
0709 13:10:22.196117 (+   355us) log.cc:844] Serialized 25 byte log entry
0709 13:10:22.196336 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:22.196424 (+    88us) write_op.cc:454] Released schema lock
0709 13:10:22.196481 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:22.196962 (+   481us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:22.196993 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1425367,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":178721,"apply.run_cpu_time_us":5585,"apply.run_wall_time_us":175833,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":604461,"prepare.run_cpu_time_us":11149,"prepare.run_wall_time_us":247020,"raft.queue_time_us":217815,"raft.run_cpu_time_us":41702,"raft.run_wall_time_us":245574,"replication_time_us":625380,"thread_start_us":689843,"threads_started":4,"wal-append.queue_time_us":274349,"wal-append.run_cpu_time_us":20412,"wal-append.run_wall_time_us":1932496}]]}
I20260709 13:10:28.283604 23668 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:28.271660 29206 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:10:28.291944 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.293064 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:28.297113 23592 leader_election.cc:400] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:10:28.297860 23592 leader_election.cc:403] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:28.302342 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:28.312947 23773 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:28.314146 29167 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
W20260709 13:10:28.315411 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 154342us
I20260709 13:10:28.320930 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.321743 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:28.325004 29248 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:10:28.339426 28953 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:28.359388 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.358670 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:28.373126 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 46685.8us
I20260709 13:10:28.363812 23624 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:28.344996 29238 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:28.355324 29214 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:28.385351 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.403115 29077 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:28.387857 29208 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:10:28.406585 29214 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:28.407872 29214 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.408456 28882 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.410887 28882 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:28.418064 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:28.441747 24392 raft_consensus.cc:2468] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:28.407178 29084 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:28.449784 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.384001 29238 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:28.384207 29038 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:28.284873 23519 catalog_manager.cc:5697] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.470243 29156 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:28.470762 28352 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:28.471429 29156 raft_consensus.cc:3055] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:28.470774 29084 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:28.472697 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 189235us
I20260709 13:10:28.471882 29156 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:28.483177 23668 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:28.465689 29238 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:28.497267 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 211381us
I20260709 13:10:28.466033 29038 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:28.513686 28930 raft_consensus.cc:2804] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:28.525408 28930 raft_consensus.cc:697] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:28.507678 29038 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.486446 29167 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:10:28.529192 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 61875.3us
I20260709 13:10:28.440382 28967 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.455790 29206 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.542615 28899 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:28.542331 28930 consensus_queue.cc:237] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.546398 29075 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:10:28.546747 28899 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.549414 28899 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:28.550194 29029 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:28.551195 29029 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:28.553881 29029 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:28.547192 29177 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:28.569545 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 52950.1us
I20260709 13:10:28.574131 23778 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:28.577529 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.527328 29052 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:28.589704 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.562012 29177 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:28.585489 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:28.538627 29156 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.621821 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:28.577184 28882 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:28.626255 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:28.628571 29177 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:28.597962 28899 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:28.569545 29179 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:10:28.654266 29167 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:28.669754 29029 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:28.671664 29029 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.661090 29177 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:28.671530 29167 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:28.652009 28899 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:28.653616 28882 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.667183 29075 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:28.697304 29094 consensus_meta.cc:287] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.005s
I20260709 13:10:28.694150 29029 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:28.713336 29052 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:28.720325 29179 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.720818 28930 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:10:28.586301 23519 catalog_manager.cc:5697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 13, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 13 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:28.743865 29254 log.cc:927] Time spent T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 13:10:28.748953 28899 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:28.784192 29179 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.787102 29179 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:28.753300 28882 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:28.716182 29094 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.754876 29238 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.755926 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:28.732339 29075 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:10:28.788187 29246 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.602s	user 0.004s	sys 0.003s
W20260709 13:10:28.789644 29236 consensus_meta.cc:287] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.003s
I20260709 13:10:28.804136 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:28.806262 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.803690 28930 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:28.792460 28953 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.813557 24388 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:28.814802 28930 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:28.815124 29167 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:28.817266 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 196834us
I20260709 13:10:28.803054 29075 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:28.820683 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.828609 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.830139 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.825325 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.815471 28930 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.834052 23628 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:28.837222 23626 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:28.830991 23624 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
W20260709 13:10:28.839187 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.831554 23667 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:28.835559 23629 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
W20260709 13:10:28.841050 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.842067 23622 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:28.854274 23624 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:28.855981 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.826745 29075 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.826993 28953 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.861130 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.856868 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.864122 23769 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:28.864243 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.872540 23628 raft_consensus.cc:2410] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:10:28.881923 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:28.858812 29167 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:28.882726 24390 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:28.892243 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:28.892349 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.894057 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.894230 23772 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:28.894765 23770 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:28.895267 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.877417 29259 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:28.896533 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.896673 29259 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:28.897763 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.899174 29259 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:28.900492 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:28.901130 23627 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.898905 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.907249 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.909916 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:28.853986 29029 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:28.923444 23778 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:28.927177 23775 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:28.961411 23772 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:10:28.964740 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44828.6us
W20260709 13:10:28.968626 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 86773.4us
I20260709 13:10:28.970325 28648 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:28.972155 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:28.972687 29258 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:10:28.973261 29063 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.973873 29063 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.982702 29156 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.924072 29259 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:10:28.984995 29259 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:28.985515 29259 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:28.986474 29259 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:28.986868 29075 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:28.988103 29238 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:28.989329 29267 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:28.957890 29094 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:28.847373 23519 catalog_manager.cc:5697] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
W20260709 13:10:28.992110 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 413365us
W20260709 13:10:28.992421 29257 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:10:28.992043 23519 catalog_manager.cc:5697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.993124 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:28.994576 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:28.996814 29263 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:28.997884 29263 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:28.998286 29263 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.998605 29263 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.999270 29259 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:29.000694 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.994055 23519 catalog_manager.cc:5697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.913321 29179 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:29.026926 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:29.033517 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:28.919528 29167 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.059139 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:29.052637 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.067387 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:29.075656 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 173920us
I20260709 13:10:29.075656 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:29.080082 23776 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:29.031947 28352 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:10:29.087858 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:29.092043 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:29.092247 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:29.052771 29238 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:10:29.087073 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:29.102093 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:29.108582 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:29.109517 23626 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:29.113647 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:29.092994 29267 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:29.114306 23623 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:10:29.115262 29267 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.107009 23628 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
W20260709 13:10:29.131245 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 136771us
W20260709 13:10:29.131985 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 209013us
W20260709 13:10:29.120600 29038 consensus_meta.cc:287] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.003s
I20260709 13:10:29.078739 29179 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.137367 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:29.146591 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:29.094986 29057 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:10:29.128945 28930 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:29.156260 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:29.153832 23627 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:10:29.154898 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:29.165449 23624 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:29.176509 24359 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:29.178470 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:29.142097 29038 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.177536 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:29.187320 23626 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:29.158120 29084 consensus_queue.cc:1059] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:10:29.190836 23628 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:29.172156 29029 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:29.191619 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:29.175650 28930 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:29.208703 23627 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.184561 29256 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:29.218518 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:29.138209 23519 catalog_manager.cc:5697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:29.248489 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 87152.5us
W20260709 13:10:29.250882 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.232542 28352 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:29.228191 29256 raft_consensus.cc:697] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:29.234838 29167 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:29.219540 28882 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:10:29.246291 29084 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:29.263470 28930 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.286305 28930 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:29.286788 24392 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:29.265666 29029 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.296738 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46080.5us
I20260709 13:10:29.320873 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 2323) took 1151 ms. Trace:
I20260709 13:10:29.292002 29273 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.321447 23775 rpcz_store.cc:276] 0709 13:10:28.153568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.184237 (+ 30669us) service_pool.cc:224] Handling call
0709 13:10:29.304398 (+1120161us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b5400430dd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:29.304546 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405493504}
W20260709 13:10:29.329151 24358 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.948s (SENT) [suppressed 18 similar messages]
I20260709 13:10:29.328142 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:29.304520 29236 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:29.346468 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:29.356036 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 137639us
I20260709 13:10:29.357666 24392 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:29.358148 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:29.334654 29179 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:29.335970 29236 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:29.360349 23627 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:29.362937 29272 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.149s	user 0.001s	sys 0.001s
I20260709 13:10:29.368156 24388 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:29.374678 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:29.373425 23743 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:29.336688 29029 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.380960 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:29.381633 24392 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:10:29.390415 28953 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:29.390985 23625 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:29.392037 29279 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:29.392563 29279 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.392906 29279 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.393409 29238 raft_consensus.cc:3055] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:29.394002 29238 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:29.394912 29238 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.378216 29069 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:29.351526 29273 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.376811 28930 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:29.399118 29273 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:29.399307 28930 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.361582 29256 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.399857 28930 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:29.402230 29277 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:10:29.402669 29236 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.404227 29238 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:29.417048 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:29.422340 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:29.377053 29038 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:29.425406 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 52104.6us
I20260709 13:10:29.430853 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:29.381366 29288 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:29.431618 23625 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:10:29.442176 28953 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:29.442577 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:29.442875 28953 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.443378 23622 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:29.445300 24359 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:29.445394 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:29.444022 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:29.443925 29287 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:29.418748 29268 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:29.446733 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:29.431627 29276 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:10:29.427590 29069 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:29.455569 29274 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:29.442710 29029 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:29.467221 28953 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:29.446885 29236 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:29.469210 23625 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:29.471276 28953 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:29.472195 28953 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:29.445120 29179 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:10:29.472788 28953 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.475178 28953 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:29.477170 29266 log.cc:927] Time spent T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:10:29.479866 29082 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:29.479537 28930 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.480340 29082 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.480736 29082 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:29.482227 28930 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:29.455751 29267 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:29.448400 29038 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:29.486919 29267 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:29.487414 29267 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:29.447090 29263 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.493559 29268 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.496268 23621 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:10:29.492681 29179 raft_consensus.cc:3055] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:29.497953 29179 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:29.404948 23519 catalog_manager.cc:5697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 17, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 17 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.499528 29179 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.501617 23519 catalog_manager.cc:5697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 15. New cstate: current_term: 15 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.502931 29179 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:29.505684 29063 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:29.463124 28882 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:29.462852 29288 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.449537 29177 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:10:29.510140 29288 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:29.510229 29177 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:29.510671 29177 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:29.427481 29273 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:10:29.517896 23628 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:29.528184 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:29.528481 23593 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:29.459373 29075 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:29.491642 29156 consensus_meta.cc:287] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.001s
I20260709 13:10:29.532071 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:29.537371 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:29.540611 29167 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:29.548455 29263 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:29.513728 28882 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:29.534430 29287 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:29.496263 29268 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:29.592020 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.513131 29191 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:10:29.592545 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48665.5us
I20260709 13:10:29.521647 29063 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:29.593902 24390 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:10:29.594393 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 149076us
W20260709 13:10:29.602988 29259 consensus_meta.cc:287] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.007s
I20260709 13:10:29.534087 29038 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:10:29.597424 24392 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:29.598932 28352 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:29.518487 29057 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.491276 29279 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.593400 23620 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:29.612192 23629 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:29.614835 28882 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.617256 24391 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:29.618342 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.600621 29167 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.601567 29255 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:29.511653 29177 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.655900 23771 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:29.621675 28930 consensus_queue.cc:1059] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:10:29.628592 29267 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.622479 28352 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:29.648986 29167 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:29.671757 28930 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:29.672411 29273 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:29.665144 29267 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:29.680372 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.653726 29268 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:10:29.629057 29063 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.646971 29057 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:29.686314 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 86297.5us
I20260709 13:10:29.681733 28930 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:29.688535 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 175314us
I20260709 13:10:29.660593 29255 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:29.694840 23669 connection.cc:256] RPC call timeout handler was delayed by -1.5075823050000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 13:10:29.700016 23669 connection.cc:256] RPC call timeout handler was delayed by -1.468050901999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:10:29.700381 23669 connection.cc:256] RPC call timeout handler was delayed by -1.4292823050000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
W20260709 13:10:29.700685 23669 connection.cc:256] RPC call timeout handler was delayed by -1.40138230499997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:10:29.700960 23669 connection.cc:256] RPC call timeout handler was delayed by -1.3023823050000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 13:10:29.701028 29279 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:29.701295 23669 connection.cc:256] RPC call timeout handler was delayed by -1.2623244810000642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 13:10:29.701458 29255 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:29.701746 23669 connection.cc:256] RPC call timeout handler was delayed by -1.2159823050000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:10:29.702278 23669 connection.cc:256] RPC call timeout handler was delayed by -1.1993763089999447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 13:10:29.702557 23669 connection.cc:256] RPC call timeout handler was delayed by -1.1270768150000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2717s for a response
I20260709 13:10:29.690424 29273 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:29.702839 23669 connection.cc:256] RPC call timeout handler was delayed by -1.0895244810000122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 13:10:29.703186 23669 connection.cc:256] RPC call timeout handler was delayed by -1.0607244809999656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
W20260709 13:10:29.703467 23669 connection.cc:256] RPC call timeout handler was delayed by -1.0413823049999564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 13:10:29.696906 28930 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:29.704260 23669 connection.cc:256] RPC call timeout handler was delayed by -1.026524481000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 13:10:29.704648 23669 connection.cc:256] RPC call timeout handler was delayed by -1.0076244809999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
I20260709 13:10:29.690282 29296 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.706041 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:29.706822 23696 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:29.708715 23696 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:29.712817 23743 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:29.720402 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:29.722023 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:29.724368 28882 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:29.725641 28882 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:29.726171 28882 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:29.727155 28882 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.734721 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:29.732782 23592 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:29.705641 29273 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:29.742153 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:29.742878 23623 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:29.719290 29302 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:10:29.754213 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:29.755606 23696 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
W20260709 13:10:29.757786 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.766721 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:29.767522 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:29.767706 23697 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:29.770015 23625 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:29.777019 29063 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:29.706787 29296 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.779701 29296 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:29.780263 29301 log.cc:927] Time spent T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:10:29.780457 29299 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:10:29.773496 28894 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:29.781951 28894 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:29.782342 28894 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:29.786708 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:29.800364 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:29.677592 23519 catalog_manager.cc:5697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.740096 29268 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:10:29.757355 29287 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:29.768193 28648 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:29.780154 29295 raft_consensus.cc:3055] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:29.812798 23696 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:29.813303 28352 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.820606 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:29.820593 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:29.828806 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:29.829607 23704 raft_consensus.cc:2368] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:10:29.823333 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:29.832226 23698 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:29.811851 29295 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:29.810799 28648 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:29.820467 29287 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:29.846623 28894 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.846341 29287 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.863309 28648 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.864446 28648 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:29.866539 29295 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.851176 29255 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:10:29.867910 29295 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:29.854364 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:29.868707 23696 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:29.877087 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:29.877727 23771 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:29.837352 29075 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.884227 29075 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:29.886547 29075 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:29.887336 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:29.890232 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:29.859217 23698 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:29.837939 28352 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:29.862596 24392 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:29.867075 29057 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:29.862037 29167 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.818205 29082 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:29.906507 23697 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.910580 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:29.949524 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:29.911017 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:29.894729 23771 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:29.895507 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:29.964377 23773 raft_consensus.cc:2410] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:10:29.965350 23776 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:29.968997 23698 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:29.969300 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:29.970561 23777 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:29.969733 24391 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:29.973130 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:29.975404 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:29.979445 24389 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:29.920328 29265 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:10:29.981110 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:29.982301 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:29.982856 23774 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.990208 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:29.993968 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:29.997957 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:29.999210 23698 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:29.970400 29238 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.001410 23777 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:29.992846 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:30.003888 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:30.013338 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:30.013885 23776 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:10:29.991699 29309 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.226s	user 0.002s	sys 0.000s
I20260709 13:10:30.032578 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:30.035807 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.039072 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:29.980747 29057 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:10:30.040186 29057 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:30.040589 29057 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:30.043556 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.046111 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:30.052883 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:30.058562 23620 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:30.060456 23696 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:30.065479 23774 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:30.030850 29267 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:30.077667 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:30.062527 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:30.075930 23776 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:10:30.079659 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:30.075238 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:30.080690 23698 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.016252 29238 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:30.064843 29268 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:30.092747 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:29.904305 23519 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 17, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 17 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:30.113018 28930 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:30.091908 29296 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:30.123939 29267 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:30.125021 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.125820 23700 raft_consensus.cc:2368] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15.
I20260709 13:10:30.126060 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.126310 29267 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:30.126626 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.127256 23700 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:30.128170 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.128603 23702 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:30.129305 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.129741 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.129914 23695 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:30.130475 23702 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:30.130813 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.131295 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.132197 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.133076 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.145867 23702 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:10:30.137601 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.131378 23695 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:30.126863 23701 raft_consensus.cc:2410] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:30.146862 23696 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:30.147570 23774 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:10:30.138491 23592 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:30.106882 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:30.154455 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 75160.4us
W20260709 13:10:30.152920 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48071.5us
I20260709 13:10:30.157325 23703 raft_consensus.cc:2410] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:30.041558 29057 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:30.158536 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.159227 23700 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:30.163054 23704 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:30.167369 23698 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:30.100708 29298 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:10:30.184935 23742 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.024s (SENT)
I20260709 13:10:30.195747 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.215867 29298 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:30.217761 29177 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:30.219981 29082 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:30.220825 29167 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:30.214659 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:30.216886 29298 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:30.224593 29057 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:30.228667 23699 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:30.229285 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 65662.2us
I20260709 13:10:30.230504 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:30.231571 29312 raft_consensus.cc:2764] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:30.232584 29311 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:30.233579 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 70961.4us
W20260709 13:10:30.234169 23742 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.028s (SENT)
I20260709 13:10:30.234551 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:30.236083 29311 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:30.237970 23742 leader_election.cc:336] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.036s (SENT)
I20260709 13:10:30.238440 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:30.243719 23696 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:30.153354 29038 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:30.244469 29311 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:30.254426 23778 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:30.255162 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:30.266793 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:30.267899 29288 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:30.268201 29029 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:30.268407 29288 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:30.268865 29029 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:30.269381 29288 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:30.269836 29029 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:30.273577 29313 log.cc:927] Time spent T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:10:30.274284 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.275703 29317 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:30.278973 29287 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:10:30.279632 23519 catalog_manager.cc:5697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 9 to 14, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 14 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:30.285527 23519 catalog_manager.cc:5697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 7 to 11, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 11 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.286376 29273 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:30.286814 29273 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:30.290053 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.291833 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.292531 29063 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:30.293038 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.159847 29310 consensus_queue.cc:1059] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:10:30.293984 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.304172 23698 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:30.305837 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:30.270735 29288 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.295136 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:30.301157 23700 raft_consensus.cc:2410] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:10:30.169028 29268 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:10:30.308215 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.309096 23695 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.161562 29267 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:30.249265 29156 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.310751 23592 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:30.312193 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:30.317808 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 79867.2us
W20260709 13:10:30.321175 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.321535 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.322176 23696 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:30.327539 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.329519 23700 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
W20260709 13:10:30.330449 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.340778 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.316571 29287 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:30.332851 23701 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 9.
I20260709 13:10:30.342921 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.319018 29256 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:30.293066 29063 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:30.319309 29267 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:30.344131 23700 raft_consensus.cc:2376] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15. Re-sending same reply.
I20260709 13:10:30.319185 29156 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:30.360574 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:30.362675 23742 leader_election.cc:336] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.202s (SENT)
I20260709 13:10:30.287438 23519 catalog_manager.cc:5697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.363263 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:30.343664 29287 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:30.354346 29315 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:10:30.369089 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:30.369470 24389 raft_consensus.cc:1240] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:10:30.303169 29273 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:30.377247 24386 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 10: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:30.381080 29267 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:30.386404 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.394696 23700 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:30.369484 29287 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.376186 29305 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:30.408434 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.420300 23696 raft_consensus.cc:2376] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16. Re-sending same reply.
I20260709 13:10:30.429188 23695 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
W20260709 13:10:30.448128 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.452279 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:30.454293 23776 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:10:30.466539 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 103857us
I20260709 13:10:30.394869 29038 consensus_queue.cc:1059] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:10:30.443307 29238 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:30.473242 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.477068 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:30.477964 23697 consensus_meta.cc:287] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260709 13:10:30.478291 23697 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:30.477691 23695 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.432765 29206 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:30.490475 29206 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:30.491245 29156 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:30.477731 29295 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:30.486109 29268 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.492655 29268 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } attrs { replace: true } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:30.489530 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:30.430359 28899 raft_consensus.cc:3055] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:30.496939 28899 raft_consensus.cc:740] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:30.497915 29268 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:30.499253 28894 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:30.480592 29259 raft_consensus.cc:476] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:30.500460 29286 raft_consensus.cc:3055] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:30.536615 29286 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:30.538100 29063 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:30.537703 29286 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:30.539038 29286 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.505482 23623 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:30.506350 23519 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 6 to 9, term changed from 8 to 9, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3), VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2) evicted. New cstate: current_term: 9 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.541618 23519 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 16, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 16 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:30.511377 23628 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:30.544140 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:30.512095 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:30.513039 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:30.548223 23621 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:30.515882 29206 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:30.549507 29206 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.517426 29295 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:30.552541 29295 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:30.552877 29295 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:30.553716 29295 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:30.555048 29295 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:30.559262 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:30.521719 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:30.522003 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 61717.1us
I20260709 13:10:30.522432 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.522698 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.590878 23702 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:30.523108 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.591863 23699 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:10:30.524778 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.592392 23625 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:30.525691 23775 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:10:30.528160 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:30.457511 29273 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.514895 28899 consensus_queue.cc:260] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:30.533524 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.617746 23700 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.534374 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.619588 23701 raft_consensus.cc:2410] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:10:30.519804 29321 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:10:30.564518 23696 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:30.568086 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:30.625062 23774 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:30.569094 29263 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.570470 23778 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:30.570855 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:30.572772 29256 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:30.573948 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:30.637722 23769 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:30.543537 23519 catalog_manager.cc:5697] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:30.636701 23621 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:10:30.581115 29287 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:30.597561 23622 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:30.593551 23776 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:30.590366 23703 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
I20260709 13:10:30.600220 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.600490 23626 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:10:30.616252 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 131364us
I20260709 13:10:30.620790 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.643529 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.623669 23628 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:10:30.625432 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.629235 23695 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:30.634347 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:30.640494 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:30.700047 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.702582 23697 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:30.704957 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.705631 23696 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
I20260709 13:10:30.709422 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.710608 23698 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:30.711239 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.711426 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:30.712368 28352 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:10:30.648125 29324 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:10:30.713577 24359 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:30.719187 23695 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:10:30.720647 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.720824 23699 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
I20260709 13:10:30.720983 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.726258 23592 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:30.728415 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.718809 23701 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:30.729321 23697 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:30.701225 29259 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:10:30.731158 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.732555 23624 raft_consensus.cc:2393] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:30.647940 29288 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:30.732996 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:10:30.733688 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 174525us
I20260709 13:10:30.708822 29167 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:30.747490 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:30.754158 23702 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:30.746201 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:30.755043 23698 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:30.751920 23771 raft_consensus.cc:1813] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Handling vote request from an unknown peer c885217113574e7489e6c3afb6950f76
I20260709 13:10:30.745494 28930 raft_consensus.cc:2764] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:10:30.645465 29255 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:10:30.717808 29075 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.756489 23771 raft_consensus.cc:2410] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:30.720980 28899 raft_consensus.cc:3060] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:30.769084 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.785117 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:30.731601 29038 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:30.790277 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.709509 29316 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:10:30.642910 29263 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:30.801636 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.806634 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:30.814776 28894 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:30.815296 28894 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:30.815949 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 104603us
I20260709 13:10:30.822459 23667 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:30.811265 23700 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:10:30.827090 23698 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
I20260709 13:10:30.815714 28894 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:30.796576 29038 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.803323 29288 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:30.792099 29167 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:30.792639 29075 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:30.845713 29038 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:30.852281 28930 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:30.883001 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.850929 29271 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:30.872225 29029 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.897966 23771 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:10:30.900264 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 109395us
I20260709 13:10:30.901225 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:30.920218 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.884950 28648 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.886832 29300 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:30.955031 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.958787 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 119632us
I20260709 13:10:30.926749 29156 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:30.932466 28930 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:30.850689 23519 catalog_manager.cc:5697] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:30.965538 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 64437.7us
I20260709 13:10:30.976331 23771 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:30.928140 28648 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:30.929435 29300 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:30.965934 29271 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:30.987586 29340 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:31.010980 29263 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:31.015646 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:31.018000 29300 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:30.997524 29156 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:31.025194 29271 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:31.028604 29029 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:31.029134 28648 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:31.033601 29156 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:31.043645 29296 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:31.057576 23519 catalog_manager.cc:5697] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 15, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 15 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:31.065697 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 60431us
I20260709 13:10:31.074298 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:31.077958 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:31.078596 23621 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:31.079196 28930 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:10:31.077181 24358 leader_election.cc:336] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.627s (SENT)
I20260709 13:10:31.039130 29340 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:31.086025 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.091087 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:31.074558 29075 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:31.103472 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:31.106417 29287 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:31.065182 28894 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:31.106518 23769 raft_consensus.cc:606] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.083065 29298 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:10:31.120961 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:31.125095 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:31.126742 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:31.128656 23769 raft_consensus.cc:614] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:31.142591 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.156535 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:31.157229 23775 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.161352 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:31.162449 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.166072 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.136211 29217 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:31.176743 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 99454.4us
W20260709 13:10:31.173058 23742 leader_election.cc:336] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.046s (SENT)
I20260709 13:10:31.180124 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.193621 23775 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:31.196795 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:31.164645 29345 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:31.201617 29273 consensus_meta.cc:287] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
W20260709 13:10:31.203474 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.220641 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.204326 29349 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:31.204669 28882 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:31.202602 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46581.5us
W20260709 13:10:31.207870 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 130707us
I20260709 13:10:31.226466 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:31.210280 23593 leader_election.cc:336] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.858s (SENT)
I20260709 13:10:31.223495 23704 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:31.226589 23743 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:31.232156 23743 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:31.234036 28352 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:31.234494 28352 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.234861 28352 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:31.263535 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.235383 23592 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:31.276379 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:31.277029 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 66779.7us
I20260709 13:10:31.277339 28899 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:31.277920 29259 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:31.278081 28899 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:31.279258 28899 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:31.105051 23519 catalog_manager.cc:5697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.219997 29345 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:31.286383 24358 leader_election.cc:336] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.797s (SENT)
I20260709 13:10:31.288972 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.294580 28352 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:31.264566 29305 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:31.304414 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:31.306560 23593 leader_election.cc:336] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.584s (SENT)
I20260709 13:10:31.306998 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.310240 28352 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:31.338985 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 122297us
I20260709 13:10:31.339802 29167 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:31.286692 29345 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:31.383920 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.284870 29298 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.296548 29256 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:31.404402 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2276) took 1115 ms. Trace:
I20260709 13:10:31.433350 23704 rpcz_store.cc:276] 0709 13:10:30.288560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.291038 (+  2478us) service_pool.cc:224] Handling call
0709 13:10:30.294904 (+  3866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.227779 (+932875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.325277 (+ 97498us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b540015cf54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:31.404245 (+ 78968us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2134456192}
W20260709 13:10:31.311383 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 77924.3us
W20260709 13:10:31.434244 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.434893 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.421389 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.427621 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 121085us
I20260709 13:10:31.432761 29340 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:31.437973 23742 leader_election.cc:336] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.140s (SENT)
W20260709 13:10:31.437417 23593 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.043s (SENT)
I20260709 13:10:31.440855 23769 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:31.442063 23775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:31.442790 23775 raft_consensus.cc:606] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:31.443171 23775 raft_consensus.cc:614] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:31.423400 29038 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.523s	user 0.014s	sys 0.000s
W20260709 13:10:31.445755 24358 leader_election.cc:336] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.582s (SENT)
I20260709 13:10:31.457142 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.446270 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.444115 29057 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:31.445163 29287 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:31.450137 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:31.454362 29299 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.451360 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:31.460736 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:31.454391 29345 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:31.461103 23626 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:31.442073 29348 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.100s	user 0.000s	sys 0.004s
I20260709 13:10:31.461328 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:31.464535 23770 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:31.465371 29299 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:31.464820 29284 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.467782 29284 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:31.468928 29299 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:31.469928 29284 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:31.473829 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:31.474787 23770 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:31.464902 28894 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:31.477952 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:31.479601 29268 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:31.480366 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 56377.5us
I20260709 13:10:31.478714 29298 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:31.486770 24358 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.652s (SENT)
I20260709 13:10:31.487229 24358 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.487638 23622 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:10:31.478185 29299 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:31.481353 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:31.458263 29038 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:31.488896 29259 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:31.456645 23519 catalog_manager.cc:5697] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 10 to 13, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 13 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:31.493666 29339 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:31.494374 29298 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:31.495012 29345 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
W20260709 13:10:31.495970 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 55392.7us
I20260709 13:10:31.502509 29268 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.509450 29038 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:31.515486 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:31.516224 23769 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:31.521123 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:31.521950 24359 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:31.496690 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:31.525272 23771 raft_consensus.cc:606] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.525792 23771 raft_consensus.cc:614] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:31.495590 23626 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
W20260709 13:10:31.497625 23593 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.085s (SENT)
W20260709 13:10:31.493037 24358 leader_election.cc:336] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.948s (SENT)
W20260709 13:10:31.529193 23593 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.102s (SENT)
I20260709 13:10:31.529094 24358 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.522943 23519 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 15, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 15 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.524037 23769 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:10:31.524246 29298 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:31.486423 28894 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:31.534729 29298 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:31.522342 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:31.535145 23519 catalog_manager.cc:5697] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 17, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 17 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.531750 29337 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:10:31.532570 23593 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.125s (SENT)
I20260709 13:10:31.536607 29337 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:31.532701 29340 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:31.537057 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:31.537810 24385 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:10:31.537643 29337 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:31.537011 23519 catalog_manager.cc:5697] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 9 to 13, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 13 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:31.542861 23519 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.541155 29273 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:31.553854 29273 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:31.554404 29273 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:31.541009 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:31.540500 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:31.556106 24385 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:31.556643 29345 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:31.558370 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:31.543758 29298 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:31.560835 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.546101 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:31.548079 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:31.562376 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:31.562974 23743 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:31.563910 29316 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:31.564568 29075 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:31.565119 29075 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.565555 29075 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:31.574963 29273 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:31.577212 23778 raft_consensus.cc:606] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.577906 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:31.578428 23778 raft_consensus.cc:614] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:31.549168 24358 leader_election.cc:336] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.014s (SENT)
I20260709 13:10:31.553316 23519 catalog_manager.cc:5697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 10 to 11, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 11 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.579195 23592 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:31.579620 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.582801 23624 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:10:31.582854 23742 leader_election.cc:336] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.789s (SENT)
I20260709 13:10:31.588457 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:31.590639 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.589015 29214 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:31.598296 28882 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:31.599319 29273 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:31.596711 28930 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:31.582558 29268 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:31.609052 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:31.582046 29316 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:31.594610 28899 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:31.622543 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
W20260709 13:10:31.622874 23593 leader_election.cc:336] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.799s (SENT)
I20260709 13:10:31.624006 23778 raft_consensus.cc:606] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:31.606997 29214 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:31.621874 28899 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.629225 29029 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.629712 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:31.595913 29340 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:10:31.632927 28899 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.637709 29316 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:31.624142 29268 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:31.640415 29286 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.640565 29268 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:31.640969 29286 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:31.642964 29286 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:31.644145 29214 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:31.646823 23774 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:10:31.647300 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.634438 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:31.649497 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:31.649945 23519 catalog_manager.cc:5697] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 7 to 9, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 9 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:31.655020 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:31.662847 29075 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:31.663352 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:31.647226 29029 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:31.668102 24358 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.804s (SENT)
I20260709 13:10:31.668586 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:31.669523 23593 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.835s (SENT)
I20260709 13:10:31.670466 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:31.672633 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:31.667474 29029 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:31.675536 28352 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:31.671478 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.683670 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:31.649498 29340 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:10:31.684581 29370 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:31.680480 29271 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:31.704977 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:31.695660 29284 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:31.713322 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:31.695895 29370 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:31.723829 29345 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:31.729096 23593 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.838s (SENT)
I20260709 13:10:31.729612 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.729887 23669 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:31.733393 23593 leader_election.cc:336] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.839s (SENT)
I20260709 13:10:31.734078 23593 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.726554 28930 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:31.742998 29075 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:31.727581 29370 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:31.735859 29029 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:31.748711 29029 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:31.749150 29029 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.758226 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:10:31.760999 23593 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.848s (SENT)
I20260709 13:10:31.732342 29345 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:31.762389 28930 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:31.752403 29287 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:31.774821 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:31.775449 24385 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:31.762933 29284 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.779263 23774 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:31.771327 29296 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:31.774111 29345 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.808111 28899 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:31.812119 23742 leader_election.cc:336] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.997s (SENT)
I20260709 13:10:31.812708 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:31.814375 29206 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:31.785974 29259 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:10:31.788826 29296 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:31.821475 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 66452.8us
W20260709 13:10:31.822841 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50487.3us
I20260709 13:10:31.823093 29296 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:31.837244 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.847237 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.820662 29316 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.854205 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.855151 23701 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
W20260709 13:10:31.858500 23593 leader_election.cc:336] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.012s (SENT)
I20260709 13:10:31.863379 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:31.868139 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.871899 28899 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:31.872159 29376 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:10:31.871944 29029 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:31.875463 29029 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:31.878702 29370 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:31.888892 23701 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:31.888916 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.890075 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.905062 29370 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:31.905133 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:31.906996 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.890209 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.890779 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.909011 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.910368 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.910981 23697 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:31.890969 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.911592 23704 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:31.891073 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.913162 23700 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:31.891893 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.914511 23695 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:31.893157 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.915704 23703 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:31.895789 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.901655 29298 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.917047 23699 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:31.917199 29298 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:31.909013 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:31.918725 23698 raft_consensus.cc:2410] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:31.903560 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:31.855862 29316 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:31.920959 23701 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:31.921820 23700 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:31.924467 23703 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:31.947535 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:31.962728 23742 leader_election.cc:336] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.639s (SENT)
W20260709 13:10:31.969357 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.991683 29206 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.992553 29206 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:31.947176 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:31.998394 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:31.999092 23703 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:32.005990 24385 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
W20260709 13:10:32.016489 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 158028us
I20260709 13:10:32.022050 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.029151 23696 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
W20260709 13:10:32.034617 23593 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.973s (SENT)
I20260709 13:10:32.035276 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:32.043641 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:32.044368 24385 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.040802 29299 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:32.050803 23700 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:32.053351 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:32.049883 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:32.054262 23775 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:10:32.065794 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:32.082188 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.087757 23624 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:32.090224 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.090902 23703 raft_consensus.cc:2376] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14. Re-sending same reply.
I20260709 13:10:32.094336 23700 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:10:32.095453 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.096032 23700 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:32.096757 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.097072 28352 raft_consensus.cc:993] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:10:32.097771 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.100394 23699 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:32.101526 23699 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:32.103647 23698 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:32.105402 24385 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:32.061820 29214 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:32.093991 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:32.126307 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 70765.8us
I20260709 13:10:32.128818 23703 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: [14.8-15.9]
I20260709 13:10:32.159830 23700 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:32.179184 23700 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:32.125765 29057 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.178038 29377 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:32.188696 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.191529 23700 raft_consensus.cc:2376] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14. Re-sending same reply.
I20260709 13:10:32.157598 28882 raft_consensus.cc:1081] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:10:32.170022 29298 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:32.204051 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:32.205286 23700 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:10:32.205770 23700 pending_rounds.cc:85] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 7
I20260709 13:10:32.206030 23700 pending_rounds.cc:107] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:10:32.207515 23700 raft_consensus.cc:2889] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:32.195632 29057 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:32.210793 29057 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:32.220122 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.221096 23703 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:32.223315 29057 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:32.225072 29057 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:32.227270 29057 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:32.158217 28648 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:10:32.241991 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.232702 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:32.234598 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.234934 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.235236 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.244295 23698 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:32.244714 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.245129 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.245656 23698 raft_consensus.cc:2376] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18. Re-sending same reply.
I20260709 13:10:32.245805 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.246469 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.247038 23698 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:32.236182 23699 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:32.248503 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.249011 23699 raft_consensus.cc:2376] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9. Re-sending same reply.
I20260709 13:10:32.236073 28930 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:32.250758 28930 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:32.253036 29206 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:32.253098 28930 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:32.254688 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.263391 29370 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:32.263939 28930 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:32.264149 29370 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:32.264499 28930 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:32.265736 23701 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:32.266546 23699 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:32.267035 29370 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:32.268160 28930 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:32.268814 29383 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:10:32.268879 29377 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.269436 29377 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:32.271030 29345 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:32.272135 23697 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:32.274633 29296 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:32.275506 29316 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:32.283088 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.280337 23774 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:32.287835 23696 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:32.294032 29337 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:32.295071 29384 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.087s	user 0.003s	sys 0.001s
I20260709 13:10:32.296131 29377 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:32.300925 23593 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.116s (SENT)
I20260709 13:10:32.301563 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:32.273239 29345 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:32.285056 29296 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:32.285543 23695 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:32.275281 23700 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:32.316387 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.312801 23593 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.150s (SENT)
I20260709 13:10:32.320948 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:32.318985 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.298978 29377 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:32.322235 23699 raft_consensus.cc:2376] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9. Re-sending same reply.
W20260709 13:10:32.333016 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.296182 29286 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.346180 23696 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
W20260709 13:10:32.346854 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 199770us
I20260709 13:10:32.350477 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.352133 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.353001 23626 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:32.351136 23622 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:32.318168 29284 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:32.386112 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:32.392457 23593 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:32.396365 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:32.343981 29038 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:32.404678 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:32.403945 29340 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:32.414861 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:32.386145 23622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
I20260709 13:10:32.418282 23621 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:32.419227 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:32.422323 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.419548 23622 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:32.423681 23622 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:32.415053 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 212402us
I20260709 13:10:32.456166 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:32.456952 24385 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
W20260709 13:10:32.423206 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 268948us
I20260709 13:10:32.380667 29286 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:32.462806 23778 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:32.465586 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:32.482620 23770 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:32.398938 29259 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:10:32.490983 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:32.480099 23743 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:32.489552 23622 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:32.490978 23742 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.891s (SENT)
I20260709 13:10:32.500219 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:32.418390 29284 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:32.504577 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:32.509344 23742 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.513s (SENT)
I20260709 13:10:32.510697 23622 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:32.512737 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:32.514508 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.517292 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:32.521938 28352 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:32.521993 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:32.525079 24390 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:10:32.526753 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 117897us
I20260709 13:10:32.498178 29214 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:32.417970 29392 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
W20260709 13:10:32.518565 29384 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:10:32.421613 29038 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
W20260709 13:10:32.541826 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 147726us
I20260709 13:10:32.517208 29029 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:32.516207 29284 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:32.564636 23669 connection.cc:256] RPC call timeout handler was delayed by -3.2191499460000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:10:32.517529 29391 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:32.567495 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.567701 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.568327 23700 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:32.568528 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.572386 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.576545 23696 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:10:32.582572 29299 consensus_meta.cc:287] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.001s
I20260709 13:10:32.583071 29299 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:32.583559 23770 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:10:32.517308 28894 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:10:32.587787 29259 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:32.574452 29389 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.590490 29389 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:32.593360 29389 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:32.597302 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.599557 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.565474 29284 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:32.601140 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.603032 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.604041 23699 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:32.604347 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.606169 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.606961 23702 raft_consensus.cc:2376] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18. Re-sending same reply.
I20260709 13:10:32.609378 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.610031 23702 raft_consensus.cc:2376] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10. Re-sending same reply.
I20260709 13:10:32.611186 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.614382 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.616107 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:32.618916 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 101197us
I20260709 13:10:32.630348 28352 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:32.631031 28352 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:32.638980 23627 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:32.641516 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.642724 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.646461 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:32.646625 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:32.647589 24385 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:32.659425 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.660502 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.666462 24390 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:10:32.668358 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.693960 23702 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:32.694133 23697 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:32.670023 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.694715 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.695429 23621 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:32.671267 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.696460 23700 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.672580 23701 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:32.642871 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.700244 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.700539 23627 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:32.676429 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.701424 28352 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:32.702178 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.681639 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.704276 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.682683 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.633713 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:32.707233 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.695390 23695 raft_consensus.cc:2376] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10. Re-sending same reply.
I20260709 13:10:32.699467 23701 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:32.674813 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:32.709636 23628 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:32.712010 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:32.713258 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 79677.8us
I20260709 13:10:32.713709 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:32.714360 23623 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.712136 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.716957 23627 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:32.719340 23621 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:32.720180 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:32.720844 23622 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:32.723912 23629 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:10:32.728158 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 219828us
I20260709 13:10:32.728214 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:32.730191 23695 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:32.730186 23700 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:32.730827 23695 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:32.732239 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.713335 23701 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:32.734649 23701 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:32.728677 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.740070 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:32.740214 23742 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.602s (SENT)
W20260709 13:10:32.741008 24358 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.094s (SENT)
I20260709 13:10:32.741420 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:32.741446 23742 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.001s (SENT)
I20260709 13:10:32.742412 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:32.737429 23702 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:10:32.745535 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.746064 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:32.746512 23702 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 10: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:10:32.750468 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 201588us
I20260709 13:10:32.756733 23628 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:32.760958 23697 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:10:32.764281 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.764565 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.765246 23696 raft_consensus.cc:2410] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:10:32.765745 28352 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:32.766546 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.767208 23698 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:32.770684 23622 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:32.771679 23621 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:32.772620 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:32.773326 23704 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 9: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:32.745713 23695 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:32.721051 29345 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.725749 29298 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:32.777771 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:32.775502 23701 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:10:32.782236 23628 raft_consensus.cc:1275] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:10:32.786679 23628 pending_rounds.cc:85] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 11
I20260709 13:10:32.787035 23628 pending_rounds.cc:107] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:10:32.787314 23628 raft_consensus.cc:2889] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:32.787962 23701 pending_rounds.cc:85] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 4
I20260709 13:10:32.788328 23701 pending_rounds.cc:107] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:10:32.788619 23701 raft_consensus.cc:2889] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:32.788371 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46941.9us
W20260709 13:10:32.789489 23742 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 2.073s (SENT)
I20260709 13:10:32.692082 29214 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:32.825469 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.751891 29268 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.832579 23700 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:10:32.835364 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 57653.3us
I20260709 13:10:32.835273 29386 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:32.774610 29388 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:10:32.851537 23695 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:32.864781 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 156266us
I20260709 13:10:32.869307 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:32.832860 29298 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:32.891331 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:32.891299 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 162139us
I20260709 13:10:32.894681 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:32.898332 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:32.845541 29397 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:10:32.899878 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:32.797887 29345 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:32.897732 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:32.906618 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:32.908519 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:32.861457 29361 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:32.837677 29268 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:32.926311 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:32.842358 29391 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:32.895800 29286 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:32.844527 29316 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:10:32.844923 29405 consensus_queue.cc:1059] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:10:32.928170 29361 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:32.915446 29038 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:10:32.945513 23628 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:32.861037 29389 consensus_queue.cc:1059] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:10:32.898058 29206 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:10:32.906064 29396 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:32.906441 29370 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:32.957181 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 57366us
I20260709 13:10:33.021059 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:32.998009 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:32.949816 23695 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:10:33.028378 23695 pending_rounds.cc:85] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 10
I20260709 13:10:32.999172 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:33.028702 23695 pending_rounds.cc:107] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:10:33.029007 23695 raft_consensus.cc:2889] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:33.011442 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:33.032225 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:32.960659 29404 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:33.040901 23620 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:32.986423 29286 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:32.985212 28648 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:32.957315 29402 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:33.008013 29396 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:32.988096 29405 raft_consensus.cc:3055] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:33.035876 29393 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:33.034008 29388 raft_consensus.cc:3055] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:32.956739 23629 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:33.051688 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 310674us
I20260709 13:10:32.985173 29411 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:10:33.047824 28648 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.064301 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:33.046448 23626 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:33.068516 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.018204 23623 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:33.072825 23627 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:33.082927 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.084702 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.049731 29402 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:32.989205 29361 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.052102 29405 raft_consensus.cc:740] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:33.056941 29388 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:33.096385 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.089618 29392 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:33.110015 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:33.080914 28648 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:33.113287 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:33.094535 29057 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:33.094024 29287 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:33.108461 29361 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.091460 29259 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:33.106264 29393 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:33.097434 29402 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.090906 29038 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:10:33.009382 29298 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:33.108839 29407 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:33.136221 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:33.137495 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.140339 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:33.141312 23628 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
W20260709 13:10:33.136835 29284 consensus_meta.cc:287] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.000s
I20260709 13:10:33.149992 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:33.150331 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.126142 29345 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:33.170897 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:33.173735 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:33.144740 29268 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:33.173619 29214 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:33.153659 29392 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:33.184161 23624 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:33.191223 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 293573us
I20260709 13:10:33.198251 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.204228 29416 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:33.157629 29284 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.214500 29408 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.135965 29396 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:33.199834 29392 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:33.223032 29392 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.227329 29316 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:33.228919 29316 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.229444 29316 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.233824 29391 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:33.234364 29391 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:33.235306 29391 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.236686 29391 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:33.137640 29405 consensus_queue.cc:260] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.242053 29405 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:33.222012 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:33.148072 29388 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.254120 28352 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:33.256642 28352 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.257073 28352 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.252408 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:33.267272 23625 raft_consensus.cc:1240] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:33.271451 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 121202us
I20260709 13:10:33.272519 23593 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.275580 23593 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.276993 29287 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:33.278048 29416 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:33.278728 29416 raft_consensus.cc:697] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:33.279824 29416 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:33.281272 29389 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:33.296600 28352 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.295241 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.270509 29316 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:33.324965 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 62391.2us
W20260709 13:10:33.333465 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.328171 23593 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.334690 29393 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:10:33.349236 29284 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:33.352365 29406 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:33.320638 29287 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:33.322252 29422 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:33.368971 29284 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:33.378912 29310 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:33.337009 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:33.380425 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 43550.9us
I20260709 13:10:33.381371 29286 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:33.381769 29286 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.382094 29286 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.392343 28882 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:33.393163 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:33.393841 23695 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:33.379623 29310 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:33.396240 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:33.396524 29310 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:33.398456 29310 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.399183 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:33.399988 23695 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:33.402320 29206 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:33.402915 29206 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:33.403383 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:33.410898 29206 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.413131 29206 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:33.414403 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:33.415234 23702 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:33.383095 29388 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.449635 23695 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
W20260709 13:10:33.454645 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.431905 23700 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:10:33.432765 23741 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.039s	sys 0.107s
W20260709 13:10:33.460084 23741 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.040s	sys 0.107s
I20260709 13:10:33.455675 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:33.462064 23695 raft_consensus.cc:2393] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:33.476529 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:33.477339 23700 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:10:33.423632 28352 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:33.489353 29391 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:33.490223 29391 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:33.494802 29391 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:33.510243 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 386748us
I20260709 13:10:33.442744 29267 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:33.444443 29268 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:33.515285 23696 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:33.470542 29370 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.473011 28882 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:33.519970 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.512223 24358 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.527468 24358 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.528050 23700 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:33.511162 29407 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:33.471375 29402 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:33.542851 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 389157us
I20260709 13:10:33.473214 29286 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:33.564685 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:33.536283 29337 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:33.535629 29340 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:33.568518 23669 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:33.516670 29214 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:10:33.520929 29267 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.574836 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:33.567207 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:33.524616 29268 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.546731 29271 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:33.608661 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:33.609289 23703 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:33.610534 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 358287us
I20260709 13:10:33.561574 29296 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:33.526286 28882 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.525039 29370 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.613113 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:33.607916 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 460683us
I20260709 13:10:33.617589 23621 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:33.560182 29038 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:10:33.635341 24385 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:33.636076 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:33.610142 29403 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:33.608342 29389 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:33.654829 23775 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:33.660889 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:33.656962 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:33.670678 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:33.671365 23627 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.673282 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:33.679316 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:33.683072 28352 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:33.643538 29410 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:33.634426 29432 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:33.631673 28648 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.659685 29414 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:33.626776 29271 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:33.665061 29412 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:33.707406 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 91817.8us
I20260709 13:10:33.640471 29296 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.680009 29345 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:33.678377 29298 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:33.691401 29410 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:33.737128 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.754379 23627 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:33.670483 29389 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.675707 29284 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:10:33.760475 23778 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 19: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:33.766937 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:33.692387 29440 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:33.667663 29403 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:33.784818 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 86740us
I20260709 13:10:33.794065 23775 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:33.760005 29410 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:33.743012 29441 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:33.904992 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 52722us
I20260709 13:10:33.905505 23592 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:10:33.924706 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 200863us
I20260709 13:10:33.749504 29385 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.129s
I20260709 13:10:33.759961 29298 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.745657 29412 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:33.923461 29407 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:33.958956 29448 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:33.959396 29426 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:10:33.959827 29448 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:33.963462 29448 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:33.968703 29434 log.cc:927] Time spent T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:10:33.970429 29370 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:33.972323 29268 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:33.973130 29256 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:33.973735 29256 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:33.976547 29412 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:33.979030 29403 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:33.980913 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:33.983776 29298 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:33.952064 29361 consensus_meta.cc:287] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.822s	user 0.009s	sys 0.003s
W20260709 13:10:33.986960 29436 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:10:33.988008 29407 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:33.989099 29407 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:33.997439 29339 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:33.998139 29339 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:34.004456 28882 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:33.997602 29256 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:34.023931 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 73402.9us
I20260709 13:10:34.020383 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.022042 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.025210 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:34.025368 23774 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:34.026177 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:34.038283 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 469839us
I20260709 13:10:34.041657 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:34.041783 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:34.043135 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:34.044615 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:34.049213 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:34.018754 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:34.078369 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 53478.5us
I20260709 13:10:34.085206 24357 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:34.086441 23695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.001s	sys 0.006s
W20260709 13:10:34.087096 23695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.002s	sys 0.007s
I20260709 13:10:34.091374 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.092773 23703 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:34.094556 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.095935 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:33.955864 29402 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:34.117455 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:34.117954 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.101282 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:34.121593 23698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.012s	sys 0.014s
W20260709 13:10:34.031287 29310 consensus_meta.cc:287] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.005s
W20260709 13:10:34.122403 23698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.012s	sys 0.014s
I20260709 13:10:34.126708 23701 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:34.133709 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:34.137534 29446 log.cc:927] Time spent T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:10:34.139837 29442 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:10:33.999233 29339 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:33.924072 29441 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:34.145467 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.162179 23700 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:10:34.162952 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 136874us
I20260709 13:10:34.180306 23592 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:34.192200 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:34.193708 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:34.194555 23774 raft_consensus.cc:606] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
W20260709 13:10:34.141690 29206 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.003s
W20260709 13:10:34.216034 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 52343.3us
I20260709 13:10:34.216732 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:34.217263 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:34.214068 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 80458.9us
I20260709 13:10:34.218120 24385 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.130138 29439 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:34.221405 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:34.221624 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 55546.3us
I20260709 13:10:34.223897 23702 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
I20260709 13:10:34.234757 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:34.211969 29411 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:34.169687 29448 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:34.232537 29437 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:10:34.255108 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:34.212025 29296 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:34.256059 23627 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.257055 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:34.235041 29038 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:34.257068 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.247066 29391 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:34.213982 29286 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:34.265887 29413 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:34.266369 29423 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:34.266918 29423 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.267892 29457 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:34.269240 29453 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:34.269311 29038 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:34.270399 29038 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.274246 29441 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:34.252753 29370 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:34.275202 29370 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:34.277691 29370 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:34.250927 28648 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:34.282491 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:34.282670 23627 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:34.261652 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:34.285986 24385 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:34.287608 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:34.288457 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.260535 29389 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:34.297117 24386 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:34.297323 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.298518 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.300377 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.300664 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.301380 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.291893 29391 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:34.258364 29440 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:10:34.307612 29391 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.280408 29271 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:34.309305 29439 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:34.325747 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.288398 29412 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.288901 29345 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:34.338932 23743 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:34.344476 29337 consensus_meta.cc:287] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.752s	user 0.004s	sys 0.006s
I20260709 13:10:34.345065 29337 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:34.345646 29458 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:34.346356 29458 raft_consensus.cc:697] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:34.347366 29458 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:34.348251 29423 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:34.350239 29410 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.355137 24390 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:34.345888 29412 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:34.372567 23776 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:10:34.376667 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:34.381206 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 68340.9us
I20260709 13:10:34.382941 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.384706 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.377507 23778 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:34.388166 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:34.389780 29461 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:34.389923 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 53438.8us
I20260709 13:10:34.390493 29461 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.395905 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:34.403380 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:34.414172 29461 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:34.429770 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45211.7us
I20260709 13:10:34.430827 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:34.415889 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.417178 29460 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:10:34.394963 29406 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:34.424158 29287 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:34.410660 29474 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:34.539958 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.456243 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:34.489487 23696 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.006s	sys 0.058s
I20260709 13:10:34.593583 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2930) took 1153 ms. Trace:
W20260709 13:10:34.450443 29388 consensus_meta.cc:287] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.997s	user 0.005s	sys 0.007s
I20260709 13:10:34.436784 29439 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:34.392993 29345 consensus_queue.cc:1048] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:10:34.462780 29447 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:34.458909 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2927) took 1021 ms. Trace:
I20260709 13:10:34.437135 29406 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:34.512198 23769 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:10:34.490754 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 60014.5us
I20260709 13:10:34.599670 29296 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:34.461632 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 66618.2us
I20260709 13:10:34.500789 29370 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:34.514730 29412 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:34.600178 29405 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.634985 29405 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.630097 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.455891 29467 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:34.641034 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:34.601593 29388 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:34.641829 29388 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:34.644261 29388 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:34.594153 23696 rpcz_store.cc:276] 0709 13:10:33.439550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.518236 (+ 78686us) service_pool.cc:224] Handling call
0709 13:10:33.518664 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.521721 (+  3057us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:33.698791 (+177070us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b18003718c0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b44d043c7 00007f2b413169a7 00007f2b413260bf
0709 13:10:33.698986 (+   195us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.947691 (+248705us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.956719 (+  9028us) log.cc:844] Serialized 26 byte log entry
0709 13:10:33.956872 (+   153us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:34.592625 (+635753us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.592905 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.593011 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.593134 (+   123us) raft_consensus.cc:1685] finished
0709 13:10:34.593154 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.593325 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20448,"prepare.queue_time_us":402539,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":302401,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":16175,"spinlock_wait_cycles":50025856,"thread_start_us":1011157,"threads_started":4,"wal-append.queue_time_us":413233}
I20260709 13:10:34.645231 29456 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:34.646003 29456 consensus_queue.cc:1059] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:34.647106 29456 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:34.631191 29406 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:34.617865 29267 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:34.647475 29456 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:34.652901 29448 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:34.641230 29438 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.512s	user 0.006s	sys 0.003s
I20260709 13:10:34.664036 29432 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:34.664741 29432 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:34.668560 29406 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.671696 29406 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:34.655783 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.675509 29439 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:34.625756 23699 rpcz_store.cc:276] 0709 13:10:33.437361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.437503 (+   142us) service_pool.cc:224] Handling call
0709 13:10:33.437836 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.633810 (+195974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.633941 (+   131us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.642348 (+  8407us) log.cc:844] Serialized 26 byte log entry
0709 13:10:33.729647 (+ 87299us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:34.099129 (+369482us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.101875 (+  2746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.102153 (+   278us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.458654 (+356501us) raft_consensus.cc:1685] finished
0709 13:10:34.458681 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.458841 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29253,"prepare.queue_time_us":391260,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":55371,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":34687,"thread_start_us":598982,"threads_started":3,"wal-append.queue_time_us":790053}
I20260709 13:10:34.677510 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.618399 29287 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.685633 29287 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:34.693993 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:34.694962 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.680555 29267 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:34.680248 29423 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:34.699334 29441 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:34.696807 29467 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:34.700052 29467 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.700525 29467 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:34.700256 29423 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:34.705030 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.709120 29447 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:34.711766 29464 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:34.712138 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:34.713451 29464 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:34.714449 29464 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:34.714825 29464 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:34.715474 28882 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:34.716113 28882 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.716542 29464 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.697053 29439 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:10:34.718901 28882 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:34.719942 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:34.720724 23628 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:34.721563 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.722060 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:34.722288 23771 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:34.723167 29464 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:34.667095 29432 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:34.723363 29417 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:34.704704 29423 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:34.724062 29417 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:34.724545 29417 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:34.720849 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.728446 23669 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:34.728857 23778 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:34.730986 29439 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:34.719466 28882 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:34.734264 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:34.735597 23592 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:34.739279 23769 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:34.741094 29406 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:34.752897 29406 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:34.753423 29406 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.741650 29423 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.743788 29456 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.748922 29467 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.758417 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:34.763391 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.764395 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:34.758369 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:34.768545 29268 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.768656 29456 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.769235 29268 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:34.771996 29310 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:34.773314 29268 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:34.762650 29461 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:34.774009 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:34.774411 29461 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:34.774917 29268 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:34.775301 29296 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:34.775550 29268 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:34.775959 29296 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:34.776855 29461 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:34.777503 29461 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:34.777181 29417 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.779044 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.783138 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:34.784762 23700 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.785597 29417 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:34.785796 29467 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:34.786617 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2322) took 1355 ms. Trace:
I20260709 13:10:34.733764 28882 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.787073 23704 rpcz_store.cc:276] 0709 13:10:33.431186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.431318 (+   132us) service_pool.cc:224] Handling call
0709 13:10:33.472566 (+ 41248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.679217 (+206651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.679252 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.688139 (+  8887us) log.cc:844] Serialized 26 byte log entry
0709 13:10:33.930245 (+242106us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:34.249477 (+319232us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.253842 (+  4365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.786195 (+532353us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400026a54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:34.786248 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.786304 (+    56us) raft_consensus.cc:1685] finished
0709 13:10:34.786404 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.786555 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42260,"prepare.queue_time_us":204370,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":268881,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":9000,"spinlock_wait_cycles":435303168,"thread_start_us":451501,"threads_started":2,"wal-append.queue_time_us":268727}
I20260709 13:10:34.790480 28882 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:34.791951 29392 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:34.792546 29392 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:34.793552 29392 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.787222 29415 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:34.796726 29405 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:34.797497 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2403) took 1053 ms. Trace:
I20260709 13:10:34.799080 29401 raft_consensus.cc:3055] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:34.799569 29401 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:34.800299 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:34.800627 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:34.800463 29401 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:34.760440 29423 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:34.801602 29401 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.801995 29423 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.808220 29410 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:34.809446 23776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:34.810127 23776 raft_consensus.cc:606] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.810475 23776 raft_consensus.cc:614] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:34.778599 29296 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:34.812703 29214 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:34.813416 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.814446 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.814978 23774 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:34.814468 29214 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.821614 29339 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:34.824762 29214 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:34.826522 29406 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:34.799103 23770 rpcz_store.cc:276] 0709 13:10:33.743955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.744602 (+   647us) service_pool.cc:224] Handling call
0709 13:10:33.744882 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.745090 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:33.770159 (+ 25069us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.796880 (+1026721us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b18000c6e80. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac23a
0709 13:10:34.797103 (+   223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.797155 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:34.797210 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.797278 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.797404 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32701,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":103,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":6439808,"thread_start_us":134017,"threads_started":1,"wal-append.queue_time_us":694916}
I20260709 13:10:34.829651 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:34.833715 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:34.863284 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:34.839092 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:34.840159 23621 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:34.865705 23774 raft_consensus.cc:606] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:34.866704 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.867478 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.867904 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.868233 23772 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:34.866291 23774 raft_consensus.cc:614] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:34.869201 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:34.837715 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:34.843530 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:34.782311 29268 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:34.872179 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.778030 29461 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:34.870002 23775 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 19: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:34.872915 23699 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:10:34.875487 23700 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:34.885540 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.886420 23696 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:34.888556 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.892127 23701 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:10:34.893842 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2928) took 1455 ms. Trace:
I20260709 13:10:34.894125 23702 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:34.896824 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:34.884567 23667 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.901161 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.902034 23696 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:34.904753 24390 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:34.906380 29395 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:34.910722 29405 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:34.915700 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:34.918468 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.919167 29298 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:34.920135 29466 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:34.920728 29466 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:34.921310 29298 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:34.923450 23667 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.924903 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:34.938834 23701 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 19: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:34.925664 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.938867 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.927314 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.939800 23698 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:34.924335 23770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:34.934589 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:34.940653 23770 raft_consensus.cc:606] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.940631 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:34.950784 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.951557 23667 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.958267 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:34.921413 29389 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:34.894273 23695 rpcz_store.cc:276] 0709 13:10:33.438029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.470932 (+ 32903us) service_pool.cc:224] Handling call
0709 13:10:33.471305 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.087472 (+616167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.087512 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.655466 (+567954us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b2c00001418. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:10:34.655919 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.729868 (+ 73949us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:34.863998 (+134130us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.864549 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.864787 (+   238us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.864851 (+    64us) raft_consensus.cc:1685] finished
0709 13:10:34.893648 (+ 28797us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.893770 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28597,"prepare.queue_time_us":148718,"raft.queue_time_us":54368,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":20953,"spinlock_wait_cycles":74727424,"thread_start_us":688510,"threads_started":2,"wal-append.queue_time_us":128373}
I20260709 13:10:34.962868 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:34.964246 24386 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:34.965298 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:34.967715 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:34.968396 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:34.968125 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.969309 23627 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:34.964777 23742 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:34.974038 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.977927 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:34.979213 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:34.980149 23704 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:34.937963 29337 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:34.982275 23697 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:34.982586 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:34.986277 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:34.986712 23628 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:34.989411 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:34.991302 23627 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:35.002702 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:34.966432 29467 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:34.954674 29370 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:35.005885 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:35.009100 29474 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.983542 29439 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:35.020655 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:35.023543 23776 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:34.972316 29268 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:34.981403 29310 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:34.980799 29460 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:34.985400 29337 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:35.013510 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 255233us
I20260709 13:10:35.014930 29466 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:35.040206 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:35.012032 29474 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.018836 23624 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:35.048095 29474 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.026829 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:35.009843 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:35.004371 29391 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:35.051981 29391 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.052501 29391 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:35.054557 23775 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:35.069422 29406 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:35.041500 29337 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:35.066968 29423 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.076349 23627 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:35.077678 29423 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:35.020582 29370 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:35.083935 29370 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:35.000202 29456 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:35.087467 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:35.017573 23770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:35.089489 23770 raft_consensus.cc:606] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:35.042184 23626 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:35.034797 29441 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:35.090703 29441 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.091925 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:35.093395 29441 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:34.995558 29447 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:10:35.094242 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:35.100937 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.102284 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:35.103019 23624 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:10:35.044265 29038 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:35.020255 29345 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:35.106514 29345 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:35.107103 29345 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:35.044313 29461 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:35.037358 29389 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:35.046739 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:35.113713 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 67075.5us
I20260709 13:10:35.114543 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:35.115705 29485 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:35.115928 29458 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:35.116427 29458 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:35.116900 29458 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:35.117058 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:35.116286 29485 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:35.120121 29431 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:35.120904 29431 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:35.122524 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:35.122171 29431 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.123149 23695 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:10:35.124346 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:35.126106 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:35.130957 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:35.132745 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:35.134243 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:35.135558 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:35.139425 24390 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
W20260709 13:10:35.142522 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 100499us
I20260709 13:10:35.152252 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2937) took 1649 ms. Trace:
I20260709 13:10:35.152724 23703 rpcz_store.cc:276] 0709 13:10:33.503402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.146606 (+643204us) service_pool.cc:224] Handling call
0709 13:10:34.146932 (+   326us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:34.214670 (+ 67738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.214698 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:34.224827 (+ 10129us) log.cc:844] Serialized 78 byte log entry
0709 13:10:34.647651 (+422824us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b1800372d60. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1 00007f2b412c7a0f
0709 13:10:34.708257 (+ 60606us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:34.740299 (+ 32042us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.751327 (+ 11028us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.752043 (+   716us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.752438 (+   395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.752614 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.152023 (+399409us) raft_consensus.cc:1685] finished
0709 13:10:35.152046 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.152190 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81053,"prepare.queue_time_us":44300,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":88,"raft.queue_time_us":103706,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":10165,"spinlock_wait_cycles":38694272,"thread_start_us":60370,"threads_started":1,"wal-append.queue_time_us":682065}
I20260709 13:10:35.137243 29485 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:35.143281 29386 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:35.141934 29441 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:35.167475 29310 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.155277 29316 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:10:35.175678 29386 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:35.155027 29389 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:10:35.193893 29405 raft_consensus.cc:993] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:10:35.197954 29386 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:35.173487 29489 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 13:10:35.254833 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 102520us
I20260709 13:10:35.182755 29441 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:35.257402 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 271183us
I20260709 13:10:35.195056 29310 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.255540 29405 raft_consensus.cc:1081] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Signalling peer 9ab488f10c434878a749f261e99a8065 to start an election
I20260709 13:10:35.256296 29406 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.273787 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:35.276984 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 100993us
I20260709 13:10:35.281132 29491 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:35.283185 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:35.262653 29298 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:35.292259 23703 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:35.295387 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:35.292716 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:35.256064 29447 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:10:35.258947 29057 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:10:35.304867 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:35.298946 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:35.273554 29388 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:35.319950 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:35.329027 23701 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:35.321210 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:35.323379 23696 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:35.332743 23695 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:35.294795 29417 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:35.294041 29485 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:35.335201 24389 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
W20260709 13:10:35.350874 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46283.5us
I20260709 13:10:35.315883 29432 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:35.296411 29406 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.293675 29402 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:10:35.362087 29493 log.cc:927] Time spent T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:10:35.362422 29441 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:35.363889 29406 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:35.349177 29485 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:35.366019 29485 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:35.370352 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:35.373976 29337 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:35.375361 24391 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:35.381817 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:35.356227 29214 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:10:35.414551 23697 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:35.415199 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:35.420203 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:35.375365 29492 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:10:35.359251 29316 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:35.347445 29417 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.435673 29310 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:35.339672 29388 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.383363 29345 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:35.489741 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 143901us
I20260709 13:10:35.493505 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:35.429952 29447 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:35.497658 23703 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:35.504752 24359 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:35.438056 29458 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.417927 28882 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
W20260709 13:10:35.506304 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 330201us
I20260709 13:10:35.457938 29474 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:35.524796 29505 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:35.527865 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:35.528651 23699 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:35.525446 29505 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:35.508512 29466 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:35.531585 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:35.541179 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:35.541594 29388 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:35.542292 29466 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.546321 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:35.547328 24388 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:10:35.506902 29406 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:10:35.545272 23592 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:35.549499 29407 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:35.561447 29410 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.029s
W20260709 13:10:35.581605 29391 consensus_meta.cc:287] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.002s
I20260709 13:10:35.598539 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:35.572815 29490 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:35.596515 29407 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:35.527851 29386 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:35.597898 29423 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:35.598297 29410 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.000s	sys 0.030s
I20260709 13:10:35.631279 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:35.600072 29337 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:35.609040 29407 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:35.635351 24392 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:35.608246 29472 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.632898 29423 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.640823 29489 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:35.647729 29423 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:35.649258 29509 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:10:35.649572 29458 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:35.608314 29391 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.652070 29391 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:35.648010 29466 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:35.588147 29505 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.653339 29505 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:35.656452 29520 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:35.657315 29464 consensus_queue.cc:1175] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" responder_term: 19 status { last_received { term: 17 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:35.658524 29423 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.619215 28882 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.667601 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:35.668663 23776 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:10:35.671597 23667 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:35.675148 23778 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:35.676791 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 131580us
I20260709 13:10:35.691433 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:35.673588 29507 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:10:35.645884 29417 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:35.677132 29268 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:35.692819 29506 log.cc:927] Time spent T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:10:35.709811 29490 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:35.717803 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:35.723948 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:35.725373 29490 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:35.726583 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:35.678449 28882 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:35.712159 29406 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:35.730737 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:35.702589 29345 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:35.705217 29441 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:35.703092 29268 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:35.732540 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:35.700656 29466 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:10:35.738610 23668 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:35.722359 29474 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:35.742899 23775 raft_consensus.cc:2368] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:10:35.744979 23778 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:35.749174 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:35.753262 23770 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:35.757941 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:35.701603 29407 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:35.764047 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:35.764413 29407 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:35.767151 23770 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:35.744374 29268 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.744803 29345 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:35.775385 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:35.744935 29441 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.779313 29532 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:35.779637 23627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:52042
I20260709 13:10:35.780256 23627 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:35.780622 23627 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:35.777441 29537 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:35.760703 29466 consensus_queue.cc:1243] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:10:35.791378 29466 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:35.791956 29466 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.794322 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:35.802435 29521 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:35.803902 29529 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:35.804522 29529 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.813143 28882 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:35.806988 29529 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:35.822219 29466 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:35.780681 29501 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:35.848306 29296 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:35.792869 29441 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:35.800334 29423 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:35.828444 29386 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:35.781759 29345 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.871424 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:35.860054 29497 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:10:35.872305 23623 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:35.873646 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:35.874388 23623 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:35.876971 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:35.875782 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:35.867328 23627 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:35.885365 23620 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:35.893873 23776 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
W20260709 13:10:35.895164 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 168720us
I20260709 13:10:35.858598 29296 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:35.897784 23628 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:35.898836 23627 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:35.913478 29345 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:35.914904 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:35.915602 23695 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:35.916697 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:35.918042 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:35.918813 23695 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:35.937750 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:35.939054 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:35.938141 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:35.945825 23701 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:35.891811 28882 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:10:36.004360 23701 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
W20260709 13:10:36.009855 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 70313.8us
I20260709 13:10:36.011466 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:36.013262 29268 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.033901 23696 raft_consensus.cc:2393] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:36.080211 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 180280us
W20260709 13:10:36.083889 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 72527.3us
I20260709 13:10:36.089035 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:36.106871 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:36.109329 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:36.084589 29536 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:36.106570 29441 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:36.126695 29538 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:36.132493 29533 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:36.135942 29268 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:36.141498 29542 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:36.134392 29408 raft_consensus.cc:993] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:36.143564 29408 raft_consensus.cc:1081] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:36.006757 29296 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.147486 29296 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:36.149405 29345 consensus_queue.cc:1175] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9ab488f10c434878a749f261e99a8065" responder_term: 18 status { last_received { term: 15 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18. Ops: [17.11-17.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:36.170274 29392 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.170914 29392 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.173054 29392 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:36.173378 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.176803 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:36.177443 23623 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:36.179071 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:36.180745 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:36.181885 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:36.182799 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:36.183187 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:36.183377 23695 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:36.184585 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:36.183790 23626 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:10:36.196503 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:36.196732 29538 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:36.198118 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:36.198590 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.198827 23697 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:36.205379 23623 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:36.207089 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:36.235203 23778 raft_consensus.cc:2393] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:36.209228 23695 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
W20260709 13:10:36.214504 29508 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.690s	user 0.006s	sys 0.004s
I20260709 13:10:36.222362 29515 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:36.224824 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:36.226540 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:36.233501 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:36.242185 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:36.186596 29537 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:36.197389 29538 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.188640 29392 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:36.268265 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 270866us
I20260709 13:10:36.243623 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:36.251413 23774 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:36.269799 23774 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:36.255857 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2339) took 1151 ms. Trace:
W20260709 13:10:36.270449 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 188521us
I20260709 13:10:36.250867 23776 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:36.253162 23592 leader_election.cc:400] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:10:36.272114 23592 leader_election.cc:403] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:36.278174 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:36.282110 23776 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:36.283864 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:36.265825 29287 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:36.265075 29268 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:36.286981 23697 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:10:36.270635 23624 rpcz_store.cc:276] 0709 13:10:35.104495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.104637 (+   142us) service_pool.cc:224] Handling call
0709 13:10:35.105026 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.105328 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:35.286625 (+181297us) log.cc:844] Serialized 14 byte log entry
0709 13:10:35.505587 (+218962us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.516535 (+ 10948us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.516813 (+   278us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:35.528124 (+ 11311us) log.cc:844] Serialized 14 byte log entry
0709 13:10:35.582755 (+ 54631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.582850 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.031846 (+448996us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b48000b0358. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:10:36.214070 (+182224us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b2400135f98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e0a59c4 00007f2b3e0a3acb 00007f2b3e25edc9 00007f2b3e25ea55 00007f2b3e25e09d 00007f2b40e9010e 00007f2b40ea788c 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221
0709 13:10:36.255528 (+ 41458us) raft_consensus.cc:1685] finished
0709 13:10:36.255570 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.255764 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88169,"prepare.queue_time_us":256321,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":98,"raft.queue_time_us":154589,"raft.run_cpu_time_us":3231,"raft.run_wall_time_us":516639,"spinlock_wait_cycles":36003584,"thread_start_us":365264,"threads_started":2,"wal-append.queue_time_us":237077}
I20260709 13:10:36.300150 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:36.276674 23774 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.303370 23774 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:36.305595 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:36.305929 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:36.250785 29413 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 13:10:36.345016 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 52814.9us
W20260709 13:10:36.346172 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 54614us
I20260709 13:10:36.346932 23742 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:36.348261 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:36.356863 23774 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:36.263406 29538 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:36.257294 29537 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.267310 29392 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.359752 23743 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:36.280053 29423 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:10:36.308208 29337 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:36.305830 29475 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.296744 29287 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:36.303494 29268 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:36.308068 29529 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:36.342787 29395 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:36.361370 29408 raft_consensus.cc:2764] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:10:36.346670 29460 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:36.306180 29406 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:10:36.396960 29395 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:36.361507 29544 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:36.413681 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63600.5us
I20260709 13:10:36.377218 29268 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:36.422412 29395 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.363083 29545 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:10:36.393676 28882 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:36.441514 29392 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:36.443779 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:36.458849 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:36.461493 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:36.462339 23699 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:36.463927 23774 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:36.455955 28882 raft_consensus.cc:697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:36.466261 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:36.466621 28882 consensus_queue.cc:237] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.458868 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:36.467932 23703 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:36.469965 29480 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:36.470497 29480 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.471163 29546 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:36.472152 23698 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:36.417848 29544 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:36.473587 29544 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:36.474139 29286 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:36.474332 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:36.474556 29286 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:36.474910 23696 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:36.412878 29529 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:36.476364 29537 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:36.476563 29529 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:36.475363 29286 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.414408 29533 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:36.481004 29533 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.483207 24388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 891) took 1159 ms. Trace:
I20260709 13:10:36.483363 29533 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:36.485366 23698 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:36.483605 24388 rpcz_store.cc:276] 0709 13:10:35.323474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.323793 (+   319us) service_pool.cc:224] Handling call
0709 13:10:35.324093 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.547853 (+223760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.482973 (+935120us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001a4fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:36.483151 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507634048}
I20260709 13:10:36.487289 23698 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:36.485430 29480 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:36.488831 23592 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:36.489658 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:36.491588 29489 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:36.492148 23703 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:36.492699 29505 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:36.494685 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:36.496302 29522 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:36.492179 29489 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:36.497570 23593 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:36.500036 29405 raft_consensus.cc:993] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
W20260709 13:10:36.502228 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 192426us
I20260709 13:10:36.511188 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:36.513010 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:36.515617 29474 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.516034 29480 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:36.521963 23696 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:36.501263 29423 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:36.442406 29287 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.524875 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:36.533354 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:36.544292 24390 raft_consensus.cc:2393] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 11: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:36.539860 29480 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.541414 29474 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.547353 23702 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:10:36.550243 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 104563us
I20260709 13:10:36.512392 29537 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:36.554620 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:36.559974 23668 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:36.560580 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:36.553170 29406 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:36.558401 29545 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:36.562759 29480 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:36.562510 29537 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.562891 29545 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.562325 29057 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:36.538694 29214 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:36.545462 29337 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:36.570185 29406 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:36.571089 29406 raft_consensus.cc:3055] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:36.570719 29337 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.571517 29406 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:36.572443 29406 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.573655 29406 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.566793 29554 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:36.576025 29556 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:36.576414 29554 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.568684 29214 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.577632 24386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 890) took 1268 ms. Trace:
I20260709 13:10:36.577755 29214 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.578013 24386 rpcz_store.cc:276] 0709 13:10:35.308824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.309097 (+   273us) service_pool.cc:224] Handling call
0709 13:10:35.309443 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.390191 (+ 80748us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:35.510184 (+119993us) log.cc:844] Serialized 14 byte log entry
0709 13:10:35.604497 (+ 94313us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:35.604587 (+    90us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:35.604664 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.577373 (+972709us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b5400603954. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:36.577420 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.577578 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1486,"prepare.queue_time_us":174220,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2413,"raft.queue_time_us":5448,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":9824,"spinlock_wait_cycles":142900480,"thread_start_us":211907,"threads_started":2,"wal-append.queue_time_us":182705}
I20260709 13:10:36.579205 29554 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:36.576563 29556 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.555176 29527 raft_consensus.cc:1081] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:36.589771 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:36.592872 29552 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:36.595027 29413 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:36.597154 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:36.604898 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:36.612747 23776 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 20: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:36.605757 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:36.555915 29423 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:36.575274 29268 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.569080 29296 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.625885 23704 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:36.629199 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:36.580471 29287 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:36.630581 23776 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:36.631544 29528 consensus_queue.cc:1059] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:10:36.556594 29392 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:10:36.661055 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:36.535521 29522 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.636777 29519 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:36.640350 29558 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:36.645146 29423 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:36.624641 29405 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.646634 29537 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:36.620318 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:36.635401 29556 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:36.611315 29458 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:36.669054 23704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:10:36.669885 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:36.584645 29057 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.696679 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:36.698936 29474 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:36.650836 29413 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.652019 29552 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:37.044273 29555 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.375s
I20260709 13:10:36.664024 29447 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.661568 29489 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:37.049243 23624 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:37.051842 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:36.715098 23704 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:10:37.063522 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 356584us
I20260709 13:10:36.699393 29558 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:37.103495 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 410017us
I20260709 13:10:37.054733 29458 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:37.070570 29526 log.cc:927] Time spent T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.346s	user 0.003s	sys 0.006s
I20260709 13:10:37.146454 24388 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:10:37.145709 29337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.032s	sys 0.029s
I20260709 13:10:37.215607 23704 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:37.074328 29539 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.359s	user 0.004s	sys 0.005s
I20260709 13:10:37.181950 29370 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:37.277735 29458 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:37.144235 29460 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.278050 28882 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:37.278474 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63125.8us
W20260709 13:10:37.306430 23696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.041s
I20260709 13:10:37.146548 29480 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:37.312676 23696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.009s	sys 0.042s
W20260709 13:10:37.286775 29337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.032s	sys 0.030s
I20260709 13:10:37.182380 29386 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:37.326700 29480 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:37.328406 29564 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:10:37.278097 29268 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:37.290426 29556 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:37.267630 29545 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:37.267156 29528 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:37.337059 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:37.345266 23704 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:37.400772 24393 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:37.416976 23701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:10:37.417987 23701 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:37.418401 23701 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.420083 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:37.434713 24386 consensus_meta.cc:287] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.822s	user 0.010s	sys 0.001s
I20260709 13:10:37.435258 24386 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:37.437001 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:37.444434 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:37.444787 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:37.449285 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:37.335978 29576 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:37.177424 29447 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:37.457360 23704 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:37.323699 29441 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 13:10:37.311669 29370 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:37.441186 29526 log.cc:927] Time spent T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:10:37.411586 29545 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:37.407568 29556 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:37.322361 29460 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:37.437882 29268 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:37.321786 28882 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:37.473553 23701 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:37.364104 29386 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:37.570647 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:37.526854 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:37.578007 29561 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:10:37.584185 23701 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:37.588320 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 445170us
I20260709 13:10:37.504952 29057 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:37.592070 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2367) took 1093 ms. Trace:
I20260709 13:10:37.410574 29528 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:37.603381 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:37.604971 23698 rpcz_store.cc:276] 0709 13:10:36.498452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.501427 (+  2975us) service_pool.cc:224] Handling call
0709 13:10:36.501719 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.501962 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:10:37.063195 (+561233us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.589291 (+526096us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.591381 (+  2090us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.591559 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.591617 (+    58us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:37.591706 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.591816 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.591990 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38188,"prepare.queue_time_us":83899,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"thread_start_us":654729,"threads_started":2}
I20260709 13:10:37.613921 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:37.615258 23704 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
W20260709 13:10:37.616693 23699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.003s	sys 0.032s
W20260709 13:10:37.617074 23699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.003s	sys 0.032s
I20260709 13:10:37.619987 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:37.620916 23704 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:37.617714 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2370) took 1115 ms. Trace:
I20260709 13:10:37.620096 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:37.622833 24359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.006s	sys 0.022s
W20260709 13:10:37.624018 24359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.006s	sys 0.022s
I20260709 13:10:37.624784 24357 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:37.621672 23699 rpcz_store.cc:276] 0709 13:10:36.502675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.502807 (+   132us) service_pool.cc:224] Handling call
0709 13:10:36.503112 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.503329 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:36.670479 (+167150us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.061282 (+390803us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.617367 (+556085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.617425 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:37.617465 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.617534 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.617656 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132607,"prepare.queue_time_us":556872,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":112,"raft.queue_time_us":215236,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":82,"spinlock_wait_cycles":14363520,"thread_start_us":652690,"threads_started":2}
I20260709 13:10:37.665500 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:37.518435 29545 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:37.623034 23668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.013s	sys 0.013s
W20260709 13:10:37.682420 23668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.014s	sys 0.013s
I20260709 13:10:37.685637 23699 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:37.605312 29522 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:37.616228 29407 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.495117 29576 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:37.583006 29268 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:37.660204 29544 consensus_meta.cc:287] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.186s	user 0.015s	sys 0.005s
I20260709 13:10:37.697907 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:37.720126 28882 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:37.720405 29495 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:37.721570 29567 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:10:37.721696 29480 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:37.722414 29490 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:37.723114 29490 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:36.109570 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:37.698758 29413 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:37.706460 29407 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:37.705651 29583 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:37.727435 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.728092 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2452) took 1225 ms. Trace:
I20260709 13:10:37.744822 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2976) took 1805 ms. Trace:
I20260709 13:10:37.760692 23774 rpcz_store.cc:276] 0709 13:10:36.502752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.503508 (+   756us) service_pool.cc:224] Handling call
0709 13:10:36.503839 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.504173 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.504207 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.504819 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.573554 (+ 68735us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b4800280758. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:10:36.661869 (+ 88315us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:36.662640 (+   771us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.668750 (+  6110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.668821 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.727716 (+1058895us) raft_consensus.cc:1685] finished
0709 13:10:37.727844 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.728018 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12255,"prepare.queue_time_us":491,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":24601,"raft.queue_time_us":13921,"raft.run_cpu_time_us":1605,"raft.run_wall_time_us":75680,"spinlock_wait_cycles":19250048,"thread_start_us":156677,"threads_started":1,"wal-append.queue_time_us":1011426}
W20260709 13:10:37.726388 24360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.007s	sys 0.040s
W20260709 13:10:37.770645 24360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.008s	sys 0.040s
I20260709 13:10:37.736248 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2356) took 1290 ms. Trace:
I20260709 13:10:37.766188 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:37.769037 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:37.769860 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:37.730008 23527 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:37.741907 29268 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:37.788236 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:37.746847 29583 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:37.737095 29214 consensus_meta.cc:287] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.159s	user 0.009s	sys 0.000s
I20260709 13:10:37.780224 23626 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.771351 23620 rpcz_store.cc:276] 0709 13:10:36.445687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.445837 (+   150us) service_pool.cc:224] Handling call
0709 13:10:36.446219 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.449155 (+  2936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.449190 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:36.449237 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:36.449279 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.735992 (+1286713us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b54003241d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:37.736049 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.736185 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6244224}
I20260709 13:10:37.740507 29388 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:37.780668 29475 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:37.786206 29406 consensus_meta.cc:287] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.212s	user 0.012s	sys 0.000s
I20260709 13:10:37.734009 29370 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:37.743468 29528 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:37.746153 29574 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:10:37.733292 29576 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:37.755558 29584 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:37.745651 29407 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:37.727363 29386 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:37.783608 29474 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:37.768849 29339 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:37.762796 29552 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:37.785511 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 2980) took 1132 ms. Trace:
I20260709 13:10:37.841202 23696 rpcz_store.cc:276] 0709 13:10:36.653432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.654246 (+   814us) service_pool.cc:224] Handling call
0709 13:10:36.654561 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:36.662327 (+  7766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.662356 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:36.662873 (+   517us) log.cc:844] Serialized 52 byte log entry
0709 13:10:37.313118 (+650245us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:37.313158 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.313227 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.785269 (+472042us) raft_consensus.cc:1685] finished
0709 13:10:37.785291 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.785448 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":349409,"raft.queue_time_us":9363,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":27271,"thread_start_us":550330,"threads_started":1,"wal-append.queue_time_us":822697}
I20260709 13:10:37.778705 28882 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:10:37.744408 29538 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:37.726293 29572 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.006s
W20260709 13:10:37.789423 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 186169us
I20260709 13:10:37.789446 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:37.856868 23623 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:37.765053 23702 rpcz_store.cc:276] 0709 13:10:35.938899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.941529 (+  2630us) service_pool.cc:224] Handling call
0709 13:10:35.941830 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.554156 (+612326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.744548 (+1190392us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400405454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:37.744759 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391810944}
I20260709 13:10:37.729928 29410 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:37.796722 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 172005us
I20260709 13:10:37.799289 24392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 896) took 1193 ms. Trace:
I20260709 13:10:37.744557 29591 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:37.786768 29458 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:37.764979 29432 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.725831 29490 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:37.716699 29544 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:37.827986 23627 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
W20260709 13:10:37.888664 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 180320us
I20260709 13:10:37.889329 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2453) took 1313 ms. Trace:
I20260709 13:10:37.889917 23770 rpcz_store.cc:276] 0709 13:10:36.576256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.580003 (+  3747us) service_pool.cc:224] Handling call
0709 13:10:36.580357 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.580717 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.580744 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.600528 (+ 19784us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.917501 (+316973us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:36.922829 (+  5328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.922956 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.889074 (+966118us) raft_consensus.cc:1685] finished
0709 13:10:37.889103 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.889258 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3843,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5623,"thread_start_us":264231,"threads_started":1,"wal-append.queue_time_us":675822}
I20260709 13:10:37.892243 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:37.892416 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:37.885800 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:37.833873 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47257.8us
W20260709 13:10:37.829591 29571 log.cc:927] Time spent T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.371s	user 0.000s	sys 0.002s
I20260709 13:10:37.858522 29556 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:37.839982 29287 consensus_meta.cc:287] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.192s	user 0.009s	sys 0.004s
I20260709 13:10:37.858381 29538 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:37.799587 29388 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:37.822062 29406 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:37.883237 29579 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 13:10:37.796286 29214 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:37.848788 29575 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:10:37.864876 24392 rpcz_store.cc:276] 0709 13:10:36.605792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.605964 (+   172us) service_pool.cc:224] Handling call
0709 13:10:36.632647 (+ 26683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.632956 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:10:37.024577 (+391621us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.787858 (+763281us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b18000813a0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b3e221a40 00007f2b3e21c4e4 00007f2b3e21c455 00007f2b44d043c7 00007f2b413169a7 00007f2b413260bf 00007f2b41326038
0709 13:10:37.788075 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.798878 (+ 10803us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.798954 (+    76us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:37.799019 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.799094 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.799229 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71830,"prepare.queue_time_us":709316,"prepare.run_wall_time_us":42,"raft.queue_time_us":14207,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":37656,"spinlock_wait_cycles":67792512,"thread_start_us":643354,"threads_started":2,"wal-append.queue_time_us":657671}
I20260709 13:10:37.885579 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:37.802758 29475 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:37.876698 23667 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:37.908908 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:37.913046 23769 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:37.850394 29447 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:37.922719 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 46143.8us
I20260709 13:10:37.923906 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:37.909152 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:37.899914 29489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.005s	sys 0.005s
I20260709 13:10:37.927382 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:37.932039 29581 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 13:10:37.932714 29475 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:37.933362 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:37.879817 29410 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:37.934877 29480 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:37.935256 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:37.936380 29595 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:37.895041 29490 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:37.894415 29458 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:37.939049 29489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.006s	sys 0.006s
I20260709 13:10:37.894769 29432 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:37.922421 29558 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:37.914284 29406 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:37.935101 29402 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:37.840395 29584 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:37.933985 29417 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:37.951375 29370 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:37.947611 29537 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:37.958670 29268 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:37.954535 29407 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:37.956993 29423 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:37.962749 29480 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:37.914080 29460 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:10:37.960897 29545 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:37.977156 29519 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:37.969600 29522 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:37.983522 29402 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:38.031674 29592 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:38.032583 29592 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.032636 29402 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.036319 29516 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:38.037412 29406 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:37.970323 29490 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.038164 29589 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.038923 29589 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.041687 29589 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.042646 29214 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.040880 29490 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:37.997359 29417 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:38.044447 29586 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:10:38.046258 29417 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.015328 29423 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:37.999759 29268 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:38.043294 29596 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:10:38.037158 29516 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.051627 29538 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.052516 29584 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.058190 29516 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.052687 29480 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.053594 29388 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.054775 29410 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.055277 29583 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.055955 29432 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:38.058477 29405 consensus_meta.cc:287] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.354s	user 0.010s	sys 0.002s
I20260709 13:10:38.060091 29405 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.060226 29458 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:37.966078 29595 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.062126 29595 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.024122 29407 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.064127 29485 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:38.064541 29407 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.064756 29485 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:10:38.066077 29296 consensus_meta.cc:287] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.418s	user 0.004s	sys 0.008s
I20260709 13:10:38.066684 29296 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.066097 29485 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.067497 29268 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.067524 29485 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.071779 29286 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:38.079517 29547 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.365s	user 0.011s	sys 0.009s
I20260709 13:10:38.031675 29522 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.081693 29533 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:38.085582 29522 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.086227 29533 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:38.086944 29533 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.050508 29592 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.049768 29519 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.091068 29544 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.090602 29533 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:37.937834 23626 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:37.955891 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.132401 23622 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:37.956229 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.141583 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.142817 23625 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:37.953359 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.144693 23628 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:38.146458 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:38.146762 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 222868us
I20260709 13:10:38.142715 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:38.148079 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 238839us
I20260709 13:10:38.148475 23629 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:38.148746 23667 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:38.149655 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:38.132872 23621 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:38.151757 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:38.147648 23628 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:38.050091 24393 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:38.169348 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.170403 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.171828 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.173269 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.174039 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.174991 23776 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:10:38.176438 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.177268 23696 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:38.177527 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.178336 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.180502 23621 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:38.173333 23770 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:38.168378 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.181849 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.179210 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.184321 23622 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:38.188262 29388 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:38.204437 29388 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.189383 29310 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:38.207275 29310 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.189558 29316 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:38.209481 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.191303 29392 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:38.210459 23701 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:10:38.210616 29392 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.211831 23629 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:38.195585 29370 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:38.213542 29370 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.214413 29392 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.215004 29392 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:38.216641 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.217782 23695 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:38.218696 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.195740 29441 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:38.219785 23702 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:38.220193 29441 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:38.221081 29441 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.222635 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.196089 29287 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:38.224262 29287 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.227099 29287 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.193977 29423 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:38.232234 23769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 2447) took 1999 ms (client timeout 2417 ms). Trace:
W20260709 13:10:38.232771 23769 rpcz_store.cc:269] 0709 13:10:36.233220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.233331 (+   111us) service_pool.cc:224] Handling call
0709 13:10:37.665340 (+1432009us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b5800003c98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462d20a0 00007f2b462d1984 00007f2b3f84c6d4 00007f2b3f84c662
0709 13:10:38.231864 (+566524us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400346a54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:38.232058 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570440448}
I20260709 13:10:38.233897 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.200405 29447 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:38.223632 23695 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:38.197247 29456 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:38.235020 23698 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 9.
I20260709 13:10:38.237360 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.239219 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:38.240324 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.209318 29316 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.248601 23699 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:38.249011 29460 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.249687 29460 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.251011 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.251927 23699 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:38.253572 29460 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.254209 29460 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:38.254362 23699 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:10:38.004683 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 84610.7us
I20260709 13:10:38.243420 29316 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.248802 29370 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.271124 29447 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:38.273864 29519 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.271534 23699 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:38.254949 29460 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.262923 29392 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.271341 29456 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 20 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:38.281844 29310 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.270874 29296 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:38.289165 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.295158 29590 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:38.295655 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.296173 29590 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.297713 29447 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.298672 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:38.302769 29538 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:38.303416 29583 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:38.304028 29584 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.315948 29296 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.316948 29584 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.299141 23701 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:10:38.308142 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.310873 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.311841 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.312243 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:38.312668 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.313014 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.313340 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.313916 29413 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:38.314877 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.315275 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.326799 23777 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:38.324991 29538 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.327512 29583 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.329101 23698 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:38.329509 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.330031 23778 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:38.333932 23624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 2360) took 1705 ms (client timeout 2098 ms). Trace:
W20260709 13:10:38.344391 23624 rpcz_store.cc:269] 0709 13:10:36.628639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.628849 (+   210us) service_pool.cc:224] Handling call
0709 13:10:38.333544 (+1704695us) spinlock_profiling.cc:243] Waited 83.9 ms on lock 0x7b54002440d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:38.333723 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192856832}
I20260709 13:10:38.330956 29413 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.334805 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.336833 23668 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:10:38.342865 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.351830 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.352087 29467 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:38.352689 29467 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:38.353214 29467 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.341635 29460 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.330576 23695 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.356274 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.361073 29413 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.353717 29268 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.366564 29456 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.373914 24390 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:38.382716 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:38.292272 29519 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.388275 29519 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.396725 23527 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 7 to 9, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 9 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.403447 29584 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.406205 29402 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.420217 29590 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.308689 29441 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.322767 29296 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.425719 29423 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:38.429152 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46639.7us
I20260709 13:10:38.423911 29616 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:38.470288 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 94963us
I20260709 13:10:38.391376 29519 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.477945 23695 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:38.483436 23668 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:38.486440 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 113102us
W20260709 13:10:38.486827 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 128488us
I20260709 13:10:38.489346 29415 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:38.490171 29415 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.474967 29423 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.494860 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.489373 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.497485 29415 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.486887 29392 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.498268 29423 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:38.510215 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.507488 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:38.504441 29584 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:38.516289 29617 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:38.516901 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.517128 29617 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.518091 23624 raft_consensus.cc:2410] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:38.519572 23625 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:38.504633 29388 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:38.524750 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.525156 29495 consensus_queue.cc:1059] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:10:38.526432 29495 raft_consensus.cc:3055] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:38.526790 29495 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:38.524519 23778 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:38.530551 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:38.530580 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 53806.1us
I20260709 13:10:38.535310 29608 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.536098 29608 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:38.536537 29608 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.539116 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.540380 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.520516 29584 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.535499 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.546057 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.547765 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.548440 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.543350 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.523924 23527 catalog_manager.cc:5697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.553051 23625 raft_consensus.cc:2410] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:10:38.556546 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.565994 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.545401 29584 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.534282 29617 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.571667 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:38.564211 29296 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:38.582297 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:38.581950 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.589942 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.535243 29495 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.597674 29592 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.598167 29592 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:38.598608 29592 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.598731 29603 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:38.599684 29603 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.602778 29603 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.605880 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.607434 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.613655 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:38.614566 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.616463 29546 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:10:38.617115 23592 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:38.616420 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.618995 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.622241 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.624043 23773 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:38.580411 29296 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:38.625336 29296 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:38.625893 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.616400 29415 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:38.628930 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.632192 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.633301 29555 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:38.633464 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.634325 24392 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:38.635397 29528 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.636793 29495 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.637760 23629 raft_consensus.cc:2368] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13.
I20260709 13:10:38.645422 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.645726 29214 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.586835 29617 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:38.648402 29268 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.647935 29214 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.649062 29617 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.629889 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:38.653683 29464 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.654126 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:38.654292 29464 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.655200 29607 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.655611 29607 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:38.655983 29538 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.656052 29607 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.651335 29214 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.660529 29588 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.663470 29464 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.666218 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.672873 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.665990 23527 catalog_manager.cc:5697] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 2 to 6, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 6 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:38.676281 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.675953 23527 catalog_manager.cc:5697] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 3 to 6, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 6 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:38.678066 29528 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.667575 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.680274 24388 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
W20260709 13:10:38.682296 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 90369.8us
I20260709 13:10:38.683148 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:38.667905 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.683920 29287 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:38.685218 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:38.685417 29522 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:38.686676 29622 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:10:38.687077 29519 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.687085 29522 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:38.688481 29467 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.688625 29522 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:38.689970 29286 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.618s	user 0.013s	sys 0.001s
I20260709 13:10:38.690922 23775 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:38.692050 29621 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.692571 29621 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.694339 29555 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:38.695261 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:38.678472 23527 catalog_manager.cc:5697] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 3 to 11. New cstate: current_term: 11 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:38.671707 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:38.700636 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.698252 29287 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:38.704955 29287 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:38.707486 29597 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.708298 29597 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.711252 29597 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.706174 29287 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.713558 29621 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.751319 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.698684 29467 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:38.754881 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 185033us
I20260709 13:10:38.757618 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:38.752943 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.651398 29617 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:38.760839 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:38.761686 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 46096.7us
I20260709 13:10:38.763361 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:38.714500 29592 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:38.778074 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 124045us
I20260709 13:10:38.794726 29608 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.799505 23625 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:38.797714 23774 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:38.781941 24358 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:38.779685 29555 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:38.802282 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:38.763227 29464 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:38.802174 29431 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.804363 29467 raft_consensus.cc:2764] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:10:38.827751 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 156193us
I20260709 13:10:38.812237 29583 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:38.843525 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 86020.7us
I20260709 13:10:38.825206 29616 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:38.857596 23702 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:38.864666 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:38.865725 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 161054us
I20260709 13:10:38.865748 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.866307 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.865258 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.865216 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.865270 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:38.864290 23743 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:38.882244 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:38.889739 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:38.870301 29608 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.896766 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.879470 29555 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:38.899537 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:38.882113 29392 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:38.836158 29431 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.895509 23701 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 20.
W20260709 13:10:38.910032 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 44865.8us
I20260709 13:10:38.914693 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:38.898046 29286 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:38.903079 29555 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:38.901875 29456 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:38.924037 29555 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.924264 29456 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.926826 29456 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:38.927053 29474 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:38.922264 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 119705us
I20260709 13:10:38.897832 29588 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:38.918316 29533 consensus_meta.cc:287] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.798s	user 0.010s	sys 0.006s
W20260709 13:10:38.944499 29627 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:10:38.951004 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.929028 29608 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.915693 29467 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:38.955955 24359 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:38.956884 23743 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:38.958750 23695 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:38.945431 29607 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.964573 29607 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:38.966708 29467 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:38.968063 29485 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.968189 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:38.966777 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46983.1us
I20260709 13:10:38.945297 29456 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.972685 29538 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:38.973551 23519 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 182) took 16773 ms (client timeout 15000 ms). Trace:
I20260709 13:10:38.974385 23698 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:38.969303 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:38.982995 23695 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:10:38.985453 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 118964us
I20260709 13:10:38.990834 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:38.993508 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 78895.1us
I20260709 13:10:38.986236 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:38.987402 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:38.998291 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:38.999661 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49379.1us
I20260709 13:10:38.983088 29607 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:39.028050 23695 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 10.
I20260709 13:10:39.007328 29607 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:38.988315 29456 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:38.992865 29423 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.078037 23622 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 20: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:39.078995 29423 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.012953 29485 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:38.979046 23519 rpcz_store.cc:269] 0709 13:10:22.200286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.201424 (+  1138us) service_pool.cc:224] Handling call
0709 13:10:38.973230 (+16771806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:32.085676 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:32.086324 (+   648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:32.086387 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:10:32.086411 (+    24us) tablet.cc:662] Decoding operations
0709 13:10:32.129033 (+ 42622us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:32.129153 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:32.129188 (+    35us) tablet.cc:685] Acquiring locks for 34 operations
0709 13:10:32.132788 (+  3600us) tablet.cc:701] Row locks acquired
0709 13:10:32.132851 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:10:32.133022 (+   171us) write_op.cc:270] Start()
0709 13:10:32.133184 (+   162us) write_op.cc:276] Timestamp: P: 1783602632132961 usec, L: 0
0709 13:10:32.133223 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:10:32.133957 (+   734us) log.cc:844] Serialized 13248 byte log entry
0709 13:10:32.955835 (+821878us) op_driver.cc:464] REPLICATION: finished
0709 13:10:33.205855 (+250020us) write_op.cc:301] APPLY: starting
0709 13:10:33.205969 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:34.342225 (+1136256us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:34.342371 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:35.081956 (+739585us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:35.082571 (+   615us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=68,mrs_lookups=0
0709 13:10:35.082666 (+    95us) write_op.cc:312] APPLY: finished
0709 13:10:35.083470 (+   804us) log.cc:844] Serialized 292 byte log entry
0709 13:10:35.277813 (+194343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:35.278457 (+   644us) write_op.cc:454] Released schema lock
0709 13:10:35.278666 (+   209us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:35.314122 (+ 35456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:35.321804 (+  7682us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":386365,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":249705,"apply.run_cpu_time_us":79214,"apply.run_wall_time_us":2085171,"cfile_cache_hit":138,"cfile_cache_hit_bytes":146451,"num_ops":34,"prepare.queue_time_us":103431,"prepare.run_cpu_time_us":12220,"prepare.run_wall_time_us":96166,"raft.queue_time_us":723843,"raft.run_cpu_time_us":14133,"raft.run_wall_time_us":181938,"replication_time_us":822433,"thread_start_us":940195,"threads_started":5,"wal-append.queue_time_us":365082,"wal-append.run_cpu_time_us":19947,"wal-append.run_wall_time_us":2582905}]]}
I20260709 13:10:38.991492 29584 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:39.042426 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.051213 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:39.054862 29474 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:39.007982 29538 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.060875 29467 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.032493 29597 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:39.064811 29628 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.053s	user 0.003s	sys 0.000s
W20260709 13:10:39.067896 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 77141.9us
I20260709 13:10:39.069146 29431 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:39.071908 23700 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:39.044166 29607 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:39.097520 29546 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:39.094961 29214 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:10:39.115914 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:39.117173 29519 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:39.117306 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:39.117599 29519 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:39.118014 29519 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:39.118566 23593 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:39.108032 29546 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:39.120055 29546 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:39.133369 29406 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:39.126061 29590 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:39.141753 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 103627us
I20260709 13:10:39.108319 29597 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.113292 29296 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.157433 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:39.184679 24358 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:39.167692 29597 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.169831 29485 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:39.191609 29588 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:39.191363 29415 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:10:39.206367 29485 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:39.210528 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:39.213065 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.190313 29474 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
W20260709 13:10:39.217935 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 63848.1us
I20260709 13:10:39.201977 29456 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.205906 29597 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:39.207437 29588 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:39.221457 29495 consensus_meta.cc:287] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.005s
I20260709 13:10:39.224058 29584 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.225791 29538 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.231992 29588 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:39.229664 29456 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:39.229949 29592 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.235038 29415 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:39.243470 29474 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:39.256989 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46567.4us
I20260709 13:10:39.236759 29597 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.254914 29415 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.267251 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:39.268419 24358 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:39.269449 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:39.272199 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:39.254315 29621 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:39.283281 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:39.285225 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:39.290900 23593 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:39.256381 29456 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.272768 29415 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:39.276239 29608 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:39.277015 29296 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.284049 29464 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:39.296204 29528 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:39.296559 29590 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:39.297715 29592 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.262305 29485 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.303751 29603 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:39.293802 29621 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.308981 29528 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.322690 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:39.317222 29603 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:39.344734 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:39.313401 29474 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:10:39.323969 29528 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:39.351981 29555 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.352499 23700 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:39.329667 29590 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:39.347824 29464 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:10:39.314214 29592 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.363694 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:39.370030 29474 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:39.370555 29474 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:39.370990 29555 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.372409 29485 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.372673 29456 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.375777 29621 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.376606 29597 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.347062 29603 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.382131 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.382328 23700 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:39.370975 29474 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:39.382951 29495 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:39.383402 29495 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:39.383814 29495 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:39.383837 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.384549 23699 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:39.385962 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:39.382659 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 52541.1us
W20260709 13:10:39.386270 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 338493us
I20260709 13:10:39.388552 23593 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:39.379102 29402 consensus_meta.cc:287] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.904s	user 0.009s	sys 0.003s
I20260709 13:10:39.396665 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:39.397419 23698 raft_consensus.cc:2368] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13.
I20260709 13:10:39.391528 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:39.398886 23772 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:39.399279 23698 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:39.349416 29296 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.400084 29296 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.401100 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.402290 29296 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.392581 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.403069 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.403256 23695 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:39.403446 23698 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:39.393906 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.404318 23701 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:39.404456 23700 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:10:39.362347 29590 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:39.405388 29590 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:39.395191 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.395030 29464 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:39.330713 29518 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:10:39.414410 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 64502.1us
I20260709 13:10:39.419708 29641 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:39.422155 29608 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.422736 29608 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.426959 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:39.427302 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:39.415104 29402 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:39.429306 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:39.428694 23623 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:39.430083 23622 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:39.432329 23627 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:39.433354 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:39.443972 23775 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:39.494940 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.444729 29431 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:10:39.496446 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:39.497157 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54268.8us
I20260709 13:10:39.425613 29621 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.505748 29621 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.442559 29641 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.501619 23772 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:10:39.508257 29641 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.509022 29415 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.510289 24390 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:10:39.498600 29592 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.517781 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:39.524657 24392 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:39.432021 29607 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:39.525544 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 77469.3us
I20260709 13:10:39.530716 29528 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.532305 29607 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.519447 29608 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.535111 29528 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.523330 29519 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.539115 24389 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:39.534303 29647 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:39.539888 29392 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:39.541260 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.540391 29647 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.548566 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:39.548862 29392 raft_consensus.cc:3055] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:39.549252 29392 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:39.548571 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.561146 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:39.540520 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:39.568058 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:39.568804 24386 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:39.539609 29519 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.526306 29641 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.575445 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.578024 23696 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:10:39.561743 29464 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:10:39.524143 29474 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.577283 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:39.595335 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.595561 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:39.586977 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.598729 23703 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:39.591391 23592 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:39.596091 23704 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:39.601022 29655 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:10:39.601408 23704 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:39.612294 23775 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:39.616091 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:39.621657 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:39.624577 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:39.627241 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:39.628046 24392 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:39.631287 23703 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:39.639089 24393 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:39.650833 23778 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
W20260709 13:10:39.622213 29546 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.502s	user 0.015s	sys 0.004s
I20260709 13:10:39.652544 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:39.652556 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:39.657651 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:39.626622 29608 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:39.686338 29608 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:39.673286 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:39.688580 23696 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:39.595983 29519 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:10:39.675891 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:39.676569 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.677171 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:39.677886 29474 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:39.689239 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:39.678954 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:39.680073 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:39.700347 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46628.3us
I20260709 13:10:39.681607 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:39.683218 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:39.683169 29592 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:39.684602 29588 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.685225 23668 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:39.672398 29546 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.578626 29392 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.696110 23770 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:39.696376 24386 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:39.700625 23700 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:39.680909 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:39.709332 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:39.652995 29621 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:39.660729 29518 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.711274 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:39.687459 29608 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.717748 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:39.724200 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:39.703600 29402 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:39.705595 29592 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:39.745805 24390 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:39.717813 29296 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:39.724407 29597 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.812937 23771 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:39.725898 29415 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:39.823493 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 74426.5us
I20260709 13:10:39.825163 24388 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:39.818401 29423 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:39.816525 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 67312.4us
I20260709 13:10:39.743184 29592 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:39.720743 29518 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.837524 23698 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:39.842867 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.825122 29392 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:39.745306 29590 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.822953 29528 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:39.744207 29603 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.745605 29402 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.852589 29546 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.839390 29519 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.854157 29495 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.857264 29518 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.869091 29588 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:39.917200 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 71610.4us
I20260709 13:10:39.826876 29597 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.872462 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:39.876235 29423 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.878700 29576 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:39.880049 29670 consensus_queue.cc:1059] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:39.882349 23771 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:39.863569 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.887881 23696 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:10:39.915349 29519 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:39.872144 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:39.941740 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:39.919471 24392 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:39.924865 23778 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:39.925846 29576 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:39.952344 23629 raft_consensus.cc:2410] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:10:39.952978 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:39.937525 29597 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.937976 29495 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.930110 23770 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:39.939877 29592 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.930526 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:39.945462 23668 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:39.960763 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:39.960868 23700 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:39.960448 23773 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
W20260709 13:10:39.953282 29661 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.317s	user 0.000s	sys 0.005s
I20260709 13:10:39.968571 23743 leader_election.cc:400] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13.
I20260709 13:10:39.970103 23743 leader_election.cc:403] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:39.957396 29392 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:39.960868 29415 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:10:39.971032 29392 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:39.932735 29423 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.975852 29392 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:39.977859 29659 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:10:39.978564 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:39.985311 23700 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:10:39.979869 23667 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.3:45959 timed out after 1.570s (SENT) [suppressed 45 similar messages]
I20260709 13:10:39.920486 29528 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:39.953207 29485 consensus_queue.cc:1059] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:10:39.996145 29528 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.998638 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:39.966715 29214 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 13:10:40.002270 29214 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:40.002655 29214 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:40.009891 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:40.010617 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:40.011412 23696 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:40.011879 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:39.990618 29592 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:39.991708 29603 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:40.013715 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:40.003546 29214 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:40.015878 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49782.3us
I20260709 13:10:39.992903 29590 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.993135 29402 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:39.993320 29538 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:39.995581 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:39.984023 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 59703.7us
I20260709 13:10:40.016067 29214 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:40.028005 23695 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:40.038975 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:40.042196 29647 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:40.045176 29485 raft_consensus.cc:3055] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:40.045735 29485 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:10:40.047901 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 43621.1us
I20260709 13:10:40.049134 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:40.050177 29474 raft_consensus.cc:3055] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:40.050570 29474 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:40.052419 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:40.054216 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:40.046836 29485 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.069887 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:40.028815 29495 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13.
I20260709 13:10:40.080914 29670 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:40.075541 29643 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:40.085750 29643 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:40.086268 29643 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:40.063370 29645 consensus_queue.cc:1059] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:10:40.096340 29546 raft_consensus.cc:3055] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:40.096797 29546 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:40.097034 29645 raft_consensus.cc:3055] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:40.097419 29645 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:40.097752 29546 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.098307 29645 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.114739 29669 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.115340 29669 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:40.117640 29669 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:40.075862 29648 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 13:10:40.133965 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 60652us
W20260709 13:10:40.138294 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 63865.4us
I20260709 13:10:40.139827 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:40.142235 29648 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:40.142807 29648 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:40.143924 29590 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:40.144546 29590 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:40.145197 29519 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:40.063815 29538 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:40.145718 29590 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.147176 29538 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.152204 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.154253 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:40.154989 29495 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:40.150183 29648 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.157083 29648 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.151427 29645 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:40.160167 29670 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:40.160655 29670 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:40.161037 29670 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.164570 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.165535 29603 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:40.166389 29603 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.166927 29603 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:40.174474 23772 raft_consensus.cc:1240] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:40.025951 29522 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 13:10:40.168533 29641 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:10:40.051424 29474 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.180141 29485 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.180420 29603 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:40.201750 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:40.193409 23700 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:40.206036 23742 leader_election.cc:400] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13.
I20260709 13:10:40.208302 29592 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.218107 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 238259us
I20260709 13:10:40.221776 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:40.222018 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:40.226017 23592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.042s	sys 0.069s
W20260709 13:10:40.226441 23592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.042s	sys 0.069s
I20260709 13:10:40.228672 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.228488 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:40.230661 29402 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:40.231204 29402 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.231839 29402 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.024613 29576 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:40.200693 29669 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:40.209376 29214 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:40.208963 29592 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:40.239604 23772 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 20: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:40.242328 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.216920 29519 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:10:40.248344 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:40.254354 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:40.234663 29467 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:10:40.236745 29296 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:40.238010 29608 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:10:40.273844 23742 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:10:40.279630 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55207.3us
I20260709 13:10:40.267846 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:40.240127 29214 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:40.253085 29474 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.279567 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.266229 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.282382 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:40.283322 23769 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:40.284157 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.253455 29603 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:40.288754 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:40.290450 23704 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:40.288106 23629 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:40.238998 29538 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:10:40.258010 29642 consensus_queue.cc:1059] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 13:10:40.295243 29642 raft_consensus.cc:3055] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:40.295688 29642 raft_consensus.cc:740] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:40.296152 29287 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:40.296805 29642 consensus_queue.cc:260] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.299330 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.296964 29287 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.300707 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:40.302556 29287 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:40.247992 29495 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:10:40.289813 29467 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.313117 29495 consensus_queue.cc:1243] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:40.313331 29467 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:40.315259 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:40.320451 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.320956 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.321321 23773 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:40.322491 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.323504 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:40.260080 29588 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:40.321141 23774 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:40.251879 29669 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:40.328418 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.349802 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.350196 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.350898 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.351636 23777 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:40.351382 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.352542 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.332113 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:40.353317 23777 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 20: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:40.322048 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.333992 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.285972 29214 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:40.348191 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.355039 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:40.357987 29670 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:40.359891 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.360574 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:40.307961 29663 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:40.361598 23770 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
W20260709 13:10:40.367702 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 94006.2us
I20260709 13:10:40.368570 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.365593 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:40.372645 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:40.373519 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:40.374740 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:40.380745 29592 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:40.381815 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:40.333156 29643 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.385813 29643 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:40.389518 29519 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:40.394541 29670 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:40.399353 23772 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:40.404145 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:40.402567 23592 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.415297 23623 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:40.370823 29663 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:40.345896 29642 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:40.419668 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:40.422338 23770 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:40.324647 29467 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:40.425807 23592 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:40.428297 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:40.430051 24358 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.432628 24358 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:40.434255 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 65787.1us
I20260709 13:10:40.436518 24358 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.437651 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:40.440006 29518 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:40.441110 29518 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:40.441447 29518 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:40.442308 29518 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:40.443864 29641 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:40.443655 29518 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:40.445525 29546 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:40.445969 29485 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:40.447139 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:40.446872 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet d5fa82982f53411c84a07a2fb3918888 with delete_type TABLET_DATA_TOMBSTONED (TS c885217113574e7489e6c3afb6950f76 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:57370
I20260709 13:10:40.420635 29663 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.438257 23697 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 11.
I20260709 13:10:40.432873 29608 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:40.451049 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:40.453063 23623 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:40.427336 29664 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:40.436498 29616 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:40.465206 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.452203 29608 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.470204 29644 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:40.476842 23770 raft_consensus.cc:2468] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
I20260709 13:10:40.477222 23527 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet d5fa82982f53411c84a07a2fb3918888 with cas_config_opid_index 6: aborting the task: latest config opid_index 9; task opid_index 6
I20260709 13:10:40.479308 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.481403 24357 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:40.457264 29621 raft_consensus.cc:2764] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 13:10:40.484305 23527 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 122) took 46394 ms (client timeout 15000 ms). Trace:
I20260709 13:10:40.485471 29485 raft_consensus.cc:2804] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:40.489727 23770 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:40.491151 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.480214 29608 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:40.480582 29669 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:40.498029 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.490314 29664 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:40.486075 23527 rpcz_store.cc:269] 0709 13:09:54.090202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.090382 (+   180us) service_pool.cc:224] Handling call
0709 13:09:54.307199 (+216817us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b5400002210. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e80b2 00007f2b47161a89 00007f2b470f9da6 00007f2b470cb088 00007f2b471c937e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc
0709 13:10:40.484193 (+46176994us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:39.266130 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:39.332199 (+ 66069us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:39.332252 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:10:39.332276 (+    24us) tablet.cc:662] Decoding operations
0709 13:10:39.377504 (+ 45228us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:39.377625 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:39.377656 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:10:39.378313 (+   657us) tablet.cc:701] Row locks acquired
0709 13:10:39.378361 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:10:39.378528 (+   167us) write_op.cc:270] Start()
0709 13:10:39.378676 (+   148us) write_op.cc:276] Timestamp: P: 1783602639378456 usec, L: 0
0709 13:10:39.378716 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:10:39.381954 (+  3238us) log.cc:844] Serialized 2434 byte log entry
0709 13:10:39.635492 (+253538us) op_driver.cc:464] REPLICATION: finished
0709 13:10:39.696823 (+ 61331us) write_op.cc:301] APPLY: starting
0709 13:10:39.716765 (+ 19942us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:39.883907 (+167142us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:39.884050 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:39.998895 (+114845us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:39.999207 (+   312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:10:39.999275 (+    68us) write_op.cc:312] APPLY: finished
0709 13:10:39.999617 (+   342us) log.cc:844] Serialized 65 byte log entry
0709 13:10:39.999836 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:39.999966 (+   130us) write_op.cc:454] Released schema lock
0709 13:10:40.000027 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:40.000501 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:40.000532 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2942436,"reported_tablets":27,"spinlock_wait_cycles":8641408,"child_traces":[["op",{"apply.queue_time_us":32991,"apply.run_cpu_time_us":15759,"apply.run_wall_time_us":331587,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":347851,"prepare.run_cpu_time_us":13284,"prepare.run_wall_time_us":248445,"raft.queue_time_us":79062,"raft.run_cpu_time_us":25622,"raft.run_wall_time_us":33191,"replication_time_us":256592,"thread_start_us":343035,"threads_started":4,"wal-append.queue_time_us":160752}]]}
I20260709 13:10:40.516853 29495 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:40.525136 29649 raft_consensus.cc:3055] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:40.525857 29649 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:40.540115 29603 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:40.540738 29603 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:40.542081 29603 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:40.547573 29576 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.553963 29296 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:40.554687 29296 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.558660 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:40.559463 24394 raft_consensus.cc:2393] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:40.561388 23524 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:40.564327 29296 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:40.576056 29603 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.563390 23524 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.594456 23524 catalog_manager.cc:5697] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 7 to 14, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 14 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:40.492938 29485 raft_consensus.cc:697] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:10:40.600346 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 144090us
W20260709 13:10:40.608364 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 95301.4us
I20260709 13:10:40.597538 23524 catalog_manager.cc:5697] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 7 to 11, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 11 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:40.613132 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:40.614682 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:40.620908 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:40.622748 23702 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:40.621044 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:40.627821 23699 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:40.622042 23524 catalog_manager.cc:5697] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 13 to 17, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 17 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:40.630690 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.495493 29214 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.500134 29670 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 13:10:40.633385 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.499085 29646 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.127s
I20260709 13:10:40.644191 23524 catalog_manager.cc:5697] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 6 to 10, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 10 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.670342 23627 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:40.671444 29686 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:10:40.672061 29528 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:40.672739 29528 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:40.674266 29682 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:10:40.673972 29528 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:40.670817 23524 catalog_manager.cc:5697] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 13 to 14, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 14 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:40.677968 23524 catalog_manager.cc:5697] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 9 to 15, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 15 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.721791 23524 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 16 to 18, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 18 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:40.723203 23524 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 9 to 10, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 10 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.620440 29485 consensus_queue.cc:237] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.735589 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:40.741151 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 120825us
I20260709 13:10:40.745689 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.778120 23524 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 7 to 9, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 9 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:40.788786 29673 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:40.789465 23524 catalog_manager.cc:5697] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.791585 29673 raft_consensus.cc:3055] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:40.791687 23524 catalog_manager.cc:5697] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 11 to 15, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 15 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:40.797169 23524 catalog_manager.cc:5697] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.798902 23524 catalog_manager.cc:5697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 9 to 15, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 15 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.800643 29691 tablet_replica.cc:333] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:10:40.801878 29691 raft_consensus.cc:2243] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.802767 29691 raft_consensus.cc:2272] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.801218 23524 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 5 to 8, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 8 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:10:40.804399 29689 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:10:40.804363 23524 catalog_manager.cc:5697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 8 to 13, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 13 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.806663 23524 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.808210 23524 catalog_manager.cc:5697] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:40.809194 29688 log.cc:927] Time spent T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:10:40.812376 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:40.812714 29646 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:40.813094 23774 raft_consensus.cc:606] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.813431 23774 raft_consensus.cc:614] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:40.813519 29646 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:40.813891 29646 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:40.814743 29646 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:40.752326 29402 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:40.817389 24388 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:40.792089 29673 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:40.740893 29522 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:40.829881 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:40.793269 29685 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:10:40.835614 23774 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:10:40.835002 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 201700us
I20260709 13:10:40.852550 23620 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:40.853061 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.817173 29423 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:40.835505 29406 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:40.792922 29214 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:40.864897 29402 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:40.880456 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:40.837118 29646 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:40.887123 23592 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.870707 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.876547 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:40.878911 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.881676 29522 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:40.879952 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:40.890043 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:40.890461 23699 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:40.889642 23695 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.799530 29663 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:40.905189 24392 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:40.914167 23772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:40.914848 23772 raft_consensus.cc:606] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:40.915290 23772 raft_consensus.cc:614] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:40.878495 29406 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.927963 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.938199 23695 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:40.917409 29214 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.907567 29584 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.889622 29647 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:10:40.927093 29402 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:40.930763 29406 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:40.961246 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:40.966501 23774 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.962643 23778 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:40.930032 29590 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:40.934482 29287 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:40.980370 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 96615.5us
W20260709 13:10:40.988080 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 117523us
I20260709 13:10:40.988646 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:40.955361 29522 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.006982 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:40.964218 29584 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:41.016273 29687 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:10:41.020139 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.021070 23770 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:41.021687 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.021848 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.022440 23770 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:41.022941 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.023272 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.023873 29660 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:41.024063 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:41.024785 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.025171 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.025282 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:41.025888 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.026458 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:41.026881 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.027087 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:41.029534 23777 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 20: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:41.030334 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.032490 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.033208 23770 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:41.024508 29660 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.039242 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:41.027558 29518 consensus_meta.cc:287] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.004s
I20260709 13:10:41.004797 29402 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.047960 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.005900 29287 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.052309 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:41.055126 23774 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:41.059911 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:41.065701 23776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:41.066339 23776 raft_consensus.cc:606] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:40.955008 29673 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.066021 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.065984 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:41.051177 29642 consensus_meta.cc:287] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.622s	user 0.003s	sys 0.005s
I20260709 13:10:41.070107 23774 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:41.074488 29608 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.001s
I20260709 13:10:41.041149 29704 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.074661 23773 raft_consensus.cc:1240] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:10:41.076077 23777 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:41.046448 29691 ts_tablet_manager.cc:1916] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:41.069320 23776 raft_consensus.cc:614] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:41.051406 29214 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:41.042606 29663 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:41.096801 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.043210 29467 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.101428 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.047528 29528 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:10:41.110232 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:41.126690 29707 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:41.165628 23770 raft_consensus.cc:2376] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14. Re-sending same reply.
I20260709 13:10:41.166788 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.167891 23770 raft_consensus.cc:2410] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:10:41.080013 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.111963 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:41.170106 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.171094 23774 raft_consensus.cc:2393] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 20: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:41.066802 29402 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.074271 29287 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:41.120323 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 51517.9us
I20260709 13:10:41.172226 23771 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:41.132208 23775 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:41.120338 29709 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.174846 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.175094 29709 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.177585 29709 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:41.155652 23772 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:41.162750 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:41.163184 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 54134.9us
I20260709 13:10:41.172175 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:41.080353 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.179482 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:41.192072 23623 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:41.201309 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.161612 29708 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:41.135480 29647 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:10:41.208675 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.173051 29648 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.172837 29707 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.155108 29608 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:41.232638 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 74682us
I20260709 13:10:41.160588 29704 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.202266 29663 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:41.204521 29709 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:41.204680 29711 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.236104 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:41.246850 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 67487.7us
I20260709 13:10:41.213004 29670 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:41.249034 23620 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:10:41.228005 29584 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.178774 29467 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.217690 29707 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.235985 29713 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.255931 29690 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:41.235780 29660 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.253593 29711 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.261853 29402 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.264868 29406 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.249800 29712 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:41.249187 29528 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:41.266072 29670 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.286180 23776 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:41.286792 29522 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:41.287668 29670 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:41.269583 29467 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:41.251077 29709 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.291235 29709 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:41.293939 29660 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.294644 29660 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.297288 29214 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:41.297716 29214 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:41.275899 24389 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
W20260709 13:10:41.275306 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 73928.3us
I20260709 13:10:41.212211 29714 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:10:41.234954 29648 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.279500 29287 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.281251 29608 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.248625 29663 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.272017 23769 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:41.301589 23627 raft_consensus.cc:2393] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:41.296846 29660 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.300799 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.309175 29690 raft_consensus.cc:697] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:41.309867 29663 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:41.309176 29709 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:41.310254 29690 consensus_queue.cc:237] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.278924 29713 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.312345 29649 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.314260 29713 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:41.315809 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 104947us
I20260709 13:10:41.316650 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:41.298525 29214 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.318413 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:41.318653 29679 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.331s	user 0.002s	sys 0.000s
I20260709 13:10:41.307138 29287 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:41.332850 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:41.319540 29713 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:41.342344 29711 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:41.346238 24388 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:41.347234 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:41.348045 24385 raft_consensus.cc:2393] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 21: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:41.348572 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:41.348933 29700 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.247s	user 0.002s	sys 0.000s
I20260709 13:10:41.347919 29648 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.351853 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.352555 23623 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:41.351146 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.349123 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:41.354730 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.355538 23625 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:41.356242 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.356972 23623 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:41.332245 29722 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:41.357690 29485 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.357942 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.358415 24391 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:41.349236 29406 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.360239 23629 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:41.359202 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:41.361300 24393 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:41.353783 23628 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:41.363629 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.364405 23622 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:10:41.355786 29214 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.368408 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:41.363656 29296 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:41.372082 29296 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:41.372557 29296 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.368914 29522 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:41.374537 29522 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.365919 29722 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:41.377352 29722 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.378769 29649 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.378829 29522 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:41.337225 29287 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.360468 29485 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.386396 29522 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:41.384649 29584 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.368251 29467 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.401589 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:41.381501 29646 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:41.405150 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.409971 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.401571 29584 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.407164 29713 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:41.404820 29646 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.413183 23667 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.412969 29719 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:41.414734 29698 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.412s	user 0.000s	sys 0.004s
I20260709 13:10:41.414399 29719 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.402787 29712 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 13:10:41.416839 23742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.030s	sys 0.118s
I20260709 13:10:41.416800 29719 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:41.417367 23742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.030s	sys 0.118s
I20260709 13:10:41.417493 29719 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:41.417897 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 919888us
I20260709 13:10:41.418563 29712 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:41.403651 29467 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.421201 29467 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.400792 29522 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.423590 29522 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:41.426940 29707 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.429342 29707 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.444778 29485 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.445314 29646 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.411093 29730 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:41.434168 24393 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:41.437229 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:41.437853 29584 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.440459 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:41.457434 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:41.442819 29296 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.465636 29296 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:41.443687 29467 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:41.466614 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:41.427601 29673 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.467371 24393 raft_consensus.cc:2393] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 12: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:41.457805 24385 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:41.470983 29485 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.471504 29485 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.443399 29669 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:10:41.473695 29485 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.462406 23697 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:41.474417 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.474901 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:41.475482 23697 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.476099 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.476590 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.477196 23771 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:10:41.479028 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.479656 29643 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.480626 29728 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:10:41.480435 29643 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.481029 29474 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.481658 29474 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.482565 29643 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.482862 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.483451 23623 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:41.483798 29474 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.484301 29474 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.450850 24394 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:41.446477 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.486182 23627 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 10.
I20260709 13:10:41.486728 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.487296 23772 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:41.487696 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:41.458079 23704 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:41.488406 24359 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:41.489248 29645 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:41.489616 29645 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.489919 29645 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:41.458793 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45710us
I20260709 13:10:41.493847 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:41.493959 29402 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:41.494529 29402 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.494956 23667 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.461875 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:41.495841 23698 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:41.496690 29402 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:41.496974 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.487303 23628 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:41.497452 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.498801 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.500087 29467 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:41.500815 29467 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:41.501150 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.502110 23667 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.462016 23702 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:41.462424 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:41.462512 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:41.503499 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.504025 23699 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:41.504963 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.505570 23772 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:10:41.457845 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:41.475040 23622 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:41.479650 23629 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:41.507308 29704 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.485270 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:41.462819 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:41.507977 23623 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.508162 23700 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:41.509047 29710 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:41.509419 29710 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:41.509611 23624 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:41.510281 29710 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:41.456579 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:41.475533 23769 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:41.513522 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.502507 29474 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.516340 24359 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:41.517928 23623 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:41.518934 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:41.539112 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.539216 23774 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:41.519398 23697 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:41.519044 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:41.520380 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.540066 23626 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:41.453500 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:41.522964 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:41.528599 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:41.541374 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:41.541772 24389 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:41.541986 23628 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:41.532424 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:41.548518 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:41.549275 23620 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.511605 29710 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.460425 29214 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.093s
I20260709 13:10:41.461133 29287 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:41.554100 29709 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:41.554606 29709 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.554999 29709 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.549664 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.550809 23669 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:41.551143 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:41.557457 23622 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.543603 24391 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:41.561784 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:41.570390 23669 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:41.572417 23667 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:41.541631 29467 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:41.581532 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:41.583178 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:41.584928 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:41.586633 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:41.556118 29648 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:41.587992 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:41.591164 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:41.588490 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:41.556983 29296 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:41.599426 23629 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:41.577381 29214 consensus_queue.cc:1243] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer b1e32a12daf44ebbbd71cc3ce41d7d8e log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:10:41.609067 23667 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.573625 29584 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:41.567211 29592 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:41.615047 23629 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:41.591924 29690 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:41.594446 29730 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.568053 29644 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:10:41.606225 29713 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:41.591202 29648 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.609593 29467 raft_consensus.cc:2764] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:41.632928 29694 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:41.633387 29732 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:41.633833 29645 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.622786 29712 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:41.622567 29690 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:41.640349 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.681413 23626 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 12: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:41.642122 23621 raft_consensus.cc:3055] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:41.646032 29719 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:41.589111 29704 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:10:41.659868 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.614815 29584 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.688424 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.636322 29474 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.693562 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.666587 23623 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:41.638504 29713 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:41.677384 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 223936us
I20260709 13:10:41.700909 24388 raft_consensus.cc:2368] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:10:41.708544 29720 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:41.709794 29694 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:41.710914 29694 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.717795 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:41.718287 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.718492 23777 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.720471 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.693346 29584 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.721246 23775 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 11: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:41.725477 29645 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.726378 23777 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:41.726856 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.728734 23778 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:41.664728 29732 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.731560 29732 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:41.688520 29696 consensus_queue.cc:1059] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:10:41.734993 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:41.737089 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.738093 23775 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:41.740703 23776 raft_consensus.cc:2393] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:41.683610 29690 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.739262 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:41.743494 23771 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:41.747668 29713 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:41.679826 23628 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:41.682089 23621 raft_consensus.cc:740] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:41.684789 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.638929 29296 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:41.685822 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.638600 29670 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:41.753242 29670 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:41.753758 29670 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:41.753079 23621 consensus_queue.cc:260] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.754809 23621 raft_consensus.cc:3060] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:41.689169 23625 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:41.663259 29648 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:41.756623 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.680650 29712 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.759363 29712 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.664023 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:41.760542 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:41.698992 23695 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:41.696246 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:41.701692 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:41.770910 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 69335.5us
I20260709 13:10:41.771149 23622 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:41.771538 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.753029 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:41.770931 23623 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:41.773267 23772 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:41.776213 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:41.785223 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.786226 23769 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
W20260709 13:10:41.788575 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 176868us
I20260709 13:10:41.772897 23627 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:41.790753 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:41.791517 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:41.772346 29519 raft_consensus.cc:2764] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:10:41.789915 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:41.796371 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:41.793823 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:41.797241 23778 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.806740 23593 leader_election.cc:400] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:10:41.807255 23593 leader_election.cc:403] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:41.812958 23621 raft_consensus.cc:1275] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:41.793011 29663 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:41.817210 23772 raft_consensus.cc:3055] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:41.807803 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:41.828588 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:41.829761 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:41.794857 29474 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:41.825394 23772 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:41.832456 23778 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:41.831893 23776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:41.834831 23776 raft_consensus.cc:606] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.835306 23776 raft_consensus.cc:614] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:41.836391 24357 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:41.832158 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 223173us
I20260709 13:10:41.841671 23667 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.816411 29707 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:41.795292 29719 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:41.840031 23772 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:41.826100 29406 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:10:41.824584 29663 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:41.824824 29718 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.855997 23771 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
I20260709 13:10:41.835565 29711 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:41.837917 29474 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:41.886978 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 57322us
I20260709 13:10:41.834879 29592 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:41.833103 29743 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:41.859622 23592 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:41.891083 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:41.874347 24359 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.893174 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:41.847215 29645 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.869778 29663 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.844254 29642 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:41.894282 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:41.880175 23772 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.846007 29707 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.896792 23704 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:41.888211 23620 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:41.902662 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:41.857547 29744 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:41.909931 23696 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:41.891229 29474 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.911185 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:41.904613 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:41.895916 29518 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:41.910076 23592 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:41.897753 29695 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:41.895131 29731 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:41.889984 29592 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:41.920056 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 78460.7us
I20260709 13:10:41.922320 23667 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.906658 29643 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.909296 29694 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:41.928375 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "9ab488f10c434878a749f261e99a8065"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:41.912142 29392 raft_consensus.cc:2764] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:10:41.913757 29707 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:41.897362 29669 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:10:41.936760 23771 raft_consensus.cc:606] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Received request to transfer leadership to TS 9ab488f10c434878a749f261e99a8065
I20260709 13:10:41.949034 23771 raft_consensus.cc:614] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:41.949812 29670 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.897317 29214 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:10:41.915062 29646 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.954499 29646 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.954938 29467 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:41.960783 29709 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:41.963201 29709 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:41.964125 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:41.964571 29670 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:41.964879 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.925805 29726 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.513s	user 0.004s	sys 0.004s
I20260709 13:10:41.970932 23702 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:41.973639 23626 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:41.919515 29719 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:41.928350 29592 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.965380 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:41.924571 29730 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:41.984411 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 193733us
I20260709 13:10:41.936381 29694 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:41.926736 29711 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:41.908677 29485 consensus_queue.cc:1048] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
W20260709 13:10:42.032791 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 241352us
I20260709 13:10:42.059087 23772 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:10:42.059991 23772 pending_rounds.cc:85] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 7
I20260709 13:10:41.959093 29691 ts_tablet_manager.cc:1929] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 13:10:42.020570 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:41.959059 29648 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:41.931305 29714 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:41.926944 29729 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:42.028410 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:41.901822 29645 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:42.025208 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:42.036013 23697 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:42.017207 29719 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:10:42.019203 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 85411us
W20260709 13:10:42.109575 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 81290.7us
I20260709 13:10:42.110894 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:42.020269 29710 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:42.067853 23743 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:42.082504 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:42.082885 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:42.095386 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 185375us
W20260709 13:10:42.102298 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 180103us
I20260709 13:10:42.030092 29518 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.060439 23772 pending_rounds.cc:107] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:10:42.120909 23772 raft_consensus.cc:2889] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:42.054762 29694 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.123011 29732 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.125461 29732 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:42.103703 29698 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:10:42.128118 29712 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.108455 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:42.021626 29616 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:10:42.116001 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:42.131665 29648 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:42.133594 29648 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.120864 29695 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:42.135089 29695 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.101626 29714 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:42.137627 29714 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:42.141682 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 73995.2us
I20260709 13:10:42.142885 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:42.133890 29694 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:42.157335 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 48994.9us
I20260709 13:10:42.079233 29642 raft_consensus.cc:697] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:42.158450 23593 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:42.157310 23592 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:42.158484 29518 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:42.105998 29731 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:10:42.159901 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 195835us
W20260709 13:10:42.181742 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.157086 29746 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:10:42.113628 29710 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.114091 29744 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.167165 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:42.156572 29691 log.cc:1199] T d5fa82982f53411c84a07a2fb3918888 P c885217113574e7489e6c3afb6950f76: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/wals/d5fa82982f53411c84a07a2fb3918888
W20260709 13:10:42.191999 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 81207.9us
I20260709 13:10:42.191239 23623 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:42.191576 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:42.191663 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 76017.1us
I20260709 13:10:42.210042 23667 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:42.211390 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:42.189850 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:42.212843 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:42.201416 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 56874.6us
I20260709 13:10:42.217882 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:42.218818 23776 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:42.165831 29616 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:42.164474 29296 raft_consensus.cc:2764] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:10:42.219672 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:42.216158 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:42.187556 29423 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:42.228420 23778 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:42.160656 29751 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.228174 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:42.222782 23743 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:42.225530 23695 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:42.238569 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:42.240123 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:42.240808 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:42.240748 24394 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:42.243378 23704 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:42.188589 29763 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:42.201959 29710 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.245108 24388 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:42.246173 23695 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:42.246295 23700 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:42.202590 29720 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.252576 23743 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:42.191417 29669 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:10:42.236310 29732 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:10:42.220208 29729 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:42.220463 29467 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.260156 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:42.244524 29763 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:42.268823 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:42.254304 24357 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:42.231880 29616 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:42.275887 29765 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.287642 29712 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:42.277101 29747 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
I20260709 13:10:42.281239 29694 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:42.282421 29645 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:42.266249 29670 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:10:42.284003 29731 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:42.228165 29711 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.296375 29760 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:42.263377 29642 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:42.297360 29518 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:42.300279 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 87761.4us
I20260709 13:10:42.338620 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:42.256314 29720 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:42.315425 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 61197.4us
I20260709 13:10:42.210155 29719 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.347280 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:42.348224 23697 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:42.250909 29749 consensus_queue.cc:1059] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:10:42.267230 29733 raft_consensus.cc:2764] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:10:42.289741 29691 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57370 (request call id 0) took 1977 ms. Trace:
I20260709 13:10:42.342514 29767 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:42.342960 29709 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:42.306447 29616 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.345584 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:42.352007 29707 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:42.353170 29690 consensus_meta.cc:287] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:10:42.348589 29663 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.389084 29718 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 11. Current term is 12.
I20260709 13:10:42.389493 29663 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:42.390321 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:42.390686 29713 consensus_meta.cc:287] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.000s
I20260709 13:10:42.391929 29719 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:42.308485 29584 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.002s
I20260709 13:10:42.395888 29770 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:42.396042 29584 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:42.397589 23704 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:42.368528 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:42.365590 29691 rpcz_store.cc:276] 0709 13:10:40.367319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.446442 (+ 79123us) service_pool.cc:224] Handling call
0709 13:10:40.800142 (+353700us) ts_tablet_manager.cc:1151] Deleting tablet d5fa82982f53411c84a07a2fb3918888
0709 13:10:40.800249 (+   107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:10:41.555705 (+755456us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:41.958928 (+403223us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:42.289647 (+330719us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":277911,"thread_start_us":178241,"threads_started":1}
I20260709 13:10:42.398669 23769 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:42.370545 23697 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:42.413425 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 67924.5us
I20260709 13:10:42.417517 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:42.418196 24388 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:42.339743 23776 raft_consensus.cc:2468] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
W20260709 13:10:42.384066 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 180802us
I20260709 13:10:42.273157 29763 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:42.333706 29474 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:42.387274 29690 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:42.421288 23624 raft_consensus.cc:2393] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:42.414482 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:42.439500 23701 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:42.391264 29713 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:42.446553 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:42.385074 29643 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:42.454368 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:42.462162 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:42.464213 23742 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:42.465425 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:42.474406 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:42.426781 29645 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.478593 23620 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:42.422202 29474 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:42.426326 29741 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:42.488979 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:42.411630 29644 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 13:10:42.452860 29648 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:42.498174 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.460397 29690 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:42.500059 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:42.483505 29743 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:42.486980 29709 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:42.397617 29714 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.528642 24394 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:42.513660 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:42.470793 29423 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:42.505568 29753 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.504499 23695 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:42.483629 29751 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:42.443037 29663 consensus_queue.cc:1059] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:10:42.529392 24385 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:42.531555 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 277702us
I20260709 13:10:42.532532 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:42.467592 29760 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:10:42.547186 24391 raft_consensus.cc:2368] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:10:42.526198 29738 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:42.548141 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 130220us
I20260709 13:10:42.492125 29645 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:42.549716 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:42.553695 23701 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:42.531159 29519 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:42.554742 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:42.512395 29744 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:10:42.510174 29670 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:10:42.550082 29738 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.534714 29732 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:10:42.663764 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 104901us
I20260709 13:10:42.645790 29751 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:42.653334 29738 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.544224 29733 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:42.674126 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 127274us
I20260709 13:10:42.555743 29709 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:42.565500 29519 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.672179 29720 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:42.684307 23593 leader_election.cc:400] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:10:42.695786 23593 leader_election.cc:403] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:10:42.548839 29743 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 13:10:42.664580 29669 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.671545 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet d5fa82982f53411c84a07a2fb3918888 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
W20260709 13:10:42.704241 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 159978us
W20260709 13:10:42.704804 23512 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 262077us
I20260709 13:10:42.705260 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:42.676709 29733 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.671780 29759 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:42.683209 29783 raft_consensus.cc:3055] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:42.697302 29752 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.727236 23699 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:42.728044 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:42.708863 29733 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.714164 29783 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:42.740597 29713 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:42.737072 29673 raft_consensus.cc:3060] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:42.724360 29761 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:42.730765 29752 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:42.783586 29584 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:42.708882 29669 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:42.790305 29645 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:42.706499 29423 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.709551 29776 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:10:42.790971 29794 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:42.791270 29519 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:42.704764 29788 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:10:42.779042 29743 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:10:42.844574 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:42.845573 23702 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:42.792644 29785 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.110s	user 0.000s	sys 0.003s
I20260709 13:10:42.846423 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:42.854431 29669 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:42.795497 29695 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.846434 29743 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:42.795694 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:42.795825 29474 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:42.790380 29789 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.782925 29709 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.744712 29751 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:42.798141 29710 consensus_meta.cc:287] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.542s	user 0.003s	sys 0.006s
W20260709 13:10:42.800467 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 245800us
I20260709 13:10:42.885272 24357 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:42.810086 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:42.886596 23620 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 21.
W20260709 13:10:42.800480 29592 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.770s	user 0.010s	sys 0.001s
I20260709 13:10:42.817422 29761 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:42.847679 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:42.795210 29467 consensus_meta.cc:287] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.000s
I20260709 13:10:42.868602 23700 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:42.855360 29743 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:42.868521 29474 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:42.874143 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:42.875272 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:42.925662 24385 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:42.925989 23696 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 12.
I20260709 13:10:42.878826 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:42.927856 23626 raft_consensus.cc:2410] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:10:42.879379 29752 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:42.922590 29719 consensus_meta.cc:287] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.005s
I20260709 13:10:42.913722 29592 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.933962 29673 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:10:42.934556 29592 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:42.900553 29710 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.935834 29793 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:42.936581 23627 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:42.875131 29783 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:42.849959 29780 log.cc:927] Time spent T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:10:42.888178 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:42.902715 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:42.904145 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:42.943415 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:42.946251 23770 raft_consensus.cc:2368] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:10:42.912122 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:42.848628 29725 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:42.911579 23702 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 21.
W20260709 13:10:42.945179 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 57070.7us
I20260709 13:10:42.848994 29768 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:42.855265 29695 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.919487 29763 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.869362 29794 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:42.856112 29714 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:42.937772 23698 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:42.952509 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:42.964339 23772 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.965858 23703 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:42.927047 29467 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.974334 23626 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:42.941735 29642 raft_consensus.cc:2804] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:42.940919 29669 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:42.989665 23697 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.951839 29793 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:42.963176 29768 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.882120 29789 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:42.969283 29648 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:42.973729 29643 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:43.023945 23772 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:43.002811 23699 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:43.034452 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:43.036506 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 331329us
I20260709 13:10:43.037322 23743 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:43.039269 23697 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:43.032862 29648 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.041600 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.063830 23772 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:43.064253 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:43.065166 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.066219 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:43.067250 29670 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:43.067911 29670 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:43.068074 29788 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:42.994386 29690 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:43.072654 23743 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:42.996057 29711 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:43.000767 29768 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.068789 29788 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:42.974339 29725 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.031927 29669 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.061360 29648 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:43.064239 29519 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:43.083575 29616 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.002s
I20260709 13:10:43.042569 29643 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.106474 29642 raft_consensus.cc:697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:43.098487 29754 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:43.099498 29796 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:43.036914 29474 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.096995 29806 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:43.098356 29801 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.100564 29710 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.089954 29711 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.085520 29690 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.180874 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.183399 29771 raft_consensus.cc:3055] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:43.184132 29771 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:43.185153 29771 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.188180 29771 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:43.191370 29738 consensus_meta.cc:287] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.002s
I20260709 13:10:43.193267 29738 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.205144 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.206173 23697 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:43.106935 29752 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:43.207250 29752 raft_consensus.cc:697] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:10:43.207827 29782 log.cc:927] Time spent T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.415s	user 0.007s	sys 0.000s
I20260709 13:10:43.208245 29752 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.210541 29783 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.220481 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 2422) took 1031 ms. Trace:
I20260709 13:10:43.220954 23627 rpcz_store.cc:276] 0709 13:10:42.189396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.189557 (+   161us) service_pool.cc:224] Handling call
0709 13:10:43.220248 (+1030691us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54002440d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:43.220399 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664054144}
I20260709 13:10:43.123917 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:43.222559 23699 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:43.222232 29738 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.116199 29754 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.224466 29812 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:43.225030 29754 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.136101 29772 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:43.226329 29772 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:43.226016 29768 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.139614 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.140410 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:43.258443 24358 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:43.142891 29649 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:43.143350 29669 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:43.098049 29519 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.144768 29663 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:43.150684 29789 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.098723 29616 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.152540 29763 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.154325 29725 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.158282 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:43.158869 29695 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.162830 29744 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.104660 29793 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.095497 29733 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.167009 29646 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:43.171873 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.172364 29711 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:43.091665 29794 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.174417 29759 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:43.174037 29642 consensus_queue.cc:237] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.176959 29643 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.177114 29777 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:43.304857 29732 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.206655 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.138815 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2532) took 1488 ms. Trace:
I20260709 13:10:43.227174 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:43.227375 29788 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.231076 29707 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.232621 29648 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.183488 23775 raft_consensus.cc:2393] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:43.360592 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.362185 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.241806 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:43.068969 29670 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.251945 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:43.252007 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:43.254488 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:43.364586 29793 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.263954 23696 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:43.264339 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:43.381156 23627 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:43.285322 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.382454 23704 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:43.294878 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:43.296037 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:43.297585 23770 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:43.299338 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:43.300911 23623 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:43.303620 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:43.309507 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 236951us
I20260709 13:10:43.384552 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:43.264309 29663 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:43.177249 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:43.261139 29723 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:10:43.350848 23592 leader_election.cc:400] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
W20260709 13:10:43.389556 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45922.3us
I20260709 13:10:43.351379 23774 rpcz_store.cc:276] 0709 13:10:41.650607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.656575 (+  5968us) service_pool.cc:224] Handling call
0709 13:10:41.656983 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.657229 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:41.772807 (+115578us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.138225 (+1365418us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b18001fdb60. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287
0709 13:10:43.138337 (+   112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.138394 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:43.138538 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.138614 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.138731 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49667,"prepare.queue_time_us":147876,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1738,"raft.queue_time_us":121748,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":6901,"spinlock_wait_cycles":7420672,"thread_start_us":527683,"threads_started":3,"wal-append.queue_time_us":531556,"wal-append.run_cpu_time_us":1185,"wal-append.run_wall_time_us":1001565}
I20260709 13:10:43.341636 29759 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:43.297884 29649 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.367430 23772 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:43.394088 23625 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:43.225028 29812 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.400512 23592 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:43.369318 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:43.227227 29772 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:43.378537 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 126645us
I20260709 13:10:43.406441 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:43.406330 24359 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:43.256043 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:43.378895 24393 raft_consensus.cc:2368] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22.
W20260709 13:10:43.379364 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.407758 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:43.408437 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 374034us
I20260709 13:10:43.307168 29744 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.393232 29802 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:43.416697 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.396124 24385 raft_consensus.cc:2368] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14.
I20260709 13:10:43.401427 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:43.378669 23620 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:43.353202 29777 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.359915 29732 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.379551 29754 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.417117 23743 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:43.395094 29789 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:43.425156 23624 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:43.425241 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.425721 23625 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:43.426201 23774 raft_consensus.cc:2368] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11.
I20260709 13:10:43.422277 23622 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:10:43.428264 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:43.461676 23627 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:43.462699 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:43.429570 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:43.430442 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:43.405418 29794 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.465183 29744 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.465662 29392 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:43.466116 29392 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.399966 29783 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.417259 29741 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:43.433838 23775 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:43.436594 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:43.440562 23667 leader_election.cc:400] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11.
I20260709 13:10:43.441738 29768 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.471036 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.442687 29733 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:43.432523 29813 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:10:43.444700 29648 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.427122 29804 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:43.472990 29783 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.473729 29804 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:43.474045 23772 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:43.474223 29804 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.475047 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.476253 29519 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:43.435928 29751 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:43.479373 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.449203 29812 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.449376 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2555) took 1634 ms. Trace:
I20260709 13:10:43.480672 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:43.481442 23778 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:43.437325 29663 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.430214 29696 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:43.456909 29649 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.421289 29802 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.457923 29690 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:43.427663 29772 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.466882 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:43.568472 23627 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.434327 23625 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:43.469524 23667 leader_election.cc:403] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:43.427943 29646 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.466513 29392 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.476183 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:43.436208 29789 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:43.586748 29789 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:43.590708 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:43.591393 24385 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:43.595849 29711 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:43.550149 29751 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:43.599968 29646 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.433297 29423 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:43.515206 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.438107 29755 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:43.468080 29485 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:10:43.571350 29764 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.005s	sys 0.028s
I20260709 13:10:43.552752 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.563040 29673 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.613540 23778 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
I20260709 13:10:43.613653 29673 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.614635 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:43.574156 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.616631 29673 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:43.617583 29806 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.618263 29744 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:43.618131 29806 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.618816 29744 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.620599 29806 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:43.618139 29733 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:43.438479 29754 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
W20260709 13:10:43.578088 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 140980us
I20260709 13:10:43.584789 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:43.621984 29733 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.600153 29751 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:43.577363 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 111261us
I20260709 13:10:43.475420 29783 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.607759 23774 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:43.481082 23773 rpcz_store.cc:276] 0709 13:10:41.814736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.815554 (+   818us) service_pool.cc:224] Handling call
0709 13:10:41.815902 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:41.878023 (+ 62121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.878056 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:41.898098 (+ 20042us) log.cc:844] Serialized 52 byte log entry
0709 13:10:42.388504 (+490406us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b18003d7f80. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f557 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:10:43.084878 (+696374us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b18003d7f80. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e1ed2a6 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e1ed2a6 00007f2b3e1ed240
0709 13:10:43.214997 (+130119us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b18003d7f80. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1 00007f2b412c7a0f
0709 13:10:43.349072 (+134075us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:43.349139 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.352378 (+  3239us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.449163 (+ 96785us) raft_consensus.cc:1685] finished
0709 13:10:43.449184 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.449319 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54817,"raft.queue_time_us":101971,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6389,"spinlock_wait_cycles":36611840,"thread_start_us":184529,"threads_started":2,"wal-append.queue_time_us":1535550}
I20260709 13:10:43.628755 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:43.629092 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.552685 29696 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:43.609997 23627 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:43.480765 29741 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.621263 29806 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:43.622376 23625 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:43.585446 29616 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.602675 29646 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.624714 23667 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:43.639860 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:43.626931 29764 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.005s	sys 0.029s
I20260709 13:10:43.609345 29423 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.635172 24359 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:43.636626 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:43.637530 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.612582 29663 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.646675 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:43.644657 23772 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:43.648639 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.649173 23772 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:43.649983 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:43.627341 24385 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:43.644589 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:43.651170 23773 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.645720 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:43.634228 29696 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:43.653303 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:43.652679 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:43.658255 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:43.646514 29423 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.631747 29754 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:10:43.626327 29485 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.659411 29467 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:10:43.659584 29823 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:10:43.660530 29777 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.662061 23743 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:43.663709 29815 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:43.641991 29214 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.664240 29732 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:43.675683 23593 leader_election.cc:400] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14.
I20260709 13:10:43.657240 29755 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:43.684115 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:43.666194 29788 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:43.684834 23773 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:43.687130 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2429) took 1236 ms. Trace:
I20260709 13:10:43.668370 29669 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.687760 23593 leader_election.cc:403] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:43.688100 24385 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:43.689144 24388 raft_consensus.cc:2410] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:10:43.694725 29485 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.699641 29519 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14.
I20260709 13:10:43.674999 29759 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.684217 29815 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:43.686646 29789 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.692981 23629 rpcz_store.cc:276] 0709 13:10:42.447905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.448054 (+   149us) service_pool.cc:224] Handling call
0709 13:10:42.448475 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.486720 (+ 38245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.486754 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.487233 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.476037 (+988804us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b1800428500. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1 00007f2b412c7a0f
0709 13:10:43.569028 (+ 92991us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:43.569236 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.569374 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.675456 (+106082us) raft_consensus.cc:1685] finished
0709 13:10:43.675476 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.683974 (+  8498us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37806,"raft.queue_time_us":53117,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":21729,"spinlock_wait_cycles":5587200,"thread_start_us":92675,"threads_started":1,"wal-append.queue_time_us":1097402}
I20260709 13:10:43.687871 29733 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.689550 29806 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:43.690624 29781 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 1.151s	user 0.000s	sys 0.005s
I20260709 13:10:43.703920 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:43.703811 29649 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.716048 29649 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.716552 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:43.718302 29649 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.709996 29815 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.708757 23629 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:43.697059 29755 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:43.701545 29751 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.689463 29214 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.733734 23625 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:43.735503 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.695860 29792 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:43.748059 29792 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:43.750986 23621 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:43.702196 29788 raft_consensus.cc:697] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:43.711795 29806 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.713948 29759 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.757714 29806 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.758008 29759 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:43.758718 29759 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.710443 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:43.722786 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:43.760609 23629 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:43.724313 29741 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:43.761209 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.762005 23769 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 20: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:43.762903 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.727299 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.749191 29742 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.764405 23770 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:43.766315 29811 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:43.766652 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:43.767436 29811 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:43.767701 29786 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:43.768672 29786 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:43.768816 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:43.769157 29786 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:43.769727 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:43.720005 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.690887 29743 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.731076 29832 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.747038 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.758760 29804 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.724509 29474 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:43.777456 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 67097.1us
I20260709 13:10:43.730041 29755 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.773242 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:43.775321 29832 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.782730 29696 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.785373 29741 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:43.785828 23668 leader_election.cc:400] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22.
I20260709 13:10:43.786159 23668 leader_election.cc:403] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:10:43.788030 29832 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.719985 29789 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.788947 29696 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.786729 29467 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:43.791158 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:43.791473 29467 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.792032 29709 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:43.793470 29711 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 10. Current term is 11.
I20260709 13:10:43.793905 29467 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.800681 23593 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:43.779210 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:43.777462 29645 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:43.780431 29792 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.773873 29732 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:10:43.803149 29711 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.777081 29649 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:43.808570 29711 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.809124 29649 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.795315 29713 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.809623 29649 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.810606 29711 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:43.810997 29423 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.813381 29744 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:43.815210 29392 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.817386 29815 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.818176 29392 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:43.819684 29756 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:43.819871 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:43.785847 29741 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.800787 23628 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:43.783892 29214 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:43.770816 23773 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:43.801538 23777 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:43.767846 29811 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:43.802882 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:43.805476 29645 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.779870 23770 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 20. Current term is 21. Ops: [19.11-20.12]
I20260709 13:10:43.834028 24357 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:43.783380 29751 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:10:43.838984 29715 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:43.839885 29644 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:43.840407 29644 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.842049 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:43.842551 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:43.843003 23773 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:43.844485 23773 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:43.854259 23702 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:43.857975 23772 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:43.858774 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:43.859288 23702 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.856294 23769 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:43.860242 23697 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:43.861088 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:43.820708 29714 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:43.905133 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.856509 29792 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:43.915161 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.917037 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:43.925242 23701 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:43.925453 23700 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:43.863668 29732 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:43.919301 23698 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:10:43.926689 23698 pending_rounds.cc:85] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 11
I20260709 13:10:43.926949 23698 pending_rounds.cc:107] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:10:43.927228 23698 raft_consensus.cc:2889] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:43.927668 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:43.843514 29645 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.870047 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:43.836983 29741 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.929369 23629 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:43.935883 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:43.839560 29715 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:43.932870 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.936765 23626 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:43.919373 23696 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:43.937234 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:43.864040 29812 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:43.857712 29711 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:43.907176 29644 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:43.942075 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:43.951419 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:43.946112 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:43.942274 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.946312 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:43.952702 23773 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:43.953042 24390 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.941394 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.950021 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.955886 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.910392 29214 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:10:43.958693 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:43.939244 29485 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.911520 29752 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:10:43.982349 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:43.983096 24357 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:43.983691 23704 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:43.985625 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:43.937047 29732 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:43.947119 29768 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:10:43.911175 29788 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:43.993772 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:43.998438 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:43.985980 29835 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:10:43.995175 23696 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:44.000630 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:43.955473 29711 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.001590 23626 raft_consensus.cc:2368] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13.
I20260709 13:10:43.994092 29392 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.972429 29649 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.010524 23700 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:10:44.013150 29807 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:44.013689 29807 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:44.014086 29807 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.017448 23772 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:43.993515 29812 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.993774 29833 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:44.020104 23769 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:44.021520 23769 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:44.031061 24391 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:10:44.044684 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:44.039211 29812 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:44.040285 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.977319 29485 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.038949 29715 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.051548 29769 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:44.052009 29833 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:44.052907 29392 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.053488 29772 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.947392 29811 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.051537 29711 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.059588 24387 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:44.060482 29649 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.061537 29804 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:44.062383 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.063463 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.030274 29806 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.064213 29714 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:44.065807 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:44.066053 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.066169 29815 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:44.068225 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:44.070425 29423 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:44.071671 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:44.076683 29732 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:44.077643 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:44.080564 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:44.080807 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.079087 29779 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:10:44.201475 23772 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:44.083719 23702 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:44.084056 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:44.085264 24359 leader_election.cc:400] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13.
I20260709 13:10:44.204468 24359 leader_election.cc:403] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:44.092195 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.204957 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:44.205374 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 113326us
I20260709 13:10:44.205751 23700 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:44.206025 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:44.206959 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.207476 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:44.208194 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:44.097136 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:44.209482 23626 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.099540 24390 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:44.112421 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:44.082319 29756 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22.
I20260709 13:10:44.136435 23669 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:44.137951 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.138465 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:44.164711 29392 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:44.165832 29772 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.140765 29833 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.169132 29485 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.169845 24385 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:44.133368 29474 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:10:44.238009 29833 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.107285 29769 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:44.188055 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:44.192677 24386 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.213030 29792 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:44.199086 23697 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:44.211784 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 126677us
I20260709 13:10:44.212253 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:44.212642 23701 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:44.213089 24392 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:44.214463 29801 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:44.217248 29645 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.218055 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:44.219026 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:10:44.275382 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 56447.7us
I20260709 13:10:44.276358 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.219216 29806 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:44.220706 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:44.222076 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:44.224869 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 88548.4us
I20260709 13:10:44.285969 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.296737 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:44.302377 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 163996us
I20260709 13:10:44.303624 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:44.226775 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:44.227540 23626 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:10:44.199047 23775 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:44.241460 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 103620us
I20260709 13:10:44.308601 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.309051 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:44.310479 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.312268 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.273550 29287 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:44.274729 29707 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:44.321856 24394 raft_consensus.cc:2393] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:44.319397 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.305526 29793 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:44.307104 29616 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:44.328575 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2494) took 1045 ms. Trace:
I20260709 13:10:44.329022 23696 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 22.
I20260709 13:10:44.320734 24386 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:44.317508 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:44.345423 23701 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.306012 29751 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:44.306936 29752 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:44.318581 23623 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:44.341253 23769 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:10:44.314306 29714 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:44.363210 29714 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:44.363713 29714 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:44.344247 29616 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.364614 29616 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.346005 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.368450 29645 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.334563 29775 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.369367 29775 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.370440 23624 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:44.371330 29775 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.373790 29759 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:44.344478 23699 rpcz_store.cc:276] 0709 13:10:43.283443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.283586 (+   143us) service_pool.cc:224] Handling call
0709 13:10:43.283970 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.284220 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:43.555755 (+271535us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.638293 (+ 82538us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.084642 (+446349us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b1800176380. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287 00007f2b41327208
0709 13:10:44.328087 (+243445us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.328158 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:44.328223 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.328303 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.328482 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19944,"prepare.queue_time_us":187181,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":54,"raft.queue_time_us":36786,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":12558,"spinlock_wait_cycles":4967680,"thread_start_us":540386,"threads_started":3,"wal-append.queue_time_us":137019}
I20260709 13:10:44.353565 29743 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:44.376194 29789 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:44.306671 29467 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:10:44.326269 29287 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.347421 29649 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13.
I20260709 13:10:44.321301 29812 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:44.381695 23772 raft_consensus.cc:1275] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:44.385695 23701 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:44.396790 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:44.403914 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:44.399549 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.314172 29832 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:10:44.399679 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.406548 23695 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:44.407904 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:44.408787 23624 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.316071 29768 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:10:44.340271 29723 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.411182 23775 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:44.314903 29807 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.415062 29711 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.421646 29711 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.424059 29812 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:44.424281 29802 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:44.424777 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.425062 29812 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.427326 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 2579) took 1254 ms. Trace:
I20260709 13:10:44.427711 23777 rpcz_store.cc:276] 0709 13:10:43.173321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.226890 (+ 53569us) service_pool.cc:224] Handling call
0709 13:10:44.427155 (+1200265us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54003412d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:44.427268 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970116992}
I20260709 13:10:44.428719 29741 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.431090 29741 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:44.394672 29287 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.438186 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:44.438844 24390 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.439302 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.411134 29732 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:10:44.440514 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:44.441706 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.442427 29772 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:44.442690 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.444003 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.342805 29769 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.445448 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.445955 29769 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.447198 24390 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:44.447965 29723 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:44.448355 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:44.449263 29732 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:44.449723 29732 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:44.444031 29711 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.450508 29723 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:44.451992 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.452283 24389 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:44.411432 29756 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.454438 23620 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:44.455790 23743 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.461778 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.458912 23699 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:44.459595 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:44.462211 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.467839 23773 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:44.468845 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.469470 23624 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:10:44.469621 23697 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:10:44.457131 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.472441 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3505) took 1086 ms. Trace:
I20260709 13:10:44.472911 23621 rpcz_store.cc:276] 0709 13:10:43.386465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.416500 (+ 30035us) service_pool.cc:224] Handling call
0709 13:10:43.750761 (+334261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.751527 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.472244 (+720717us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54000db6d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:44.472388 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732250880}
I20260709 13:10:44.460949 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:44.490163 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.497550 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:44.472250 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:44.500638 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:44.456211 29772 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:44.465291 29837 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:44.512027 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 51197.2us
I20260709 13:10:44.497284 29759 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:44.517305 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:44.525727 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:44.505787 29792 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:44.505539 29474 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:44.526964 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.450536 29732 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.473165 29756 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.538817 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.501816 29287 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.518818 29741 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:44.543121 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:44.527957 29711 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:44.541512 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:44.550405 29817 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 1.068s	user 0.004s	sys 0.003s
I20260709 13:10:44.518127 29837 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.560837 23624 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:10:44.544683 29786 consensus_meta.cc:287] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.775s	user 0.013s	sys 0.004s
I20260709 13:10:44.563941 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:44.564810 23773 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:44.543273 29474 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:44.543493 29807 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.542541 29759 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:44.572597 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.557747 29792 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:44.538254 29616 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.581487 23625 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:44.584748 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:44.583856 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 211333us
I20260709 13:10:44.585383 23772 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:44.545300 29714 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:44.588804 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.593632 23625 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:44.595155 23623 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:44.596487 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:44.598589 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:44.585510 29802 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:44.602015 23700 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.603744 23626 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:44.613715 29287 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.597323 29711 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:44.618255 29711 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.587226 29769 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:10:44.620573 29711 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.621115 29711 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:44.595645 29851 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:44.621922 29851 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.622941 29616 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.623983 29851 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.569593 29786 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.607535 29777 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:44.634909 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:44.634140 29848 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:10:44.642138 24388 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:44.612277 29741 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:10:44.643815 23700 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:44.639876 29287 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:44.644486 29853 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:10:44.642453 29772 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:44.656059 24389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46594 (request call id 972) took 1386 ms. Trace:
I20260709 13:10:44.639814 29777 raft_consensus.cc:697] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:44.627087 29474 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.663990 24389 rpcz_store.cc:276] 0709 13:10:43.264997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.265887 (+   890us) service_pool.cc:224] Handling call
0709 13:10:43.729895 (+464008us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b5800010e98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:10:43.940331 (+210436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.452933 (+512602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.650177 (+197244us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54005f28d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:44.651405 (+  1228us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54005f28d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:44.651580 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1728195584}
I20260709 13:10:44.682124 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 1171) took 1286 ms. Trace:
I20260709 13:10:44.682557 23627 rpcz_store.cc:276] 0709 13:10:43.395822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.656492 (+260670us) service_pool.cc:224] Handling call
0709 13:10:43.656925 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.663257 (+  6332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.663291 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.052025 (+388734us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b2c00058238. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:10:44.052460 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.238701 (+186241us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:44.238737 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.238802 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.680933 (+442131us) raft_consensus.cc:1685] finished
0709 13:10:44.680974 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.682048 (+  1074us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5949,"raft.queue_time_us":6382,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"spinlock_wait_cycles":12508032,"thread_start_us":185859,"threads_started":1,"wal-append.queue_time_us":450960}
I20260709 13:10:44.688871 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2586) took 1233 ms. Trace:
I20260709 13:10:44.689334 23770 rpcz_store.cc:276] 0709 13:10:43.455285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.838373 (+383088us) service_pool.cc:224] Handling call
0709 13:10:43.838611 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.073324 (+234713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.073356 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.073397 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:44.073428 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.688637 (+615209us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b540032f354. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:44.688682 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.688811 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539292544}
I20260709 13:10:44.663955 29287 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:44.715961 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 118495us
I20260709 13:10:44.717617 29756 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:44.729600 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 132728us
I20260709 13:10:44.701730 29802 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.733713 23667 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:44.726017 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 128209us
I20260709 13:10:44.703099 29402 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:44.742321 29711 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:44.742399 29793 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:44.744212 24386 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:44.732956 29837 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.752370 29811 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.753733 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.734689 29402 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:44.755613 29786 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.748245 23592 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.734045 29714 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:44.758852 29710 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:44.759245 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.758935 29777 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.759476 29851 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:44.759861 29812 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:44.734436 29756 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:10:44.765888 23592 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.766288 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:44.739656 29707 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:10:44.735864 29802 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.803385 23703 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:44.833464 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:44.833763 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:44.834352 23703 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.831159 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:44.803220 29718 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:44.841555 23702 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:44.757834 29287 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.847714 23667 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:44.838387 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:44.765156 29714 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:44.829262 29772 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:44.805968 29711 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:10:44.762633 29402 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.852178 29756 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:44.844727 29793 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.848989 29865 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:44.838788 29423 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:10:44.810847 29851 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:44.804466 29812 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:44.899319 29772 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.877537 29759 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:10:44.903599 29864 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:44.920107 23592 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.925427 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:44.929319 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:44.908823 29865 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:44.918563 29402 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:44.936975 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.934442 23628 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:10:44.934454 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.934898 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:45.002357 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:45.006341 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46594 (request call id 975) took 1163 ms. Trace:
I20260709 13:10:44.913237 29793 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:44.933244 29777 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:45.010511 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:44.939850 29392 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:44.934904 29718 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:44.920776 29709 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:10:44.921890 29851 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:45.022333 29871 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:45.006973 24391 rpcz_store.cc:276] 0709 13:10:43.778781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.778958 (+   177us) service_pool.cc:224] Handling call
0709 13:10:44.941660 (+1162702us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400612bd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:44.941766 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527610624}
I20260709 13:10:45.023317 29851 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:45.010828 29743 consensus_meta.cc:287] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.001s
I20260709 13:10:45.034706 23776 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
W20260709 13:10:45.037070 23776 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 2571) took 2129 ms (client timeout 1502 ms). Trace:
W20260709 13:10:45.037917 23776 rpcz_store.cc:269] 0709 13:10:42.907080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.907512 (+   432us) service_pool.cc:224] Handling call
0709 13:10:45.036729 (+2129217us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b540014e454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:45.036871 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4780248960}
I20260709 13:10:45.043339 23743 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:45.044617 23772 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:45.045207 23743 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:45.046162 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.050370 29743 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:45.051041 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:45.052080 29792 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:45.053273 29792 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:45.053966 29792 raft_consensus.cc:3055] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:45.054376 29792 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:10:45.055244 29866 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:10:45.056638 24385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46566 (request call id 958) took 1134 ms. Trace:
I20260709 13:10:45.057149 24385 rpcz_store.cc:276] 0709 13:10:43.922090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.922246 (+   156us) service_pool.cc:224] Handling call
0709 13:10:45.056406 (+1134160us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54005f3554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:45.056571 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523019136}
I20260709 13:10:45.017879 29777 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:45.060173 24357 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:45.061352 29777 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.062326 29807 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.017716 29392 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:45.065507 29392 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:45.065349 29755 consensus_queue.cc:1048] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:45.069083 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 806) took 1064 ms. Trace:
I20260709 13:10:45.051338 29743 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:10:45.069459 23696 rpcz_store.cc:276] 0709 13:10:44.005001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.005223 (+   222us) service_pool.cc:224] Handling call
0709 13:10:45.068885 (+1063662us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540008a7d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:45.069000 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448575360}
I20260709 13:10:45.072887 29812 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:45.075700 29865 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.077157 29865 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.080139 29709 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:45.080547 29709 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:45.081321 29709 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.082417 29709 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:45.084462 29870 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.151s	user 0.001s	sys 0.001s
I20260709 13:10:45.085920 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2512) took 1230 ms. Trace:
I20260709 13:10:45.086488 29793 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:45.087205 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:45.087600 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.086387 23698 rpcz_store.cc:276] 0709 13:10:43.855382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.979634 (+124252us) service_pool.cc:224] Handling call
0709 13:10:43.996453 (+ 16819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.003402 (+  6949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.003436 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.003478 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:44.003510 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.085625 (+1082115us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b540042b654. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:45.085667 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.085817 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15545216}
I20260709 13:10:45.054677 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:45.098281 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 43686.6us
I20260709 13:10:45.098335 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:45.099313 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:45.100294 23703 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:45.100947 23695 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:10:45.108871 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:45.113116 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.118616 29519 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.107623 29755 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:10:45.122742 29802 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:45.055469 29792 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.131508 29851 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:45.132710 29851 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:45.133060 29851 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:45.133850 29851 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.135031 29851 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:45.140381 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.140506 23772 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:45.141414 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.142827 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.141515 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.143945 23775 raft_consensus.cc:2376] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18. Re-sending same reply.
I20260709 13:10:45.146173 23776 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:45.146646 23776 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:45.102262 29832 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.112351 29842 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:45.164381 29842 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:45.164819 29842 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:45.159441 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.151845 23776 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.169302 23773 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:45.169414 23776 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.161734 29711 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.135854 29696 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:45.157019 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:45.205014 24358 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.582s (SENT) [suppressed 24 similar messages]
I20260709 13:10:45.219697 23776 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:10:45.221912 23776 pending_rounds.cc:85] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 11
I20260709 13:10:45.223192 23776 pending_rounds.cc:107] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:10:45.224740 23776 raft_consensus.cc:2889] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:45.187934 29723 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:45.275812 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.277159 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.277555 29768 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:45.176640 29711 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.253185 29723 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.316457 23621 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:45.326907 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 281749us
I20260709 13:10:45.329813 29392 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.329913 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:45.336505 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.340739 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.351912 23770 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:10:45.316805 29723 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.351372 23769 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.354358 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.356374 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.358570 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.358868 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.362782 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.363405 23777 raft_consensus.cc:2376] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14. Re-sending same reply.
I20260709 13:10:45.359591 23772 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:45.364799 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.365701 23772 raft_consensus.cc:2368] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13.
I20260709 13:10:45.366946 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.367363 23667 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:45.367529 23770 raft_consensus.cc:2376] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14. Re-sending same reply.
I20260709 13:10:45.367565 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.369680 24387 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:45.366106 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.339627 29392 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:45.369226 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:45.372520 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:45.373806 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 43998us
I20260709 13:10:45.372655 23777 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:10:45.378342 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.383050 29751 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:45.384095 29751 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:45.384450 29751 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:45.385139 23623 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:45.386539 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:45.388157 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:45.388731 23623 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:10:45.388337 29878 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:10:45.385226 29751 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.396504 29214 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:45.380517 29881 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:45.399132 23592 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:45.402056 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:45.403630 29474 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:45.405367 29811 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.004s
I20260709 13:10:45.406065 29772 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:45.408602 29880 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:45.409634 29711 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:45.410130 24386 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:45.411523 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:45.367766 29839 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:45.441017 29839 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:45.441882 29839 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.431574 29812 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:45.372678 29879 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:45.444727 29879 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:45.445161 29879 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:45.422672 29775 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:45.423321 23667 leader_election.cc:400] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13.
I20260709 13:10:45.417104 23769 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:45.427178 29802 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:45.380224 29709 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:45.434545 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.436800 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:45.439709 24391 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:10:45.442305 29214 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:45.426112 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:45.450104 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 245132us
I20260709 13:10:45.455816 23623 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:45.458681 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:10:45.459559 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.462071 29709 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:45.462540 29709 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.463300 29856 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:45.464547 29856 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:45.465503 29856 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.420053 29793 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:45.466845 29793 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.468995 29793 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:45.430532 29881 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.469193 29214 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.470005 29881 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.470595 29839 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:45.472784 23626 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:45.474682 29709 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.475680 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:45.477097 29709 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:45.477325 29802 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:45.482280 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:45.490162 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:45.483325 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 62927.2us
I20260709 13:10:45.483572 29742 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:45.484812 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:45.486395 29775 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.487879 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:45.436712 29882 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.488363 29802 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:45.481098 29759 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:10:45.497437 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.498078 23769 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.499958 29772 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:45.457087 29711 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:45.493158 23668 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:45.501457 23629 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:45.502383 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:45.506197 23769 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:45.511252 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:45.457574 29751 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:45.433612 29755 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
W20260709 13:10:45.489178 29861 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:45.519765 23699 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:45.547106 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:45.522361 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:45.522975 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:45.530367 29879 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.531296 23703 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:45.491982 29645 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.532102 29881 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.533051 29723 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:45.433210 29842 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.488809 29741 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:45.550364 23696 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
W20260709 13:10:45.556810 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 126379us
I20260709 13:10:45.501088 29711 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.566658 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:45.558037 29772 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.585167 23628 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:45.585172 23621 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:10:45.517491 29775 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.576313 29741 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.517835 29742 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:45.596522 29732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.014s	sys 0.000s
I20260709 13:10:45.547094 29718 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:45.564406 29696 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.601649 23699 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 20.
I20260709 13:10:45.517735 29882 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.562868 29645 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.577064 29751 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:10:45.586789 29769 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:10:45.637879 29895 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:10:45.638909 29742 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:45.631832 29743 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.639799 29711 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:45.623855 29732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.015s	sys 0.001s
I20260709 13:10:45.599967 29772 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.649156 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:45.651993 29772 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:45.653141 29772 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:45.654271 29902 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.653877 29772 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.654798 29902 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.639890 29743 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.636307 29769 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.634215 29696 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.668409 29769 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:45.780857 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 210317us
I20260709 13:10:45.781908 29879 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:45.741681 29718 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.786826 29881 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:45.790486 29842 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:45.813371 29897 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:10:45.818841 29907 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:10:45.797619 29741 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:45.825404 29896 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
I20260709 13:10:45.827051 29802 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.828188 29802 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:45.822562 29899 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:10:45.819623 29645 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:45.823112 29772 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:45.844558 29902 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:45.849776 29910 log.cc:927] Time spent T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:10:45.839466 29743 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:45.854792 29913 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:10:45.860415 29792 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.888018 29909 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:45.892102 29909 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.894997 29909 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:45.898797 29889 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.417s	user 0.000s	sys 0.016s
I20260709 13:10:45.903103 29882 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:45.906519 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.888481 29802 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:45.867547 29769 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.919310 29696 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:45.919862 29743 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.954103 23620 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:10:45.920593 29884 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:45.923480 29759 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:45.927675 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 415646us
W20260709 13:10:45.928287 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 405378us
I20260709 13:10:45.968456 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:45.969575 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.969980 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.928972 29864 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:45.930920 29839 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.930967 29742 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.937534 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:45.935904 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:45.940325 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:45.940384 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.980566 23623 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:45.941928 23772 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:45.950007 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 456902us
I20260709 13:10:45.951267 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.952157 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.961104 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:45.984246 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:45.984603 24386 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:45.970808 23773 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:45.967371 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:45.972898 24385 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:45.971869 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:45.992249 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.993556 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:45.982162 23743 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:45.995301 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.979851 29741 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:45.996618 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.997597 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.003052 23772 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:46.004063 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:45.966068 29793 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:46.008388 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.010411 24388 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:10:46.011649 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:46.015435 23773 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 20. Current term is 21.
I20260709 13:10:45.949244 29802 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:45.965711 29909 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:10:45.989638 29864 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:45.970420 29884 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.051664 29709 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:46.056874 29769 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.061048 29879 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.061586 29879 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:45.973551 29759 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.065145 29879 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.027489 29793 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.067549 29793 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:45.968945 29743 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.070250 29743 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.071682 23770 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:45.996416 29742 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.040109 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.075659 23772 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:46.076237 23775 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:46.001804 29772 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:46.043610 29922 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:10:46.046779 29914 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:46.048539 23777 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:10:45.979923 29839 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.083328 23777 pending_rounds.cc:85] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 12
I20260709 13:10:46.083992 23777 pending_rounds.cc:107] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:10:46.084395 23777 raft_consensus.cc:2889] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.079972 23771 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:10:46.082015 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 109399us
I20260709 13:10:46.086990 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:46.087585 24388 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:46.088616 23667 leader_election.cc:400] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 20. Current term is 21.
I20260709 13:10:46.088965 23667 leader_election.cc:403] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:10:46.078469 29772 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.080826 29865 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:46.127112 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:46.129300 24385 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:46.121851 29772 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:46.136364 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 153664us
I20260709 13:10:46.140129 24388 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:10:46.141808 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:10:46.146092 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 174347us
W20260709 13:10:46.149866 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 61352.8us
I20260709 13:10:46.130541 29742 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.155104 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:46.158284 24388 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:10:46.156057 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.156543 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:46.159967 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:46.165776 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:46.166764 24385 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:46.154178 29751 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:46.092790 29914 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.153792 29925 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:46.168071 29742 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.189450 29751 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:46.146750 29864 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.235590 29711 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:46.238721 29851 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.239324 29851 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.241870 29851 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:46.220337 29929 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:46.244158 29929 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.244539 29929 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:46.201267 29927 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:46.217550 29474 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.278887 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.280112 23775 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:10:46.200223 29742 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.283143 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.284039 23773 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:46.254328 29932 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:46.255270 29723 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:46.273520 29899 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.087s	user 0.000s	sys 0.005s
I20260709 13:10:46.281963 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:46.316349 29924 log.cc:927] Time spent T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:10:46.277328 29927 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:46.276507 29792 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.291100 29839 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:46.326669 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 125047us
I20260709 13:10:46.309693 29932 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:46.332374 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:46.332932 29932 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.333951 29932 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:46.275682 29474 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.336069 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:46.337170 29743 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:46.337499 29474 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:46.340317 29709 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:46.342013 29709 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.342922 29709 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:46.344115 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:46.351943 29864 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:46.352167 29879 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:46.349910 29743 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:46.352852 29879 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.353415 29743 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:46.353900 29743 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:46.355793 29879 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:46.356582 29879 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:46.331029 29927 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.345427 29792 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.316847 29751 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.366432 29933 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.367172 29933 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.383845 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.384297 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.384557 23695 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:46.386044 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:46.386631 23698 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.387877 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.389431 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:46.390407 29926 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:10:46.387960 29759 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:46.400194 29914 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.401226 29927 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:46.401764 29742 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.403321 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:46.404040 24388 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:46.405766 23668 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:46.408109 23698 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:46.414985 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:46.382805 29864 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.357167 29879 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.402323 29933 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:46.421521 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:46.388139 29802 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:46.418834 29759 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.431806 29709 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.431876 29759 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.434279 29759 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.434336 29709 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:46.417758 29914 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.447983 29914 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.420428 29941 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:46.450210 29941 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.457866 29941 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.458175 29879 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:46.459419 29929 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.461935 29929 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.430810 29936 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.463042 29936 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.465536 29936 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:46.471314 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 495457us
W20260709 13:10:46.473084 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 537545us
I20260709 13:10:46.474212 29918 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:46.474875 29918 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:46.476485 29904 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.738s	user 0.005s	sys 0.000s
I20260709 13:10:46.477861 29856 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:46.478173 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:46.478283 29392 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.478399 29856 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.437124 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.479502 23699 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:46.479564 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:46.480237 24388 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:46.480520 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.481138 23699 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:46.481945 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.482239 29743 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.468626 29792 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:46.439392 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.441453 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:46.486320 23696 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
W20260709 13:10:46.486729 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45392.5us
I20260709 13:10:46.487609 23696 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:46.487872 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:46.478912 29392 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.488780 23696 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:46.489423 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:46.489876 29392 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:46.444010 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.490341 29802 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:46.490780 29802 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.491148 29802 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:46.492434 29793 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:46.493428 29793 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:46.493957 29793 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:46.494884 29793 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.497516 29916 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:46.498988 29769 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.499577 29769 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.502538 29769 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.503986 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.426187 29864 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.505456 29914 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:46.506379 29802 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.506829 29864 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:46.507709 29925 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 20. Current term is 21.
I20260709 13:10:46.510772 24388 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 23.
I20260709 13:10:46.436075 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:46.512718 23702 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:46.478960 23700 raft_consensus.cc:2368] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 22. Current term is 23.
I20260709 13:10:46.514006 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:46.516888 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.520023 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:46.522509 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.523310 23623 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:46.524053 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:46.525154 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.527138 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.527571 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.527861 23620 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
W20260709 13:10:46.527340 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.522351 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.538763 23703 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:10:46.540251 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.543556 29743 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:46.547950 29842 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:46.552711 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 54916.6us
I20260709 13:10:46.548724 29772 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.556520 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.574895 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.575162 23622 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:10:46.575661 23624 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:46.576181 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:46.576635 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.577169 23625 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:46.575178 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.569623 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:46.582755 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.529695 29864 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:46.594861 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:46.597409 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.583446 23629 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:10:46.555073 29287 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:46.564786 29919 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:46.559496 29920 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:46.607250 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.596098 29743 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:46.577323 23620 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:46.604223 29919 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:46.583424 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.586001 23743 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:46.608556 24388 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:46.619417 29772 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:46.620677 29802 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:46.621306 29881 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:46.621790 29881 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.622136 29881 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:46.623248 29759 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:46.623657 29759 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.623992 29759 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.605280 29287 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.624737 29919 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:46.612332 29920 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.629454 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.630191 23698 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:46.601244 29856 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:46.602195 29864 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:46.608678 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.626013 29919 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.613161 23743 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:46.643671 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.645411 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.632472 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.610462 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.648206 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:46.592373 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.648849 23772 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:46.649186 23623 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:46.650395 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.646250 23771 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:46.651535 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.652582 23623 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:46.609251 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:46.661577 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.662540 23775 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:46.662674 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:46.662786 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.663477 23628 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:46.665136 23769 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:46.666867 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:46.670473 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 61312.2us
I20260709 13:10:46.676620 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:46.682394 29751 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:46.682933 24358 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:46.682310 29908 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:46.685596 29920 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:46.686625 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.687521 23773 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 19: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:46.688479 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.689340 23776 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:46.700554 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.701030 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:46.702508 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.703234 23622 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:46.703397 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.704135 23620 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:46.704764 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.716396 23628 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:10:46.718551 29287 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:46.719772 29864 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.729718 29941 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.732322 29474 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:46.733440 23695 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:46.736548 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 53704us
I20260709 13:10:46.737483 24358 leader_election.cc:400] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 22. Current term is 23.
I20260709 13:10:46.705075 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:46.738091 24358 leader_election.cc:403] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:10:46.738545 23620 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:10:46.750126 23772 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:10:46.753208 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:46.755215 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:46.745429 29842 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:10:46.759812 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 219546us
W20260709 13:10:46.759238 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 237552us
I20260709 13:10:46.749871 29768 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:46.749128 29474 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:46.752702 29769 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.752000 29906 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:46.772042 29714 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:46.788818 29901 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 22. Current term is 23.
I20260709 13:10:46.790690 29901 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:46.773592 29710 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:10:46.759797 29842 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:46.798286 29842 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.796401 29474 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.804124 23620 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 23.
I20260709 13:10:46.799626 29842 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:46.822501 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 227751us
W20260709 13:10:46.826538 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 53605.3us
I20260709 13:10:46.802498 29856 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:46.826884 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:46.830557 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 69182.8us
I20260709 13:10:46.784211 29769 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.788144 29906 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.807919 29214 consensus_queue.cc:1059] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:10:46.824705 29941 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.845335 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:46.844370 29287 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:46.853945 29715 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:10:46.860936 29906 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:46.856141 29714 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:46.861726 29714 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:46.862680 29714 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.863812 29214 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:46.866161 29775 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.868861 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.843688 29908 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:46.831281 29759 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.858812 29287 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.878633 29214 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:46.906147 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 53082.5us
W20260709 13:10:46.900430 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 55214.4us
I20260709 13:10:46.909811 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.883953 29714 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.885867 29287 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:46.883764 29949 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.917739 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:46.919615 24385 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.920140 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:46.921023 23772 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:10:46.921448 23772 pending_rounds.cc:85] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 7
I20260709 13:10:46.921703 23772 pending_rounds.cc:107] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:10:46.921962 23772 raft_consensus.cc:2889] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.893983 29839 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.894234 29793 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:46.926786 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.938884 23772 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
W20260709 13:10:46.928469 29951 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:10:46.928821 29908 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.906708 29919 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:46.946086 29919 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:46.948604 29919 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:46.949627 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:46.950670 29957 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:46.952803 29839 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.954344 29793 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.960199 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.960927 23697 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:46.964295 23774 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2635) took 1019 ms. Trace:
I20260709 13:10:46.975028 29793 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.977725 24387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 873) took 2585 ms. Trace:
I20260709 13:10:46.978459 29884 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:46.985181 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:46.986169 23626 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:46.987248 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.988945 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.989310 29920 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:46.989892 29920 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:46.991578 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.991883 29925 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:46.992439 23700 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:46.993568 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:46.994180 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:46.994959 23703 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 16: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:46.997112 23773 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:46.992448 29925 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:46.935268 29769 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.999152 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:46.999974 23769 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:47.000865 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.001510 23698 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:47.001641 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:47.003134 29759 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:47.004248 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:46.964774 23774 rpcz_store.cc:276] 0709 13:10:45.945178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.945326 (+   148us) service_pool.cc:224] Handling call
0709 13:10:45.945626 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.070005 (+124379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.070052 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.070112 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:46.070161 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.963950 (+893789us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54002c9cd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:46.964006 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.964229 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285525760}
I20260709 13:10:47.014246 29839 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:46.905893 29214 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.014952 29214 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.978183 24387 rpcz_store.cc:276] 0709 13:10:44.391991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.392172 (+   181us) service_pool.cc:224] Handling call
0709 13:10:44.654187 (+262015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.370226 (+716039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.922489 (+552263us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b5400602cd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:46.977472 (+1054983us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400602cd0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:46.977626 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2213347968}
I20260709 13:10:46.918948 29881 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:46.927945 29947 log.cc:927] Time spent T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:10:46.925575 29710 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:10:47.021675 29881 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.022158 29751 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.934816 29949 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:47.022635 29751 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:47.023550 23623 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:47.025295 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.025841 29949 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.026027 23697 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:10:47.027002 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.027657 23699 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:46.991035 29920 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.030337 29920 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:47.031288 23704 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:47.035547 29732 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:47.035868 29423 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:47.036227 29732 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:47.036966 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.038761 29732 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.044201 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:47.044912 29711 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.047199 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:47.048782 23701 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:47.048674 29711 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.050345 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:47.076874 23774 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:47.080437 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:47.080991 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.081764 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:47.082223 29769 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:47.082939 29769 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:47.084726 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:47.093426 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:47.093520 29287 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.096271 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:47.097286 24387 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:47.100257 29925 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:47.102705 29925 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.103245 29925 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.051282 29711 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.052096 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:47.052549 29864 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:47.108392 29864 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.108870 29864 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:47.111990 23699 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.053464 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.112711 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:47.113111 23702 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 20: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
W20260709 13:10:47.047982 29931 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.824s	user 0.005s	sys 0.005s
I20260709 13:10:47.135437 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58448 (request call id 1196) took 1203 ms. Trace:
I20260709 13:10:47.054553 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:47.135893 23621 rpcz_store.cc:276] 0709 13:10:45.932069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.932244 (+   175us) service_pool.cc:224] Handling call
0709 13:10:45.932554 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.932860 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.932889 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.933323 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:10:46.142725 (+209402us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:46.142780 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.142872 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.548225 (+405353us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b48000b0358. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:10:46.958297 (+410072us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:47.135198 (+176901us) raft_consensus.cc:1685] finished
0709 13:10:47.135222 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.135371 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5857,"raft.queue_time_us":2033,"raft.run_cpu_time_us":4155,"raft.run_wall_time_us":598875,"spinlock_wait_cycles":24243200,"thread_start_us":208985,"threads_started":1,"wal-append.queue_time_us":228712}
W20260709 13:10:47.137153 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 82675.7us
I20260709 13:10:47.137889 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:47.138656 23624 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:47.139804 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:47.140183 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:47.054800 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:47.140793 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:47.141732 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 87012.1us
I20260709 13:10:47.142515 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:47.142995 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:47.055941 29423 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.150981 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:47.151897 23773 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.057089 29392 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.169317 23699 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:47.114914 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:47.117168 24385 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:47.054237 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:47.118351 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:47.200047 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 85227.4us
W20260709 13:10:47.200410 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 146250us
I20260709 13:10:47.121934 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:47.123392 23700 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:47.083468 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:47.201440 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:47.132712 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.202368 23697 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:47.174036 29741 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.144459 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:47.108780 29925 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.113029 23701 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:10:47.146175 29857 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:47.182430 29287 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.183282 23773 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
W20260709 13:10:47.183403 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.222357 23668 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:47.186789 23592 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:47.165192 29941 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:47.170753 29732 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:47.150635 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:47.170948 29392 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.208779 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:47.217780 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 78068.1us
I20260709 13:10:47.195072 29884 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.185745 29865 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.164512 29423 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.197871 29710 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:10:47.203089 29905 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:47.224251 29941 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.214816 29769 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:47.219624 29711 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:47.219331 29759 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:10:47.203362 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 119964us
I20260709 13:10:47.203361 29842 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:47.255914 23626 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 19: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:47.244065 23592 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:47.228825 29925 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:47.229030 29881 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:47.229220 29732 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.246024 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:47.229192 29948 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.254369 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:47.249120 29839 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:47.260190 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:47.218750 29741 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:47.224663 29857 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:47.232859 29715 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:10:47.248803 29941 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.251504 29759 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.275933 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:47.248390 29769 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.274979 29839 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:47.294341 24388 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:47.264621 29881 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.241793 29865 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.275805 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:47.248735 29214 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:47.322710 24385 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:47.323907 23620 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:10:47.307572 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 382924us
I20260709 13:10:47.240283 29884 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.255785 29793 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:47.296420 29759 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.268151 29732 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.318208 23625 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:47.274369 29775 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:47.276821 29919 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:47.277001 29925 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:47.337520 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:47.339414 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:47.359058 24387 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.320992 29723 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:47.324753 29881 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:47.313042 29769 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:47.354228 29214 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:47.360359 24357 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:47.349642 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:47.279713 29842 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
W20260709 13:10:47.408416 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48144us
I20260709 13:10:47.358703 29919 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.374774 29723 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:47.277577 29948 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:47.416818 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:47.419819 24389 raft_consensus.cc:2368] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 22. Current term is 23.
I20260709 13:10:47.354669 29793 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.393527 29775 raft_consensus.cc:697] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:47.429728 29948 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:47.430572 29974 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.431221 29974 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:47.415365 29901 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:47.434211 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:47.420986 29839 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:47.434834 29775 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.419926 29751 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.437351 29751 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:47.440587 29974 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:47.440915 23774 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:47.442915 29864 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.445147 23704 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:47.441917 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:47.448045 29865 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:47.454288 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 252915us
I20260709 13:10:47.455137 24391 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:47.416512 29919 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:47.455467 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:47.375787 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 143377us
I20260709 13:10:47.467005 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:47.476612 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:47.501796 29769 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.504629 29864 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.481817 29851 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:47.508090 29851 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.508455 29851 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:47.516335 24387 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:47.480726 29974 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:47.431325 29925 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.479943 29952 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:10:47.527081 29741 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:47.531098 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:47.533149 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 331917us
I20260709 13:10:47.534327 23743 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:47.538560 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 62094us
I20260709 13:10:47.540606 23669 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:10:47.553645 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 85195.2us
I20260709 13:10:47.521723 29884 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:47.551311 29741 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:47.497851 29723 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.573601 23593 leader_election.cc:400] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 22. Current term is 23.
I20260709 13:10:47.537909 29732 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.580775 29723 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:47.582398 29732 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.583537 23593 leader_election.cc:403] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:47.584295 29952 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 22. Current term is 23.
I20260709 13:10:47.585108 29759 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.585765 29952 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:47.569612 29769 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:47.588384 29769 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:47.588907 29769 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:47.589293 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:47.590109 24393 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:47.589789 29769 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.592651 29793 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:47.593302 24393 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:47.600976 29423 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.587448 29759 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:47.575289 23772 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:47.607121 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 343650us
I20260709 13:10:47.573407 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:47.591178 29941 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.567313 29884 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.617198 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:47.618616 23769 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
W20260709 13:10:47.618932 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45650.7us
I20260709 13:10:47.623247 23772 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:47.575786 29842 raft_consensus.cc:2764] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:10:47.613184 29974 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.626192 29881 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.628336 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:47.633124 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:47.637001 23771 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:47.637306 23772 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:10:47.634516 23778 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:47.637912 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 368071us
I20260709 13:10:47.639585 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:47.643010 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:47.627174 29732 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:47.653796 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:47.626683 29974 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.660238 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:47.643771 29711 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:47.660889 23776 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:10:47.629321 29884 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:47.636114 29755 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:10:47.638399 29287 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:10:47.680558 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:47.644140 29975 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:47.657284 29732 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:47.698473 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 164200us
I20260709 13:10:47.694197 29865 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:47.655759 29857 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:47.664076 29842 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:47.692917 29864 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:47.664964 29711 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.703688 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:47.704188 29732 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:47.737143 29711 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:47.747150 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54977.8us
I20260709 13:10:47.749327 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:47.750720 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.751339 23699 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:47.752737 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:47.754096 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:47.754679 23697 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.755340 23704 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:47.756917 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.757783 23700 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:47.700382 29851 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:47.814643 23704 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:47.814524 23700 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:47.826179 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.815811 23702 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:47.815658 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.817039 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.817839 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.831888 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:47.837193 23704 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:47.823521 23697 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:47.759490 29793 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:47.845880 23695 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:10:47.829200 29842 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.852339 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:47.874884 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 171313us
I20260709 13:10:47.888741 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:47.893227 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:47.894132 23626 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:47.889619 23625 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:10:47.845063 29941 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.900759 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:47.901727 23625 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:47.906026 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:47.907068 23620 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:47.911255 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:47.874859 29881 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.913620 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:47.913934 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:47.912606 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:47.912858 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:47.881274 29976 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:47.900223 29392 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.914855 23774 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:10:47.920063 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:47.915977 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:47.916734 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:47.921157 23697 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:47.914726 23771 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:10:47.922036 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:47.922631 23777 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.922849 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:47.911900 23629 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.924216 23774 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:47.918433 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:47.920324 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:47.852165 29793 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:47.874607 29842 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:47.931695 29842 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:47.933038 29989 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:47.919296 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:47.923450 23771 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:47.925434 29941 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:47.927202 29864 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.929420 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:47.913349 29983 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.936810 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.937470 23697 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:47.935065 23742 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:47.911302 29988 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:47.938558 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.920277 29976 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:47.939893 23774 raft_consensus.cc:2393] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:47.939278 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.933544 29989 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.940838 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.923877 29974 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:47.966069 23777 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:47.924832 29769 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.955982 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:47.975948 23742 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:47.984685 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:47.974804 29715 raft_consensus.cc:3055] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:47.989589 29715 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:47.989833 29992 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:47.947677 29988 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:47.947656 23704 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:47.990603 29715 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:47.992367 29988 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
W20260709 13:10:47.993109 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.990324 29992 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:47.993818 29992 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.976722 29989 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.016309 29884 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:47.948231 29976 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:47.936954 29990 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.983386 29769 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.029630 23704 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:48.029817 29715 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:47.980867 29986 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:48.048406 29982 log.cc:927] Time spent T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:10:48.051986 23704 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:48.047667 29851 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:47.945192 29864 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.063248 29864 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.055171 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:48.067992 29857 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:48.068676 29857 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:48.071187 29857 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:47.941720 29983 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.078473 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:48.079316 23620 raft_consensus.cc:2410] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:10:48.072479 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:48.079870 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 160654us
I20260709 13:10:48.080279 23777 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:48.073487 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:48.083082 23667 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:48.053068 29974 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:48.088078 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.079445 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.088809 23620 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:48.085649 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.077913 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:48.090310 23592 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:48.090899 23628 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.090474 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:48.093760 23624 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:48.083206 23777 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:10:48.095281 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:48.047705 29978 log.cc:927] Time spent T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.342s	user 0.007s	sys 0.000s
I20260709 13:10:48.084026 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.096104 23777 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:48.084794 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:48.085036 23623 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:10:48.097111 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:48.076681 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.098156 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:48.098795 23777 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:10:48.099527 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:48.100859 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:48.101727 23777 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:48.109367 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:48.110960 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:48.115358 23628 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
W20260709 13:10:48.060233 29919 consensus_meta.cc:287] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
I20260709 13:10:48.157497 29919 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.159174 24386 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:10:48.160967 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50081us
I20260709 13:10:48.161439 23770 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:48.162324 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:48.118953 23592 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:48.089178 29900 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:48.116854 29948 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 13:10:48.120765 29973 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:48.121508 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.121878 29775 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:48.124131 29991 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:10:48.124423 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:48.133829 29984 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:10:48.141889 29759 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:48.056999 29986 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.152810 29793 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:48.117678 29974 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:48.108939 29992 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:48.156955 29842 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:48.169687 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50815.3us
I20260709 13:10:48.186882 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:48.172595 29214 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:48.187922 29214 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.188501 29214 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:48.188560 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:48.170392 29973 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:48.131083 29989 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:48.177991 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 202106us
I20260709 13:10:48.185266 29986 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:48.176342 29287 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:10:48.143443 29711 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.195808 29842 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:48.196768 29768 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:48.242156 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:48.197544 29973 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:48.197880 29980 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.357s	user 0.002s	sys 0.000s
I20260709 13:10:48.198762 23774 raft_consensus.cc:1240] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:48.198650 29214 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.184738 29975 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:48.172585 29851 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:48.163012 29919 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:48.231240 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44447us
I20260709 13:10:48.252923 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:48.230533 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 135495us
I20260709 13:10:48.230430 29948 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.234592 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:10:48.235567 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47843.3us
I20260709 13:10:48.255923 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:48.177021 29865 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.068s
I20260709 13:10:48.199851 29992 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:48.183745 29918 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:10:48.176961 29723 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.277870 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:48.244509 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:48.246320 23629 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:48.169199 29864 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:48.127602 29732 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.247514 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:48.283031 23703 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:48.251770 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:48.262574 23701 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:48.236910 29976 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.265196 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:48.266512 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:48.267362 29214 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.239578 23697 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:10:48.240489 29842 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:48.244035 23700 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:10:48.277505 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:48.282133 23592 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:48.319094 23699 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:48.253882 29975 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.330781 29975 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.331490 29961 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:48.331972 29961 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.332295 29961 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:48.275367 29948 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:48.240926 29392 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:48.348762 29392 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:48.263566 29990 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:48.275969 29741 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:48.301014 29214 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:48.275177 29793 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:48.271461 29851 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:48.295392 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1412) took 1089 ms. Trace:
I20260709 13:10:48.288977 29723 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.282759 29864 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.310655 23773 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:48.361773 23699 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
W20260709 13:10:48.325454 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 60383.2us
I20260709 13:10:48.363049 23742 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:48.296573 29884 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:48.392277 29723 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.394215 29976 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:48.349198 29392 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:48.395815 29392 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.397133 29392 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:48.371323 29769 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:48.327893 29751 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:48.328840 29989 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:48.238020 29423 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:48.343039 29974 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:48.347007 29711 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.351788 23701 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:48.299116 23696 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:48.293780 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:48.364768 29214 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.424702 29214 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.354743 29741 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:48.355489 23775 rpcz_store.cc:276] 0709 13:10:47.206409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.209534 (+  3125us) service_pool.cc:224] Handling call
0709 13:10:47.209950 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:47.215232 (+  5282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.215281 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:47.215919 (+   638us) log.cc:844] Serialized 26 byte log entry
0709 13:10:47.440102 (+224183us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b1800334000. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1 00007f2b412c7a0f
0709 13:10:47.658017 (+217915us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:47.709540 (+ 51523us) log.cc:844] Serialized 14 byte log entry
0709 13:10:48.294904 (+585364us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b1800334000. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287
0709 13:10:48.295041 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.295137 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:48.295182 (+    45us) raft_consensus.cc:1685] finished
0709 13:10:48.295195 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.295333 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31597,"prepare.queue_time_us":182780,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":144225,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":42727,"spinlock_wait_cycles":8030976,"thread_start_us":367239,"threads_started":3,"wal-append.queue_time_us":531199}
I20260709 13:10:48.372247 29851 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.280422 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:48.404208 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:48.446204 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:48.446647 24393 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:10:48.446959 23697 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 21.
W20260709 13:10:48.447759 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 167378us
I20260709 13:10:48.400426 29864 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:48.453694 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:48.450101 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:48.458192 23778 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:10:48.460894 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 56777.1us
I20260709 13:10:48.462185 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:48.411304 29949 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:48.468106 29884 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:48.445137 29974 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:48.425340 29751 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:48.450522 29741 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.478549 29214 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.413937 29976 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:48.469628 29793 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:48.486943 29986 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.455363 29732 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.470093 29769 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.481729 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:48.494329 29948 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.495188 29793 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:48.497695 29751 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.496820 29769 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.501845 29769 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:48.475380 29949 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:48.495092 29976 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:48.504946 29949 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:48.499609 29793 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.504773 29976 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:48.509873 29715 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:48.509539 29842 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.509452 29973 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.510305 29715 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:48.512271 29842 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.526623 29986 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:48.495899 29961 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.529646 29973 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:48.560774 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 241869us
W20260709 13:10:48.358970 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 106128us
I20260709 13:10:48.567942 23628 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:10:48.568783 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.570389 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:48.431607 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 137909us
I20260709 13:10:48.609843 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:48.612826 29973 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:48.613312 29973 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:48.613871 29973 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.588408 29839 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:48.511137 29715 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.604225 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:48.604808 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 142582us
I20260709 13:10:48.606037 29751 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:48.620581 29751 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:48.621114 29751 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:48.623261 29857 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:48.628525 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.629556 23626 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:10:48.630754 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.632264 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:48.633540 23629 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 20: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:48.634402 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:48.636194 29793 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:48.641278 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:48.642448 29986 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:48.643388 29986 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.646775 29986 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:48.649875 29983 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:48.650059 29865 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.650869 29983 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:48.651021 29865 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.654125 29865 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.657519 29839 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:48.658133 29839 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:48.660226 23627 raft_consensus.cc:2410] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:10:48.664664 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:48.666594 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:48.670790 23771 raft_consensus.cc:2368] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:10:48.677754 29864 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:48.619621 29715 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:48.693734 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 73316us
I20260709 13:10:48.706732 29864 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:48.707502 23524 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 124) took 14400 ms (client timeout 15000 ms). Trace:
I20260709 13:10:48.699972 29986 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.685845 29214 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:48.712666 29786 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:48.713840 29986 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.697414 23702 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:48.708699 23527 catalog_manager.cc:5697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 14 to 15, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 15 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:48.716938 29741 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:48.717376 23527 catalog_manager.cc:5697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 17, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 17 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:48.704377 29954 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:10:48.703395 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 255058us
W20260709 13:10:48.715878 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 74446.5us
W20260709 13:10:48.740495 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.735575 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:48.725097 29881 consensus_queue.cc:1059] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:48.719619 29741 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:10:48.747514 29986 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:48.771130 29287 raft_consensus.cc:3055] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:48.772765 29287 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:48.775009 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:48.771189 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.776041 29741 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:48.776299 23629 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:48.774538 29287 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.778409 29287 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:48.742726 23527 catalog_manager.cc:5697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 10 to 13, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 13 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:48.779486 29901 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.780370 29901 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:48.781710 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:48.781091 23527 catalog_manager.cc:5697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 13, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 13 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:48.782572 23775 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:48.783053 29901 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:48.724211 29214 consensus_queue.cc:1059] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:10:48.784507 29214 raft_consensus.cc:3055] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:48.784580 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:48.784832 24359 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:48.785586 23771 raft_consensus.cc:2368] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20.
I20260709 13:10:48.785497 29992 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:48.785985 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:48.786343 29992 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.787067 29948 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:48.787506 29948 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:48.787919 29948 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:48.788771 29865 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.789533 29865 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.788767 29732 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.791875 29992 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:48.792444 29732 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.795254 29732 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:48.772986 30010 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
W20260709 13:10:48.772079 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 131237us
I20260709 13:10:48.760030 29954 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.784965 29214 raft_consensus.cc:740] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:48.795528 23667 leader_election.cc:400] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:10:48.786885 23770 raft_consensus.cc:2368] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18.
I20260709 13:10:48.800412 23775 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:10:48.748255 23742 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:48.801978 23667 leader_election.cc:403] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:10:48.782980 23527 catalog_manager.cc:5697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:48.718340 29961 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.796110 29865 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:48.803314 29954 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:48.824369 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:48.710829 23524 rpcz_store.cc:269] 0709 13:10:34.307298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.307500 (+   202us) service_pool.cc:224] Handling call
0709 13:10:48.707209 (+14399709us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:41.051671 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:41.154790 (+103119us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:41.160348 (+  5558us) write_op.cc:435] Acquired schema lock
0709 13:10:41.162244 (+  1896us) tablet.cc:662] Decoding operations
0709 13:10:41.288275 (+126031us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:41.288329 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:41.288360 (+    31us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:10:41.289750 (+  1390us) tablet.cc:701] Row locks acquired
0709 13:10:41.289776 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:10:41.290108 (+   332us) write_op.cc:270] Start()
0709 13:10:41.290241 (+   133us) write_op.cc:276] Timestamp: P: 1783602641290044 usec, L: 0
0709 13:10:41.290259 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:10:41.291028 (+   769us) log.cc:844] Serialized 7436 byte log entry
0709 13:10:41.826541 (+535513us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:42.361402 (+534861us) op_driver.cc:464] REPLICATION: finished
0709 13:10:43.434391 (+1072989us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b3e2020ac 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b44d42ef0
0709 13:10:43.601613 (+167222us) write_op.cc:301] APPLY: starting
0709 13:10:43.601707 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:43.940237 (+338530us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:43.945430 (+  5193us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:44.057750 (+112320us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b1800433840. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b44d42ef0 00007f2b44d43489 00007f2b44d4571a
0709 13:10:45.102652 (+1044902us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:45.122238 (+ 19586us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:10:45.122314 (+    76us) write_op.cc:312] APPLY: finished
0709 13:10:45.122891 (+   577us) log.cc:844] Serialized 172 byte log entry
0709 13:10:45.351001 (+228110us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:45.361850 (+ 10849us) write_op.cc:454] Released schema lock
0709 13:10:45.372935 (+ 11085us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:45.447604 (+ 74669us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b1800433840. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:10:45.448504 (+   900us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:45.453377 (+  4873us) write_op.cc:454] Released schema lock
0709 13:10:45.898163 (+444786us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
Metrics: {"mutex_wait_us":13910,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":1220651,"apply.run_cpu_time_us":53520,"apply.run_wall_time_us":1829279,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83661,"num_ops":19,"prepare.queue_time_us":141972,"prepare.run_cpu_time_us":26184,"prepare.run_wall_time_us":345485,"raft.queue_time_us":239904,"raft.run_cpu_time_us":37905,"raft.run_wall_time_us":1787536,"replication_time_us":1024580,"spinlock_wait_cycles":97508864,"thread_start_us":1786790,"threads_started":5,"wal-append.queue_time_us":426483,"wal-append.run_cpu_time_us":59236,"wal-append.run_wall_time_us":3266216}]]}
I20260709 13:10:48.810896 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.834251 29786 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:48.835330 29786 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:48.835791 29786 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:48.839347 29786 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:48.843370 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48108.5us
I20260709 13:10:48.850167 29214 consensus_queue.cc:260] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:48.850946 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:48.852166 29214 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:48.850157 29786 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:48.886464 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.883069 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55229.7us
I20260709 13:10:48.861426 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.826951 29983 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:48.895082 24393 raft_consensus.cc:2410] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 13:10:48.874938 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 223243us
I20260709 13:10:48.855229 23628 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 23.
I20260709 13:10:48.872113 24387 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:48.861271 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:48.866703 29905 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:48.862859 29963 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:48.905222 29905 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:48.855964 29865 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:10:48.856335 29732 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.060s
I20260709 13:10:48.926939 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:48.930248 23770 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:48.925722 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:48.920928 29963 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:48.924642 29881 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.940842 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.929332 29961 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:48.951345 23667 leader_election.cc:400] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20.
I20260709 13:10:48.951989 23667 leader_election.cc:403] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:10:48.956118 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:48.942943 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:48.921298 29741 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:10:48.961242 23527 catalog_manager.cc:5697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 13, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 13 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:48.966140 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:48.927173 29973 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.970361 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:48.958372 29881 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:48.959414 29786 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:48.980608 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 119464us
W20260709 13:10:48.986879 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45484.2us
I20260709 13:10:48.993536 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:48.993408 23770 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:48.997619 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:48.983825 29857 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.004140 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 102875us
I20260709 13:10:48.976369 29864 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:49.011423 29732 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:49.011425 29842 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:49.018092 29755 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:49.018769 29755 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:49.019299 29755 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:49.005421 29983 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:49.005108 29786 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.024067 29842 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20.
I20260709 13:10:49.025318 29963 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.026854 29786 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.025115 23667 leader_election.cc:400] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18.
I20260709 13:10:49.027599 23667 leader_election.cc:403] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:49.028784 29851 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18.
I20260709 13:10:49.032410 29857 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:49.035125 29857 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:48.992295 29741 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:10:49.046502 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.036928 23527 catalog_manager.cc:5697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 7 to 17, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 17 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:49.060520 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.062196 23527 catalog_manager.cc:5697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 17 to 18, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 18 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:49.063090 29954 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:49.066920 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 141351us
I20260709 13:10:49.068209 23667 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:49.070639 29954 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.082430 23622 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:49.083810 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.086840 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:49.078794 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.088032 29865 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:49.088414 29865 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:49.088604 29864 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:49.089480 29865 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.089906 29864 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:49.091274 29865 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:49.092373 29842 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:49.092803 29842 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.093158 23626 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:49.093793 23770 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:49.093169 29842 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:49.099972 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 89426.5us
I20260709 13:10:49.102126 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:49.102988 29851 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:49.104543 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:49.105716 29851 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:49.071476 29905 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.117020 23628 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
I20260709 13:10:49.122829 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:49.101073 29881 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.131774 23773 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:49.137683 30013 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:10:49.137239 29842 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.141672 29954 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.142167 29986 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.142346 29954 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.142779 29986 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.143195 29983 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.143826 29983 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.145130 29986 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.145668 29986 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:49.145994 29983 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.147161 29954 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.161906 23527 catalog_manager.cc:5697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.168289 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:49.167711 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.171972 29989 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.119956 29732 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:49.141307 29842 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.172964 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:49.180295 23628 raft_consensus.cc:2410] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:10:49.181746 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.184866 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:10:49.188505 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45689.1us
W20260709 13:10:49.189980 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 65853.7us
I20260709 13:10:49.177423 29983 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:10:49.196478 29732 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.197975 29976 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:10:49.185154 30018 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:10:49.183439 29989 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.203852 29989 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:49.204948 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 47212.3us
I20260709 13:10:49.192298 29755 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.205977 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:49.190682 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:49.209843 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:49.210386 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:49.211117 23704 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:49.213783 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:49.213932 29989 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:49.214515 29989 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.214937 29989 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:49.216120 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:49.217047 23702 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:49.218242 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:49.220506 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:49.221800 30027 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:49.223482 30020 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 13:10:49.225814 29751 consensus_meta.cc:287] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.009s
I20260709 13:10:49.227392 23771 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:49.226297 29751 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.228300 23777 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:49.230187 29751 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.233564 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:49.243574 23775 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:49.241071 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:49.244274 23627 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:49.241709 29857 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:49.245776 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.167092 29973 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.247833 23704 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 22.
I20260709 13:10:49.247901 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:49.188078 29839 consensus_meta.cc:287] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.529s	user 0.001s	sys 0.012s
I20260709 13:10:49.255020 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:49.256479 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.258185 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:49.234812 29755 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.260769 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:49.261654 23620 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:49.257064 29842 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:10:49.264329 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:49.274104 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.284471 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:49.284557 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:49.299800 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:49.305238 23527 catalog_manager.cc:5697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 14 to 17, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 17 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.307991 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:49.308696 29905 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:49.309765 29905 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:49.310372 29905 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:49.312773 24386 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 23. Current term is 24. Ops: []
I20260709 13:10:49.319025 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.258847 29839 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.321381 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.279078 29954 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:49.325170 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.325750 23701 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:49.326493 29839 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:49.323005 23527 catalog_manager.cc:5697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 11 to 12, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 12 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:49.327533 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:49.297755 29973 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:49.341857 30032 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:10:49.342967 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:49.333196 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:49.267160 29961 consensus_queue.cc:1059] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:10:49.358318 23773 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 20: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:49.276216 29948 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.357154 23527 catalog_manager.cc:5697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.372043 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.341192 30026 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:49.377835 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:49.341696 30029 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:49.383226 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 192642us
I20260709 13:10:49.387900 23629 raft_consensus.cc:2368] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18.
I20260709 13:10:49.392582 24393 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:49.311514 29905 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.397148 29214 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:49.398869 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:49.399609 23775 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:49.399897 23629 raft_consensus.cc:2368] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:10:49.379693 29973 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:49.404184 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.404639 23627 raft_consensus.cc:2468] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 24.
I20260709 13:10:49.382172 30026 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.410848 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:49.420912 30025 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.293s	user 0.000s	sys 0.002s
I20260709 13:10:49.424240 23527 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 18 to 19, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 19 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:49.428067 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:10:49.444598 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.409509 29839 consensus_queue.cc:1059] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 13:10:49.404258 30029 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:49.415781 29842 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.430794 29786 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:49.433991 29973 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:49.427037 23527 catalog_manager.cc:5697] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 16, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 16 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:49.450706 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:49.457134 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 124062us
I20260709 13:10:49.457826 23627 raft_consensus.cc:2368] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20.
I20260709 13:10:49.418694 24359 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:49.383013 29989 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.466437 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.466693 23626 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:10:49.454522 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:49.459455 29865 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.409996 30028 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.463768 23623 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:10:49.469336 23623 pending_rounds.cc:85] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 10
I20260709 13:10:49.414028 30026 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:49.464577 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.467052 23626 pending_rounds.cc:85] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 10
I20260709 13:10:49.464813 30029 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:49.467903 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49311.2us
I20260709 13:10:49.472012 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:49.477977 23629 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:49.484138 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.484808 23627 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
W20260709 13:10:49.485800 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 77364.1us
I20260709 13:10:49.469663 23623 pending_rounds.cc:107] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:10:49.487114 23623 raft_consensus.cc:2889] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:49.487437 30039 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.488080 29715 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.488047 30039 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.488674 29715 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.490556 30039 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.491508 30039 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.493458 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:49.493853 23624 raft_consensus.cc:1240] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:10:49.498092 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:49.498935 23628 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:49.472909 23626 pending_rounds.cc:107] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:10:49.502821 23626 raft_consensus.cc:2889] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:49.476522 29901 raft_consensus.cc:2804] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:49.520023 23629 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:49.484884 29983 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:49.503846 29842 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.519246 29865 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.530055 29842 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.531847 29865 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.506083 23527 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.492254 30039 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.534045 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:49.548357 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 139692us
I20260709 13:10:49.537247 29901 raft_consensus.cc:697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:49.537828 29974 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.554102 23527 catalog_manager.cc:5697] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 6 to 13, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 13 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:49.540542 29961 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:10:49.517409 30028 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.546608 29983 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:49.559859 29948 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.570580 23527 catalog_manager.cc:5697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 9 to 15, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 15 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:49.578414 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44738.7us
W20260709 13:10:49.586149 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 65793.2us
I20260709 13:10:49.588881 29983 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.602605 23628 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:49.603489 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:49.612131 29865 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.612890 29865 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.617301 29786 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.618057 29786 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.620786 23527 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 19, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 19 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:49.622500 23527 catalog_manager.cc:5697] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 4 to 15, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 15 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.624303 30042 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:49.633929 29851 raft_consensus.cc:3055] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:10:49.634438 29851 raft_consensus.cc:740] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:10:49.636029 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.637949 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:49.638392 29715 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:49.638911 29992 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.639635 30028 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.639519 29992 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.642378 29992 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.642944 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.599794 29901 consensus_queue.cc:237] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.644289 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.645083 29857 raft_consensus.cc:3055] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:49.645507 29857 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:49.645637 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.646909 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.596282 29989 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.635362 29851 consensus_queue.cc:260] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.664812 29851 raft_consensus.cc:3060] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:49.665189 30034 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.258s	user 0.003s	sys 0.000s
I20260709 13:10:49.670768 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.671808 23771 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:49.635589 23527 catalog_manager.cc:5697] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 14, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 14 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.673250 23527 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 15, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 15 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:49.651439 23624 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
I20260709 13:10:49.646536 29857 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.655678 23773 raft_consensus.cc:2393] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:49.655813 30042 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.657094 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.660274 30039 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.573223 29974 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:49.662279 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 50994us
I20260709 13:10:49.643647 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:49.674261 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.678107 29741 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:49.679030 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:49.724797 23776 raft_consensus.cc:2410] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:10:49.680049 30026 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.680634 29989 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.681542 29755 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:49.679069 29768 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:49.682760 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.736423 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.683130 29786 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.736691 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:49.687443 29865 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:49.736809 24386 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:49.750989 29974 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.747852 29989 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.738654 30042 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:49.803996 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 67514.4us
I20260709 13:10:49.805444 30042 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:49.717576 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:49.730274 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 86719.3us
I20260709 13:10:49.727593 23527 catalog_manager.cc:5697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.739513 30027 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.808825 30027 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.809407 23527 catalog_manager.cc:5697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 7 to 12, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 12 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.738519 29973 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:49.748124 29768 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.814661 29768 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.757442 29839 raft_consensus.cc:3055] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:49.825349 29839 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:49.826965 29839 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.739360 29857 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.756798 23742 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:49.844794 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 88145.3us
I20260709 13:10:49.845933 23742 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:49.758826 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:49.709801 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 167600us
W20260709 13:10:49.783197 30047 log.cc:927] Time spent T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:10:49.818820 23667 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:49.757014 29992 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:10:49.822486 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:49.851408 30042 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:49.805701 29976 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:49.852202 30042 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:49.852339 29751 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:49.852509 29976 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:49.852721 30042 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:49.852505 29992 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:49.853633 29976 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.853765 30042 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.738503 30040 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.855352 30040 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:49.858459 30040 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.828696 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.829454 29865 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.862160 29865 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.830183 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:49.864044 24386 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:49.864095 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.865826 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.788549 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:49.868492 24393 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.836509 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.850797 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:49.851081 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 92355us
I20260709 13:10:49.851225 24392 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:49.855688 29214 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:49.787508 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:49.694800 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 95619.5us
I20260709 13:10:49.859297 29989 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.869225 23625 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:10:49.868294 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.748631 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:49.732091 29755 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:49.874521 23770 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:49.875808 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.876741 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:49.753738 30026 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:49.877584 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:49.874469 23668 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:49.881014 23669 leader_election.cc:400] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18.
W20260709 13:10:49.883049 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.893185 29715 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:49.893718 29715 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:49.894659 29715 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.880201 29974 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.902643 29954 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:49.899343 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:49.937225 29842 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.940217 29842 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.942390 29842 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.943931 29839 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.914837 29715 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:49.954480 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 59921.9us
I20260709 13:10:49.955790 23669 leader_election.cc:400] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
W20260709 13:10:49.958279 30058 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:10:49.959013 30041 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:49.959889 30041 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:49.961992 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 116193us
I20260709 13:10:49.965277 30028 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.965696 24387 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:49.932869 29954 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:49.970486 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:49.969571 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:49.975898 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.949455 29948 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:49.983278 29214 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.983898 29214 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:49.987066 24393 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:49.966853 29864 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:49.966224 29865 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.997519 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:49.966289 29786 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:49.977012 29954 raft_consensus.cc:3060] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:49.970386 30041 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:49.949079 29974 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:50.010221 24393 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:10:50.011147 23769 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:49.997932 29741 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:50.020219 29214 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:49.976375 29986 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:50.003304 29864 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:50.028316 29864 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:49.981073 30028 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:50.035627 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 77872.3us
I20260709 13:10:50.037912 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.042484 23669 leader_election.cc:400] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20.
W20260709 13:10:50.044080 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.046599 30028 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.047256 29992 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:10:49.996841 29755 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.013388 29786 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.058434 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:50.060896 23669 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:50.062292 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:50.081230 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:50.086535 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:50.051389 29992 consensus_queue.cc:1243] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer b1e32a12daf44ebbbd71cc3ce41d7d8e log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:10:50.082444 29842 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.092235 30039 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:10:50.089294 29851 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.095381 29974 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.083994 29741 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:10:50.096313 29865 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:10:50.117180 29786 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.089773 30028 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:50.112326 29842 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:50.113371 30027 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.093048 24392 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 11.
I20260709 13:10:50.117204 23620 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:50.123198 29864 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.124526 29954 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.126313 23624 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:10:50.127089 29954 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.123548 29755 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:50.128260 29976 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:50.129254 29976 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:50.129611 29976 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:50.130625 29976 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:50.131620 23624 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:50.135105 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:50.136883 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:50.149128 29842 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:50.149653 29842 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:50.150028 29842 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:50.153203 29751 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:50.153644 29751 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:50.154554 29751 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.155994 30061 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:10:50.137660 29976 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:50.136091 29864 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:50.168092 29751 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:50.175410 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 88966.8us
W20260709 13:10:50.176167 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 86100.9us
I20260709 13:10:50.178982 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:50.181282 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.183493 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.183853 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.184366 23629 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:50.185242 29214 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.172685 29715 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.189373 23620 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:10:50.191700 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.195425 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.200085 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.201805 23769 raft_consensus.cc:2410] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:10:50.201576 29214 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:50.211812 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:50.212935 23777 raft_consensus.cc:2393] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:50.216450 29715 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:50.218698 29715 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.219604 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.222558 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:50.225276 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.228205 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.230464 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.232731 29287 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:50.236899 23621 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:50.239382 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.242611 29755 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:10:50.247299 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.248200 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.246810 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.249296 23626 raft_consensus.cc:2393] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 19: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:50.256219 29214 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.264520 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:50.266681 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.268667 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.271849 29857 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:50.273473 30054 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:50.274029 30054 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:50.267594 23770 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:50.279264 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.288178 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.288713 30027 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.289235 30027 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.291283 30027 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:50.293867 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.283342 29973 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.296703 29973 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:50.298923 29973 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.299362 23627 raft_consensus.cc:2468] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:10:50.300836 24359 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:50.286877 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.180410 29842 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.302914 23777 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:50.304425 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:50.301956 30069 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:50.307821 29949 raft_consensus.cc:2804] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:50.282254 30054 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.319146 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.323092 30069 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.329427 30069 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:50.330260 23770 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:10:50.330997 29949 raft_consensus.cc:697] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:50.331426 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:50.332172 24392 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:50.332094 29949 consensus_queue.cc:237] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.333570 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:50.336016 29751 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:50.336306 23775 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:10:50.336454 29751 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:50.336745 23775 pending_rounds.cc:85] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 15
I20260709 13:10:50.337039 23775 pending_rounds.cc:107] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:10:50.336938 29751 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:50.337459 23775 raft_consensus.cc:2889] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:50.338587 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.321353 29715 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:50.340230 29715 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.340631 29715 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.345379 30054 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.355808 30070 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:50.359426 24357 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:50.367632 30070 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.368248 29954 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:50.368712 29954 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.369062 29954 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.357527 30041 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.370112 30070 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:50.369968 30041 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:50.371172 23704 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:50.366510 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:50.371670 23701 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:50.375970 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.376650 23702 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:10:50.401384 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:50.402982 30041 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.405643 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:50.419193 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:50.418743 23774 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:50.406404 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.423274 23592 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:50.425546 23701 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:10:50.417798 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.433072 23776 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:50.433425 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.438571 29842 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:50.438984 30059 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:50.439286 23629 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:50.434131 23697 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:10:50.439528 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:50.447086 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.448060 23774 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:10:50.466521 29989 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:50.469556 30071 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:50.439525 30059 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.473470 30059 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.473728 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.474933 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:50.478673 29751 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.495605 23774 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:50.490541 23667 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:50.483338 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.450860 30070 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:10:50.484093 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.475626 23702 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:50.495144 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.480139 30054 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:50.503953 23704 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:10:50.506217 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.507934 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.509057 23620 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:10:50.521881 23700 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:10:50.520395 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:50.526916 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:50.522549 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:50.528882 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.530047 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.530722 23698 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:50.533694 30054 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:50.536044 30071 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:50.537492 29751 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:50.536067 30054 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.502028 29865 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:50.539937 29865 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.540477 29865 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.545042 23702 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 20: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:50.545729 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.550213 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:50.554073 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.554715 23695 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:50.555198 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.556277 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.548115 29715 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:50.557329 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:50.558406 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.558969 29715 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.559891 23696 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:50.553457 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.562654 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:50.564481 23696 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:10:50.564950 23698 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:10:50.544291 30040 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:10:50.565680 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.566107 23698 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:50.566814 30072 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:50.568065 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.561156 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:50.569984 23770 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:50.523007 29842 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:10:50.548636 29954 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:50.575542 24393 raft_consensus.cc:2368] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18.
I20260709 13:10:50.579763 23695 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 22: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:50.592737 23695 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:50.596473 23742 leader_election.cc:400] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18.
I20260709 13:10:50.596899 23742 leader_election.cc:403] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:50.592399 29865 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:50.592837 23703 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:50.625948 23700 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:50.606268 29986 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.635088 23702 raft_consensus.cc:2368] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18.
I20260709 13:10:50.639343 23700 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:10:50.642004 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.645279 23697 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:50.648217 30059 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:50.651491 30059 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.606146 30069 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:10:50.657860 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:50.659740 23700 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:50.657838 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.658867 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:50.661149 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.661963 23696 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:10:50.663385 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.663823 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:10:50.664770 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.666800 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:50.667063 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:50.667366 23771 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.667614 23778 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.668025 23697 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:50.674074 23703 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:10:50.677183 23702 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:10:50.678936 29954 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.675088 23778 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:10:50.692842 23667 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:50.696547 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:50.659926 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.694554 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:50.698511 23772 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:50.702093 23702 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:10:50.706622 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.707937 23703 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 12: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:50.659874 29865 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.701951 30041 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:50.712618 30077 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 13:10:50.720568 23702 raft_consensus.cc:1275] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:10:50.745604 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.749845 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:50.750869 23703 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:10:50.752966 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:50.746426 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:50.753676 23702 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.724850 30041 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:50.760257 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:50.757050 24358 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:50.761869 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:50.824896 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 75346.8us
I20260709 13:10:50.989800 23702 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
I20260709 13:10:50.992633 29287 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:50.993362 29287 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:50.995685 29287 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:50.996543 23593 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:10:50.995991 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 249824us
I20260709 13:10:50.996434 30056 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:10:50.998772 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:50.999284 30056 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:50.999821 30056 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:51.000155 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.000880 30056 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:51.001451 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.001892 23623 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:51.002620 30056 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.002686 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.003337 29992 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:50.997542 29287 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:51.005086 29287 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:51.005395 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:50.763584 23628 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:51.007011 29857 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:51.007650 29857 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:51.008736 29857 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.011049 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:50.988687 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.005635 29287 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:50.984704 30071 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.014807 29755 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:51.018733 30095 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.013790 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.021543 23771 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:51.021878 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:10:51.014211 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 257307us
I20260709 13:10:51.026084 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.026723 30095 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.015043 29989 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:51.038107 23625 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:51.046703 24358 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:51.049798 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.019363 29976 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.016029 30029 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:51.060966 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 47248.4us
I20260709 13:10:51.062209 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.064337 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.029911 29992 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.053994 29905 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.067934 30061 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:51.068711 30069 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:51.088738 23669 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:50.999656 30041 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.090487 23669 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:51.096939 29287 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.023330 30071 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:51.098572 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:51.080644 30040 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:51.145663 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47417.3us
I20260709 13:10:51.146802 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:51.136914 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.079109 29989 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:51.153936 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 142958us
I20260709 13:10:51.154134 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:51.095027 29905 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:51.157058 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:51.159992 30040 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:51.161877 30040 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:51.163236 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.166364 29214 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:51.166947 29214 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:51.167429 29214 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:51.176384 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 112172us
I20260709 13:10:51.176954 29287 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:51.177635 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.098416 29842 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:51.180994 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.184528 29287 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:51.107851 30059 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.188586 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.201957 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:51.207602 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.156723 29865 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.156481 30070 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.233605 29214 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.221879 23592 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:51.186998 29842 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:51.190549 29989 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:51.238360 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 180837us
I20260709 13:10:51.251590 24358 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.255318 29287 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:51.240475 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:51.238047 30095 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:51.206938 30061 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.157171 29755 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.080s
I20260709 13:10:51.187469 30069 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:51.255578 29986 consensus_meta.cc:287] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.615s	user 0.013s	sys 0.004s
I20260709 13:10:51.257726 29865 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:51.259397 30095 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:51.281361 29214 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:51.287848 29287 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:51.289099 29287 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.249917 29842 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.233462 29992 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:10:51.308729 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 148243us
W20260709 13:10:51.317198 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 109706us
I20260709 13:10:51.264726 30100 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.301393 29989 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:51.302506 29986 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18.
W20260709 13:10:51.318487 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 164486us
I20260709 13:10:51.312288 30061 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.334406 23772 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:10:51.342883 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 179718us
I20260709 13:10:51.348958 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:51.350960 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:51.333500 30102 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:51.362150 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:51.364231 23776 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
I20260709 13:10:51.248457 30029 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:10:51.366230 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.282673 29905 consensus_queue.cc:1048] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 13:10:51.371920 23742 leader_election.cc:400] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18.
I20260709 13:10:51.372325 23742 leader_election.cc:403] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:51.366890 30098 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:51.353302 30109 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:51.373257 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:51.374439 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:51.379873 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:51.340229 30061 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.362474 30104 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:51.345296 30069 consensus_queue.cc:1059] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:10:51.386757 23593 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.387279 30071 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:51.385898 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:51.394743 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:51.377630 29986 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18.
I20260709 13:10:51.384534 30095 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:51.384657 29865 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:51.406030 30114 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.407567 30112 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.406055 30098 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:51.407996 30071 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:51.408872 30098 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:51.412017 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 264496us
I20260709 13:10:51.400461 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:51.368040 30094 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:10:51.417666 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:51.417711 29715 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.419759 29715 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.385617 30110 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:10:51.370662 23770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:51.424139 23770 raft_consensus.cc:606] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
W20260709 13:10:51.425761 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 80911.9us
I20260709 13:10:51.424132 30110 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:51.372165 30102 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:51.412065 30108 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.426481 30104 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.424886 29986 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:10:51.417796 29961 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:10:51.475817 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48537.1us
I20260709 13:10:51.478989 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:51.479322 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:51.537918 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:51.538719 23620 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:51.462703 30125 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.085s
W20260709 13:10:51.554900 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 161081us
I20260709 13:10:51.535418 30110 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:51.544770 30114 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.557927 23620 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:51.576417 30110 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.558952 30061 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:51.525997 30121 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:10:51.613312 30056 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:51.614017 30056 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:51.566282 30114 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:51.653371 23743 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:51.666919 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 240728us
I20260709 13:10:51.667869 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:51.683493 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:51.686882 30136 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:51.687973 30136 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:51.658186 29989 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.697268 23629 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:51.692782 29976 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:51.706598 29976 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.707149 29976 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:51.691566 30104 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:51.704927 30102 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:51.706084 30114 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:51.692293 30061 consensus_queue.cc:1059] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:10:51.736385 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:51.737378 23702 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.745239 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:51.699357 29989 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.749392 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:51.751434 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:51.752007 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:51.752602 23695 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:51.764011 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:51.764767 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:51.729511 30069 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:10:51.766569 23702 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:51.774833 30112 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:51.775542 30112 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.780076 30069 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:51.780616 30069 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:51.781706 30069 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.783164 30069 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:51.784001 30112 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:51.759281 29961 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.793702 23593 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.785212 29755 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:51.795904 23593 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.796423 23695 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:10:51.801215 30112 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:51.875174 30095 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.806455 30054 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:51.884476 30095 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:51.887300 30095 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:51.888307 29715 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:51.883275 30128 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:51.864543 29755 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:51.904712 29989 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:51.905954 29755 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:51.791604 29961 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:51.912506 29961 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:51.913192 23629 raft_consensus.cc:1275] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:51.915797 30096 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:51.916530 30096 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:51.918058 30128 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.919106 30096 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:51.921406 30128 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:51.923403 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:51.921674 30040 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:51.936640 30040 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:51.938280 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:51.938999 23769 raft_consensus.cc:606] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:51.939385 23769 raft_consensus.cc:614] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:51.939539 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:51.940467 23699 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:51.942452 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:51.942809 30117 consensus_queue.cc:1048] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:51.943240 24388 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:10:51.934731 30108 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:51.944283 30108 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:51.938803 30056 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:51.958599 23702 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:10:51.951792 30100 consensus_meta.cc:287] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.005s
I20260709 13:10:51.934381 30126 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.955238 29905 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.954161 30108 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:51.997234 23699 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:10:51.959218 29986 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:52.045554 30141 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.362s	user 0.005s	sys 0.000s
I20260709 13:10:52.048230 29986 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.050666 29986 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:51.977181 30100 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:52.056627 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:52.054666 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:52.068892 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 92594.2us
I20260709 13:10:52.077328 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:52.078042 23778 raft_consensus.cc:606] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:52.078390 23778 raft_consensus.cc:614] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:52.091811 24386 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:52.080780 29842 consensus_meta.cc:287] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.765s	user 0.016s	sys 0.001s
I20260709 13:10:52.055606 30138 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:52.086055 30056 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.996217 29905 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.076409 30108 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:52.119621 23593 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:51.991374 30126 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.136581 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:52.100023 30095 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:52.141412 30095 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.098044 30104 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:52.144533 23778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
W20260709 13:10:52.145166 30150 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:10:52.144714 30104 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.145606 23778 raft_consensus.cc:606] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
W20260709 13:10:52.146488 30090 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:10:52.146888 30116 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:52.136756 30108 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.151435 30108 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:52.151602 23696 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 21: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:52.152696 30126 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:52.147392 30104 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:52.155695 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 171888us
I20260709 13:10:52.160476 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:52.136978 30109 raft_consensus.cc:3055] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:52.121754 29842 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.209700 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:52.210340 23704 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:10:52.159301 29961 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:52.212679 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:52.197522 30108 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.223624 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:52.224869 23704 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:52.229483 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.230818 30061 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:52.231541 30061 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:52.232059 30149 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.143s	user 0.000s	sys 0.002s
I20260709 13:10:52.234385 30061 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:52.237855 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:52.240197 30061 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:52.240806 30061 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:52.229403 30040 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:52.241818 30061 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:52.246233 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.246732 30102 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:52.247169 30102 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:52.249509 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.126735 30138 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.255081 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.257719 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.265635 23625 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:52.226356 23699 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:52.267132 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:52.267861 23771 raft_consensus.cc:606] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:52.204432 30109 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:52.268997 23771 raft_consensus.cc:614] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:52.211051 30095 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:52.274600 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:52.277767 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.279479 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.280193 24387 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:52.281369 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.283483 30106 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:52.284536 30169 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.285142 30169 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.287431 30169 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:52.287845 30052 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:52.288546 30052 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:52.288280 30109 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.289503 30109 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:52.289659 30052 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.268673 30108 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.292227 30129 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:52.292943 30129 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.294958 30108 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:52.295670 30137 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.005s	sys 0.000s
I20260709 13:10:52.295904 30152 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.296613 30152 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:52.297717 29976 consensus_meta.cc:287] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.590s	user 0.004s	sys 0.008s
I20260709 13:10:52.298190 29976 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.299155 30152 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:52.300292 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.300982 24388 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
W20260709 13:10:52.296114 30137 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.005s	sys 0.000s
I20260709 13:10:52.301910 30102 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.303051 30102 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.303540 29842 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:52.251713 30059 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:52.304399 30059 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.306648 30155 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:52.306938 30059 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:52.307307 30155 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.308077 23742 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:52.308996 30128 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:52.309407 30128 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:52.309808 30128 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:52.311072 30153 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:10:52.312543 30154 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:10:52.316059 30029 consensus_queue.cc:1175] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9ab488f10c434878a749f261e99a8065" responder_term: 14 status { last_received { term: 13 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:52.295375 30129 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:52.321684 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:52.363336 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:52.373600 23624 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.361793 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:52.251950 29986 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:52.371405 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:52.322885 29976 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:52.376930 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:52.380339 23704 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:52.378074 29986 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:52.385136 30069 consensus_meta.cc:287] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.004s
W20260709 13:10:52.387884 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 66308.6us
I20260709 13:10:52.375838 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:52.392738 29976 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:52.392983 30106 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:52.357167 30056 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:52.384305 23704 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:10:52.371366 30153 log.cc:927] Time spent T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:10:52.396215 23622 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:52.394655 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:52.394922 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.408020 23704 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:52.395171 29986 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:52.404873 24357 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.3:45959 timed out after 1.686s (SENT)
W20260709 13:10:52.436555 23776 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42298 (request call id 1482) took 1734 ms (client timeout 1686 ms). Trace:
I20260709 13:10:52.437428 23624 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
W20260709 13:10:52.437125 23776 rpcz_store.cc:269] 0709 13:10:50.695765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.696235 (+   470us) service_pool.cc:224] Handling call
0709 13:10:52.429883 (+1733648us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b5400347454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:52.430029 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470904192}
I20260709 13:10:52.405069 30069 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:10:52.451825 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.404989 30056 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:52.520956 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 116825us
I20260709 13:10:52.524595 23704 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:10:52.518946 30158 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:10:52.519584 30138 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:52.532233 30056 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:52.533138 30160 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:10:52.542681 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:52.543275 23771 raft_consensus.cc:2376] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18. Re-sending same reply.
I20260709 13:10:52.549896 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.556084 24389 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:10:52.558195 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:52.529750 30128 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.561578 30128 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:52.567932 30061 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.577811 30061 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:52.575532 29986 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.580976 29986 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:52.590970 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.589293 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:52.593173 23774 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:52.589872 30143 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:52.587258 30041 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.595835 30041 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.597190 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.597884 23778 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:52.598165 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.598372 30041 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:52.598052 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.598496 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.599439 23770 raft_consensus.cc:2410] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:52.599532 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.600216 23773 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:52.602219 23775 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:52.602290 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.604686 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.605346 23774 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:10:52.606607 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:52.606920 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.608072 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.609493 23773 raft_consensus.cc:2368] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14.
I20260709 13:10:52.609939 23776 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:52.616945 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.617605 24388 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
W20260709 13:10:52.618788 30174 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.109s	user 0.000s	sys 0.003s
I20260709 13:10:52.621703 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.623762 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.627624 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:52.632125 24394 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:10:52.632448 23667 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:52.636400 30117 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:52.636965 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:52.624933 30155 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:52.637854 29992 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:52.638433 29992 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:52.639300 29992 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.626875 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.644685 23773 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
I20260709 13:10:52.646435 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.647444 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.648146 23775 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:52.647356 23773 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:52.651316 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.657406 23667 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:52.661357 29214 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.661459 30129 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:52.655160 30136 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:52.664631 30136 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.664811 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.665020 30136 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.665723 24392 raft_consensus.cc:2410] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:52.670581 23622 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.671145 30106 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:52.671669 30106 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.673535 30070 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:52.673730 30106 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:52.673979 30070 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:52.674449 30070 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.675923 30143 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:52.678170 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:52.679194 23622 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:10:52.684034 30143 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:52.684659 30143 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.685084 30143 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:52.689250 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.689918 23626 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:52.661962 30129 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:52.694973 29905 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:52.695950 23668 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:52.697160 24359 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:52.697228 29865 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:52.700670 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:52.661935 29214 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.705544 23667 leader_election.cc:400] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14.
I20260709 13:10:52.706254 23667 leader_election.cc:403] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.701597 23743 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:52.709745 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.711120 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:52.712069 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:52.707839 29949 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:10:52.714423 29986 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:52.714828 30052 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:52.714959 29986 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:52.715308 30052 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.715605 30104 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.716009 29986 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.704320 30051 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.717406 30051 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.719390 30051 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:52.719940 30105 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:52.720621 23772 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:52.715746 30052 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.724794 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.726392 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.720590 30105 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:52.729406 29214 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:52.732234 30162 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.303s	user 0.000s	sys 0.002s
I20260709 13:10:52.742439 30105 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.742534 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:52.744063 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:52.744669 23700 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:52.719890 30156 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.644s	user 0.004s	sys 0.000s
I20260709 13:10:52.695016 30129 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.752413 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:52.773651 23698 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:52.766736 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:52.774900 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:52.766848 30136 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.786531 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.769778 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:52.760442 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:52.800233 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:52.747994 29989 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:52.808529 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 59565.1us
I20260709 13:10:52.809928 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:52.810935 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 110601us
I20260709 13:10:52.817389 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.818919 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.820616 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.822711 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.824105 23626 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:52.829999 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.830581 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.832144 23626 raft_consensus.cc:2393] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:52.833395 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:52.837409 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:52.838487 23700 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:10:52.840145 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:52.840757 23697 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:52.845773 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.846427 23621 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:52.852224 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:52.852807 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 77995.9us
I20260709 13:10:52.854753 23700 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:10:52.856433 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46619.9us
I20260709 13:10:52.857045 23621 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:52.861224 29287 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:52.862145 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:52.863304 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:10:52.864140 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 132795us
I20260709 13:10:52.866189 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:52.786227 30029 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:52.830022 30056 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:52.878641 29287 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:52.821727 30096 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:52.879338 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.878458 23703 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:52.822307 30102 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:52.883124 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:52.885468 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:52.886950 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.887369 29214 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:52.888089 29214 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.888505 29214 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.861822 30104 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14.
W20260709 13:10:52.891842 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 80104us
I20260709 13:10:52.858407 30110 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:52.893483 23701 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:52.862751 29949 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:52.845656 30109 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:10:52.867666 30128 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:52.878961 30056 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.830680 29989 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.929282 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.905192 30120 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:52.883234 30029 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.959846 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:52.960680 23621 raft_consensus.cc:2368] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14.
I20260709 13:10:52.970227 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3135) took 1008 ms. Trace:
I20260709 13:10:52.970815 23702 rpcz_store.cc:276] 0709 13:10:51.962084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.978559 (+ 16475us) service_pool.cc:224] Handling call
0709 13:10:51.979801 (+  1242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.992999 (+ 13198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.993053 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.047864 (+ 54811us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b4800190158. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:10:52.057259 (+  9395us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.275418 (+218159us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:52.283213 (+  7795us) log.cc:844] Serialized 14 byte log entry
0709 13:10:52.283421 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.283503 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.731634 (+448131us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:52.969962 (+238328us) raft_consensus.cc:1685] finished
0709 13:10:52.969988 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.970150 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8060,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":3644,"raft.run_cpu_time_us":2306,"raft.run_wall_time_us":55885,"spinlock_wait_cycles":48482432,"thread_start_us":151823,"threads_started":1,"wal-append.queue_time_us":299658}
I20260709 13:10:52.974982 29989 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:52.917626 30056 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.894299 30133 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:10:52.892786 30102 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:52.936158 30125 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:52.995699 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:52.995461 30125 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:53.002566 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 113915us
I20260709 13:10:53.003073 29214 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.913794 30096 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.005404 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:52.921118 30128 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:52.986071 30120 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:53.017210 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:53.020495 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:53.024893 30102 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:53.029547 30069 raft_consensus.cc:993] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:53.031831 30059 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:53.031358 30128 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:53.033349 30105 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:53.034019 23696 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:53.034462 30029 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:53.001612 30143 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:53.035660 30105 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:52.988229 30052 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:53.046784 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:53.047127 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:53.047873 23626 raft_consensus.cc:2368] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 15. Current term is 16.
I20260709 13:10:53.048641 23628 raft_consensus.cc:2368] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16.
I20260709 13:10:53.053580 30120 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.039062 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:53.056095 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:53.056741 24391 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:53.039357 23699 raft_consensus.cc:2368] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22.
I20260709 13:10:53.059064 30070 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.063439 24359 leader_election.cc:400] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 15. Current term is 16.
I20260709 13:10:53.063825 24359 leader_election.cc:403] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:10:53.063668 30096 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:53.040482 30143 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:53.040875 29973 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:10:53.069396 23773 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:10:53.041205 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:53.071065 23773 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:53.072149 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:53.072397 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:53.073767 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:53.042002 30069 raft_consensus.cc:1081] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:53.044450 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:53.044711 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:53.036720 24387 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:53.039826 29976 raft_consensus.cc:993] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:53.084124 29973 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:53.084355 29976 raft_consensus.cc:1081] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:53.084945 29973 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:53.085330 29973 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.043361 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:53.085728 29973 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.085966 23771 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:53.074339 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:53.096554 23698 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:53.097172 30104 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:53.097540 23771 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:53.098038 23695 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:53.099253 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:53.100126 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 203848us
I20260709 13:10:53.040266 30094 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:53.061236 30099 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:53.105845 30105 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.122907 24391 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:10:53.104511 30143 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:53.124076 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:53.107896 30152 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:10:53.215866 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 157979us
I20260709 13:10:53.209986 30069 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.216187 30108 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:53.207146 30143 raft_consensus.cc:697] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:53.246474 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:53.257562 23621 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:53.207988 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 84030.9us
I20260709 13:10:53.261526 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:53.236956 30069 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:53.271713 30184 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:53.272138 30152 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:53.271659 23669 leader_election.cc:400] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14.
I20260709 13:10:53.286700 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:53.228819 30056 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:53.297569 30056 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:53.293896 30143 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:53.298593 23627 raft_consensus.cc:2393] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:53.300354 30129 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.297890 29214 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:53.285028 30125 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:53.309549 23742 leader_election.cc:400] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22.
I20260709 13:10:53.326699 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:53.329250 23742 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:53.291085 29865 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:53.302229 30070 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:53.338025 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:53.342178 23771 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:53.346122 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:53.346846 23697 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:53.348131 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:53.356271 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:53.358057 23702 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:53.358778 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:53.359970 23700 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:53.363154 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:53.364893 30102 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:53.369485 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:53.302175 29973 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.377911 23703 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:53.373344 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:53.369228 23697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:10:53.370751 23696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:10:53.387415 23696 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.388211 23696 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:53.391804 23697 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.392616 23697 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:53.336033 30191 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:53.402434 23742 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:53.411418 23701 raft_consensus.cc:2368] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16.
I20260709 13:10:53.411494 30191 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:53.421689 30069 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:53.422570 30191 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.374385 30102 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:10:53.429278 29973 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:53.408911 29986 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:53.409212 30129 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:53.400007 30189 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:10:53.413815 23697 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.413679 23696 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.409482 30120 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:53.439847 23696 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:53.440533 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:53.449014 30136 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:53.449617 29986 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:53.450165 29986 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:53.451680 23697 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:53.450994 29986 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:53.454568 29986 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:53.468055 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:53.468972 24391 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:53.474090 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:53.488170 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:53.493268 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:53.494019 24392 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.502342 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:53.468611 30189 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:53.503255 30189 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:53.506240 30189 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:53.467911 30102 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:53.512394 30136 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:10:53.534716 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 157988us
I20260709 13:10:53.535061 24391 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:53.536542 23667 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:53.541831 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:53.542692 23778 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.543601 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:53.544205 23777 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:53.544557 23777 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:53.547411 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:53.545356 23777 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.534665 30128 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:53.551107 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:53.551705 23775 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:53.552062 23775 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:53.520807 30102 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:53.536968 30136 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 22 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:53.549614 30108 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:53.560606 23778 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:53.558894 23775 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:53.571286 30204 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.153s	user 0.001s	sys 0.001s
I20260709 13:10:53.573443 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:53.580520 30138 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:53.581379 30138 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:53.582635 30138 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:53.602742 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 370721us
I20260709 13:10:53.604306 24392 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:53.563877 30108 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:53.556279 30128 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:53.611860 23743 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:53.614106 23773 raft_consensus.cc:2410] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:10:53.615016 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:53.616591 30051 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.617625 30059 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:53.575948 30105 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 15. Current term is 16.
I20260709 13:10:53.623057 29986 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:53.626396 30212 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:53.627354 30136 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:53.629113 30108 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.633244 30102 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:53.635248 30128 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:53.636176 30205 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.216s	user 0.003s	sys 0.000s
I20260709 13:10:53.639784 29986 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.618317 30096 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 13:10:53.637786 30195 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:10:53.642129 30051 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.668262 30051 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:53.675531 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.623181 30125 raft_consensus.cc:2764] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:10:53.687897 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45049.4us
W20260709 13:10:53.696317 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 80962.6us
I20260709 13:10:53.697482 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:53.699532 30188 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:53.724076 30219 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:53.725612 30220 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:53.726226 30202 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:53.726720 30202 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:53.729943 30052 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:53.731637 30203 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.305s	user 0.002s	sys 0.000s
I20260709 13:10:53.727582 30202 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.757656 23771 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:53.703408 30096 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:10:53.700438 30197 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:10:53.767160 30207 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 13:10:53.771802 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 73123us
W20260709 13:10:53.779935 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 82584.2us
I20260709 13:10:53.780524 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:53.781961 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:53.782641 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:53.784348 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:53.784348 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:53.785295 24392 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.785583 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:53.775262 30096 consensus_queue.cc:1243] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:53.807840 24392 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:53.817011 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:53.820526 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:53.821035 23696 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:53.821208 23697 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.822556 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:53.818434 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:53.825117 23695 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.823282 23696 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.831076 23592 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:53.832114 30096 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:53.832592 30220 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:53.833643 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 48897.7us
I20260709 13:10:53.834450 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:10:53.835274 30220 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:53.837118 30220 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:53.839015 30220 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:53.853082 30202 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.860677 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:53.871701 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:53.875550 23697 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:53.882014 30099 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:53.882694 30099 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:53.885893 30188 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:53.886664 30188 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:53.890255 30099 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:53.892102 30099 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:53.894883 29986 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:53.897619 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:53.904341 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:53.906183 23771 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:10:53.907222 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:53.907330 23695 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:53.907902 23771 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:53.910161 23696 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:53.909286 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:53.918234 23773 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.926402 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:53.899488 30121 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:53.963934 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:53.969521 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:53.970505 23629 raft_consensus.cc:2393] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:53.971635 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:53.973064 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:53.975278 23625 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:53.978461 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:53.981521 23629 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:53.988677 24392 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:53.990554 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:53.991348 23621 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.992651 23627 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:53.956333 30188 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.999229 23592 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:54.010756 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:54.012277 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:54.020046 23695 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:54.023424 23703 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:54.076750 23621 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:10:54.032878 30221 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 13:10:54.095283 24387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46566 (request call id 1013) took 1335 ms (client timeout 1705 ms). Trace:
W20260709 13:10:54.095829 24387 rpcz_store.cc:269] 0709 13:10:52.759792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.760139 (+   347us) service_pool.cc:224] Handling call
0709 13:10:54.095068 (+1334929us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540060a4d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:54.095185 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564158336}
I20260709 13:10:54.102414 23625 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:10:54.028644 30218 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:54.113770 23773 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:54.009868 30188 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:54.126341 30191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.043s	sys 0.073s
I20260709 13:10:54.138535 30218 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.150635 30218 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.151500 29992 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:54.156054 29986 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:54.156299 29992 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:54.156860 29986 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:54.158838 29992 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:54.148618 30224 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:10:54.161006 29986 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:54.166745 29986 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:54.167654 29986 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:54.170863 29986 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:54.147790 30191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.044s	sys 0.073s
I20260709 13:10:54.180845 23774 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:54.183461 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.206918 23629 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:10:54.208573 23628 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:54.173209 30188 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:54.188539 30191 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:54.248550 24385 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:10:54.249601 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 183885us
I20260709 13:10:54.250626 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:54.277328 30106 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:54.148301 30102 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:54.192226 30051 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:54.287303 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:54.294972 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:54.286116 30051 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:54.306661 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 273127us
W20260709 13:10:54.304502 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 279327us
I20260709 13:10:54.300225 30202 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:54.305769 30096 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:54.289620 30102 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:54.362707 30197 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:54.370308 30197 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:54.372857 30197 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:54.305944 30198 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 13:10:54.397123 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 117603us
I20260709 13:10:54.399814 24387 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:54.335938 30202 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:54.366104 30096 raft_consensus.cc:697] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:54.456223 30070 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:54.459643 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 127771us
W20260709 13:10:54.469533 30230 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:10:54.472126 30102 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:54.411466 30152 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:54.476372 30152 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:54.478727 30152 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:54.456899 30070 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:54.408715 30120 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:54.484306 30120 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:54.490658 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 49041.7us
W20260709 13:10:54.555490 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 63702.4us
I20260709 13:10:54.559415 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:54.570142 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 77799.5us
I20260709 13:10:54.492664 30129 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:54.581169 30070 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:54.574481 30198 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:54.583436 30099 consensus_meta.cc:287] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.003s
I20260709 13:10:54.585999 30200 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:53.846158 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:54.604432 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1513) took 1097 ms. Trace:
I20260709 13:10:54.610319 23622 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:54.606971 23770 rpcz_store.cc:276] 0709 13:10:53.496500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.496685 (+   185us) service_pool.cc:224] Handling call
0709 13:10:53.499238 (+  2553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.513332 (+ 14094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.513393 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.513459 (+    66us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:53.513510 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.593474 (+1079964us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54003403d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:54.593541 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.593715 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31685504}
W20260709 13:10:54.605443 30214 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:10:54.619386 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 158427us
I20260709 13:10:54.606020 30070 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.568491 30202 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:54.605126 30129 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:54.608248 30198 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:54.656183 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 47409.3us
I20260709 13:10:54.624655 30200 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:54.698235 30200 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:54.607447 30096 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:54.659070 30120 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:54.630074 30070 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:54.700965 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.701469 30070 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:54.704741 30051 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:54.707404 30051 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:54.706712 23777 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:54.712324 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:54.694223 30198 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:54.694527 30242 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.297s	user 0.006s	sys 0.004s
I20260709 13:10:54.716674 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:54.718122 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:54.749096 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:54.718972 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:54.719352 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:54.719923 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:54.724848 30129 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:54.724984 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:54.724766 30102 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:54.733197 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:54.764003 30102 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:54.764819 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:54.735584 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:54.736645 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:54.768095 23620 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:54.740784 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.746831 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:54.770566 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:54.755192 23742 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:54.771474 23621 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:54.753265 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:54.712520 30218 consensus_meta.cc:287] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.005s
I20260709 13:10:54.756742 30029 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:54.758694 23777 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:10:54.783241 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 2836) took 1241 ms. Trace:
I20260709 13:10:54.783772 23777 rpcz_store.cc:276] 0709 13:10:53.541949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.543422 (+  1473us) service_pool.cc:224] Handling call
0709 13:10:54.117075 (+573653us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b180015d740. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41347646 00007f2b4128158e 00007f2b41302f9e 00007f2b413047de 00007f2b4131027c 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c
0709 13:10:54.706428 (+589353us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b58004f19d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b412680aa 00007f2b412ea447 00007f2b41302fe7 00007f2b413047de 00007f2b4131027c 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c
0709 13:10:54.783152 (+ 76724us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400752256}
I20260709 13:10:54.793185 23742 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:54.803660 23742 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:54.766388 30102 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:54.803295 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:54.819802 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.823652 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 273523us
I20260709 13:10:54.826270 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:54.781530 30218 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:54.834147 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:54.815537 30125 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:54.818019 29986 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:54.839447 29214 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:54.843461 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:54.824054 30128 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:54.823153 30256 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:54.858795 23742 leader_election.cc:400] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16.
I20260709 13:10:54.837024 30198 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:54.839931 30120 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:54.865876 29992 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:54.922400 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 301112us
I20260709 13:10:54.902532 23775 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:54.850898 30102 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:54.906234 30256 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:54.907060 30253 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.938810 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:10:54.952708 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.946542 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.952540 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:10:54.913810 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 256477us
I20260709 13:10:54.956431 24392 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:10:54.957720 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:54.959991 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:54.926954 30029 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:54.977864 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.963235 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 88786us
I20260709 13:10:54.925123 30106 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:54.971076 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:54.973837 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:54.985532 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:54.972433 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:54.988068 23621 raft_consensus.cc:2410] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:10:54.918027 30198 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:54.963244 30129 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:55.003358 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:54.973868 30246 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:55.016717 30218 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:54.960537 30253 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:55.019294 30253 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:54.988649 29992 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:54.969208 30152 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:10:55.034443 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:55.037292 24391 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:10:55.038691 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:54.987823 30029 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:54.995430 30106 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:55.051884 23775 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:10:55.052707 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43460 (request call id 2835) took 1511 ms. Trace:
I20260709 13:10:55.030151 30129 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:55.053436 23775 rpcz_store.cc:276] 0709 13:10:53.541615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.543366 (+  1751us) service_pool.cc:224] Handling call
0709 13:10:54.288549 (+745183us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b180026a540. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41347646 00007f2b4128158e 00007f2b41302f9e 00007f2b413047de 00007f2b4131027c 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c
0709 13:10:54.588429 (+299880us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b58006f23d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b412680aa 00007f2b412ea447 00007f2b41302fe7 00007f2b413047de 00007f2b4131027c 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c
0709 13:10:54.902077 (+313648us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b58005fc9d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b412680aa 00007f2b412ea447 00007f2b41302fe7 00007f2b413047de 00007f2b4131027c 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c
0709 13:10:55.052628 (+150551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2162120704}
I20260709 13:10:55.059844 29992 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:55.044838 30253 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 13:10:55.042812 30256 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:55.130481 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2578) took 1161 ms. Trace:
I20260709 13:10:55.152040 23629 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:55.166916 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:55.167639 23771 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:55.135125 23624 rpcz_store.cc:276] 0709 13:10:53.968668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.972440 (+  3772us) service_pool.cc:224] Handling call
0709 13:10:53.989324 (+ 16884us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:54.018494 (+ 29170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.018548 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:54.544173 (+525625us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b2c00058238. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:10:54.567137 (+ 22964us) log.cc:844] Serialized 52 byte log entry
0709 13:10:54.786981 (+219844us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:55.092936 (+305955us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.100581 (+  7645us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.125762 (+ 25181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.126495 (+   733us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.127896 (+  1401us) raft_consensus.cc:1685] finished
0709 13:10:55.128093 (+   197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.129584 (+  1491us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43832,"prepare.queue_time_us":261451,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":53469,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":16264,"spinlock_wait_cycles":25233408,"thread_start_us":448130,"threads_started":2,"wal-append.queue_time_us":297563}
W20260709 13:10:55.190186 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 210895us
I20260709 13:10:55.192986 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:55.097611 29992 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:55.119076 30099 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:55.219259 23771 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
W20260709 13:10:55.192960 30255 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:10:55.187568 30061 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:10:55.235939 30246 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:10:55.338275 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 129812us
I20260709 13:10:55.319218 30061 consensus_queue.cc:1243] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:55.229766 30099 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:55.352543 30260 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
W20260709 13:10:55.353473 30265 log.cc:927] Time spent T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 13:10:55.355091 30263 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 13:10:55.356069 30246 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:55.206643 30129 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:55.363631 30261 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.288s	user 0.001s	sys 0.001s
W20260709 13:10:55.389948 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 203275us
W20260709 13:10:55.456467 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.333329 30152 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:55.374583 30106 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:55.482980 30029 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:55.492916 30269 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:55.653569 30121 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:10:55.658303 30270 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.173s	user 0.001s	sys 0.002s
I20260709 13:10:55.657858 30269 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:55.660125 30276 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.157s	user 0.003s	sys 0.000s
I20260709 13:10:55.617591 30223 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:55.690328 30269 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:55.702802 30210 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:55.703188 30269 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:55.704761 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.705757 30269 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:55.708163 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.708829 23701 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:10:55.709002 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.709857 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.710462 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.711535 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.721160 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.721839 23704 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:55.733294 23695 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:10:55.694733 30136 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:55.701856 30070 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:55.739311 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.655587 30121 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:55.738253 29992 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:55.759660 23697 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:55.703390 30210 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:55.745597 30289 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:55.609323 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 113667us
I20260709 13:10:55.712798 30223 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:55.765234 30278 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:55.766971 30278 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:55.770092 30278 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:55.749672 30070 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:55.747519 30136 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:55.784804 23703 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:55.785972 30070 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:55.794207 30121 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:55.756120 30269 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:55.787665 30223 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:55.766158 30289 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:55.797528 23704 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:55.822981 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.787985 30099 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:55.785981 30136 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:55.809660 30210 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:55.830842 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:55.818118 30289 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:55.827905 30290 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:55.837805 23698 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:55.829157 23670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.013s	sys 0.046s
I20260709 13:10:55.840241 30106 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:55.843552 30210 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:55.852281 23670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.014s	sys 0.046s
I20260709 13:10:55.866237 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:55.886425 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:55.892746 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:55.893548 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:55.894207 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:55.897991 23770 raft_consensus.cc:2410] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for term 23 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:10:55.849967 30136 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:55.905519 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:55.880016 30117 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:55.880033 30223 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:55.902709 30029 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:55.902357 29992 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:55.904069 30109 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:55.916115 23668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.018s	sys 0.026s
W20260709 13:10:55.919956 23668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.018s	sys 0.026s
I20260709 13:10:55.908159 30136 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:55.929582 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.930223 29986 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:55.930773 29986 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:55.916904 30223 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:55.931185 29986 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:55.932904 30223 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:55.897586 30210 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:55.935274 30210 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:55.890736 30106 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:55.915653 30300 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.852011 30290 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:55.939330 30106 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:55.919900 30029 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:55.958819 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 107742us
I20260709 13:10:55.959254 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.957373 23593 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:55.962078 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.956105 30300 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:55.963420 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:55.965911 30300 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:55.940171 30099 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:10:55.979003 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 68529.4us
I20260709 13:10:55.956041 30223 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.915424 30117 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:55.961052 30029 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:55.958494 30219 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:55.981922 30307 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:55.987954 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:55.988204 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:55.991063 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:55.989766 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3650) took 1257 ms. Trace:
I20260709 13:10:56.025043 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:55.984715 30099 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.033538 30306 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.034229 30306 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.034873 30099 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.036262 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:55.982206 30251 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:55.995424 23623 rpcz_store.cc:276] 0709 13:10:54.732491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.739988 (+  7497us) service_pool.cc:224] Handling call
0709 13:10:54.767719 (+ 27731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.021401 (+253682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.021438 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:55.021491 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:55.021529 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.989520 (+967991us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54003250d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:55.989572 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.989696 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12532,"raft.queue_time_us":13056,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":553520384}
I20260709 13:10:56.044293 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.048014 24392 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:10:56.035508 30099 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.061133 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:56.064625 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:55.994674 30210 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:56.071883 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:55.998174 30283 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:56.036309 30297 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.098s	user 0.002s	sys 0.000s
W20260709 13:10:56.070914 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 165934us
I20260709 13:10:55.990960 30106 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:10:56.041455 30136 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:55.988600 30223 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.068785 30152 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:56.068579 30246 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:56.089922 30306 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:56.092324 30298 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 13:10:56.094182 30294 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:10:56.102402 30109 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:56.074393 30291 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:55.998884 30219 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.104835 30117 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.064000 30251 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.086138 30301 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:10:56.110814 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.096700 30290 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.114801 30223 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.121754 30069 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:10:56.132570 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 144684us
I20260709 13:10:56.161855 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.149278 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.154520 30219 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.123090 29986 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.158902 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:10:56.165258 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 132808us
W20260709 13:10:56.174578 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 195765us
W20260709 13:10:56.174898 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45487.2us
I20260709 13:10:56.167877 30300 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:56.163064 30069 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.157418 30029 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.168677 29992 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:56.195991 29992 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.198326 29992 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.198946 29992 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:56.160502 30301 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:56.205907 29992 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.207259 30301 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.189666 30251 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.178974 30316 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:10:56.179191 30312 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.211107 30312 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.213485 30312 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.191928 24359 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:56.189294 29986 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.216053 29986 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.216543 29986 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.216957 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.217269 23668 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:56.218434 29986 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.200106 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.218636 30101 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.219547 30253 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:56.219970 30253 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:56.220325 30253 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:56.221910 30301 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:56.222378 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.223080 24385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 1023) took 1360 ms. Trace:
I20260709 13:10:56.223479 24385 rpcz_store.cc:276] 0709 13:10:54.862468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.862694 (+   226us) service_pool.cc:224] Handling call
0709 13:10:54.863130 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.863617 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.863658 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.109145 (+1245487us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b18004101a0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e1ed2a6 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a
0709 13:10:56.109598 (+   453us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b2c00100048. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:10:56.110181 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.144438 (+ 34257us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:56.144493 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.144592 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.222852 (+ 78260us) raft_consensus.cc:1685] finished
0709 13:10:56.222873 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.222999 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":381,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":5105,"spinlock_wait_cycles":64107648,"thread_start_us":33839,"threads_started":1,"wal-append.queue_time_us":67511}
I20260709 13:10:56.201121 30029 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.203150 30069 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.215592 29992 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:56.240711 30302 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:56.241087 30284 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.241417 30302 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.241658 30284 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.243765 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.245085 23771 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:56.245600 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.246129 24394 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:56.250345 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.268525 30302 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.269685 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.272030 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.273851 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.273736 30069 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:56.278048 30069 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.278514 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:56.279872 29214 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:56.280222 30069 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.280479 29214 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.282750 29214 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:56.285296 30284 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:56.295469 30198 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:56.298252 30323 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:56.298897 30323 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.304952 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:56.305572 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.306226 23624 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:56.306239 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:56.307893 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.311313 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.312285 23629 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:56.313122 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.313738 23628 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:56.315514 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.316108 23628 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:56.317919 23623 pending_rounds.cc:85] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 10
I20260709 13:10:56.318244 23623 pending_rounds.cc:107] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:10:56.318470 23623 raft_consensus.cc:2889] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:56.321555 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.322502 23629 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:10:56.326869 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 49510.7us
I20260709 13:10:56.326975 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.331490 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.310465 30198 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:56.333662 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.337036 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.338208 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.341149 23699 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:56.275624 30096 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:10:56.344439 24392 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:56.345629 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.348726 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.326923 30290 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:56.324934 29986 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.351106 23695 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:10:56.370043 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45815.6us
I20260709 13:10:56.329591 30069 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:56.368935 30101 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:56.348884 30198 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.373524 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.378736 24392 raft_consensus.cc:2410] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:56.386546 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.390396 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.390781 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:56.404754 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 61669.3us
I20260709 13:10:56.405948 23743 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.408314 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:56.410260 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 73940.9us
I20260709 13:10:56.385232 30286 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.416293 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.411262 30328 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:56.379320 30069 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:56.424693 30268 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 1.191s	user 0.001s	sys 0.010s
I20260709 13:10:56.425011 30069 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.428177 30069 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:56.428736 30069 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.429304 30069 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:56.421058 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.433543 30323 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.377579 29986 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.436209 29986 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.392477 30253 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.381027 30101 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.441743 30101 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.420439 30286 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.443799 30328 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.447104 23700 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:56.451538 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.453439 30253 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:56.411923 30056 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:10:56.461721 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:56.462316 30312 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.462446 24391 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:56.462993 30312 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.467083 30252 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:56.477768 30252 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.478374 29986 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.479162 29986 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.479969 30291 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:56.480646 30291 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.481551 30328 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.482183 29986 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.482736 30252 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:56.483047 30291 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:56.484308 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2778) took 1895 ms. Trace:
I20260709 13:10:56.484967 30312 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:56.484844 23776 rpcz_store.cc:276] 0709 13:10:54.588547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.590084 (+  1537us) service_pool.cc:224] Handling call
0709 13:10:54.590500 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.590963 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.591004 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.591579 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.880109 (+288530us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b18004a7340. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1 00007f2b412c7a0f
0709 13:10:55.071991 (+191882us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:55.072053 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.072149 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.423929 (+1351780us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:10:56.483995 (+ 60066us) raft_consensus.cc:1685] finished
0709 13:10:56.484038 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.484227 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11339,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":775,"spinlock_wait_cycles":9959040,"thread_start_us":191632,"threads_started":1,"wal-append.queue_time_us":594732}
I20260709 13:10:56.472601 30253 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:56.487416 30253 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.493307 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.494035 23771 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:56.495148 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.501673 24391 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:10:56.502637 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.502923 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.504093 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.504194 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.506305 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.506357 23668 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:56.503398 23769 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:10:56.509378 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.509909 23769 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:10:56.511611 23743 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:56.512633 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.518257 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:56.519942 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.529081 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.529073 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:56.530462 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:56.513548 23769 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:10:56.533692 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.535812 23592 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.535830 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.538906 23743 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:56.539827 23743 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:56.540475 30198 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.540565 30323 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:56.541136 30323 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.541613 30323 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:56.542235 30329 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:56.542661 30329 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.543138 30329 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:56.546655 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.547096 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.550441 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.552796 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.554605 30056 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.554934 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.555264 30253 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:56.555137 30056 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.557868 30328 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:56.558334 30328 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.558722 30328 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:56.559922 30300 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.560456 30300 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.562562 30300 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.563046 30300 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.530475 30271 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:56.564792 30271 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:56.565459 30219 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:56.566401 30223 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:56.565935 30271 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.568694 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.565969 30219 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:56.570284 23592 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:56.572497 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.579515 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.578276 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.584631 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.586174 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:56.587181 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.590476 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.563450 30300 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.585626 23699 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 9.
I20260709 13:10:56.557523 30056 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.600611 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:56.573932 30301 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.619813 30301 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.621995 30301 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.602937 30324 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:56.622771 30324 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.623304 30324 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:56.584568 30202 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:56.623941 30202 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.624428 30202 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:56.570616 30219 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.605587 30317 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:56.619540 30329 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.614588 30220 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:56.641002 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.644626 23775 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:56.646204 23592 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:56.647580 23592 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:56.649009 23592 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:56.649802 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:56.689153 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.696992 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.699303 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.694453 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.690011 23774 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:10:56.700022 23774 pending_rounds.cc:85] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 16
I20260709 13:10:56.700276 23772 raft_consensus.cc:2410] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:56.700414 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.693986 23776 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:56.701766 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.700261 23774 pending_rounds.cc:107] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:10:56.703508 23774 raft_consensus.cc:2889] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:56.682366 30329 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.708920 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.710691 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.712175 23629 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:10:56.713969 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.714939 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.653136 30096 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:56.682081 30299 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:56.653345 30307 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:56.722734 30286 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.656832 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:56.725232 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.692481 30202 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.683943 30069 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.727499 23776 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:10:56.729574 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.731096 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.731793 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.732079 30105 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:56.732219 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.732424 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.733239 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.643344 29986 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.642679 30220 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.743140 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:56.792145 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49077.8us
I20260709 13:10:56.792901 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.743211 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.794939 23624 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:56.744203 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:56.744644 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:56.796321 23621 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:56.691479 30328 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:56.747555 23774 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:56.733868 30299 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.751219 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.651639 30280 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:56.752753 30323 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.753674 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.765277 30300 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.767923 30202 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.769631 23769 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:56.770120 30069 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.719146 30096 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.758682 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.724400 30305 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:56.835286 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:56.835877 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 77319.7us
I20260709 13:10:56.832050 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:56.837751 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:56.749063 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 92194.3us
I20260709 13:10:56.746119 30307 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.803336 30286 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:56.803581 30248 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:56.834573 30096 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:56.824626 30321 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:10:56.796639 30105 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.885615 30105 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.887799 30220 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:56.888465 30069 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.813555 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.892649 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.813555 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.894039 23695 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:10:56.815804 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.755350 30198 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:56.823119 24385 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:56.823009 23621 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:56.828287 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:56.829645 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.831759 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.840174 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.840694 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.807847 30299 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:56.842792 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:56.806033 29287 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:56.920897 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 83255.4us
I20260709 13:10:56.922010 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.923954 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.925099 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.926098 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.832619 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:56.847033 30323 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:56.932269 23620 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:56.847610 23778 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:56.856628 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:56.867471 30307 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:56.805388 29986 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:56.873133 30328 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:56.899770 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 67817.5us
W20260709 13:10:56.900339 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 86870.2us
I20260709 13:10:56.942121 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:10:56.942453 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 109949us
I20260709 13:10:56.905572 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.944299 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.906499 23625 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:56.946735 23625 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:56.933548 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.938282 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.938687 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.935405 24358 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:56.951167 23593 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.951705 29287 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:56.924018 30220 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.953603 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.940637 30207 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.956518 30207 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:56.958791 30207 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:56.960826 30306 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:56.949234 23743 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:56.961958 23743 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:56.960848 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:56.963517 30286 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:56.964403 30328 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:56.964846 30328 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.965206 30328 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:56.953434 30271 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:56.968359 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:56.972209 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.972530 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.973517 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.968418 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.974623 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.974623 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:56.976536 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:56.973508 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:56.977092 23626 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:56.923265 29976 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:56.987645 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 65746.8us
I20260709 13:10:56.980706 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.990036 29287 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:56.990831 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:56.993309 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.981642 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:56.955096 30198 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:56.996789 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:56.934087 30329 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:56.998025 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:56.999492 23776 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:57.008584 30324 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.009939 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:57.010582 29986 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:57.011045 30129 consensus_queue.cc:1059] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:56.967964 30301 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:57.012684 23769 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:57.016541 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:57.022372 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:57.024616 23771 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:56.987897 29976 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:56.980319 30069 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:57.025777 30324 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:57.026110 30069 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.025787 29976 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:57.028167 30069 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:57.028429 30096 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.018909 30266 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:57.032202 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:57.007233 30307 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.035558 23629 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 20: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:57.037812 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:57.044183 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:57.037098 30198 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.045496 23625 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:57.034044 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:57.059038 30301 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:57.042356 30220 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:10:57.066161 23621 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:57.038264 30125 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:57.066620 29214 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:57.077613 29214 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:57.078094 29214 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:57.069173 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:57.079015 23769 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:57.074299 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 103094us
I20260709 13:10:57.082082 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:57.085693 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:57.059621 30202 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.087755 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:57.089375 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:57.103427 29214 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.065052 30096 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:57.077355 30198 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:10:57.077057 30125 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:57.137691 23527 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 183) took 15529 ms (client timeout 15000 ms). Trace:
I20260709 13:10:57.137732 30198 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:57.140367 30198 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:57.141404 30198 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.142942 30198 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.127203 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:57.084239 30324 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.129701 23626 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:57.166472 23620 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:57.167832 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:57.123354 30069 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.168411 23743 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:57.172631 30061 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:57.173318 30061 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:57.174404 30258 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.174239 30061 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.134215 30202 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:57.136044 30252 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:57.145681 30125 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:57.138206 23527 rpcz_store.cc:269] 0709 13:10:41.615584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.622698 (+  7114us) service_pool.cc:224] Handling call
0709 13:10:42.514403 (+891705us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b5400002210. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e8640 00007f2b470bfb76 00007f2b471c9c3e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc 00007f2b45689392 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:57.137581 (+14623178us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:50.025316 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:50.026054 (+   738us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:50.026108 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:10:50.026125 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:50.084857 (+ 58732us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:50.119641 (+ 34784us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:50.120827 (+  1186us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:10:50.158576 (+ 37749us) tablet.cc:701] Row locks acquired
0709 13:10:50.158627 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:10:50.158820 (+   193us) write_op.cc:270] Start()
0709 13:10:50.158977 (+   157us) write_op.cc:276] Timestamp: P: 1783602650158738 usec, L: 0
0709 13:10:50.159016 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:10:50.159833 (+   817us) log.cc:844] Serialized 9056 byte log entry
0709 13:10:50.572901 (+413068us) op_driver.cc:464] REPLICATION: finished
0709 13:10:51.008270 (+435369us) write_op.cc:301] APPLY: starting
0709 13:10:51.008387 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:51.616687 (+608300us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:51.616829 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:52.585065 (+968236us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:52.585659 (+   594us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:10:52.585737 (+    78us) write_op.cc:312] APPLY: finished
0709 13:10:52.639208 (+ 53471us) log.cc:844] Serialized 204 byte log entry
0709 13:10:52.865337 (+226129us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:52.892402 (+ 27065us) write_op.cc:454] Released schema lock
0709 13:10:52.913927 (+ 21525us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:52.998196 (+ 84269us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.002206 (+  4010us) write_op.cc:454] Released schema lock
0709 13:10:53.266546 (+264340us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b18001cf660. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
Metrics: {"mutex_wait_us":1591177,"reported_tablets":51,"spinlock_wait_cycles":42345344,"child_traces":[["op",{"apply.queue_time_us":434963,"apply.run_cpu_time_us":138217,"apply.run_wall_time_us":1945875,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100405,"num_ops":23,"prepare.queue_time_us":153644,"prepare.run_cpu_time_us":81319,"prepare.run_wall_time_us":286425,"raft.queue_time_us":203285,"raft.run_cpu_time_us":49911,"raft.run_wall_time_us":190515,"replication_time_us":413714,"spinlock_wait_cycles":12731776,"thread_start_us":724755,"threads_started":5,"wal-append.queue_time_us":542348,"wal-append.run_cpu_time_us":45377,"wal-append.run_wall_time_us":2220626}]]}
I20260709 13:10:57.193416 29287 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:57.194406 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 67308.8us
I20260709 13:10:57.198863 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:57.195294 30219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.021s	sys 0.077s
W20260709 13:10:57.218489 30219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.021s	sys 0.077s
I20260709 13:10:57.221787 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:57.244585 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.148943 30301 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.217418 30248 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:57.222386 30029 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.234957 30316 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:57.260489 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 174895us
W20260709 13:10:57.272383 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 329202us
W20260709 13:10:57.271718 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50004.9us
I20260709 13:10:57.276579 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:57.281728 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:57.286229 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:57.289086 23628 raft_consensus.cc:1240] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:57.250022 30299 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:57.333120 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 46984.4us
I20260709 13:10:57.335765 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:57.292641 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:57.287362 30207 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.278983 30307 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:57.392284 23624 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:57.332472 30252 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.286116 30029 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.389621 30316 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.329803 30258 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:10:57.414801 23769 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
W20260709 13:10:57.404302 30341 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:10:57.406780 30207 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.448812 30258 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:10:57.453594 30207 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.451400 30252 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:57.454319 30207 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:57.455425 30207 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:10:57.450907 30349 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:57.485486 30029 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:57.488873 30299 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:10:57.472873 30347 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:10:57.457281 30207 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:57.487607 30328 consensus_meta.cc:287] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.001s
W20260709 13:10:57.527654 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 243323us
I20260709 13:10:57.544559 30207 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:57.574512 29976 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.002s
I20260709 13:10:57.575172 29976 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.518178 30328 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:57.653493 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.673767 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 336422us
I20260709 13:10:57.674817 30252 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:57.677054 30252 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:57.678341 30252 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:57.678773 30252 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:57.679932 30252 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.681102 30252 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:57.703564 30271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.001s	sys 0.014s
W20260709 13:10:57.704751 30271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.001s	sys 0.014s
W20260709 13:10:57.707286 23742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.012s	sys 0.003s
W20260709 13:10:57.708009 23742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.012s	sys 0.003s
W20260709 13:10:57.708426 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 602461us
W20260709 13:10:57.708665 23744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.007s	sys 0.007s
I20260709 13:10:57.709321 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:10:57.709342 23744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.008s	sys 0.007s
I20260709 13:10:57.720850 23742 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:57.662453 30328 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:10:57.736325 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 443746us
I20260709 13:10:57.740015 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:10:57.716161 30125 consensus_meta.cc:287] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.002s
W20260709 13:10:57.709416 30220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.007s	sys 0.013s
W20260709 13:10:57.759945 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.769908 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49183.8us
I20260709 13:10:57.771692 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:57.725059 29976 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:57.780112 30061 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.725468 30029 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.784691 30354 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:57.786756 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 79575.5us
W20260709 13:10:57.766008 30220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.007s	sys 0.013s
W20260709 13:10:57.796151 23623 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.011s	sys 0.011s
W20260709 13:10:57.814267 23623 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.012s	sys 0.012s
I20260709 13:10:57.822965 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:57.785343 30366 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:10:57.793550 30198 consensus_meta.cc:287] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.007s
I20260709 13:10:57.828329 23770 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:57.829978 23771 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:57.831368 23773 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:10:57.838982 30365 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:57.815615 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3678) took 1120 ms. Trace:
I20260709 13:10:57.844727 30299 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 13:10:57.848385 30029 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.764729 30125 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:57.820750 29976 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.839617 30365 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:57.828402 30366 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:57.857416 30354 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:57.858246 30354 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:57.846019 23623 rpcz_store.cc:276] 0709 13:10:56.695642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.695796 (+   154us) service_pool.cc:224] Handling call
0709 13:10:56.696196 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.696457 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:56.979950 (+283493us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.815048 (+835098us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.815200 (+   152us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:57.815313 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.815389 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.815547 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12742,"prepare.queue_time_us":147047,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":122772,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5635,"thread_start_us":1100983,"threads_started":3}
I20260709 13:10:57.868395 30365 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:57.870234 30365 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.393117 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:57.874603 24391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 1035) took 1080 ms. Trace:
I20260709 13:10:57.876034 23769 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:57.866940 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:57.875100 24391 rpcz_store.cc:276] 0709 13:10:56.794489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.794622 (+   133us) service_pool.cc:224] Handling call
0709 13:10:56.817807 (+ 23185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.818231 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.818271 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.829759 (+ 11488us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.878083 (+ 48324us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b1800174c40. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e201e07 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b 00007f2b40eabd23 00007f2b40eac0d1 00007f2b412c7a0f
0709 13:10:57.224209 (+346126us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:57.224270 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.224362 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.863796 (+639434us) raft_consensus.cc:1685] finished
0709 13:10:57.863817 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.874519 (+ 10702us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1343,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":9533,"spinlock_wait_cycles":20697472,"thread_start_us":345866,"threads_started":1,"wal-append.queue_time_us":976721}
I20260709 13:10:57.876662 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3677) took 1181 ms. Trace:
I20260709 13:10:57.880816 23627 rpcz_store.cc:276] 0709 13:10:56.695340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.696204 (+   864us) service_pool.cc:224] Handling call
0709 13:10:56.696543 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.824621 (+128078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.824666 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.825251 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.337197 (+511946us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:57.392594 (+ 55397us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.393667 (+  1073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.864665 (+470998us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54003250d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:57.864712 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.864764 (+    52us) raft_consensus.cc:1685] finished
0709 13:10:57.876426 (+ 11662us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.876596 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":807,"prepare.queue_time_us":60915,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":7509,"spinlock_wait_cycles":297354368,"thread_start_us":448004,"threads_started":1,"wal-append.queue_time_us":920784}
I20260709 13:10:57.855651 30366 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:58.146201 30366 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:58.146418 30354 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:58.144744 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 404813us
I20260709 13:10:58.145699 30125 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.140317 30317 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:58.155177 30357 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.155378 30366 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.155999 30357 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.156910 30366 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.159741 30357 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:58.161320 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2622) took 1196 ms. Trace:
I20260709 13:10:58.153968 30312 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.165246 30312 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.162777 30317 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.170527 30317 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.162664 23626 rpcz_store.cc:276] 0709 13:10:56.964763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.183389 (+218626us) service_pool.cc:224] Handling call
0709 13:10:57.183717 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.197357 (+ 13640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.197385 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.197425 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:57.197451 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.161086 (+963635us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b540001d6d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:58.161135 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.161265 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30889728}
I20260709 13:10:58.144666 30029 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:58.167552 30312 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.143190 29976 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:10:58.172910 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.162232 30368 log.cc:927] Time spent T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.378s	user 0.015s	sys 0.047s
I20260709 13:10:58.184203 30248 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.177151 30129 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.182332 30306 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:58.171969 30029 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:58.164353 30343 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.372s	user 0.001s	sys 0.008s
I20260709 13:10:58.186069 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:58.187008 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2603) took 1282 ms. Trace:
I20260709 13:10:58.188751 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:58.193286 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:58.192764 23620 rpcz_store.cc:276] 0709 13:10:56.904983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.938368 (+ 33385us) service_pool.cc:224] Handling call
0709 13:10:57.005857 (+ 67489us) spinlock_profiling.cc:243] Waited 903 us on lock 0x7b5800010598. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7eee 0000000000375939 00007f2b4625b1e0 00007f2b463240c4 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:10:57.166264 (+160407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.166972 (+   708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.186809 (+1019837us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002b5a50. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:58.186945 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370587648}
I20260709 13:10:58.196216 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:58.197666 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:58.197389 23777 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.197942 23628 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:58.199088 23626 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:10:58.199397 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.185321 30248 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.188129 30291 raft_consensus.cc:3055] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:58.190848 30370 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:10:58.204095 23773 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:58.204643 23771 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:58.206331 23669 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:58.189958 30306 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:58.200507 30271 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.200838 30252 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.215055 30354 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:58.215670 30354 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.215915 30323 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:10:58.216320 30029 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.205014 30291 raft_consensus.cc:740] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:58.217849 30354 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.218590 30291 consensus_queue.cc:260] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.219954 30291 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.212916 30253 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:58.214272 30252 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.227233 30252 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.213423 30271 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.210340 30328 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:58.192397 30129 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.228382 30306 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.242837 30354 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:10:58.251549 30306 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:58.211031 30312 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:10:58.233238 30371 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:58.268018 23625 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20. Ops: []
W20260709 13:10:58.269972 23629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 3684) took 1554 ms (client timeout 1862 ms). Trace:
W20260709 13:10:58.271368 23629 rpcz_store.cc:269] 0709 13:10:56.713196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.714619 (+  1423us) service_pool.cc:224] Handling call
0709 13:10:58.267559 (+1552940us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54003241d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:58.267809 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723586304}
I20260709 13:10:58.276224 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:58.265638 30266 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.235709 30253 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:10:58.234351 30328 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.275305 30354 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:10:58.262239 30372 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
W20260709 13:10:58.295760 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.304539 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2612) took 1342 ms. Trace:
I20260709 13:10:58.305039 23624 rpcz_store.cc:276] 0709 13:10:56.961742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.988728 (+ 26986us) service_pool.cc:224] Handling call
0709 13:10:56.989036 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.392878 (+403842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.304259 (+911381us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540012dc54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:10:58.304473 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923367808}
I20260709 13:10:58.288580 30301 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:58.308250 30207 consensus_meta.cc:287] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.008s
I20260709 13:10:58.356774 30207 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.357354 30207 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.289193 30370 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:10:58.318313 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2621) took 1353 ms. Trace:
I20260709 13:10:58.320552 29214 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:58.308285 30324 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.339291 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:58.341241 30258 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:58.313548 30366 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:58.352196 30253 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.353161 30129 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.354395 30328 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:58.418308 23592 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:58.305838 30356 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:58.419690 30307 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:58.419919 30356 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.420320 30307 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.422463 30356 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.422623 30307 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.360069 23625 rpcz_store.cc:276] 0709 13:10:56.964463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.063153 (+ 98690us) service_pool.cc:224] Handling call
0709 13:10:58.267766 (+1204613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.271382 (+  3616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.318080 (+ 46698us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003241d0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130b8ad 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:10:58.318242 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2769561856}
I20260709 13:10:58.295451 30266 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.361614 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:58.425665 30266 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:58.309316 30371 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:58.365729 23772 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.426456 30371 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:58.427430 30371 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.428812 30371 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.366371 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:58.367033 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:58.371610 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:58.377332 30258 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:58.433393 23627 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:58.434314 30258 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:58.435812 30258 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.436756 23772 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:10:58.438635 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:58.440961 30354 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:58.441576 30354 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:58.377581 30324 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.378189 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:58.446762 24388 raft_consensus.cc:2410] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:10:58.363767 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:58.449450 23769 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:58.400926 30376 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.401350 30135 consensus_queue.cc:1059] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:58.404294 30271 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.404879 30253 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.461558 30315 raft_consensus.cc:3055] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:58.462044 30315 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:58.461656 30376 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.314319 30372 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:58.390149 30366 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:58.409485 30365 consensus_meta.cc:287] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.539s	user 0.003s	sys 0.008s
I20260709 13:10:58.413800 30051 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:58.420538 30099 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:58.397650 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:10:58.457446 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 85997.1us
I20260709 13:10:58.359627 30207 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.442696 30354 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:58.464860 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 233575us
I20260709 13:10:58.494225 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:58.499198 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.475695 23769 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:10:58.462992 30315 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.463902 30372 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.462971 30253 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.491856 30051 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.503638 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:58.503808 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:58.504320 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:58.506234 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:58.477569 30306 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:58.510425 30306 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.512116 23627 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:58.511714 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:58.513643 30252 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.513845 30306 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.517861 30252 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:58.518997 30271 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:58.519537 30271 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:58.520797 30271 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.527923 23624 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 19: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:10:58.524318 23743 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:58.530622 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:58.522614 30207 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:58.536516 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:58.481952 30324 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:58.505939 30305 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:58.522830 30350 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:58.507617 30061 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:58.522230 30271 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:58.523742 30356 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.532119 30366 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.532351 30099 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:58.536044 30323 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:58.558163 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.559767 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.535974 30307 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:58.542230 30328 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:58.545300 30373 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:58.583904 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 334993us
I20260709 13:10:58.534574 30129 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:10:58.587843 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.588338 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.600154 23769 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:10:58.600850 23775 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:58.589416 23592 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:58.602311 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:58.602520 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.603318 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:58.603193 23775 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:10:58.580601 30323 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:58.581125 30362 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:58.584225 30328 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:10:58.607906 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 216765us
I20260709 13:10:58.609246 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.609802 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.601662 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.611445 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:58.612839 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.605983 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.631289 23775 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 21: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:58.559654 30305 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.633268 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.634754 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:58.574275 30061 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.639757 30051 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.607849 30376 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.640273 30099 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.643684 24359 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:58.585925 30307 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.596772 30373 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.612432 30361 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.580252 30356 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.606532 30306 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:58.657572 24385 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:58.596401 30366 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.613278 30323 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:58.616353 30117 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:58.606835 30280 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:58.706398 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:58.659001 30302 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.711002 30372 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:58.711980 30378 log.cc:927] Time spent T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:10:58.712208 30357 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:58.718406 30253 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:58.666152 30051 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:58.666069 30286 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:58.723327 30106 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:58.638440 30328 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:58.731119 23776 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:58.741935 30379 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.742976 30376 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:58.779553 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 167100us
W20260709 13:10:58.754595 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 117243us
W20260709 13:10:58.780984 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.774022 30253 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.617168 30248 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:58.765836 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.792228 24392 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:58.731184 30306 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:58.764490 30302 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.796977 30061 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.796254 30306 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.632917 30362 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:10:58.797595 30302 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:58.775959 30051 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.799086 30362 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:58.800474 30356 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:58.731453 30366 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.802487 30366 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.763439 30280 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:10:58.765269 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 60458.2us
I20260709 13:10:58.804097 30125 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:58.804879 30377 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:58.804672 30125 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.805285 30377 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:58.769464 30372 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:58.805949 30372 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.806958 30125 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.807811 30373 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:58.795810 30307 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.809538 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:58.810755 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:58.811785 24357 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:58.804488 30280 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.792316 30291 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:10:58.744199 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:58.754256 30117 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:58.825955 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 81880.5us
I20260709 13:10:58.828989 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.819460 30248 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.832631 24391 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:58.782326 30379 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.833609 23778 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:58.829643 23773 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:10:58.836128 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.778853 30106 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.820734 30372 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.824673 30289 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:58.844401 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.843189 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:58.838161 30366 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:58.829993 30291 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.865471 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:58.872089 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:58.851738 30051 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.885900 30323 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.874662 30253 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.876456 30354 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.860401 30372 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:10:58.862670 30366 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:10:58.880913 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.873435 30106 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.895839 23769 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:58.890010 30305 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.894290 30366 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.908980 30379 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.910370 30117 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.912681 30366 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.913779 30377 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:58.929142 30377 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.929425 30323 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:58.927650 30328 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:58.915938 30291 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.918866 30315 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.932950 30366 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:58.933418 30328 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:58.979586 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:58.996760 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:58.998811 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:59.005568 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:59.007699 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.013911 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.014149 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:59.015973 23696 raft_consensus.cc:2410] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:10:59.016665 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:59.012861 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.020794 23697 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:10:59.023808 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.025063 23695 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:10:59.026726 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.031810 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:59.038033 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.041981 23699 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:59.042582 23702 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:59.043627 23697 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:59.046712 23704 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:59.063323 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.063922 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:59.065066 23770 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 20: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:59.040844 23696 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:59.071306 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.072822 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.075029 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:59.048312 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.050616 23703 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:59.047974 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.055274 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.076656 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.062639 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.077781 23624 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:10:59.078146 23702 raft_consensus.cc:2410] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:10:59.064815 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.078951 23623 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:59.079180 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.077737 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.080068 23702 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:10:59.080752 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.081043 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:59.081944 23702 raft_consensus.cc:2410] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:10:59.061625 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:59.076817 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.086707 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.087539 23703 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:59.088606 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.077718 23695 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:59.089910 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.090703 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:59.079969 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.092163 23695 raft_consensus.cc:2410] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:10:59.092532 23771 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:59.052332 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.093731 23699 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:10:59.094352 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.094681 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.095919 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:59.096692 23625 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:59.096801 23667 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:59.100077 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.082816 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:59.101876 23699 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:10:59.100302 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:59.091439 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.101676 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.103986 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.104944 23775 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 19: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:59.103420 23699 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:59.099537 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:59.103353 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.106926 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.108043 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:59.104157 23623 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:59.101717 23702 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:59.127655 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:59.127933 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:59.129367 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:10:59.108570 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:59.127717 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:59.141201 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.141383 23625 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:59.145491 23775 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:59.148034 23774 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 10: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:59.151917 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.154582 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.160393 30354 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.168529 30354 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.171164 30300 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:59.171808 30370 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:59.172749 30366 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:59.175369 30371 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.175896 30258 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:59.168563 30350 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.176185 30305 consensus_queue.cc:1059] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:59.156795 23696 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:10:59.181241 29976 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.184301 30099 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.186430 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 78402.5us
I20260709 13:10:59.193097 23704 raft_consensus.cc:2410] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:10:59.213879 23702 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:10:59.227133 30305 raft_consensus.cc:3055] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:59.227664 30305 raft_consensus.cc:740] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:10:59.229103 30305 consensus_queue.cc:260] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:59.230722 30305 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:59.193940 30029 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.210683 30370 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:59.232115 30370 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:59.231949 30258 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:59.235893 30099 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:59.238348 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.238982 29976 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.241832 29976 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:59.242508 23743 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:59.246394 24358 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:59.247208 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:59.246477 23519 catalog_manager.cc:5697] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 13 to 20, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 20 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:59.248768 29214 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:10:59.249229 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.249466 29214 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:59.250800 23519 catalog_manager.cc:5697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 11 to 12, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 12 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:10:59.252341 30280 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.253314 30271 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:59.254030 30271 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:59.254478 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.255892 30106 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:59.256821 29214 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:59.256354 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.257620 23627 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:10:59.258090 23704 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:10:59.258461 23704 pending_rounds.cc:85] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 7
I20260709 13:10:59.258739 23704 pending_rounds.cc:107] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:10:59.259171 23704 raft_consensus.cc:2889] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:59.256090 23519 catalog_manager.cc:5697] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 6 to 10, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 10 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:59.260557 23519 catalog_manager.cc:5697] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 9 to 20, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 20 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.191672 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:59.264074 30300 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.266502 30291 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:59.266944 30291 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:59.264730 30299 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.267922 30300 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:59.270640 30286 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:59.272157 23775 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:59.275293 30099 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:59.272255 23519 catalog_manager.cc:5697] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 14 to 15, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 15 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.276510 30258 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:59.285761 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:10:59.221274 23698 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:10:59.194293 30354 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:59.291364 23701 raft_consensus.cc:1240] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: [13.9-15.10]
W20260709 13:10:59.293677 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 102260us
I20260709 13:10:59.294029 23623 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:59.296236 23700 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:10:59.296160 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 71875.5us
I20260709 13:10:59.302759 23626 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:10:59.309402 23704 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:59.318795 24385 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:10:59.321914 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.323159 23624 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
W20260709 13:10:59.324793 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 74724.6us
I20260709 13:10:59.335760 23697 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 10.
I20260709 13:10:59.336797 23702 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:59.329767 23695 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:59.292273 30029 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:10:59.343679 30271 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:59.344296 29976 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:59.345180 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:59.347271 23776 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:59.347898 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:59.405249 23593 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.980s (SENT) [suppressed 3 similar messages]
I20260709 13:10:59.348009 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:59.353938 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.355127 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.355506 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.420418 30370 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.362462 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.381886 30291 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.256645 30106 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:59.387267 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:10:59.425356 23696 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:59.389882 23622 raft_consensus.cc:1240] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:59.392546 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 95046.4us
I20260709 13:10:59.405634 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.426635 23698 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:59.409739 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:10:59.400482 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.416694 30029 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:59.389307 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:59.429791 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:10:59.418622 29976 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.453727 30061 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.454061 23629 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:10:59.437516 23519 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 8 to 9, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 9 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:59.458305 30286 consensus_queue.cc:1059] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:59.462020 30286 raft_consensus.cc:3055] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:59.462646 30286 raft_consensus.cc:740] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:59.465291 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.466526 23621 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
W20260709 13:10:59.472836 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.476002 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 87008.6us
W20260709 13:10:59.476678 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.480099 30029 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:10:59.480901 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet d5fa82982f53411c84a07a2fb3918888 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:57370
I20260709 13:10:59.476372 30371 raft_consensus.cc:2764] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:10:59.481945 30408 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:10:59.484330 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 136620us
I20260709 13:10:59.485837 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:10:59.489580 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44749.5us
W20260709 13:10:59.492348 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.497303 30370 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:59.499825 30291 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:59.500568 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:10:59.503835 30397 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:59.504297 30397 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:10:59.504693 30397 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:59.515399 23743 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:59.450987 29976 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:59.521694 30029 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:10:59.569448 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 163919us
I20260709 13:10:59.571096 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:10:59.573285 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.574141 30286 consensus_queue.cc:260] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:59.575801 30286 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:59.576030 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 60811.1us
I20260709 13:10:59.576938 23743 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:59.577454 30106 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:10:59.579911 30315 consensus_queue.cc:1175] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9ab488f10c434878a749f261e99a8065" responder_term: 17 status { last_received { term: 16 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:59.584148 30029 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:59.584841 30029 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:59.586011 30029 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.588097 23623 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:10:59.586855 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:59.599020 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.599825 23621 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
W20260709 13:10:59.607549 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 121997us
I20260709 13:10:59.610411 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.600610 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:10:59.620397 23771 raft_consensus.cc:606] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
W20260709 13:10:59.621387 23511 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 334c9018414947cabb4405ef47b8018e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4466bf6d6cf84ee89e84ea074e3964c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:10:59.622615 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.624001 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.624351 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:59.624938 23526 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52058 (request call id 190) took 69784 ms (client timeout 15000 ms). Trace:
I20260709 13:10:59.625124 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:59.625636 30356 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:10:59.625432 23526 rpcz_store.cc:269] 0709 13:09:49.732954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.101901 (+1368947us) service_pool.cc:224] Handling call
0709 13:10:59.510105 (+68408204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2098677,"reported_tablets":51}
I20260709 13:10:59.626088 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:59.626318 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.627170 30129 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:59.627319 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:10:59.627825 30129 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:59.626392 30356 raft_consensus.cc:697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:10:59.624548 23627 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:59.623430 23743 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:10:59.633838 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.633216 30258 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:59.604921 30350 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:10:59.645541 23771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
W20260709 13:10:59.655069 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 47706.3us
I20260709 13:10:59.660890 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.659049 23771 raft_consensus.cc:606] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:10:59.669509 23773 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:59.670574 23771 raft_consensus.cc:614] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:59.666815 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:59.677908 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:59.678795 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:59.680565 30125 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:59.635643 30371 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:10:59.685949 23776 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:59.689267 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:10:59.689401 30328 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.693866 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet d5fa82982f53411c84a07a2fb3918888 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:10:59.694844 30377 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:59.695134 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 87791.4us
I20260709 13:10:59.696444 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:59.682760 30125 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.708593 30258 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:59.712860 30258 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:59.714871 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:10:59.718964 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.721197 23771 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:59.706756 30350 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:59.722929 23773 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:59.714134 30125 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:59.726719 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.717120 30258 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:59.735702 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 61384.5us
I20260709 13:10:59.736272 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:59.748867 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.749076 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:10:59.726434 30356 consensus_queue.cc:237] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:10:59.752127 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 46219us
I20260709 13:10:59.753058 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:10:59.754124 30350 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:59.755051 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:59.756057 30266 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.756611 30266 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.757943 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:59.747025 30328 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.691886 30129 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.765064 30029 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:59.765619 30029 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:59.766002 30029 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:59.766062 30400 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:10:59.767913 30312 raft_consensus.cc:993] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:59.768440 30312 raft_consensus.cc:1081] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:10:59.768833 30266 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:59.779408 30365 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:59.780226 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:59.783120 30354 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:59.783597 30354 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:10:59.762928 29976 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.785075 23776 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:10:59.786087 29976 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:59.789620 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:59.790275 23627 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:59.795985 30252 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:59.796640 30252 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:10:59.797149 30252 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:59.762799 30350 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:59.803439 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:10:59.804527 23625 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:10:59.806397 23774 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:59.808178 30299 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.808838 30299 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.810376 30029 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.811367 30299 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:10:59.811930 30350 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:59.812695 30350 consensus_queue.cc:1243] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:10:59.838500 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 58465us
I20260709 13:10:59.765798 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:10:59.814527 30099 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:59.844744 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 86876.8us
I20260709 13:10:59.845660 30397 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:59.848409 23627 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:10:59.849013 23743 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:59.862115 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50278us
W20260709 13:10:59.868144 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54198.8us
I20260709 13:10:59.863888 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:59.920933 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 57187.2us
I20260709 13:10:59.872253 30061 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:59.917300 24359 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:10:59.918933 30029 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:59.870427 23743 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:10:59.924350 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 158686us
I20260709 13:10:59.929423 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:10:59.930517 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.932953 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 62634.5us
I20260709 13:10:59.935842 30299 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:59.936887 24386 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:59.939231 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:10:59.940133 30354 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.931134 30252 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.935632 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:10:59.954104 30397 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:10:59.932049 30366 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.964275 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:10:59.968869 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.955176 30125 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.951303 30258 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:10:59.944322 30029 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:59.944573 30061 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:59.955336 30366 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:10:59.977041 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44629.7us
I20260709 13:10:59.972126 30129 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:59.985853 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.990778 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45393.4us
I20260709 13:10:59.991499 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:10:59.977125 30305 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:59.980103 30315 raft_consensus.cc:2804] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:59.994237 30315 raft_consensus.cc:697] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:10:59.997521 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:00.001771 30357 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:00.002326 30357 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.002682 30357 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:59.979447 30061 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:11:00.005710 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 76324.6us
W20260709 13:11:00.008792 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 141125us
I20260709 13:10:59.995323 30315 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:10:59.986651 30354 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:59.986488 30029 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:00.016717 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:00.018844 23627 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.017736 23593 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:10:59.992189 30299 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:00.025631 30252 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.027220 30029 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.028115 30366 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.013423 30061 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:00.040648 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44306.6us
W20260709 13:11:00.041074 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49613.2us
I20260709 13:11:00.033141 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:00.020421 30106 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:00.053681 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:00.054720 30431 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.043857 30099 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:00.059290 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:00.060173 30099 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:00.062239 30099 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:00.023201 30377 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:11:00.066920 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:00.068359 30291 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:00.068818 30291 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:00.069772 30291 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:00.070998 30291 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.076531 30125 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:00.076870 30106 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:00.055289 30431 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:00.088425 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 43750.1us
I20260709 13:11:00.089795 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:00.091820 30323 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:00.092396 30323 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:00.092602 30258 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.093628 30323 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.096614 30312 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:00.097353 30431 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:00.097559 30328 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:00.097412 30312 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:00.099522 30312 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.098165 23742 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:00.110227 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:00.111109 23778 raft_consensus.cc:2368] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22.
I20260709 13:11:00.112784 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:00.113483 23626 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:00.116478 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.141902 23626 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
I20260709 13:11:00.142786 23627 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 20.
I20260709 13:11:00.149319 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:00.149397 30125 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:00.152268 23743 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:00.152896 30125 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:00.159312 23667 leader_election.cc:400] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22.
I20260709 13:11:00.159812 23667 leader_election.cc:403] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:11:00.161804 30402 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:00.162505 30402 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:00.158329 30328 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:00.164268 30328 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:00.165196 30357 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.165318 30328 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.168855 30125 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:00.163534 30402 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:00.176239 30350 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:00.180042 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 82040.3us
W20260709 13:11:00.180104 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 130036us
W20260709 13:11:00.232647 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.156270 30305 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:00.254551 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:00.250286 30357 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:00.268822 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 187721us
I20260709 13:11:00.271401 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:00.235399 30061 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:00.280045 23774 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:00.283175 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:00.284895 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:00.285518 30099 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.286912 23627 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.265928 30431 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:00.308506 23627 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:00.307585 30099 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.273201 30366 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.264894 30305 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:11:00.334887 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 61799.6us
I20260709 13:11:00.345302 23620 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:00.346871 23743 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:00.326493 30357 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:00.350236 23629 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:00.352623 30431 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:00.352806 30357 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:00.353479 30431 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:00.353607 30357 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.354717 30431 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.326745 30356 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:00.341171 30354 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:00.368136 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 83406.9us
I20260709 13:11:00.366088 30252 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.350757 30370 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:11:00.360170 30356 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:00.346469 30366 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:00.414805 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 147718us
W20260709 13:11:00.420910 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.432868 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:00.391121 30305 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:11:00.392805 30266 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:11:00.458461 30106 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:00.476629 30061 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:00.407522 30402 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:00.408855 30356 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:00.391352 30354 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.408352 30029 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:11:00.446482 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:00.447517 30312 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:00.448768 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.449204 30439 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:00.450241 30350 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22.
W20260709 13:11:00.499953 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54444.5us
I20260709 13:11:00.425743 30252 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:00.524860 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 153924us
I20260709 13:11:00.504838 30312 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:00.529138 23774 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:00.533056 23704 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:00.539281 30106 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:00.523561 30440 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:00.505470 30402 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:00.549024 30366 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.549611 30402 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.551146 30354 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.556790 30129 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:00.557399 30129 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.559399 23625 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:11:00.561306 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 114951us
I20260709 13:11:00.564783 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:00.566758 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 122817us
I20260709 13:11:00.533056 30312 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:00.576719 23774 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:00.573411 30436 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:11:00.573472 30384 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:00.574654 30129 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.575210 23704 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:11:00.571381 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:00.561031 30440 raft_consensus.cc:697] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:00.608433 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:00.612673 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:00.614406 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:00.618798 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:00.622586 24358 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:00.616714 23701 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:00.629935 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:00.630461 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:00.606593 30129 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:00.633937 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:00.635008 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:00.635270 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:00.636226 23698 raft_consensus.cc:2410] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:11:00.603767 30029 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:11:00.628008 30061 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:00.642854 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 64640.3us
I20260709 13:11:00.606276 30395 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:11:00.646726 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:00.644325 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:00.648447 23703 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.634627 23695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:11:00.649781 23695 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.650188 23695 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.646246 30440 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:00.658018 30299 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:00.658412 30299 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:00.644009 30371 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:00.662763 30450 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:11:00.640345 30449 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:11:00.667977 30248 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:00.668504 30248 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:00.668951 30248 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:00.675007 30291 consensus_meta.cc:287] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.604s	user 0.012s	sys 0.001s
I20260709 13:11:00.651022 30129 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:00.700316 23695 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.702898 23699 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:00.704459 30455 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:00.704870 30252 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.705070 30455 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:00.647454 30061 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:00.714417 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 79230.6us
I20260709 13:11:00.726383 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.728274 23703 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
W20260709 13:11:00.729204 23511 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 334c9018414947cabb4405ef47b8018e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4466bf6d6cf84ee89e84ea074e3964c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:00.659322 30299 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:00.760372 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.761077 30299 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.762408 30029 raft_consensus.cc:2955] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 5 to 12, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:00.735955 30357 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:00.768919 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:00.769692 30357 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:00.770388 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:00.771376 23772 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:00.772224 23775 raft_consensus.cc:3060] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.772344 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:00.772500 30395 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:00.772955 23778 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:11:00.773159 30395 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:00.737111 30356 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.776860 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.777410 30356 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:00.723994 30455 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:00.778030 23667 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:00.744772 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:00.779696 30459 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.780072 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:00.743516 30061 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:00.749946 30315 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:00.783165 30315 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:00.784195 30315 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:00.785539 30315 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:00.788017 30099 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:00.788861 30099 consensus_queue.cc:1059] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:00.771618 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:00.790428 30305 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:00.751943 23626 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:11:00.790915 30305 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:00.755864 30266 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:00.756407 23625 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:00.732543 30135 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:00.763933 30350 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:00.766474 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:00.766716 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:00.801147 23776 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:11:00.766974 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:00.775593 30395 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.798756 30366 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:00.798842 30354 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:00.791814 30305 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.807087 30305 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:00.801214 23769 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:00.810536 30252 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:00.811197 30252 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.811762 30459 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:00.812438 30135 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:00.813876 30402 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:00.814446 30402 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:00.815653 30350 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.816526 30402 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:00.817287 30252 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.817047 30421 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:00.791853 30266 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.817487 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:00.815835 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:00.831557 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.818011 23667 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:00.818608 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:00.814630 30135 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:00.820796 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:00.831513 24391 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:00.821120 23775 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:00.827698 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:00.833585 23769 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:11:00.824529 23695 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.817818 30350 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:00.849964 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:00.830330 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 60066us
I20260709 13:11:00.846426 23625 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:00.846964 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:00.847488 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:00.848570 23776 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:00.827497 30395 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:00.851905 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:00.852411 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.852610 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:00.856878 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:00.875965 23771 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:00.876344 23771 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:00.876133 23702 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:11:00.877496 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:00.878322 23702 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:00.861460 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.863833 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:00.865511 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:00.880775 23703 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:11:00.881492 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:00.818418 30258 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:00.868054 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:00.877861 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:00.882038 23703 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:00.883095 23774 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 21: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:00.880156 23699 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:11:00.867190 23704 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:00.884716 23702 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:11:00.885082 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45341.5us
I20260709 13:11:00.884758 23771 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:00.817878 30455 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:11:00.882763 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:00.933683 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:00.933856 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:00.934947 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:00.935926 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.890247 23625 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:11:00.908480 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.911819 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.905663 30397 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:00.901826 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.939445 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.890690 30258 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.942833 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.875027 30366 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:00.943351 23624 raft_consensus.cc:2368] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22.
I20260709 13:11:00.889184 30129 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:00.944962 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 67163.2us
W20260709 13:11:00.940079 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 57407us
I20260709 13:11:00.947032 23778 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:00.946771 23621 raft_consensus.cc:2368] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:11:00.952409 23771 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.953192 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:00.956807 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:00.957541 23627 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.958503 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:00.967360 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:00.934525 30350 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:00.946261 30395 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:00.981438 23620 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:00.954275 30258 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.947072 30377 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:00.982354 23626 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:00.949324 30125 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:00.953496 30129 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.000646 23621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:46526
I20260709 13:11:01.001626 23621 raft_consensus.cc:606] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
W20260709 13:11:01.006343 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 46845.5us
I20260709 13:11:01.017584 23627 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:00.982995 30395 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:01.020736 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:00.973461 30459 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:11:00.988296 30377 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.996995 30129 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.967176 30312 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.053113 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:00.982021 30350 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:01.055353 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 59263.7us
I20260709 13:11:00.979352 30366 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.045495 30395 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:01.056469 30099 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:01.045045 30365 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.051605 30377 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:01.139273 30462 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:11:01.143821 30473 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:01.144491 30452 log.cc:927] Time spent T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:11:01.124246 30328 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:01.123939 30029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49186 (request call id 0) took 2887 ms. Trace:
W20260709 13:11:01.163856 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.233381 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 350376us
W20260709 13:11:01.245997 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 205406us
I20260709 13:11:01.135324 30448 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.158s
I20260709 13:11:01.007102 30356 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:11:01.324451 23773 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:01.326381 23771 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:01.136471 30458 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.347898 30299 consensus_meta.cc:287] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.586s	user 0.017s	sys 0.017s
I20260709 13:11:01.368705 23625 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:01.370769 30473 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.374110 30370 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.374818 30370 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
W20260709 13:11:01.344405 30315 consensus_meta.cc:287] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.012s
I20260709 13:11:01.390970 30266 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:01.392185 30312 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:01.393736 30370 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:11:01.383929 30458 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.332135 30365 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.398252 30458 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:01.371337 30473 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.400722 30473 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:01.354871 30248 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.009s
I20260709 13:11:01.440974 30441 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:01.441581 30441 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:11:01.442085 30466 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:11:01.442490 30441 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.443490 30485 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:11:01.430266 30266 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:11:01.451123 30258 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.348771 30029 rpcz_store.cc:276] 0709 13:10:58.188385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.189087 (+   702us) service_pool.cc:224] Handling call
0709 13:10:58.205091 (+ 16004us) log.cc:844] Serialized 494 byte log entry
0709 13:10:58.410983 (+205892us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b540027bda0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4128cb26 00007f2b4128649a 00007f2b41285714 00007f2b41265eaa 00007f2b4126cd53 00007f2b4126ccd9 00007f2b4126cc69 00007f2b4126cc31 00007f2b4126bdfd 000000000038f354
0709 13:11:01.060107 (+2649124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52435,"raft.queue_time_us":9933,"raft.run_cpu_time_us":3772,"raft.run_wall_time_us":149726,"spinlock_wait_cycles":16746368,"thread_start_us":83003,"threads_started":1,"wal-append.queue_time_us":131138,"wal-append.run_cpu_time_us":2100,"wal-append.run_wall_time_us":1002842}
I20260709 13:11:01.398280 30365 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:01.453924 30258 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:01.454341 30377 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.458392 30377 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:01.401607 30248 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:01.465016 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:01.395341 30395 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:01.470219 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.462343 30441 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:01.471814 24388 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:01.477823 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:01.481089 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:01.482066 30356 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:01.487388 24385 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:01.473160 30350 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:01.474076 30485 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:11:01.526423 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 169510us
I20260709 13:11:01.513296 30029 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:01.527259 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:01.528854 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:01.532123 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:01.536628 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 182158us
I20260709 13:11:01.544710 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:01.550427 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:01.530503 30029 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:01.549803 30421 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:01.558707 30305 consensus_meta.cc:287] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.749s	user 0.013s	sys 0.025s
I20260709 13:11:01.553858 30484 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:01.569538 30402 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:01.710418 24392 raft_consensus.cc:1275] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:01.581159 30366 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:01.625154 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 87781.9us
I20260709 13:11:01.583808 30493 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:01.625394 30480 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:01.685361 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 135019us
I20260709 13:11:01.687849 30248 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:01.688797 23524 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 13 to 14, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 14 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:01.690968 24391 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:01.693038 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:01.553422 30495 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.686417 30487 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:01.706431 30503 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:01.708830 30421 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:01.706614 30029 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:01.716454 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:01.727476 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:01.724946 30503 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:01.749636 30371 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:01.750597 23626 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:11:01.712047 30402 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:01.752178 30135 raft_consensus.cc:3055] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:01.726071 29976 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:11:01.719259 30495 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:01.753127 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:01.753974 30441 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:01.726622 30356 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:11:01.709923 30484 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:01.777098 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:01.777886 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 61562.9us
W20260709 13:11:01.782804 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 57706.2us
I20260709 13:11:01.772156 30421 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:01.780521 30402 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.789650 23669 leader_election.cc:400] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22.
W20260709 13:11:01.786044 30129 consensus_meta.cc:287] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.725s	user 0.011s	sys 0.010s
I20260709 13:11:01.791849 30305 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.795934 30129 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.796084 30305 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:01.798132 30305 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:01.798766 30312 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:01.799417 30312 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.800007 30475 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:01.800100 30431 consensus_queue.cc:1048] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:11:01.800695 30475 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.802209 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:01.792610 30499 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:01.802914 30499 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:01.803567 30497 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.780961 30135 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:01.804143 30497 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:01.804736 30135 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:01.806056 30135 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:01.810133 30499 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:01.787904 30484 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.812119 30499 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:01.813206 29976 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.813740 29976 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.820825 23669 leader_election.cc:400] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:11:01.821241 23669 leader_election.cc:403] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:11:01.822203 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:01.822332 30366 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.823623 30350 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:01.824313 30350 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:01.825325 30350 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:01.828079 23775 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:01.829311 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:01.830019 23620 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:01.831923 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:01.836750 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:01.836982 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:01.837989 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:01.838228 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:01.839227 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:01.841898 30468 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.842525 30468 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:01.844945 30455 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.854478 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:01.858307 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:01.855325 23620 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:01.788367 30498 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:01.864171 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:01.845570 30455 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:01.928035 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:01.930182 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:01.932726 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:01.930821 23777 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:01.941045 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:01.949863 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:01.952036 23777 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:01.951107 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:01.954344 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:01.957202 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:01.957798 30029 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:01.978022 23623 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
I20260709 13:11:01.977761 23625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2662) took 1097 ms. Trace:
I20260709 13:11:01.979102 23625 rpcz_store.cc:276] 0709 13:11:00.880348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.941286 (+ 60938us) service_pool.cc:224] Handling call
0709 13:11:00.946399 (+  5113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.369103 (+422704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.977469 (+608366us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b540012c354. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:01.977689 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970170240}
W20260709 13:11:01.984581 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.984813 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:01.986907 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:01.988696 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:01.989415 23624 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
W20260709 13:11:01.990418 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 127985us
I20260709 13:11:02.000532 30305 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:02.001081 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:02.001196 30305 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.002732 23622 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:02.003616 30305 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.010687 30503 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:02.013712 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:02.021073 23771 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:02.018450 30507 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:02.014930 30354 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:02.035650 30354 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.037849 30377 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:02.037937 30354 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.038542 30377 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.040609 30377 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.041091 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:02.041479 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:02.042330 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:11:02.042966 23769 raft_consensus.cc:606] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:02.043336 23769 raft_consensus.cc:614] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:02.033816 23511 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d67625249f734ae3b71d554b7a2ba33b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:11:02.044718 23511 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 334c9018414947cabb4405ef47b8018e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4466bf6d6cf84ee89e84ea074e3964c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:02.045188 30501 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.045290 30061 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:02.045931 30061 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.048949 30061 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:02.049073 30371 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:02.053246 23773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:11:02.054064 23773 raft_consensus.cc:606] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:02.013341 30366 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:11:02.087579 23773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:11:02.088325 23773 raft_consensus.cc:606] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:02.088773 23773 raft_consensus.cc:614] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:02.093259 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:02.095544 23627 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:11:02.023442 30467 log.cc:927] Time spent T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.021s	user 0.006s	sys 0.000s
I20260709 13:11:02.031653 30487 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.007556 30421 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.128409 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:02.056561 30299 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:11:02.133805 23622 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
W20260709 13:11:02.131502 30515 log.cc:927] Time spent T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:11:02.139050 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:02.115301 30061 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:11:02.152971 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:02.165838 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:02.034633 30507 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.135869 30487 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.174693 24394 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:02.175164 30477 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:11:02.167172 30061 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:02.171756 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 180284us
W20260709 13:11:02.176604 30516 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:11:02.045732 30501 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.190086 30061 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.189723 30029 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:02.212595 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:02.209447 30487 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:02.215121 30501 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.216535 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:02.210033 23777 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:02.185039 30402 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.217214 23702 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:11:02.217681 30507 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.218387 24386 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:02.218864 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:02.219255 30402 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:02.219552 23702 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:02.224172 23775 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:11:02.211458 30061 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:02.230437 23702 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:11:02.232125 23697 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:11:02.236351 23701 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:02.235041 23700 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:02.238744 23703 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:02.250339 23697 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:02.250174 30484 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.251152 23695 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:02.252688 30484 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:02.254077 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:02.254913 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:02.255707 23701 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:11:02.254935 23703 raft_consensus.cc:2368] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20.
I20260709 13:11:02.265132 23703 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:02.268383 23700 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:02.269256 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:02.269989 23698 raft_consensus.cc:2368] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20.
I20260709 13:11:02.271662 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:02.268702 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:02.274798 23703 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:02.277557 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:02.282275 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:02.313071 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:02.314056 23698 raft_consensus.cc:2410] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:11:02.314693 30421 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:02.316736 24387 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:02.318380 23524 catalog_manager.cc:5697] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 20 to 24, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 24 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.311811 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:02.320322 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:02.334638 23696 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.382s	user 0.021s	sys 0.022s
W20260709 13:11:02.339150 23696 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.387s	user 0.021s	sys 0.022s
I20260709 13:11:02.388616 24385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 935) took 1574 ms. Trace:
I20260709 13:11:02.390920 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3258) took 1512 ms. Trace:
I20260709 13:11:02.396747 30455 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.320097 30457 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.090s
I20260709 13:11:02.402582 30395 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.406113 30441 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:02.406908 30441 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.408593 30129 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.409826 30312 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:02.409994 30441 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.410827 30441 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:02.416152 30441 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.417109 30061 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.417896 30497 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:02.419246 30441 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:02.389149 24385 rpcz_store.cc:276] 0709 13:11:00.814345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.815153 (+   808us) service_pool.cc:224] Handling call
0709 13:11:00.815483 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.514624 (+699141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.388252 (+873628us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b54004713d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:02.388514 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529322368}
I20260709 13:11:02.424695 23524 catalog_manager.cc:5697] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 11 to 14, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 14 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:11:02.413038 30512 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.488s	user 0.000s	sys 0.002s
I20260709 13:11:02.412932 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:02.450774 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:02.467391 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.465417 23769 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:02.475952 23592 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:02.477165 30441 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.481932 23742 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:02.419375 30061 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:02.391498 23696 rpcz_store.cc:276] 0709 13:11:00.865785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.865936 (+   151us) service_pool.cc:224] Handling call
0709 13:11:00.866278 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.887181 (+ 20903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.887215 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:00.887666 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:11:00.951700 (+ 64034us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:01.958497 (+1006797us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:11:02.339801 (+381304us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.340253 (+   452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.340384 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:02.340437 (+    53us) raft_consensus.cc:1685] finished
0709 13:11:02.378252 (+ 37815us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.378419 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21571,"prepare.queue_time_us":574541,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":13029,"raft.queue_time_us":26315,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":1036,"spinlock_wait_cycles":9061248,"thread_start_us":1451130,"threads_started":2,"wal-append.queue_time_us":63806}
I20260709 13:11:02.477568 30441 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:02.474043 30099 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:02.479548 30323 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:02.489667 30497 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:02.503903 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:11:02.495507 30521 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.348s	user 0.004s	sys 0.000s
I20260709 13:11:02.498886 30061 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:02.500149 30441 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.537021 30357 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:02.537478 30485 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:02.507357 30480 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:02.503655 30099 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.532145 30061 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:02.544981 30482 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:11:02.536890 30312 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
W20260709 13:11:02.550518 23626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 3762) took 1526 ms (client timeout 1917 ms). Trace:
W20260709 13:11:02.550981 23626 rpcz_store.cc:269] 0709 13:11:01.024680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.028351 (+  3671us) service_pool.cc:224] Handling call
0709 13:11:02.550305 (+1521954us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54002035d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:11:02.550439 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508477696}
I20260709 13:11:02.547546 30480 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:02.553705 30480 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.554843 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:02.555766 30029 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:02.556311 30029 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:02.557226 30029 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.557796 30509 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:02.558764 30509 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:02.559105 30509 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:02.559929 30509 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.561273 30509 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.560616 30495 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:02.563802 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:02.564759 23769 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:02.566491 30252 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.566973 30252 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.506385 30323 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.569199 30252 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.569850 30323 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:02.570807 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:02.508069 30497 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.573518 30305 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:02.573742 30492 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:02.573973 30305 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:02.574334 30492 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.574760 30497 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:02.569075 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:02.575784 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.579058 24386 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:02.579975 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:02.569725 30252 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:02.582207 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:02.587792 24385 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:02.587632 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:02.589510 30445 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.589653 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:02.589881 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:02.590175 30445 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.587268 24359 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:02.581575 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:02.582317 30252 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.605564 30445 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.606490 30252 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:02.606489 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:02.578846 30495 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:02.608043 30495 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.609557 30457 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:02.610414 30495 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.611503 30492 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:02.614622 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:02.626315 29976 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:02.627538 30468 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.574808 30305 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.636417 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:02.638099 30350 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:02.638545 30350 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.639014 30350 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:02.639223 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:02.640542 30305 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:02.641489 23701 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:02.645052 30475 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:02.651968 30435 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:02.652717 30435 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.653043 30457 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:02.654217 30457 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.655989 30503 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:02.655797 30531 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:11:02.656214 30448 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:02.656638 30503 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.658049 30461 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:02.658450 30461 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:02.659296 30461 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.660637 30461 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.660756 30530 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:02.662122 30530 raft_consensus.cc:3055] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:02.661916 30299 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:02.662542 30530 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:02.663672 30526 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:02.663501 30530 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.664304 30526 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:02.665350 30530 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:02.666903 30498 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:02.665663 30526 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.667941 30526 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.668829 30498 consensus_queue.cc:1243] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:11:02.669561 30529 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:02.670024 30529 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:02.670846 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:02.670925 30529 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.672288 30507 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:02.672999 30507 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.676332 30493 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:02.676822 30487 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:02.676975 30493 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.677420 30487 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:02.679129 30129 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.575925 30061 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.648828 23524 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.696642 24357 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:02.709412 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:02.724859 23743 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:11:02.723242 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 46854.8us
W20260709 13:11:02.769071 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 124491us
I20260709 13:11:02.770135 23524 catalog_manager.cc:5697] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:02.772356 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47784us
I20260709 13:11:02.773316 30435 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.776058 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:02.710386 30529 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:02.708885 30366 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:02.708799 30129 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:02.780975 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:02.786062 24394 raft_consensus.cc:1813] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Handling vote request from an unknown peer 9ab488f10c434878a749f261e99a8065
W20260709 13:11:02.786576 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 169869us
I20260709 13:11:02.789278 24394 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:02.782015 23524 catalog_manager.cc:5697] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.791117 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:02.784379 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 74789us
I20260709 13:11:02.796370 30553 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:02.800249 23519 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52058 (request call id 192) took 22762 ms (client timeout 15000 ms). Trace:
I20260709 13:11:02.800421 30371 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:02.800999 30099 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.794304 30135 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:02.806118 30448 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:02.806589 30448 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:02.806982 30448 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.779404 30357 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:02.809022 30357 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:02.809937 30357 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:02.811067 30541 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.267s	user 0.002s	sys 0.000s
I20260709 13:11:02.811980 30503 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:02.789021 30129 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:02.828365 30535 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:11:02.831163 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:02.832010 24394 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 10.
I20260709 13:11:02.833145 30487 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:02.834561 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:02.839699 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:02.840261 30493 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.840449 24394 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:02.842718 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:02.790459 23524 catalog_manager.cc:5697] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:02.796868 30501 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:02.846206 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:02.853032 23742 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:02.854626 23524 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.860666 23524 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 11 to 13, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 13 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:02.863871 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:02.876808 23524 catalog_manager.cc:5697] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.791759 30366 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:02.883508 23524 catalog_manager.cc:5697] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.779219 30435 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
W20260709 13:11:02.889333 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 178031us
I20260709 13:11:02.860381 30323 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:02.897895 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:02.881075 30497 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:02.883536 30509 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:02.804165 23519 rpcz_store.cc:269] 0709 13:10:40.038001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.038174 (+   173us) service_pool.cc:224] Handling call
0709 13:11:02.800142 (+22761968us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:59.704196 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:59.705024 (+   828us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:59.705084 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:10:59.705117 (+    33us) tablet.cc:662] Decoding operations
0709 13:10:59.710332 (+  5215us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:59.710448 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:59.710473 (+    25us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:10:59.711342 (+   869us) tablet.cc:701] Row locks acquired
0709 13:10:59.711394 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:10:59.711559 (+   165us) write_op.cc:270] Start()
0709 13:10:59.711706 (+   147us) write_op.cc:276] Timestamp: P: 1783602659711497 usec, L: 0
0709 13:10:59.711779 (+    73us) op_driver.cc:348] REPLICATION: starting
0709 13:10:59.712427 (+   648us) log.cc:844] Serialized 2449 byte log entry
0709 13:11:00.277058 (+564631us) op_driver.cc:464] REPLICATION: finished
0709 13:11:00.668932 (+391874us) write_op.cc:301] APPLY: starting
0709 13:11:00.669048 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:00.712610 (+ 43562us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:00.712750 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:00.757588 (+ 44838us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:00.757931 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:11:00.758004 (+    73us) write_op.cc:312] APPLY: finished
0709 13:11:00.758383 (+   379us) log.cc:844] Serialized 65 byte log entry
0709 13:11:00.759571 (+  1188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:00.759787 (+   216us) write_op.cc:454] Released schema lock
0709 13:11:00.759902 (+   115us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:00.760677 (+   775us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:00.760708 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":175038,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":369492,"apply.run_cpu_time_us":12462,"apply.run_wall_time_us":105637,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":214175,"prepare.run_cpu_time_us":24015,"prepare.run_wall_time_us":227680,"raft.queue_time_us":272910,"raft.run_cpu_time_us":63173,"raft.run_wall_time_us":155230,"replication_time_us":565107,"thread_start_us":658787,"threads_started":4,"wal-append.queue_time_us":258859,"wal-append.run_cpu_time_us":19591,"wal-append.run_wall_time_us":1786639}]]}
I20260709 13:11:02.858018 29976 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:11:02.895332 23524 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:02.858534 30501 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:02.911976 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 197739us
I20260709 13:11:02.914031 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:02.903259 23669 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:02.922447 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:02.923211 23771 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:02.896996 30507 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:02.925578 23524 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.904170 30493 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:02.927896 30500 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:02.940567 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:02.928371 23524 catalog_manager.cc:5697] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 14 to 16, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 16 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:02.915968 30461 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:02.946878 23524 catalog_manager.cc:5697] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.926877 30487 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.959824 23524 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:02.903827 30441 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:03.059978 23524 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 19 to 20, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 20 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:03.069981 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 294009us
I20260709 13:11:02.951959 30445 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:02.953979 30461 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:03.077621 23524 catalog_manager.cc:5697] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 14 to 15, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 15 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:03.080600 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:03.082556 23623 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:03.073770 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:03.075631 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:03.087414 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:03.088135 23626 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:11:03.081321 23621 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:03.094908 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:02.973162 30487 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:03.108037 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.109637 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 400246us
I20260709 13:11:03.110524 23593 leader_election.cc:400] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20.
I20260709 13:11:02.952581 30500 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:03.119011 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 43587.6us
I20260709 13:11:03.123999 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:03.127238 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.125895 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.129290 23701 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:11:03.077587 30445 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:03.136320 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.137614 23667 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:11:03.140415 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.145848 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:03.146831 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:03.147055 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:03.147819 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:03.151895 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.111183 30487 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.146750 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:03.154742 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:03.157508 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:03.157876 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:03.159957 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:03.161170 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:03.103042 30553 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:03.109390 30489 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:03.168766 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:03.130770 30495 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:03.177888 23770 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:03.187570 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.235842 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:03.236366 23695 raft_consensus.cc:1813] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Handling vote request from an unknown peer 9ab488f10c434878a749f261e99a8065
I20260709 13:11:03.237154 23695 raft_consensus.cc:2410] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:11:03.154613 30252 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:03.283946 30561 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.285396 30252 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:03.285672 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:03.270224 23626 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:03.279253 30501 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:03.280215 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:03.287336 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:03.283034 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.287968 23769 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
W20260709 13:11:03.288079 30529 consensus_meta.cc:287] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.003s
I20260709 13:11:03.288789 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.289850 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:03.165548 30481 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.144572 30445 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:03.290570 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:03.174676 30371 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:03.145354 30554 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.291841 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.292493 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.287968 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.301578 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:03.342447 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:03.234889 30507 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:11:03.229403 30530 consensus_meta.cc:287] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.002s
W20260709 13:11:03.310988 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 200579us
I20260709 13:11:03.290218 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:03.391758 23629 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:03.244648 30493 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:03.225214 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet d5fa82982f53411c84a07a2fb3918888 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:57370
I20260709 13:11:03.272534 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:03.328120 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:03.285420 30552 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:11:03.337598 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:03.338725 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:03.340662 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.303119 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:03.345757 23626 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
W20260709 13:11:03.307457 30526 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
I20260709 13:11:03.348883 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.351339 23701 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:03.173448 30505 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.143s
I20260709 13:11:03.275506 30475 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.307806 30495 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.411422 23593 leader_election.cc:400] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20.
I20260709 13:11:03.420961 23593 leader_election.cc:403] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:03.284514 30561 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.338245 29976 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:11:03.429370 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 126329us
I20260709 13:11:03.449777 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:03.236898 30461 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.422236 23696 raft_consensus.cc:2955] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 5 to 12, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:03.434106 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:03.303620 30553 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:03.389845 30480 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:03.391556 30371 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 20 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:03.450767 30461 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:03.482945 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:03.327492 30481 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.453032 30555 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:03.451314 30497 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:03.479900 30350 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.840s	user 0.006s	sys 0.008s
I20260709 13:11:03.389848 30554 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.472361 30305 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:03.402805 30507 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:03.453471 30526 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:11:03.430876 30475 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.410303 30493 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:03.433538 30495 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.495435 30555 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:03.501459 30551 log.cc:927] Time spent T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:11:03.493583 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:03.480301 30480 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:03.594336 23668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.003s	sys 0.014s
W20260709 13:11:03.451431 30299 consensus_queue.cc:1175] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c885217113574e7489e6c3afb6950f76" responder_term: 20 status { last_received { term: 18 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:03.501776 30497 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:03.494443 30441 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:03.469497 29976 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:03.548691 30526 consensus_queue.cc:1243] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:03.624485 30526 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:03.625362 30526 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.628769 30526 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:03.595270 23668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.004s	sys 0.014s
I20260709 13:11:03.604970 30497 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:03.608268 29976 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:03.611177 24386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 941) took 1028 ms. Trace:
I20260709 13:11:03.611490 30481 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:03.611714 23621 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:11:03.587601 30549 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.396s	user 0.000s	sys 0.001s
I20260709 13:11:03.612622 30435 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:11:03.612860 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 119341us
I20260709 13:11:03.678570 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:03.586566 30555 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:03.614059 30564 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:11:03.615208 30548 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:03.629734 30561 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:03.630254 30448 consensus_meta.cc:287] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.823s	user 0.001s	sys 0.011s
I20260709 13:11:03.631647 30495 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:03.633523 30129 consensus_meta.cc:287] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.809s	user 0.007s	sys 0.003s
I20260709 13:11:03.635716 30554 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:03.638828 30507 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:03.520326 30350 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.585969 30500 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:03.642136 30480 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:03.643113 30475 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:03.648286 30371 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.652587 30493 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:03.656992 30553 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:03.657788 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.714318 23702 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 21: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:11:03.596012 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 426911us
I20260709 13:11:03.662591 30503 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:03.675469 30497 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:03.676092 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:03.682930 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:03.652647 30366 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:03.674597 24386 rpcz_store.cc:276] 0709 13:11:02.583278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.583707 (+   429us) service_pool.cc:224] Handling call
0709 13:11:02.584054 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.584496 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.584527 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.585265 (+   738us) log.cc:844] Serialized 26 byte log entry
0709 13:11:02.859883 (+274618us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:03.103398 (+243515us) log.cc:844] Serialized 14 byte log entry
0709 13:11:03.109093 (+  5695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.109181 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.500855 (+391674us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:11:03.610860 (+110005us) raft_consensus.cc:1685] finished
0709 13:11:03.610969 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.611116 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9025,"prepare.queue_time_us":293897,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":14617,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":14670,"spinlock_wait_cycles":170763008,"thread_start_us":473828,"threads_started":2,"wal-append.queue_time_us":503115}
I20260709 13:11:03.680939 30435 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:03.751828 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:03.708511 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:03.720359 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.687532 30577 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:03.739889 23667 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:03.744786 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 61958.8us
I20260709 13:11:03.757978 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:03.741679 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 440163us
I20260709 13:11:03.762070 23699 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:03.692596 30448 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.712252 30554 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:03.740110 30487 consensus_meta.cc:287] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.003s
I20260709 13:11:03.694746 30129 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:03.778728 23667 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:03.782373 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.771095 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 62675.1us
W20260709 13:11:03.795372 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 462198us
I20260709 13:11:03.795759 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:03.807750 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:03.811841 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:03.819247 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 67541.8us
I20260709 13:11:03.817873 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:03.818638 23743 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:03.820376 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:03.759793 30435 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:03.828125 30481 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.924705 23668 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:03.742848 30495 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:03.926038 23627 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:03.920148 23741 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.035s
W20260709 13:11:03.928833 23741 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.000s	sys 0.035s
W20260709 13:11:03.823141 30061 consensus_meta.cc:287] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 1.053s	user 0.014s	sys 0.000s
W20260709 13:11:03.956645 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 136335us
I20260709 13:11:03.957850 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:03.959179 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.817852 30523 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:03.742995 30503 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.936580 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1649) took 1362 ms. Trace:
I20260709 13:11:03.973522 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:03.974195 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:03.923945 30577 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.981261 24387 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:03.978190 24358 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:03.980463 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:03.920791 30457 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:03.986018 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:03.829028 30568 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:03.974902 30357 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.002s	sys 0.052s
I20260709 13:11:03.785461 30487 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.001531 30556 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:03.977172 30421 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:03.955061 30441 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.953166 30495 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.847285 30445 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:03.967857 30523 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.818233 30554 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.008148 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:04.014524 23629 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.008s	sys 0.039s
I20260709 13:11:04.015857 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:03.968674 30061 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.019086 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.968714 23773 rpcz_store.cc:276] 0709 13:11:02.562018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.566913 (+  4895us) service_pool.cc:224] Handling call
0709 13:11:02.567217 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.567551 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.567580 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.568236 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:11:02.729347 (+161111us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:02.782227 (+ 52880us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.792196 (+  9969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.792308 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.924040 (+1131732us) raft_consensus.cc:1685] finished
0709 13:11:03.924074 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.924273 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4724,"prepare.queue_time_us":53419,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1861,"raft.queue_time_us":13163,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":2419,"thread_start_us":160558,"threads_started":1,"wal-append.queue_time_us":225224}
I20260709 13:11:04.022240 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:04.022886 23703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.025s	sys 0.040s
W20260709 13:11:04.070581 23703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.025s	sys 0.040s
I20260709 13:11:03.970819 30561 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.004148 30575 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:03.982494 30501 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:11:04.015475 30578 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
W20260709 13:11:04.015302 30563 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.652s	user 0.003s	sys 0.000s
W20260709 13:11:04.007275 30357 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.002s	sys 0.052s
I20260709 13:11:03.991792 30492 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.069032 23621 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
W20260709 13:11:04.069012 23629 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.008s	sys 0.039s
I20260709 13:11:04.008279 30457 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.077957 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:04.074890 30572 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:04.082566 23623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.014s	sys 0.041s
W20260709 13:11:04.107388 23623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.014s	sys 0.041s
I20260709 13:11:04.083068 23624 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:04.085413 23695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.016s	sys 0.041s
W20260709 13:11:04.087034 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 71283.1us
I20260709 13:11:04.032473 30493 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:04.062727 30523 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.026392 30500 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:04.111192 23695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.016s	sys 0.041s
W20260709 13:11:04.113489 23701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.037s	sys 0.100s
I20260709 13:11:04.033346 30475 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:11:04.121629 23701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.037s	sys 0.101s
I20260709 13:11:04.061707 30557 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20.
I20260709 13:11:04.034986 30441 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.131063 30574 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:04.148067 30574 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.131953 30569 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.132383 30570 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.135396 30448 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.135911 30559 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:04.136838 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:04.138411 30487 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.139904 30475 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.142416 23622 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:04.141963 30523 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.143193 30129 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:11:04.145220 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:03.991751 30577 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:04.151243 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 77688.8us
I20260709 13:11:04.163762 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:04.027094 30556 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.124195 30350 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.190436 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:04.193782 30582 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:04.194628 30582 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.197664 30523 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.205669 30574 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.212833 30495 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.213200 30475 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.216115 30577 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.148335 30441 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.235919 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:04.237449 23697 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
I20260709 13:11:04.238858 23699 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:04.241204 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:04.241657 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 311644us
I20260709 13:11:04.242151 23697 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:11:04.242470 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:04.243484 23699 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:04.244647 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:04.245832 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:04.197605 30582 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:04.271643 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:04.272018 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:04.105376 30492 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.275151 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:04.238102 30497 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.282232 23623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3787) took 1129 ms. Trace:
I20260709 13:11:04.279580 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet d5fa82982f53411c84a07a2fb3918888 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
I20260709 13:11:04.282729 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:04.284816 23622 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 21: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:04.285048 23625 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:04.287562 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:04.290448 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45911.7us
W20260709 13:11:04.291867 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.288687 23621 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
W20260709 13:11:04.300525 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 375900us
W20260709 13:11:04.295123 23670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.009s	sys 0.025s
W20260709 13:11:04.302032 23670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.009s	sys 0.025s
I20260709 13:11:04.127171 30572 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.249564 30061 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:04.315894 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:04.321331 24385 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 19: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:04.322305 23697 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:04.248754 30568 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:04.324247 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:04.269795 30475 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:04.304145 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.282795 23623 rpcz_store.cc:276] 0709 13:11:03.141299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.142142 (+   843us) service_pool.cc:224] Handling call
0709 13:11:03.142437 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.142639 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:03.518868 (+376229us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.269897 (+751029us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:04.270003 (+   106us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:04.270090 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.270187 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.270356 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140682,"prepare.queue_time_us":552236,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":170079,"thread_start_us":929972,"threads_started":2,"wal-append.queue_time_us":672905}
I20260709 13:11:04.330641 23773 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:11:04.309980 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:04.328159 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:04.328418 23667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.014s	sys 0.025s
I20260709 13:11:04.327490 23697 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:04.329164 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3288) took 1031 ms. Trace:
W20260709 13:11:04.332780 23667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.014s	sys 0.025s
W20260709 13:11:04.333391 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 554747us
I20260709 13:11:04.284595 30457 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.332945 23695 rpcz_store.cc:276] 0709 13:11:03.298025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.426404 (+128379us) service_pool.cc:224] Handling call
0709 13:11:03.465751 (+ 39347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.466235 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.466277 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.504211 (+ 37934us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.120994 (+616783us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:04.121050 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.121146 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.328979 (+207833us) raft_consensus.cc:1685] finished
0709 13:11:04.329002 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.329109 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5612,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3686,"thread_start_us":564708,"threads_started":1,"wal-append.queue_time_us":615781}
I20260709 13:11:04.332032 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3287) took 1034 ms. Trace:
I20260709 13:11:04.324137 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:04.341768 23699 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
I20260709 13:11:04.300758 30441 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:04.293869 30582 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:04.342835 23703 rpcz_store.cc:276] 0709 13:11:03.297567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.410989 (+113422us) service_pool.cc:224] Handling call
0709 13:11:03.447823 (+ 36834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.470288 (+ 22465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.470348 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.477292 (+  6944us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.071145 (+593853us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:04.323385 (+252240us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.331675 (+  8290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.331774 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.331820 (+    46us) raft_consensus.cc:1685] finished
0709 13:11:04.331831 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.331979 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25362,"prepare.queue_time_us":76306,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":34498,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":799250,"threads_started":2,"wal-append.queue_time_us":633778}
I20260709 13:11:04.303791 30305 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:04.337953 30435 consensus_meta.cc:287] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.003s
I20260709 13:11:04.324931 30511 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.360374 24357 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:04.345538 30503 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.362813 30584 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
W20260709 13:11:04.384150 30481 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.000s
I20260709 13:11:04.359618 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 3284) took 1059 ms. Trace:
W20260709 13:11:04.391127 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 280361us
I20260709 13:11:04.389667 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3798) took 1185 ms. Trace:
I20260709 13:11:04.335748 30061 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.318836 30129 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:04.353979 30421 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:04.398675 30555 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.702s	user 0.007s	sys 0.006s
I20260709 13:11:04.393712 30582 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:04.401378 23702 rpcz_store.cc:276] 0709 13:11:03.283198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.289641 (+  6443us) service_pool.cc:224] Handling call
0709 13:11:04.342700 (+1053059us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b540026a7d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:11:04.342874 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":974242176}
I20260709 13:11:04.355796 30029 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:04.430917 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:04.334275 30568 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.399740 30570 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:04.400583 30445 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:04.444398 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 166435us
I20260709 13:11:04.396117 30435 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.334300 23667 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:04.416291 30481 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.436342 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:04.439178 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:04.449311 24394 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:11:04.449380 24387 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:04.416814 30554 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.383476 30441 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.443101 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:04.448252 23742 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:11:04.442654 30586 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:11:04.459034 30594 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:11:04.440822 30570 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:04.468801 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:04.475514 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:04.426434 30129 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.424813 30421 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:04.507165 23511 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 334c9018414947cabb4405ef47b8018e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4466bf6d6cf84ee89e84ea074e3964c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:04.512719 30572 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.513931 30441 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.470121 30600 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:04.516067 30435 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.516837 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3789) took 1375 ms. Trace:
W20260709 13:11:04.498513 30461 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.010s	user 0.011s	sys 0.002s
I20260709 13:11:04.517412 23627 rpcz_store.cc:276] 0709 13:11:03.141851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.143293 (+  1442us) service_pool.cc:224] Handling call
0709 13:11:03.143573 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.930816 (+787243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.516506 (+585690us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54002b4154. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:04.516743 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788696448}
I20260709 13:11:04.440062 30029 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.522608 30029 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:04.499130 30570 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.525027 30492 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.529814 30129 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.531211 30421 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:04.531952 30604 log.cc:927] Time spent T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:11:04.420524 30061 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.533016 23777 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
W20260709 13:11:04.533125 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 261386us
I20260709 13:11:04.476877 30582 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.535928 30468 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:04.536270 30061 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:04.536377 30468 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:04.537530 30468 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.478305 30568 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.478657 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:04.480819 23773 raft_consensus.cc:1240] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:04.462613 30601 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.486357 30554 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:04.486327 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:04.490876 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.492101 30509 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:04.494306 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:04.495469 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.495805 30556 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.496097 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.431937 30555 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.500159 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.572036 23771 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
I20260709 13:11:04.572217 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:04.572510 23772 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:04.505847 30299 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:04.506449 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:04.568512 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.505638 30580 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:04.575783 23769 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:11:04.581454 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.582031 24357 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:04.597136 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.600862 30505 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:04.601514 30505 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:04.602001 30505 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:04.569568 30554 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:04.604485 30554 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.605607 30449 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:04.606854 30449 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:04.607291 30449 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:04.576479 30581 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:11:04.576296 30509 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.573316 30601 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.611032 30509 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:04.611886 30601 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.615406 23627 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:04.618031 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2683) took 1553 ms. Trace:
I20260709 13:11:04.403278 23629 rpcz_store.cc:276] 0709 13:11:03.204532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.412346 (+207814us) service_pool.cc:224] Handling call
0709 13:11:03.425227 (+ 12881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.425533 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:04.097274 (+671741us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.389298 (+292024us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:04.389357 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:04.389406 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.389469 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.389606 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":317790,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":2272,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5641,"thread_start_us":931258,"threads_started":2}
I20260709 13:11:04.624764 30449 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.577975 30580 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.625404 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:04.626049 30449 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:04.575218 30299 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.627712 30498 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:04.628028 30299 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:04.628355 30498 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:04.629616 30498 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.631270 30498 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:04.633320 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:04.634673 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.640615 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:04.642130 30568 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:04.642894 30568 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.643610 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:04.666018 23623 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:04.644140 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:04.645812 30576 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.676198 30576 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:04.676868 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 342640us
I20260709 13:11:04.677002 30596 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:04.677671 23667 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:04.678929 30576 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.680310 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 956) took 1399 ms. Trace:
I20260709 13:11:04.681139 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.682045 23775 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:11:04.684154 23770 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:04.685217 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.651791 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:04.646863 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.625444 30555 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.627539 30580 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:04.656232 24393 raft_consensus.cc:1275] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:04.656988 30554 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.658546 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.660285 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:04.661991 30299 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.662681 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:04.666320 23622 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:11:04.665715 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.667407 30497 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.668072 30574 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:04.668808 30611 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:04.797155 30611 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:04.668862 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 336516us
W20260709 13:11:04.669435 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 339733us
I20260709 13:11:04.672011 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:04.672804 30509 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:04.673130 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3285) took 1389 ms. Trace:
I20260709 13:11:04.678929 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:04.687062 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44062.5us
I20260709 13:11:04.690066 30596 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.689898 30570 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.653167 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:04.721266 30568 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.618563 23624 rpcz_store.cc:276] 0709 13:11:03.071702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.077337 (+  5635us) service_pool.cc:224] Handling call
0709 13:11:03.082171 (+  4834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.108331 (+1026160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.617723 (+509392us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400097c54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:04.617952 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301290368}
I20260709 13:11:04.683174 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.687254 23771 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:11:04.726148 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:04.752902 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.680706 23698 rpcz_store.cc:276] 0709 13:11:03.280722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.283881 (+  3159us) service_pool.cc:224] Handling call
0709 13:11:03.284187 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.587452 (+303265us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:04.085136 (+497684us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.323892 (+238756us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.666408 (+342516us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b180026b000. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b3e221a40 00007f2b3e21c4e4 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287 00007f2b41327208
0709 13:11:04.666816 (+   408us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.666974 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:04.667013 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:04.667061 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.680092 (+ 13031us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b5400356e54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:04.680153 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.680258 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":335842,"prepare.queue_time_us":560852,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":96,"raft.queue_time_us":347849,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":5626,"spinlock_wait_cycles":725604480,"thread_start_us":716451,"threads_started":2,"wal-append.queue_time_us":370861}
I20260709 13:11:04.776201 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:04.848019 23626 raft_consensus.cc:2410] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:11:04.782794 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.794231 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.800936 23621 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:04.800221 23668 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:04.801170 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:04.849326 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.849644 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 48558.9us
I20260709 13:11:04.808224 30384 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.694509 24357 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:04.814908 23629 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:11:04.787081 30441 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:04.841781 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.836743 24359 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:04.858336 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:04.852072 23621 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:11:04.781143 30577 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:04.815057 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 136166us
I20260709 13:11:04.850594 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:04.858263 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:04.859148 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:04.856956 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 56847.9us
I20260709 13:11:04.860075 24391 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.860841 23668 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:04.802531 23701 rpcz_store.cc:276] 0709 13:11:03.283444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.415390 (+131946us) service_pool.cc:224] Handling call
0709 13:11:03.415791 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.452113 (+ 36322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.452166 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.474266 (+ 22100us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.122740 (+648474us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:04.437541 (+314801us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.672704 (+235163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.672816 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.672878 (+    62us) raft_consensus.cc:1685] finished
0709 13:11:04.672897 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.673052 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":270325,"prepare.queue_time_us":39970,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":271749,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":11960,"thread_start_us":875685,"threads_started":2,"wal-append.queue_time_us":897486}
W20260709 13:11:04.856850 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 162453us
I20260709 13:11:04.866150 23592 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:04.860002 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:04.800263 30574 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:04.799890 30554 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.882558 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:04.883201 23626 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:11:04.871938 23592 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:04.877767 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:04.885818 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:04.802225 30509 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.887182 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:04.918316 23624 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:11:04.850061 30487 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.868235 30507 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:04.801324 30497 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.870872 30099 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:04.871284 30553 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:04.871011 30421 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:04.864990 30556 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.922958 30554 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.889830 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:04.881994 30574 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:04.877772 30448 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:04.867174 29976 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:11:04.942899 30099 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.920986 30503 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.922413 30597 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:04.969220 30497 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.969437 30597 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:04.969880 30597 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:04.969280 30503 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.975896 30503 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.980067 24391 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:11:04.982517 30366 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:04.983177 30366 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.985421 30366 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.985906 30503 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.986915 30572 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:04.986644 30503 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.953256 23701 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:04.928167 30507 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.864660 30384 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.926019 30533 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:04.872717 30441 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.928673 30598 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:04.960014 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 70284.6us
I20260709 13:11:04.998315 23702 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:04.999087 23667 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:04.866658 30029 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:11:04.876108 30568 consensus_queue.cc:1059] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:11:04.885262 30129 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:11:04.939119 30557 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:05.009892 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:04.871227 30577 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.010602 23701 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
I20260709 13:11:04.946592 30421 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.964123 30505 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.018389 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:05.019850 30505 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:04.944367 30323 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:11:04.996939 30299 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:04.965037 30099 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:05.021731 30568 raft_consensus.cc:3055] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:05.022136 30568 raft_consensus.cc:740] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:05.022933 30568 consensus_queue.cc:260] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:04.939281 30555 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:11:05.024343 30555 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:04.957049 30554 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:04.884768 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:04.955268 30448 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.000859 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:04.965972 30553 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:05.020231 30570 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.013151 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:05.026835 23698 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:11:04.994136 30507 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:05.024688 30555 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:05.041898 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.042469 23699 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:04.998265 30598 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:05.043030 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 158340us
I20260709 13:11:05.040432 30448 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:05.058751 30555 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.046062 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.059973 30577 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.061488 30598 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.064802 30554 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:05.064648 30597 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:05.065747 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 203431us
I20260709 13:11:05.066771 23668 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:05.067147 30597 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:05.010555 30596 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:05.048650 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.025827 30421 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.068498 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.069183 30468 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.069555 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.070291 23700 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 21: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:05.028383 30503 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.072160 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.069204 23695 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:11:04.998324 30533 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:05.076504 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.078084 23743 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:05.079964 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 216030us
I20260709 13:11:05.049991 30579 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:05.089799 23777 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:05.088619 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:05.089545 23743 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:05.090597 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 213907us
I20260709 13:11:05.091444 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.091529 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.092813 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:05.088416 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.095008 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 154918us
I20260709 13:11:05.095234 23702 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
W20260709 13:11:05.092958 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 221064us
I20260709 13:11:05.096318 30135 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:05.096554 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.097658 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:05.097880 30559 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:05.098317 30559 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:05.098449 30554 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:05.099102 23592 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:05.099869 30577 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:05.100416 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:05.100446 30577 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:05.055419 30556 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:05.102677 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.102886 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:05.103967 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:05.108165 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:05.110210 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:05.110347 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:05.078631 30601 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:05.078694 30597 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:05.077497 30611 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:05.093101 30555 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:05.101419 30579 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.092547 30487 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:05.101678 30584 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:05.121991 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 185006us
I20260709 13:11:05.094079 30366 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:05.128551 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:05.108661 30554 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:05.132452 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:05.133525 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.114984 30299 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:05.106911 30252 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:05.106995 30596 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:05.104373 30553 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:05.134706 23776 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:11:05.129725 23593 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:05.135391 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.119804 30601 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.143978 23770 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:11:05.136059 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.137300 23700 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
I20260709 13:11:05.145697 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:05.128441 30440 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:05.138104 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:05.138227 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:05.149501 24391 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:11:05.118000 30557 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:05.119618 30582 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:05.154271 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.142278 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:05.142081 30573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.009s	sys 0.013s
I20260709 13:11:05.146057 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:05.165736 24388 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
I20260709 13:11:05.130013 30579 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:05.151799 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:05.110437 30497 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:11:05.169231 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.137259 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:05.131127 30584 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:05.168849 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.149096 23629 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 13.
I20260709 13:11:05.134816 30509 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:05.157145 23592 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:05.180411 23703 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:05.218688 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.145834 30601 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:05.173049 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:05.148912 30440 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:05.171031 30573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.009s	sys 0.013s
I20260709 13:11:05.134521 30487 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.243984 30384 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.245152 30461 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:05.245606 30461 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:05.245770 30487 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:05.137492 30366 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.246958 30533 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.247881 30366 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.151005 30503 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:05.137924 30494 consensus_queue.cc:1048] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:11:05.233583 30561 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:05.237973 30566 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:11:05.241474 30627 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:11:05.242789 30625 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:05.170145 30441 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.174501 30584 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.157569 30553 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.146587 30252 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.246044 30461 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:05.154726 30581 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:05.156347 30495 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.153656 30554 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:05.217413 30299 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:05.216539 30577 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:05.226619 30587 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:11:05.263857 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 127912us
I20260709 13:11:05.169809 30498 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:11:05.270262 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 124924us
I20260709 13:11:05.277163 30580 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:05.283140 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.149143 30596 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:05.286074 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 121599us
W20260709 13:11:05.306897 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.254701 30440 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:05.308198 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 160856us
I20260709 13:11:05.269443 30561 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.343395 30561 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:05.317413 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:05.334336 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.347772 23775 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:11:05.348696 30596 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:05.349964 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.336521 30498 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:05.352131 30498 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:05.352516 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:05.353668 23742 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.353736 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:05.354830 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.356124 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:05.357084 30633 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:05.357326 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:05.358237 30570 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:05.358081 30633 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:05.358604 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.358686 30029 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:05.359373 30445 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.359875 30445 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.358840 30497 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:05.309499 30581 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:05.368449 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.364563 24357 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:11:05.365124 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 208045us
I20260709 13:11:05.286609 30366 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:05.363409 24358 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.271157 30503 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.355135 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:05.366819 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.366092 30061 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:05.374418 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.375206 30582 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:05.369809 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:05.440660 30568 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:05.445261 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 81912.3us
I20260709 13:11:05.446693 30576 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:05.457448 23624 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:05.370428 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:11:05.469554 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 99197.5us
I20260709 13:11:05.383138 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.376411 30480 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:05.380362 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.371372 30610 consensus_queue.cc:1059] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:11:05.382370 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.471421 30610 raft_consensus.cc:3055] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:05.385871 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:05.471954 30610 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:11:05.472575 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 86832.2us
I20260709 13:11:05.472808 30610 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.474260 30439 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:05.474687 30439 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:05.475065 30439 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:05.476188 30449 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:05.476529 30633 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:05.358632 30494 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:05.474259 30610 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.478157 30494 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:05.478704 30494 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:05.336728 30580 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:05.375833 30582 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:05.387813 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:05.390812 30481 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:05.482025 29976 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:05.482740 29976 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:05.482072 30580 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:05.482892 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 95185.9us
I20260709 13:11:05.483534 29976 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.485356 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:05.401005 30630 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:05.284178 30625 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.378975 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:05.403175 30503 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.311264 30099 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.517709 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.518628 30252 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.519055 30099 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.520298 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.330018 30554 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:05.371614 30581 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:05.532434 23625 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:11:05.327531 30495 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.412950 23772 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:05.388558 30448 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.414660 23622 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:05.414446 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:05.538307 23629 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
W20260709 13:11:05.516089 30574 consensus_meta.cc:287] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 13:11:05.461191 30553 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:05.515568 30596 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.366436 30497 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:05.376073 30421 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.482260 30481 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:05.486250 30129 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:05.486771 29976 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:05.488270 30580 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:05.393853 30598 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:05.491287 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 342206us
I20260709 13:11:05.528095 30498 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.492807 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:05.497588 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:05.585655 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 92940.5us
W20260709 13:11:05.586048 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 88523.7us
I20260709 13:11:05.586938 30596 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:05.587383 30596 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:05.587837 30596 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.499547 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.501899 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:05.588990 30553 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:05.589666 30553 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:05.373173 30366 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.591414 30553 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:05.503204 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:05.497828 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:11:05.595907 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 98144.3us
I20260709 13:11:05.532630 30559 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.596556 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:11:05.534915 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 361906us
I20260709 13:11:05.581844 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:05.418336 30445 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:05.496600 30630 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.446415 24358 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.554936 23622 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:05.594597 30553 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.603917 30440 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.604489 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:05.558224 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.605764 30600 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:05.606020 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47870.7us
I20260709 13:11:05.606178 30600 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.606520 30600 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.563299 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:05.538962 30623 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.578498 30497 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.608031 30323 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:05.609376 30498 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.609087 30323 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:05.609820 30497 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.591892 30597 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:05.610391 30597 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:05.576421 23700 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:05.508129 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:05.611469 23623 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:05.611227 30597 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.612083 23777 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:11:05.612380 30597 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:05.612268 30631 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:05.612712 30630 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.592473 30366 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.531009 30561 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.496978 30638 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:05.600982 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:05.608055 30623 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.609920 30323 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.630362 30468 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.520993 30507 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.593149 23667 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:05.617566 23698 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:11:05.615769 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:05.622368 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 176083us
I20260709 13:11:05.620204 30638 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.554551 30574 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.521533 30579 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.633008 23699 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:05.636646 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:11:05.636775 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44080us
I20260709 13:11:05.615974 30611 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:05.623600 23620 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:05.640841 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:05.644799 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:05.606489 30553 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.643127 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:05.659268 23667 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:05.585515 30601 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:05.693250 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 50246.6us
I20260709 13:11:05.693228 24391 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:05.700806 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.640618 30129 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.648983 30638 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:05.703394 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:05.702473 23696 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:05.663142 30435 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:05.705363 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:05.713696 24391 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:05.714131 23770 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:05.699676 23695 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:11:05.706737 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:05.707962 23667 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:05.710996 23774 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:05.716977 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:05.718394 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:05.704653 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63892.3us
I20260709 13:11:05.706421 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:05.690515 30611 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:05.721735 24393 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 17: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:05.724658 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:05.698102 30555 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:05.725642 24392 raft_consensus.cc:2368] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:11:05.727536 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:05.713272 30640 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:11:05.728263 24391 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:05.729872 24394 raft_consensus.cc:1240] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:05.706105 30487 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:05.634249 30481 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:05.736245 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:05.736086 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:05.743259 24385 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 17: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:05.737912 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:05.739171 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:05.741925 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:05.744096 24386 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:05.710825 30561 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.748907 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:05.744855 24387 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:11:05.749897 23629 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 22: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:05.754230 23667 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:05.724423 30252 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:05.724900 30611 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:05.758998 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:05.764386 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:05.766934 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.737673 30099 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:05.734377 30636 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:05.728503 30555 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:05.774828 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.768024 30495 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.768492 30299 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:05.713455 30599 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:11:05.734591 30503 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:05.790465 23696 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:05.755544 30129 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:05.809008 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:05.811165 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.765749 30481 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.789239 30487 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:05.782707 30435 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:05.773070 30553 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:05.862598 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.864917 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:05.865722 23695 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:05.863466 23696 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
I20260709 13:11:05.867915 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.804975 30555 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.807523 30561 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:05.810971 30299 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.820214 30448 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.887816 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:05.899549 23696 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:05.891844 30461 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.003s
I20260709 13:11:05.907994 30461 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.910117 30461 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:05.892475 30646 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:05.911142 23621 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22. Ops: []
W20260709 13:11:05.893383 24419 heartbeater.cc:646] Failed to heartbeat to 127.21.244.62:36967 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.21.244.62:36967 timed out after 15.000s (SENT)
W20260709 13:11:05.874014 30639 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:11:05.913766 24386 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
W20260709 13:11:05.873760 30642 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:11:05.916879 30601 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:05.917550 30598 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:05.920580 30574 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:05.923327 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.924101 23701 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:05.925024 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:05.925560 23701 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:05.926651 30507 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.855429 30503 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.929531 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:05.931938 30487 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:05.936046 30577 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:05.936630 30577 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.938724 30577 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:05.885268 30561 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.949275 30561 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:05.899993 30299 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:05.953346 30559 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:05.873723 30435 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.886176 30553 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.895812 30117 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:05.886863 23593 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.532s (SENT)
W20260709 13:11:05.891618 30641 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:05.973893 30480 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.987268 23695 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
W20260709 13:11:05.974499 30568 consensus_meta.cc:287] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.001s
I20260709 13:11:06.004848 30440 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.007082 30554 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:06.007813 30596 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.010793 30596 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.015064 23698 raft_consensus.cc:2410] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:11:06.016477 23699 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:11:05.807394 30636 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.974649 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:05.974931 30566 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:05.975052 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:05.977502 30630 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.018640 23774 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
W20260709 13:11:05.957906 30584 consensus_meta.cc:287] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
I20260709 13:11:05.951102 30600 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:05.989313 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:06.022833 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:05.860044 30439 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:05.979457 30480 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:06.029011 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 243447us
I20260709 13:11:06.029608 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:05.964221 30494 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:06.054762 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 263156us
I20260709 13:11:06.026840 30584 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.087976 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:06.088263 23778 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:06.087898 30597 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:06.089627 30597 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:06.090466 30597 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:06.068717 30623 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.072654 23776 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:06.051714 23696 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:06.092264 30623 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:06.092756 30623 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:06.072292 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.095643 23623 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:06.098191 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.098366 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.098788 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.099611 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:06.099838 30623 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.100333 23775 raft_consensus.cc:2368] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:11:06.100118 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.100718 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:06.102450 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:06.103298 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.106330 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:06.107538 23667 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:06.091352 30597 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.110674 30507 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:06.111400 23621 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:06.111513 30507 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:06.098286 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.117841 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.118533 23667 leader_election.cc:400] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:11:06.119930 23667 leader_election.cc:403] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:11:06.121403 30596 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.122004 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.118923 23620 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 22: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:06.128803 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:06.129762 24388 raft_consensus.cc:2368] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18.
W20260709 13:11:06.132831 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 60584.5us
I20260709 13:11:06.133541 24385 raft_consensus.cc:1240] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:06.133740 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:06.134549 23774 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:06.135602 24394 raft_consensus.cc:2368] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:11:06.138135 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:06.139089 24386 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 13: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:06.029841 30568 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:06.032431 30503 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:06.087442 30637 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.030s	sys 0.031s
I20260709 13:11:06.149503 30600 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.142138 30568 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:06.150236 30636 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.150624 30568 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.153168 30480 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:06.147186 30637 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.030s	sys 0.031s
I20260709 13:11:06.133970 30579 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:06.131608 30580 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:11:06.160128 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.161216 30630 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.031970 30566 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.133869 30507 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.162400 30507 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.164945 30507 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.054593 30099 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:06.170017 23701 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:06.171506 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42298 (request call id 1683) took 1046 ms. Trace:
I20260709 13:11:06.136312 30649 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:06.172541 23777 rpcz_store.cc:276] 0709 13:11:05.125541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.125658 (+   117us) service_pool.cc:224] Handling call
0709 13:11:05.125980 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.612489 (+486509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.171165 (+558676us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b540032f854. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:06.171434 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117412608}
I20260709 13:11:06.173355 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:06.138082 30468 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.182799 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.183393 23668 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:06.186012 23701 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 22: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:06.144678 30435 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.189304 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:06.163571 30566 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:06.196758 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 309898us
W20260709 13:11:06.198568 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 50462.9us
I20260709 13:11:06.165374 30449 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:11:06.204087 23668 leader_election.cc:400] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:11:06.211093 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:06.212702 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:06.190176 30598 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:06.195322 30495 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:06.214746 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:06.219551 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:06.221900 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:06.222227 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:06.222954 24387 raft_consensus.cc:1813] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Handling vote request from an unknown peer 9ab488f10c434878a749f261e99a8065
I20260709 13:11:06.225200 24387 raft_consensus.cc:2368] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:11:06.204053 30503 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.225965 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:06.190399 30630 consensus_queue.cc:1059] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:11:06.203840 30480 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:06.246105 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.195034 30468 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:06.227973 30323 consensus_meta.cc:287] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.001s
I20260709 13:11:06.237743 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:06.253116 23621 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:11:06.237023 23668 leader_election.cc:400] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18.
I20260709 13:11:06.254269 23668 leader_election.cc:403] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:11:06.248109 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.244542 30507 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:06.255446 30553 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.255618 30623 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:06.256273 30439 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:06.256706 30623 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:06.257097 30623 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:06.257938 30623 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.259083 30623 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:06.261135 30611 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.264225 23771 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:06.189958 30649 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.241139 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.251298 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:06.272910 23699 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:06.251462 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.222532 30655 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:06.269364 30323 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.269533 30611 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.282433 30553 consensus_queue.cc:1059] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:06.282747 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.282490 30497 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:06.284174 30468 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.284410 30497 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:06.259128 30561 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.286661 30323 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:06.286963 30561 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.284878 30497 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:06.288287 30497 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.289640 30497 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:06.290254 30568 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:06.291864 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.294673 23773 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:06.242945 30598 consensus_queue.cc:1059] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:11:06.296794 30494 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.298709 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.302071 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.304162 23743 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:06.310303 30579 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:06.310765 30579 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.311105 30579 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.315972 30636 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:06.316781 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.317607 23621 raft_consensus.cc:2368] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14.
I20260709 13:11:06.227772 30650 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:06.325034 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:06.325721 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.327935 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:06.329185 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.336419 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:06.338054 23593 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.339784 23593 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:06.343143 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:06.343042 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.344851 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:06.346014 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.346441 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:06.347719 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:06.350183 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:06.334215 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:06.351368 23773 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 22: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:06.352211 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.352547 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.353149 23697 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:06.355525 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.271531 30495 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 17. Current term is 18.
I20260709 13:11:06.357046 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.361730 23772 raft_consensus.cc:1813] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Handling vote request from an unknown peer 9ab488f10c434878a749f261e99a8065
I20260709 13:11:06.357414 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.355422 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:06.359344 23593 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:06.359668 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.360441 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.364609 23700 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:06.365716 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:06.366639 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.367035 23773 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:06.244831 30503 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.369225 23772 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:06.370548 23669 leader_election.cc:400] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14.
I20260709 13:11:06.249205 30480 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.372598 23669 leader_election.cc:403] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:06.373332 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.371620 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.336987 30625 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.337208 30655 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:06.356403 30498 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:06.396014 23697 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:11:06.352922 30636 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.340523 30435 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:06.335978 30611 consensus_queue.cc:1059] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:11:06.319635 30555 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.378316 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:06.399011 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.368852 30561 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:06.276449 30099 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.371385 30445 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:06.405230 23621 raft_consensus.cc:2410] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:11:06.390355 30497 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:06.408385 23777 raft_consensus.cc:2410] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:11:06.371003 30441 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:06.421128 23703 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:06.364377 30653 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:06.371652 30597 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:06.399183 30498 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:06.409533 30448 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.401248 30449 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:06.401575 30596 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:11:06.429666 30441 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:06.433040 30441 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.433604 30480 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:06.435772 30555 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.403909 30598 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 13. Current term is 14.
I20260709 13:11:06.370425 30366 raft_consensus.cc:3055] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:06.398321 30579 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.417068 30421 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.420831 30461 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.447229 30655 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:06.452744 30638 consensus_meta.cc:287] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.000s
I20260709 13:11:06.453182 30638 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.454222 23626 raft_consensus.cc:1240] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:06.417250 30561 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:06.456446 30561 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.445871 30366 raft_consensus.cc:740] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:11:06.458405 30581 consensus_meta.cc:287] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.910s	user 0.009s	sys 0.000s
I20260709 13:11:06.458844 30581 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.458978 30366 consensus_queue.cc:260] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.461141 30366 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.461262 30568 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:06.439464 30631 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:06.464453 30631 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:06.465342 30631 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.466516 30631 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:06.431325 30498 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.470553 30638 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.472915 30584 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.481262 23668 leader_election.cc:400] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17.
I20260709 13:11:06.482450 30596 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:06.484431 30600 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:06.484642 30579 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:06.485002 30600 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:06.486133 23770 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:06.493412 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.494258 23628 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.496223 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.497411 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:06.499869 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 78503.8us
I20260709 13:11:06.446077 23701 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:11:06.525292 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:06.448640 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:06.531404 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:06.532222 24387 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:06.534978 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:06.536880 24386 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:06.536013 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:06.541014 24388 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 17: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:06.540776 30555 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.563423 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.564343 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.564618 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.565701 23628 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:06.565819 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.567008 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.485980 30600 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.572965 30600 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:06.577282 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:06.578222 23702 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:06.578576 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:06.563820 30029 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:06.581216 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:06.582901 30574 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:06.583493 30574 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.585814 30574 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.577356 30581 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:06.590178 30498 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.591519 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.592311 30498 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:06.553445 30299 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.001s
I20260709 13:11:06.592934 30299 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.595100 30299 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.597008 24394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:06.597313 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:06.598526 30661 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.599108 30661 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.602315 30661 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:06.604043 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:06.604919 24389 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 17: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:06.607688 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.610078 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:06.611281 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.611907 30661 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.613286 30584 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:06.618638 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:06.637179 24389 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:06.620607 30598 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:06.638228 30598 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.639568 30661 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:06.639844 23697 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.641263 30598 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.641549 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:06.621325 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:06.622301 23511 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 334c9018414947cabb4405ef47b8018e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4466bf6d6cf84ee89e84ea074e3964c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:06.622957 30636 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.645890 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.647135 23778 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:06.648353 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.650075 30623 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:06.648490 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:06.652681 24389 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.648396 30661 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:06.656479 30661 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.656900 30661 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.663522 24387 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:11:06.668308 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:06.670241 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.669339 30636 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:06.671260 30636 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:06.672191 30636 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.674871 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:06.675040 23697 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:06.676159 30580 raft_consensus.cc:3055] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:06.676568 30580 raft_consensus.cc:740] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:06.677103 30584 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:06.678283 30495 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:06.678650 30495 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:06.679436 30495 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.680365 23622 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:06.681056 30495 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.681591 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.682986 30584 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.683534 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.684438 30625 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:06.690008 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2714) took 1130 ms. Trace:
I20260709 13:11:06.690459 23626 rpcz_store.cc:276] 0709 13:11:05.559360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.559558 (+   198us) service_pool.cc:224] Handling call
0709 13:11:05.559957 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.454606 (+894649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.689799 (+235193us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b54003af554. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:06.689951 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2056218368}
I20260709 13:11:06.691886 30651 raft_consensus.cc:3055] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:06.692309 30651 raft_consensus.cc:740] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:06.693652 23593 leader_election.cc:400] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:11:06.694053 23593 leader_election.cc:403] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:06.696954 30599 raft_consensus.cc:3055] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:06.697018 30625 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.697536 30599 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:06.701584 30503 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.705600 30500 raft_consensus.cc:3055] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:06.706022 30500 raft_consensus.cc:740] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:06.708352 30625 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17.
I20260709 13:11:06.713001 23743 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.714332 23743 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:06.715441 30610 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.719555 30651 consensus_queue.cc:260] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.721058 30651 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:06.722474 30509 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:06.723105 30509 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:06.698451 30599 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.729545 30599 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:06.730499 23621 raft_consensus.cc:1240] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:06.731549 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.731802 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.732089 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:06.732925 23774 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.736344 23621 raft_consensus.cc:1240] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:06.737581 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:06.739717 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.740564 23698 raft_consensus.cc:2376] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20. Re-sending same reply.
I20260709 13:11:06.741748 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.739926 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.739194 23770 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:06.746929 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.747779 23704 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.749234 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.750814 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:06.751641 23698 raft_consensus.cc:2368] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22.
I20260709 13:11:06.756791 23742 leader_election.cc:400] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22.
I20260709 13:11:06.757313 23742 leader_election.cc:403] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:11:06.760398 23703 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 17: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:06.781211 24389 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:06.763478 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:06.789674 24387 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:06.783778 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:06.796414 23669 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.801277 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 386855us
I20260709 13:11:06.801682 23769 raft_consensus.cc:1240] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:06.802035 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.804304 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.806612 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:06.706874 30500 consensus_queue.cc:260] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:06.817104 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 130056us
I20260709 13:11:06.822225 23774 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:11:06.806638 23769 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:11:06.815793 23620 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:06.807286 23700 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:06.780077 30366 raft_consensus.cc:2764] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:11:06.782943 30601 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:06.825270 23704 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:06.809033 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.830296 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:06.844383 23770 raft_consensus.cc:2393] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:06.677402 30580 consensus_queue.cc:260] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.807621 30634 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:06.845636 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.817929 30625 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.845664 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:06.836644 29976 consensus_queue.cc:1059] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:11:06.785619 30566 consensus_queue.cc:1059] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:11:06.788344 30574 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260709 13:11:06.834309 30581 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22.
I20260709 13:11:06.840513 30500 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:06.870245 23770 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:06.872277 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 63303.5us
I20260709 13:11:06.874650 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:06.819738 30623 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:11:06.832769 30598 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
W20260709 13:11:06.899137 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.907651 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:06.907939 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:06.866101 30634 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:06.923657 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:06.853036 30449 consensus_queue.cc:1059] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:11:06.925843 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:06.911303 30498 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:06.927795 30498 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:06.882220 30655 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.929031 30498 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.929306 30655 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.926586 30461 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:06.931255 30461 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.931707 30461 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.926898 30305 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:06.882372 30601 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:11:06.912930 30641 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:11:06.953966 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:06.915510 30644 log.cc:927] Time spent T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:11:06.942629 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:06.944562 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:06.946712 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:06.947966 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:06.883571 30649 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:06.883031 30663 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:06.940912 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:06.955543 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:06.960654 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:06.959295 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:06.956642 23699 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:11:06.961532 23622 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:11:06.853788 30509 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.963400 23770 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:06.968590 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:06.985198 23627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ec1d400f174350acc92722149e02d4"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:46526
I20260709 13:11:06.986172 23627 raft_consensus.cc:606] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:06.986630 23627 raft_consensus.cc:614] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:06.936107 30579 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:06.952411 30574 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:07.001794 23778 raft_consensus.cc:1240] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 18. Current term is 19. Ops: [18.15-18.15]
W20260709 13:11:07.005658 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.988554 30663 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:07.007686 30663 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:06.949681 30481 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.999853 30579 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:06.918010 30636 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:11:06.987458 30649 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:07.034366 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:07.036813 23778 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
W20260709 13:11:06.990294 30494 consensus_queue.cc:1175] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c885217113574e7489e6c3afb6950f76" responder_term: 22 status { last_received { term: 22 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 22 index: 14 } }
I20260709 13:11:07.015626 30651 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:07.048691 30117 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:07.052304 30117 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:06.984702 30553 consensus_queue.cc:1059] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:11:07.032557 30655 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:07.039661 30638 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:07.029790 30481 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.070616 30553 consensus_queue.cc:1243] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:07.095111 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:07.096171 30597 raft_consensus.cc:3055] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:07.096632 30597 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:07.096681 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:07.097990 23592 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:07.097702 30597 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.096201 30305 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:07.098894 30503 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:07.099436 30305 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:07.099689 30503 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:07.100132 30503 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.100513 30503 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.100517 30305 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:07.109577 30555 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:07.110062 30555 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:07.110924 30555 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.107993 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:07.122978 30666 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:11:07.123788 30584 raft_consensus.cc:3055] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:11:07.131326 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 99831.4us
I20260709 13:11:07.140717 24357 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:11:07.134601 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 138733us
I20260709 13:11:07.133862 30630 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.151008 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:07.139340 30625 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:07.155551 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:07.084770 30638 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.140019 30584 raft_consensus.cc:740] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:07.162424 24357 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:07.162456 30553 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:07.167410 30553 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:07.167769 30366 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:07.167872 30553 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:07.077852 30678 consensus_queue.cc:1059] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.092s
I20260709 13:11:07.042057 30634 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.183099 30610 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:07.162680 30630 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.186098 30630 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:07.061327 30601 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.197008 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:07.207695 30481 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:07.208884 30678 raft_consensus.cc:3055] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:07.209393 30678 raft_consensus.cc:740] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:07.165100 30576 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:07.212358 30576 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:07.212514 30579 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:07.154642 30555 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:07.212872 30576 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:07.223505 23771 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:07.229910 24387 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:11:07.233750 23769 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:07.235764 30554 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:07.242892 30638 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:07.248741 30580 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:07.252081 30584 consensus_queue.cc:260] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.253723 30584 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.255906 30649 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.256486 30649 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:07.258827 30649 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:11:07.258945 23699 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:07.259044 30682 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:07.210284 30678 consensus_queue.cc:260] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.252081 30487 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:07.262451 30487 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:07.263379 30487 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.264756 30487 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.264940 23702 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:07.267376 30596 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:07.267916 30596 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.269670 23695 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:07.272248 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:07.272442 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:07.275897 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:07.277859 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:07.278682 23699 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 19: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:07.272382 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:07.284855 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:07.276546 23702 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:11:07.280412 23621 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
W20260709 13:11:07.294538 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:07.352550 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 113423us
I20260709 13:11:07.357614 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:07.269866 30596 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:07.358956 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:07.423182 23696 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 20: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:11:07.399503 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 124277us
I20260709 13:11:07.279500 30481 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.428046 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:07.426818 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:07.435288 23629 raft_consensus.cc:2393] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:11:07.436872 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 79376us
I20260709 13:11:07.436954 29976 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:07.437624 29976 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.438063 29976 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:07.288846 30495 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:07.444357 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 165033us
I20260709 13:11:07.448577 24387 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:11:07.448967 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 95305.6us
W20260709 13:11:07.444692 30661 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.787s	user 0.007s	sys 0.005s
I20260709 13:11:07.477955 23769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:11:07.479168 23769 raft_consensus.cc:606] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:07.479523 23769 raft_consensus.cc:614] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:07.349771 30625 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:11:07.482873 24394 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:07.446382 30509 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.354846 30636 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:11:07.359153 30561 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.121s
I20260709 13:11:07.498690 30596 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.510752 30684 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:07.517113 30636 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:11:07.517132 30685 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:07.515115 30596 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.521442 30596 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:07.527870 30684 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:07.498620 30661 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.528947 30684 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.530676 30661 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:07.530920 23774 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:07.510886 30509 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.533275 30509 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:07.533802 23778 raft_consensus.cc:1240] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:11:07.432447 30461 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.544060 30606 raft_consensus.cc:3055] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:07.544617 30606 raft_consensus.cc:740] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:07.545504 30606 consensus_queue.cc:260] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.444375 30481 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.491083 30625 consensus_queue.cc:1243] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:11:07.550026 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:11:07.572649 23774 raft_consensus.cc:606] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:07.573141 23774 raft_consensus.cc:614] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:07.574708 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 114369us
I20260709 13:11:07.550933 30606 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:07.461028 30495 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.587039 30553 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.589375 30553 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:07.593751 30678 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:07.597013 30597 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:07.597496 30500 consensus_meta.cc:287] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.000s
I20260709 13:11:07.602416 30461 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:07.580906 30441 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:11:07.513588 30503 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.569037 30650 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.607045 30650 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.607690 30503 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:07.604039 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:07.608548 23771 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:07.604508 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:07.609663 30650 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:07.611605 30576 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.614432 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:07.615311 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:07.615773 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:07.615950 23777 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:07.616367 23772 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:11:07.617173 23743 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:07.614215 30576 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:07.618736 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:07.620684 23778 raft_consensus.cc:2393] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:07.619333 30610 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:07.621775 30495 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:07.629062 30610 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:07.635996 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:11:07.636796 23774 raft_consensus.cc:606] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:07.637212 23774 raft_consensus.cc:614] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:07.540316 30599 consensus_meta.cc:287] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.807s	user 0.013s	sys 0.000s
I20260709 13:11:07.646692 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:07.649151 23697 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:07.651022 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:07.653077 23704 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:07.660116 23627 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:07.654251 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:07.660957 23701 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:07.661201 23696 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:07.662312 23770 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:07.664991 29976 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.677047 23769 raft_consensus.cc:2368] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16.
I20260709 13:11:07.674763 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:07.666927 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.668005 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:07.774122 23700 pending_rounds.cc:85] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 11
I20260709 13:11:07.673352 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:07.666286 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 503915us
I20260709 13:11:07.774753 23704 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.777064 23701 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.777590 23700 pending_rounds.cc:107] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:11:07.777992 23700 raft_consensus.cc:2889] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:07.774031 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 106134us
I20260709 13:11:07.672024 23774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:11:07.784786 23774 raft_consensus.cc:606] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:07.785422 23774 raft_consensus.cc:614] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:07.787500 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 74642.6us
I20260709 13:11:07.789240 29976 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:07.790805 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:07.791675 23703 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:11:07.732640 30663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.012s	sys 0.039s
W20260709 13:11:07.803647 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 100411us
I20260709 13:11:07.813185 23704 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:07.817067 24357 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:07.821811 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:07.788483 30449 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.827214 23701 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:11:07.849099 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:07.802163 30610 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:07.807132 30663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.012s	sys 0.039s
W20260709 13:11:07.802359 30117 consensus_meta.cc:287] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.004s
I20260709 13:11:07.851248 23703 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:11:07.815618 30566 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:07.850637 23667 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:07.863283 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:07.866852 23667 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:07.868570 23667 leader_election.cc:400] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16.
I20260709 13:11:07.869024 23667 leader_election.cc:403] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:07.868834 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:07.869786 23627 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:07.848733 30495 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.856603 23593 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:07.907435 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 50929.3us
I20260709 13:11:07.850940 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:07.859947 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:07.873178 30650 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:07.874715 30566 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.826017 30690 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.802886 30561 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:11:07.884778 30599 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16.
I20260709 13:11:07.817734 30554 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:11:07.935272 23774 raft_consensus.cc:1240] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:07.852531 30610 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.852828 30449 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:07.893306 30553 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:07.894040 30117 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.904582 30497 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:07.918766 23593 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:07.959548 23620 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:07.903357 30664 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.854337 30574 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:07.938482 23770 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 11.
I20260709 13:11:07.920135 30650 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.920220 30655 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:07.963795 23701 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:07.965886 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:07.968994 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:07.951381 30610 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.966630 23629 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:11:07.969830 23703 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 11: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:07.940562 30663 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:07.920780 30687 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:07.971658 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.953979 30468 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.954598 30553 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.966156 30574 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.920454 30441 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:07.973485 30601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.006s	sys 0.024s
I20260709 13:11:07.969275 30650 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:07.946177 30690 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:07.969167 30435 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:07.921118 30495 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.007426 23627 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:11:08.014122 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:07.976446 30497 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:07.984161 30655 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:08.042192 29976 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:08.042630 29976 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.043028 29976 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:07.970412 30664 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.008710 30553 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:08.037539 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 174339us
I20260709 13:11:07.978575 30696 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:11:08.009091 30574 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.009330 30481 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:08.047421 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 179061us
W20260709 13:11:08.021510 30601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.006s	sys 0.024s
I20260709 13:11:08.058579 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:07.985283 30663 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.008989 30468 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.012732 30441 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.070770 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:08.072291 30634 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.072834 30572 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:08.074324 23702 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:08.017463 30509 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:11:08.054445 30487 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.002s
I20260709 13:11:08.078540 30117 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.079803 30487 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:08.080394 30487 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.082647 30487 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.054720 30435 raft_consensus.cc:697] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:08.065616 30599 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.072829 30634 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.089596 30435 consensus_queue.cc:237] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.090794 30634 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.088172 30599 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.093632 30599 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.108701 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:08.109249 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:08.111285 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 43573.5us
I20260709 13:11:08.113451 24357 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:08.124038 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:08.128028 29976 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.132210 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:08.133064 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:08.133077 23770 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:11:08.135442 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:08.101074 30694 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:11:08.136096 23770 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:08.134832 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:08.142706 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:08.129519 24387 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:08.145335 24393 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:08.177503 23629 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:11:08.190025 29976 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:08.190842 23592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.024s	sys 0.010s
W20260709 13:11:08.191529 23592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.025s	sys 0.010s
W20260709 13:11:08.192096 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 717374us
I20260709 13:11:08.194448 23770 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:08.196894 23770 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:08.117478 30581 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:08.201894 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:08.202747 23770 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.128357 30597 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.208181 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:08.218407 23769 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
I20260709 13:11:08.209565 23778 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:08.210065 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:08.065701 30698 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.137s
I20260709 13:11:08.220327 23777 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:08.222185 23775 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:08.211105 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:08.146291 30633 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.145780 30509 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:08.268039 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44776.8us
I20260709 13:11:08.147862 30695 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:08.170785 30596 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:08.264896 23770 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:08.269163 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:11:08.322445 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 53415us
I20260709 13:11:08.330317 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:08.334830 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:08.338819 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 145093us
W20260709 13:11:08.335673 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 195274us
I20260709 13:11:08.342223 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:08.343163 23621 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:11:08.346575 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:08.347215 23770 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:08.219957 30707 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:08.316497 30678 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.000s
I20260709 13:11:08.233302 30498 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:08.377034 30579 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.379030 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:08.432402 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:08.434273 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:08.317618 30566 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.148694 30497 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.216951 30581 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.263077 30597 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.314901 30596 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:08.175225 30655 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.428516 30695 raft_consensus.cc:697] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:08.386480 23777 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:11:08.231271 30435 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.198s
I20260709 13:11:08.273157 30449 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:08.316924 30495 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.336802 30697 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:08.428165 30707 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:08.479457 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 100562us
I20260709 13:11:08.477547 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:08.468922 30566 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:08.441928 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:08.527189 23626 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:11:08.320990 30509 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.431687 30599 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.337333 30693 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.141s
I20260709 13:11:08.442099 30636 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.468171 30487 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:08.520109 23623 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:08.313527 30633 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.517854 30449 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:08.468945 30715 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:08.504391 30596 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:08.505064 30439 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.543267 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 109465us
I20260709 13:11:08.442106 30579 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.441888 30498 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.545209 30723 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:08.515139 30568 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:08.565284 23621 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:08.518330 30697 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:08.551499 30701 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.485s	user 0.001s	sys 0.000s
I20260709 13:11:08.525633 30440 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:08.581454 23592 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:08.550630 30709 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.529815 30690 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.523496 30707 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.551185 30724 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.560732 30495 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:08.638911 30495 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.641664 30495 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.567795 30664 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:08.524816 30698 consensus_queue.cc:1059] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:11:08.577854 30468 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:08.642577 30687 consensus_meta.cc:287] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.645s	user 0.004s	sys 0.005s
I20260709 13:11:08.643219 30687 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:08.642923 30724 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.645823 30724 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.587189 30439 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.648351 30439 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.577064 30663 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:08.604075 30710 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:11:08.650197 30717 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:11:08.604849 30706 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:11:08.650955 30717 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:08.608892 30574 consensus_meta.cc:287] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.003s
W20260709 13:11:08.597858 30699 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.461s	user 0.000s	sys 0.001s
W20260709 13:11:08.605683 30703 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.407s	user 0.001s	sys 0.000s
I20260709 13:11:08.614372 30695 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.581467 30715 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.597219 30568 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.617430 30099 raft_consensus.cc:2764] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:11:08.581195 30449 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.572573 30487 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.619858 30498 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.566489 30636 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.595314 30441 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.616266 30597 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.649185 30728 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.603310 30705 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:11:08.552915 30599 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:08.677009 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 342366us
I20260709 13:11:08.596709 30697 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:08.741803 23777 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:08.679066 30727 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.657681 30625 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260709 13:11:08.692626 30610 consensus_meta.cc:287] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.001s
I20260709 13:11:08.694628 30717 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:08.699923 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47362us
I20260709 13:11:08.763032 30724 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:08.702500 30698 raft_consensus.cc:3055] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:08.763906 30698 raft_consensus.cc:740] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:08.763653 30724 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.764853 30698 consensus_queue.cc:260] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:08.703528 30553 consensus_meta.cc:287] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.646s	user 0.005s	sys 0.007s
I20260709 13:11:08.766114 30724 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.766623 30439 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.766323 30553 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.767184 30439 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.768728 30553 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:08.677273 30720 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:11:08.769484 30439 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.771793 24393 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:08.742956 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:08.773366 23774 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:11:08.773459 30715 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.774247 30715 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:08.776486 30509 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:08.776862 30732 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:08.777496 30732 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.778120 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2853) took 1102 ms. Trace:
I20260709 13:11:08.778532 23698 rpcz_store.cc:276] 0709 13:11:07.675715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.675837 (+   122us) service_pool.cc:224] Handling call
0709 13:11:07.676108 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.676311 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.676339 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:07.699308 (+ 22969us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.042476 (+343168us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:08.042516 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.042580 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.777897 (+735317us) raft_consensus.cc:1685] finished
0709 13:11:08.777921 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.778059 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":196403,"threads_started":1,"wal-append.queue_time_us":365238}
I20260709 13:11:08.749647 30727 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.782455 30727 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:08.782621 30716 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:11:08.741354 30728 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.785533 30728 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.786116 30728 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:08.786545 30449 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.786643 30599 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.735755 24389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 1083) took 1287 ms. Trace:
I20260709 13:11:08.788916 24389 rpcz_store.cc:276] 0709 13:11:07.448395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.448515 (+   120us) service_pool.cc:224] Handling call
0709 13:11:07.448823 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.449991 (+  1168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.450039 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:07.478112 (+ 28073us) log.cc:844] Serialized 26 byte log entry
0709 13:11:07.906392 (+428280us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:07.906432 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.906500 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.735490 (+828990us) raft_consensus.cc:1685] finished
0709 13:11:08.735514 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.735654 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":755,"raft.queue_time_us":69224,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":391725,"threads_started":1,"wal-append.queue_time_us":541619}
I20260709 13:11:08.745152 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:08.791214 24387 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:11:08.743451 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:08.794778 23770 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:11:08.677875 30554 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:11:08.676517 30574 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:08.889076 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:08.955705 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 66717.1us
I20260709 13:11:08.599222 30723 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.652697 30709 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:08.747334 30440 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.721073 30581 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.766213 30698 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.888031 30449 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:08.961552 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:08.962211 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:08.999081 23769 raft_consensus.cc:2393] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 19: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:08.998713 30449 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.969277 23778 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:08.999986 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:08.787457 30610 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.979545 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:08.771658 30568 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.987993 30440 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:08.990569 30723 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.976802 30553 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:08.993470 30574 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
W20260709 13:11:08.994184 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 248670us
I20260709 13:11:08.963456 30599 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.746155 30597 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.960780 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.033417 23770 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
I20260709 13:11:09.005661 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.035274 23778 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 17: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:09.008567 23772 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:08.998924 30421 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.776890 30487 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.769542 30636 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:08.998922 23774 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:11:08.890111 30722 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:08.977306 30715 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.026125 24357 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:09.023588 30553 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.974259 30732 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:09.011413 30709 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.786674 30728 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.032933 30734 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.021940 30566 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:11:09.053314 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:09.060288 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:09.067055 24357 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:09.048520 30553 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.065796 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:09.038316 30599 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.063701 30655 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:09.041150 30597 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.043507 30421 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.044791 30722 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.066555 30554 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:09.079456 30576 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:09.065912 30742 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:09.057696 30636 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:11:09.048614 30715 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.083539 30655 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.085554 30441 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:11:09.092891 30596 consensus_meta.cc:287] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.001s
I20260709 13:11:09.062016 30734 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.090018 30554 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.111339 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.111907 30554 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:09.094446 30576 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.102005 30449 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:09.102618 30597 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.106094 30723 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:09.107811 30728 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.113458 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.114357 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.117436 30576 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.124365 30440 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:09.100998 30441 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.096063 30742 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.128014 30742 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.128440 30461 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.129029 30461 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.130072 30610 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:09.127588 30441 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.101095 30655 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:09.086690 30709 consensus_queue.cc:1059] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:11:09.132870 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.134673 23774 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:09.116134 30625 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.138381 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:11:09.121503 30650 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 1.092s	user 0.011s	sys 0.002s
I20260709 13:11:09.133496 30461 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.142243 30099 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:09.144377 30099 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.144730 30099 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:09.142586 30625 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.149537 30715 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.150209 30625 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.151748 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.152040 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.152467 23774 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:09.153963 30599 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.154680 30554 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.155486 30722 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.159171 30099 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.161665 30099 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.162420 30707 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.152949 23778 raft_consensus.cc:2410] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:11:09.163904 30728 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.164587 30728 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.166965 30728 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.170490 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:09.171406 23774 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:09.133041 30723 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.177788 30723 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:09.115177 30596 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.179498 30576 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.182423 30715 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.182572 30576 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.183018 30715 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.098090 30697 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.189725 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.196177 23774 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:09.141409 30741 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.205811 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.210657 24387 raft_consensus.cc:2393] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 20: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:09.206197 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.211578 30728 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.211623 30597 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.212360 30728 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.212395 30597 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.214725 30597 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.254508 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.256807 24387 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:11:09.200182 30715 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.265900 30663 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.271607 30663 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.273761 30663 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.214725 30728 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.263911 23668 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:09.254627 30468 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.281611 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.214813 30579 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.210369 30596 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.209846 30599 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.189481 30650 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.254215 30741 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.236341 30441 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.314958 30597 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.328802 23774 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:09.329757 24389 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:11:09.303494 30728 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:09.296352 30468 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.336936 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:09.324828 30715 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:09.320405 30599 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:09.342501 30497 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.047s	sys 0.092s
I20260709 13:11:09.337898 30707 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.339210 30728 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:09.360168 30497 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.047s	sys 0.092s
I20260709 13:11:09.326694 30597 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.364413 30441 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.365511 30597 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.365849 30655 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.367208 30468 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.367887 30697 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.367998 30554 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.369040 30655 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.364508 30741 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:09.371191 30599 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:09.373595 30746 log.cc:927] Time spent T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:11:09.373715 30742 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.374553 30553 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.375559 30742 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.376359 24387 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:09.377128 30650 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.361855 30728 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:09.378139 30553 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.350617 30715 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.385144 30715 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:09.387125 30711 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.781s	user 0.011s	sys 0.011s
I20260709 13:11:09.433434 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.436141 30650 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.436319 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:09.436697 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:09.437268 30650 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.440462 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:09.441315 23774 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:09.441650 30650 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.445576 30650 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.445720 23770 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:11:09.446455 30650 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.449554 30650 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.434144 30553 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.463821 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2860) took 1421 ms. Trace:
I20260709 13:11:09.469192 30599 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:09.470538 30599 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.472160 30650 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:09.473577 30650 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.474232 23592 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:09.464568 23703 rpcz_store.cc:276] 0709 13:11:08.038694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.038872 (+   178us) service_pool.cc:224] Handling call
0709 13:11:08.039248 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.055856 (+ 16608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.055878 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:08.056254 (+   376us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.321129 (+264875us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:08.321173 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.386581 (+1065408us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:11:09.459033 (+ 72452us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5400024c54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:09.459152 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.459249 (+    97us) raft_consensus.cc:1685] finished
0709 13:11:09.459267 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.459569 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5343,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6948,"spinlock_wait_cycles":60400256,"thread_start_us":227418,"threads_started":1,"wal-append.queue_time_us":478670}
I20260709 13:11:09.481515 30625 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:09.482060 30625 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.482442 30625 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:09.489883 30633 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:09.490459 30554 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:09.495463 30441 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:09.496145 30696 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:09.497174 30696 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.497937 30554 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.496812 30441 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.502795 30441 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.450459 30553 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.504052 30599 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.505607 30554 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.506649 30553 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.503324 30610 raft_consensus.cc:3055] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:09.523273 23776 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:11:09.527361 23772 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
W20260709 13:11:09.529412 30713 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.005s	user 0.003s	sys 0.010s
I20260709 13:11:09.515190 30610 raft_consensus.cc:740] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:09.541261 30553 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.541764 30610 consensus_queue.cc:260] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.542354 30553 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.544798 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3365) took 1494 ms. Trace:
I20260709 13:11:09.545282 23701 rpcz_store.cc:276] 0709 13:11:08.050194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.050365 (+   171us) service_pool.cc:224] Handling call
0709 13:11:08.050675 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.050884 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.050911 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:08.051360 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.200799 (+149439us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:08.200843 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.200928 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.520944 (+1320016us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:11:09.544176 (+ 23232us) raft_consensus.cc:1685] finished
0709 13:11:09.544200 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.544595 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27687168,"thread_start_us":106300,"threads_started":1,"wal-append.queue_time_us":366810}
I20260709 13:11:09.545478 30553 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.552948 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:09.554229 23695 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:09.554955 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 3371) took 1486 ms. Trace:
I20260709 13:11:09.556995 30633 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:09.555322 23695 rpcz_store.cc:276] 0709 13:11:08.068490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.552021 (+1483531us) service_pool.cc:224] Handling call
0709 13:11:09.554872 (+  2851us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:09.553122 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:09.564463 23774 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 24.
I20260709 13:11:09.574800 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.574856 30553 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:09.577548 30553 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.577982 30553 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:09.586503 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.587503 23628 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:11:09.587564 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.588913 30599 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.589627 30599 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.590901 30734 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.591655 30733 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:09.592149 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.592495 30733 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.593271 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.596071 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.600093 30599 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.600308 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.601549 23621 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 21: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:11:09.575886 30736 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.887s	user 0.002s	sys 0.008s
I20260709 13:11:09.604485 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.605186 23627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3891) took 1474 ms. Trace:
I20260709 13:11:09.605283 23624 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:11:09.599359 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.606995 23629 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:11:09.607306 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.605727 23627 rpcz_store.cc:276] 0709 13:11:08.130221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.131267 (+  1046us) service_pool.cc:224] Handling call
0709 13:11:08.131679 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.135342 (+  3663us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:08.475008 (+339666us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.708330 (+233322us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:08.708846 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.709002 (+   156us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:08.709047 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.709124 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.574834 (+865710us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:11:09.604656 (+ 29822us) raft_consensus.cc:1685] finished
0709 13:11:09.604762 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.604990 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30763,"prepare.queue_time_us":552450,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":31394,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":42636,"spinlock_wait_cycles":15274240,"thread_start_us":456519,"threads_started":2,"wal-append.queue_time_us":213339}
I20260709 13:11:09.608150 23620 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 24: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:09.609489 30610 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:09.609728 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 514357us
I20260709 13:11:09.571076 30696 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:08.957231 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:09.595599 30733 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.636893 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:09.637815 23772 raft_consensus.cc:3060] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.640130 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:09.641077 23627 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.646266 30553 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.648567 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.649595 24393 raft_consensus.cc:2368] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20.
I20260709 13:11:09.649781 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.650674 24388 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:11:09.650863 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.651880 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.663648 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.667042 30718 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:09.667701 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.667888 30718 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.670884 30718 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.673846 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.674258 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.676664 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.677446 30601 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.678141 30601 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:09.679899 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44106.1us
I20260709 13:11:09.681339 23592 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:09.684439 23668 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:09.684952 30421 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:09.677619 24386 raft_consensus.cc:2368] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15.
I20260709 13:11:09.685879 30599 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:09.686410 30599 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.686893 30599 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.709568 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.713613 30650 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:09.714531 30753 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:11:09.715813 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.716553 24392 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:11:09.717543 24393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.718286 24393 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 23.
I20260709 13:11:09.718356 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.719017 24386 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
I20260709 13:11:09.720151 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.721038 23777 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 23.
I20260709 13:11:09.715410 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.696441 30718 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:09.733037 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:09.728513 30625 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.732811 30503 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:09.731673 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.739682 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.740203 23621 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:11:09.762986 23627 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
W20260709 13:11:09.760082 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 53980.5us
W20260709 13:11:09.770562 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 47228.7us
I20260709 13:11:09.758172 30553 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.768308 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.769254 23629 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:11:09.778739 30625 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.764858 30503 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:09.780385 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:09.768268 23592 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:09.719039 30554 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:11:09.781137 23623 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 12.
I20260709 13:11:09.762418 30421 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.762179 30728 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.789598 30650 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.792953 30650 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.796095 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.796821 23776 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:11:09.797385 30728 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.798568 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 2981) took 1525 ms. Trace:
I20260709 13:11:09.798982 23771 rpcz_store.cc:276] 0709 13:11:08.211046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.211193 (+   147us) service_pool.cc:224] Handling call
0709 13:11:08.211471 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.211839 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.211866 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.652754 (+1440888us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b2c0012bcd8. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3fc05a11 00007f2b3fc15372 00007f2b41347a01 00007f2b4130c43a 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2
0709 13:11:09.664287 (+ 11533us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.700870 (+ 36583us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:09.700906 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.704505 (+  3599us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.732320 (+ 27815us) raft_consensus.cc:1685] finished
0709 13:11:09.732345 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.736135 (+  3790us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":164921,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"spinlock_wait_cycles":50404224,"thread_start_us":36074,"threads_started":1,"wal-append.queue_time_us":63458}
I20260709 13:11:09.800233 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.780428 30305 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.807101 30305 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.809708 30305 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.810398 30722 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.811167 30722 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.813751 30722 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.814292 30722 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.815213 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.815661 30597 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.816054 23775 raft_consensus.cc:2368] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 23. Current term is 24.
I20260709 13:11:09.816164 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.816331 30597 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.817188 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:09.817507 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.818013 23778 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:09.818730 30707 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:09.818881 30597 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.819401 30707 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.821928 30707 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.822573 30707 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.825131 23742 leader_election.cc:400] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15.
I20260709 13:11:09.825544 23742 leader_election.cc:403] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:09.826478 23742 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:09.827960 30509 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:09.828583 30509 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.829105 30509 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:09.828038 30601 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:09.772203 30718 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:09.803615 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 56212.3us
I20260709 13:11:09.803269 30421 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.827507 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:09.831660 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:09.841698 23772 raft_consensus.cc:2468] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:11:09.832015 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:09.823176 30707 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:09.838634 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 60643.4us
I20260709 13:11:09.851835 23621 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 20.
I20260709 13:11:09.838902 23777 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:09.836066 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:09.834522 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.814842 30722 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.857362 23593 leader_election.cc:400] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20.
I20260709 13:11:09.865940 23593 leader_election.cc:403] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:09.868961 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.869961 23776 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:09.832798 30461 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:09.834033 30718 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:09.839051 30421 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:09.819556 30597 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.880604 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.876601 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:09.838956 30732 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.891856 23770 raft_consensus.cc:3060] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.893952 24385 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:09.896279 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:09.898123 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47233.6us
I20260709 13:11:09.901057 29976 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:09.877151 30461 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:09.899056 24357 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:09.902660 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:09.901261 30698 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:09.878872 30650 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:09.898123 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 62213.8us
I20260709 13:11:09.901598 29976 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:09.896144 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 68789.7us
I20260709 13:11:09.904335 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.908001 24385 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 23.
I20260709 13:11:09.901311 23778 raft_consensus.cc:3060] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:09.908993 23773 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 23: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:09.909942 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:09.910099 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.908458 30439 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15.
I20260709 13:11:09.912072 23772 raft_consensus.cc:2368] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 18. Current term is 19.
I20260709 13:11:09.907125 29976 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:09.911692 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.828419 30503 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.923405 23775 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:09.927006 23773 raft_consensus.cc:2410] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:11:09.926558 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.922394 30732 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.906221 30461 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:09.932011 23778 raft_consensus.cc:2468] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 20.
I20260709 13:11:09.933949 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.934636 23776 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:11:09.938977 30638 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:09.939764 30638 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:11:09.940160 23524 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 125) took 20130 ms (client timeout 15000 ms). Trace:
I20260709 13:11:09.940879 30638 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.933789 30597 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:09.945065 30707 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.945998 30597 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:09.946691 30722 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:09.954942 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 55979.6us
I20260709 13:11:09.955884 24357 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:09.957487 24357 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:09.960578 30743 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:09.961230 30743 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.961704 30743 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:09.964798 23770 raft_consensus.cc:2468] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
I20260709 13:11:09.967574 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:09.931105 30650 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:09.964987 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:09.931809 30698 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:09.975481 23592 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:09.967718 30733 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:09.988314 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:11:09.993856 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 64341.6us
I20260709 13:11:09.990041 30636 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:09.967521 30610 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:09.997798 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:09.998610 23770 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:09.973670 30509 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.007959 24357 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:10.009109 30750 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:11:10.011163 30568 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 19. Current term is 20.
I20260709 13:11:10.011989 30566 raft_consensus.cc:2804] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:10.012552 30566 raft_consensus.cc:697] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:10.012495 23668 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:10.013646 30566 consensus_queue.cc:237] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.014632 30722 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:10.015113 30722 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:11:10.015170 23669 connection.cc:256] RPC call timeout handler was delayed by -1.1023282909999352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
I20260709 13:11:10.016216 30728 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.016827 30597 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:10.017041 30728 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.018100 30707 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:10.018683 30707 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.019938 30553 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.020147 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.020957 30707 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.020658 30553 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.022979 24357 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:10.017580 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:10.025439 30744 raft_consensus.cc:2804] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:10.025980 30744 raft_consensus.cc:697] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:10.026986 30744 consensus_queue.cc:237] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.028443 30610 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.988240 30733 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.029047 30636 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 24 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:10.029790 30698 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.032131 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:10.032977 30687 raft_consensus.cc:2804] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:10.055207 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:10.034516 30764 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.034828 30553 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:10.033960 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:10.036120 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.036918 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.015555 30722 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:10.038041 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:10.017617 30597 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.075237 23771 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:10.040546 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:10.076467 23778 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:10.037599 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:09.999617 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 217210us
I20260709 13:11:10.077620 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:10.033792 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:10.056583 24385 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:11:10.048430 29976 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:09.998268 30633 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:10.066536 23773 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:11:10.042775 30733 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:10.095629 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:11:10.097045 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.096974 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.098201 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.098448 29976 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.083985 30633 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.099505 30633 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:10.101540 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.102919 23623 raft_consensus.cc:2368] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:10.104004 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.105244 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.106340 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.107023 23773 raft_consensus.cc:2368] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14.
I20260709 13:11:10.099409 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.116884 23770 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:11:10.119583 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:10.120270 23770 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:09.998740 30650 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.132834 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.138370 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.139247 23778 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 23. Current term is 24.
I20260709 13:11:10.139158 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.132512 30441 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:10.141829 23772 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:10.142107 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:10.142455 30655 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.142925 23622 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:10.083165 30687 raft_consensus.cc:697] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:11:10.142783 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 108968us
I20260709 13:11:10.143261 30655 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.144451 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:10.141853 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.137398 30554 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:10.142123 30441 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.146418 30554 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:10.146900 30732 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:10.148350 30655 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:10.141683 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.148674 30441 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:10.152017 30596 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:10.144492 30687 consensus_queue.cc:237] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.146943 30554 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:10.158798 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.159682 23626 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:11:10.159839 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:10.160734 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.161253 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.152339 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.162865 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.152038 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.163185 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.163378 30445 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.164383 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:10.165261 23625 raft_consensus.cc:2368] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:10.137807 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.164106 30445 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:10.178611 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44265us
I20260709 13:11:10.073920 30707 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:10.173184 23772 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:11:10.174378 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.161046 30729 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:10.132838 30568 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:10.166088 30764 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:10.209167 30728 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.184613 30305 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.248667 23629 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:10.262148 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:10.263845 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.264873 30568 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.278239 30445 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.279069 23526 catalog_manager.cc:5697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 14, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 14 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.280097 30729 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.282123 23526 catalog_manager.cc:5697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 17 to 18, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 18 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:09.940644 23524 rpcz_store.cc:269] 0709 13:10:49.809522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.809728 (+   206us) service_pool.cc:224] Handling call
0709 13:11:09.939908 (+20130180us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:04.158794 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:04.271376 (+112582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:04.277690 (+  6314us) write_op.cc:435] Acquired schema lock
0709 13:11:04.282134 (+  4444us) tablet.cc:662] Decoding operations
0709 13:11:04.508541 (+226407us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:04.508641 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:04.508678 (+    37us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:11:04.510335 (+  1657us) tablet.cc:701] Row locks acquired
0709 13:11:04.510348 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:11:04.510535 (+   187us) write_op.cc:270] Start()
0709 13:11:04.510670 (+   135us) write_op.cc:276] Timestamp: P: 1783602664510478 usec, L: 0
0709 13:11:04.510698 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:11:04.511500 (+   802us) log.cc:844] Serialized 7056 byte log entry
0709 13:11:05.100824 (+589324us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b3e2020ac 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21ec02 00007f2b40ea620b
0709 13:11:05.520063 (+419239us) op_driver.cc:464] REPLICATION: finished
0709 13:11:06.219564 (+699501us) write_op.cc:301] APPLY: starting
0709 13:11:06.225396 (+  5832us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:06.613377 (+387981us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b1800192f40. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b4104b0ec 00007f2b4104daf7 00007f2b4104efb0 00007f2b44d631bb 00007f2b44d63532 00007f2b44daab93 00007f2b44c57de3 00007f2b44c576ab 00007f2b44c58e77
0709 13:11:06.659766 (+ 46389us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:06.659832 (+    66us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:07.580111 (+920279us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:07.592110 (+ 11999us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:11:07.592158 (+    48us) write_op.cc:312] APPLY: finished
0709 13:11:07.592563 (+   405us) log.cc:844] Serialized 164 byte log entry
0709 13:11:07.994140 (+401577us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:08.013821 (+ 19681us) write_op.cc:454] Released schema lock
0709 13:11:08.028120 (+ 14299us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:08.069069 (+ 40949us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:08.100616 (+ 31547us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1601040,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":676855,"apply.run_cpu_time_us":59826,"apply.run_wall_time_us":1842482,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79475,"num_ops":18,"prepare.queue_time_us":803087,"prepare.run_cpu_time_us":31468,"prepare.run_wall_time_us":1141217,"raft.queue_time_us":277744,"raft.run_cpu_time_us":62157,"raft.run_wall_time_us":634744,"replication_time_us":1009222,"spinlock_wait_cycles":36923136,"thread_start_us":2226751,"threads_started":5,"wal-append.queue_time_us":1177745,"wal-append.run_cpu_time_us":38001,"wal-append.run_wall_time_us":2719218}]]}
W20260709 13:11:10.287372 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 64397.1us
I20260709 13:11:10.288154 30636 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.292522 30650 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:10.298746 30599 consensus_meta.cc:287] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.006s
I20260709 13:11:10.231992 30461 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.301523 23621 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:10.302649 30461 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:10.305641 30610 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.314006 23770 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:10.236658 30509 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.319662 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:10.321376 30554 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.283388 30729 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:10.324512 30743 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.328130 30554 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.327962 30305 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.330852 30305 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:10.331760 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 69848.5us
I20260709 13:11:10.332580 23743 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:10.332458 29976 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:10.333493 29976 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:10.334949 30610 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:10.334610 29976 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.335392 30610 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.335829 30610 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.338568 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.299396 30599 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.309823 23625 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:11:10.339885 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:10.340843 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 189486us
I20260709 13:11:10.327427 30743 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:10.350246 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:10.411375 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 46853.2us
I20260709 13:11:10.412259 23592 leader_election.cc:400] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 13. Current term is 14.
I20260709 13:11:10.414669 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.409287 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:10.417388 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 156872us
W20260709 13:11:10.418694 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 84225.2us
I20260709 13:11:10.221531 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.420576 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.409157 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:10.437808 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.440841 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.435591 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:10.439122 23743 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:10.256314 30707 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.459801 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.461063 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.460914 23629 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:10.457598 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.476864 23526 catalog_manager.cc:5697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 14, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 14 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.515787 23526 catalog_manager.cc:5697] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 16, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 16 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:10.517587 23526 catalog_manager.cc:5697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 15, now has a pending config: VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2), VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3), VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 15 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:10.455817 30764 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:11:10.525642 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 86622.2us
W20260709 13:11:10.535898 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 183594us
I20260709 13:11:10.539412 23526 catalog_manager.cc:5697] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 14 to 17, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 17 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.458899 30732 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:10.557094 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:10.559489 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.568384 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.505067 30568 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.532896 30764 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.572499 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:10.580302 30718 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:10.572319 30767 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:11:10.582476 23526 catalog_manager.cc:5697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 17 to 20, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 20 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:10.584475 30766 log.cc:927] Time spent T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:10.584860 23526 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 11 to 13, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 13 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:10.586407 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:10.587069 24386 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:10.576865 30764 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:10.554039 30732 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:10.587647 23526 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 17 to 18, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 18 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.597950 23743 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:11:10.621043 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 271948us
I20260709 13:11:10.627815 29976 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:10.604089 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 84110.6us
I20260709 13:11:10.628880 29976 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.629361 29976 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:10.644382 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:10.645685 24392 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 24: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:10.609301 30732 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:10.648066 23526 catalog_manager.cc:5697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 17 to 19, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 19 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:10.599220 30707 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:10.592895 30599 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.664803 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:10.597666 30633 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:10.670676 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 97210.5us
I20260709 13:11:10.678088 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:11:10.678694 30783 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:10.678560 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:10.682858 23669 leader_election.cc:400] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:10.684548 23777 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 24: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:10.686873 23526 catalog_manager.cc:5697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 13, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 13 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:10.667644 30733 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.700887 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:10.715483 29976 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.723927 30599 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:10.724643 30599 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.725201 30729 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:10.725879 30729 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.727046 30599 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:10.726313 23526 catalog_manager.cc:5697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 20 to 22, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 22 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.732530 23526 catalog_manager.cc:5697] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 8 to 15, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 15 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:10.734310 23526 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:10.735193 30729 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:10.736166 23526 catalog_manager.cc:5697] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 16, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 16 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:10.738955 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:10.739705 23526 catalog_manager.cc:5697] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:10.741323 30568 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:10.740943 23592 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:10.738530 29976 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:10.748509 24392 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 14: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
W20260709 13:11:10.749270 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 66574.1us
I20260709 13:11:10.754339 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.746671 30305 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:10.758378 30305 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:10.758594 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.758885 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.758597 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:10.759470 30305 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.761023 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:10.762997 30769 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.174s	user 0.001s	sys 0.001s
I20260709 13:11:10.719830 30638 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:10.764492 30638 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.764941 30638 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:10.767859 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:10.769114 30610 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.698930 30636 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:10.779754 23526 catalog_manager.cc:5697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 18, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 18 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
W20260709 13:11:10.758679 30777 log.cc:927] Time spent T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.169s	user 0.003s	sys 0.000s
W20260709 13:11:10.757364 30722 consensus_meta.cc:287] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.004s
I20260709 13:11:10.787861 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:10.797732 30785 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.205s	user 0.000s	sys 0.002s
W20260709 13:11:10.800997 30784 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:11:10.802127 30633 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.803128 30636 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.803429 30722 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.805768 30636 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.806849 30722 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:10.810166 30733 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:10.810468 30793 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:11:10.811259 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:10.812531 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:10.820681 30781 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.228s	user 0.002s	sys 0.000s
W20260709 13:11:10.825261 30779 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:11:10.825971 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:10.826992 23777 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 24: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:10.827364 30597 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:10.831812 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.833070 23774 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:11:10.837579 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54844.5us
I20260709 13:11:10.839099 23669 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:10.827016 23526 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 20 to 22, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 22 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:10.841794 23526 catalog_manager.cc:5697] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 17 to 20, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 20 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:10.843024 23629 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:11:10.845225 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:10.849737 30732 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.851259 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:10.792668 30610 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:10.862392 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:10.843361 23526 catalog_manager.cc:5697] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.872241 24392 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 23. Current term is 24.
I20260709 13:11:10.871856 24386 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:11:10.872859 23526 catalog_manager.cc:5697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 16, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 16 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:10.869566 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:11:10.871580 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 186052us
I20260709 13:11:10.878885 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:10.880038 23774 raft_consensus.cc:2393] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 14: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:10.881660 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:10.882360 23526 catalog_manager.cc:5697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.891152 23770 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:10.886445 23743 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:10.899103 23775 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:10.913064 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:10.916416 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:10.889310 23593 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.984s (SENT) [suppressed 18 similar messages]
I20260709 13:11:10.929487 23778 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:10.932928 23743 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:10.938068 30638 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:10.931595 30799 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:10.940200 30799 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:10.940627 30799 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.943086 30751 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:10.943993 30439 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:10.944638 30439 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:10.945498 30439 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:10.945855 30690 raft_consensus.cc:2955] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Committing config change with OpId 15.12: config changed from index 5 to 12, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:10.949947 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:10.951880 24386 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 24.
I20260709 13:11:10.898329 30568 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.971752 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:10.972182 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55856.2us
I20260709 13:11:10.973560 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:10.973912 23669 leader_election.cc:400] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:10.974236 23669 leader_election.cc:403] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:11:10.974406 30597 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:10.975026 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:10.975302 30597 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:10.932490 30722 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:10.975999 30722 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.976364 30722 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:10.978677 23668 leader_election.cc:400] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 23. Current term is 24.
I20260709 13:11:10.979060 23668 leader_election.cc:403] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:11:10.982064 23624 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:10.983357 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:10.988634 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 99342.3us
I20260709 13:11:10.974236 23620 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:10.988101 23623 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
W20260709 13:11:11.003715 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 71982.4us
I20260709 13:11:11.005060 23623 raft_consensus.cc:1275] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:11.016769 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:11.025055 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:11.026473 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:11.003930 30599 raft_consensus.cc:3060] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:11.017388 30553 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:10.971628 30568 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:11.048527 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 106959us
I20260709 13:11:11.052397 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:11.054814 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:11.058494 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:11.038822 30596 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.046564 30553 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.066211 23773 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:11.069300 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:11.070140 24386 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.072103 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:11.075148 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:11.076215 23777 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 15: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:11.077595 23778 raft_consensus.cc:2368] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 23. Current term is 24.
I20260709 13:11:11.079234 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:11.081010 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:11.081589 23774 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:11.084254 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:11.072899 30553 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.089000 23775 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:11:11.091172 23777 raft_consensus.cc:2368] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:11.071005 30638 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:11.099648 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:11.080811 30596 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:11.102212 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:11.105326 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 114871us
I20260709 13:11:11.117774 23772 raft_consensus.cc:2368] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 18. Current term is 19.
I20260709 13:11:11.122740 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:11.118418 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:11.133981 23772 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:11.132323 24359 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:11.139856 23772 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:11.142643 24386 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:11.144110 23743 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:11.146973 23772 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:11.149796 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:11.090700 30764 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:11.153258 29976 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:11.155788 29976 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.156198 29976 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.154330 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:11.158694 30601 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:11:11.180783 30509 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:11.181314 30596 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:11.186424 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:11.187263 23772 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.181514 30509 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:11.126605 30808 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:11:11.152266 30610 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:11.155808 30734 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:11:11.198863 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 66638us
W20260709 13:11:11.199213 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54703.5us
I20260709 13:11:11.190548 30707 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:11.156075 30750 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:11:11.208628 30568 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:11.216054 30764 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:11.137544 30743 consensus_queue.cc:1059] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:11:11.131105 30799 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:11.218046 30553 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:11.218442 30722 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:11.219595 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 65371.8us
I20260709 13:11:11.227907 30775 consensus_queue.cc:1048] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:11:11.229265 30800 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:11:11.236989 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:11.196732 30596 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:11:11.238983 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 160667us
W20260709 13:11:11.252151 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 96658.8us
I20260709 13:11:11.253389 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:11.272356 23592 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:11.258761 23620 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:11:11.261808 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:11.263072 30799 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:11.263865 30553 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:11.265694 30743 raft_consensus.cc:3055] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:11.276331 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:11.274876 30568 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.277717 30509 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:11.280529 30722 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:11.280458 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:11:11.281363 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46694.8us
I20260709 13:11:11.281971 30596 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:11.282485 30596 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:11.282650 30815 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:11.283222 30596 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.283332 30815 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:11.284876 30815 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:11.282124 24385 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 24: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:11.286887 30815 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.289683 30461 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.290201 30305 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:11.282397 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:11.321355 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.324857 23667 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:11.325412 29976 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:11.275381 30743 raft_consensus.cc:740] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:11.296461 30445 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:11.329190 23743 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:11.290781 30305 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:11.345088 29976 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:11.315364 30638 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:11:11.361900 23772 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:11.363425 30553 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.365829 30638 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:11.366283 30638 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:11.367271 30638 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:11.368104 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.368728 30638 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:11.368958 23701 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 21: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:11:11.374243 30806 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:11.375557 23703 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:11:11.375982 30743 consensus_queue.cc:260] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:11.379089 23778 raft_consensus.cc:1240] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:11.382965 30810 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.176s	user 0.002s	sys 0.000s
I20260709 13:11:11.348165 30816 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:11.357860 30764 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:11.394893 30597 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:11.410545 30743 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:11.428211 23593 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:11.411482 30816 raft_consensus.cc:697] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:11.417918 30764 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:11:11.450938 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 151261us
I20260709 13:11:11.453437 30305 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:11.463570 30816 consensus_queue.cc:237] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:11.467283 30732 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:11.468118 23667 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:11.469419 23667 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:11.470301 30553 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:11.471139 30553 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:11.471804 30553 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.471395 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:11.479408 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.480085 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:11.447623 30445 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:11.487485 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:11.472306 30553 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:11.489931 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:11.490602 23703 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.490823 23627 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:11.496588 23629 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:11.478864 30599 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 23. Current term is 24.
I20260709 13:11:11.500900 23695 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:11.498433 30596 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:11.501425 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:11.522104 23625 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:11:11.502962 30822 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:11.503311 30760 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:11:11.507172 30445 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:11.525776 30718 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:11.526224 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.526929 23695 raft_consensus.cc:2368] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18.
I20260709 13:11:11.526464 30445 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:11.527123 30596 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:11.509773 30553 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:11.524793 30638 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:11:11.531612 30553 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:11.515764 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.491670 30597 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:11:11.522691 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 70072.9us
I20260709 13:11:11.523244 23622 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:11:11.524457 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 53127.8us
I20260709 13:11:11.538914 30568 consensus_queue.cc:1059] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:11.537284 30597 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:11.540668 30597 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:11.546900 30568 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:11.547593 30568 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:11.536882 23703 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:11.548537 30568 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:11.548895 23513 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 334c9018414947cabb4405ef47b8018e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9ab488f10c434878a749f261e99a8065 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:11.552881 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.556155 23703 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:11:11.561651 23769 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:11.562285 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:11.564450 23625 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:11:11.576063 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:11.583446 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45077us
I20260709 13:11:11.585089 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:11.587901 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.588528 23703 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:11.611799 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.584481 30568 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.612732 23695 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:11.623978 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.634328 23703 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 22: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.555370 30764 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:11.640914 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 76624.6us
I20260709 13:11:11.609221 30718 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:11.647629 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:11.606274 30553 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.650470 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.651063 23695 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.609825 30445 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:11:11.627202 30596 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:11.606557 30732 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:11:11.661604 24386 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:11:11.662412 23695 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:11.673643 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.674539 23703 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:11.675967 30596 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:11.681172 30829 log.cc:927] Time spent T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.129s	user 0.004s	sys 0.000s
I20260709 13:11:11.682435 30596 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:11.683713 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.684738 23701 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.685739 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.688325 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.689309 23696 raft_consensus.cc:2368] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 21. Current term is 22.
I20260709 13:11:11.689741 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.690212 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.690428 23703 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
I20260709 13:11:11.690866 23696 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:11.689328 30553 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:11.692277 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.692977 23698 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:11.693969 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.694602 23698 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:11:11.697556 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.698810 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.659726 30718 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:11.701406 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:11.697376 30597 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:11.706650 23700 raft_consensus.cc:2368] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 21. Current term is 22.
I20260709 13:11:11.702235 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.695569 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.691532 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.708411 23698 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:11.705395 23742 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:11.708559 23703 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:11:11.707573 23696 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:11.713019 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.714780 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.715943 23695 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 24
W20260709 13:11:11.719903 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 72351us
I20260709 13:11:11.721405 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:11.723331 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:11.727399 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.728197 23704 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:11:11.729215 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.714092 23696 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:11.732033 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:11.738961 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.740724 23704 raft_consensus.cc:2368] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18.
I20260709 13:11:11.751210 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.752069 23700 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:11.755939 30599 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:11.757771 30597 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:11.760773 30816 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:11.761440 30816 raft_consensus.cc:697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:11.762527 30816 consensus_queue.cc:237] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:11.733630 30596 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:11.764062 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.764966 23698 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.765645 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.768463 23701 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:11.769438 23695 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 24.
I20260709 13:11:11.772998 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.773285 23703 raft_consensus.cc:2368] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 21. Current term is 22.
I20260709 13:11:11.773731 23695 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 24.
I20260709 13:11:11.775907 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:11.779943 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.733956 30553 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:11.780735 23701 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:11.785979 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.787103 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.788164 23667 leader_election.cc:400] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 23. Current term is 24.
I20260709 13:11:11.789436 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:11.791858 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.791577 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.796020 23698 raft_consensus.cc:2393] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.793221 23704 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:11:11.801195 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.801326 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.802894 23695 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:11.806977 23701 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.806982 23703 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 19: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.813333 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.814205 23701 raft_consensus.cc:2376] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 24. Re-sending same reply.
I20260709 13:11:11.815392 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.816936 23701 raft_consensus.cc:2376] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23. Re-sending same reply.
I20260709 13:11:11.817481 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:11.819535 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.821065 23701 raft_consensus.cc:2376] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19. Re-sending same reply.
I20260709 13:11:11.822096 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:11.816340 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.827828 23700 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 20.
I20260709 13:11:11.829180 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.830310 23698 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 19: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.830471 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.803988 30764 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:11.831252 23701 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
W20260709 13:11:11.836349 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.832813 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.837395 23703 raft_consensus.cc:2393] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 22: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.840155 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.840873 23695 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:11.809582 30596 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:11.842330 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.844038 23695 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:11.843943 30597 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.848672 23698 raft_consensus.cc:1240] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:11.850384 23696 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:11.835098 30553 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.796936 30718 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:11.871673 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.872093 24385 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:11.885464 23701 raft_consensus.cc:1813] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Handling vote request from an unknown peer 9ab488f10c434878a749f261e99a8065
I20260709 13:11:11.885661 23703 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 24.
I20260709 13:11:11.888670 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.886329 23701 raft_consensus.cc:2410] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:11:11.894101 23698 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:11:11.897822 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.899848 23700 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.893174 30825 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.010s
I20260709 13:11:11.908232 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.918642 23703 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 24: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:11:11.932127 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.947285 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.949221 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.950176 23703 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 19: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.948230 23698 raft_consensus.cc:2376] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 20. Re-sending same reply.
W20260709 13:11:11.960173 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 138208us
I20260709 13:11:11.964957 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.965859 23698 raft_consensus.cc:2368] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 23. Current term is 24.
I20260709 13:11:11.966756 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.967483 23698 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.968358 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.969025 23698 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:11.971009 24358 leader_election.cc:336] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.780s (SENT)
I20260709 13:11:11.971550 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:11.972241 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.973133 23700 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.973994 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.974745 23700 raft_consensus.cc:2393] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.975932 30734 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:11:11.975461 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 60776.4us
I20260709 13:11:11.977866 23698 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:11.982612 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:11.983888 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:11.975538 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.013067 23698 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:11.987874 23701 raft_consensus.cc:2468] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 24.
I20260709 13:11:12.004127 23667 leader_election.cc:400] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 23. Current term is 24.
I20260709 13:11:12.012079 24386 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:12.014078 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.014861 23701 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 22: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.013069 23703 raft_consensus.cc:2368] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 23. Current term is 24.
I20260709 13:11:12.029623 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.030532 23701 raft_consensus.cc:2368] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15.
I20260709 13:11:12.033186 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.035059 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.037698 23703 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:11:12.038057 23701 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 24: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.041188 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.042043 23698 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 15: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.042260 23703 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:12.042526 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:12.046141 23700 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:12.046617 23701 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:12.019482 30461 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:11:12.052026 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.052641 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.052706 30596 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:12.056212 23695 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:12.062582 23698 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:12.066898 23703 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:12.069844 23695 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:11:12.070466 23695 pending_rounds.cc:85] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 12
I20260709 13:11:12.069787 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.072183 23700 raft_consensus.cc:2368] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22.
I20260709 13:11:12.072268 23701 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:11:12.052752 23702 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:12.072623 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.078738 23698 raft_consensus.cc:1240] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:12.079893 23696 raft_consensus.cc:1275] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:12.070695 23695 pending_rounds.cc:107] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:11:12.081830 23695 raft_consensus.cc:2889] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:12.086015 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:12.087010 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49794.7us
I20260709 13:11:12.088354 23667 leader_election.cc:400] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
W20260709 13:11:12.159035 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 70868us
I20260709 13:11:12.170710 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.171182 23667 leader_election.cc:400] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 18. Current term is 19.
I20260709 13:11:12.171542 23667 leader_election.cc:403] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:12.168444 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.178001 23697 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:12.179270 23700 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 19: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:12.184371 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:12.179129 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.188108 23696 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.096661 23702 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:12.191339 30596 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 18. Current term is 19.
I20260709 13:11:12.198889 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.199748 23696 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:11:12.202736 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.203051 23698 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:12.203619 23700 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:12.205802 23701 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:11:12.210523 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 128287us
I20260709 13:11:12.222206 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.223390 23701 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.227497 23620 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:12.228593 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:12.230907 23703 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 24: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:12.233106 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:12.233443 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:12.233930 23770 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:12.237027 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:12.237425 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:11:12.325039 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 235773us
I20260709 13:11:12.254734 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:12.354542 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:12.354966 23776 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 22: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:12.258947 30786 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
W20260709 13:11:12.341778 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.254902 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.252435 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:12.256467 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:12.356861 23703 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 23: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.237994 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:12.253249 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:12.358292 23777 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:11:12.361565 30858 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.362188 30858 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:12.264660 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.258509 23699 raft_consensus.cc:1275] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:11:12.290149 30850 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:11:12.367024 23772 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:12.372617 23777 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
W20260709 13:11:12.364984 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 125923us
I20260709 13:11:12.365513 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:12.349880 30857 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:11:12.342116 30853 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:11:12.373718 23697 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
W20260709 13:11:12.382196 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 143867us
W20260709 13:11:12.381769 23742 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.562s (SENT)
I20260709 13:11:12.383038 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:12.385107 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:12.380509 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:12.388154 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.386132 23667 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:12.374517 30815 raft_consensus.cc:2764] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:11:12.374078 30445 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.398022 23622 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:12.401722 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.403115 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.405920 23778 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:12.407684 23697 raft_consensus.cc:2393] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 24: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:12.388010 30858 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:12.387048 30553 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:12.392906 30825 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:12.414215 23667 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:12.418570 30815 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:12.424240 30815 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 22 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:12.425226 30815 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:12.433043 23593 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.589s (SENT)
I20260709 13:11:12.438529 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:12.438131 30553 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:11:12.440857 30827 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:12.442924 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.443578 23704 raft_consensus.cc:2376] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20. Re-sending same reply.
I20260709 13:11:12.415319 30597 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:12.444895 23704 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:12.445798 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.446982 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.450436 23622 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:11:12.452984 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:12.454610 23700 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:12.454936 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.456076 23696 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 22: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.455210 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.405129 30445 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:12.459985 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:12.460644 23698 raft_consensus.cc:2376] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20. Re-sending same reply.
I20260709 13:11:12.461556 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.462078 30445 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:12.462797 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:12.463613 23700 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.464377 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.462792 23625 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:12.466116 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.462110 23698 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 11.
I20260709 13:11:12.467767 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:12.468737 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 51964.7us
I20260709 13:11:12.468932 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:12.469734 23696 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.470253 23700 raft_consensus.cc:2368] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15.
I20260709 13:11:12.467926 23697 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:11:12.472286 23696 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:12.464241 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:12.466920 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:12.477807 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.478156 23703 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:12.481974 23699 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 22: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.481952 23700 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:12.478516 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.484549 23701 raft_consensus.cc:2393] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 19: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:12.485641 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.486763 23698 raft_consensus.cc:2393] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 16: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:12.486857 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.487790 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.488209 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.488385 23697 raft_consensus.cc:2393] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 24: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:12.488500 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:12.490412 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.496627 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.498137 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:12.498862 23770 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:12.465186 30859 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 13:11:12.503325 30847 log.cc:927] Time spent T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.343s	user 0.000s	sys 0.003s
I20260709 13:11:12.504675 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:12.511415 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.514447 23703 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:11:12.486050 30827 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
W20260709 13:11:12.518818 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.520416 30823 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:12.522188 30823 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:12.522621 30823 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:12.540517 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.540913 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.541448 23703 raft_consensus.cc:2376] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19. Re-sending same reply.
W20260709 13:11:12.545526 23742 leader_election.cc:336] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.709s (SENT)
I20260709 13:11:12.547557 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.554652 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:12.546450 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:12.555567 24386 raft_consensus.cc:1275] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:11:12.557068 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.557828 23703 raft_consensus.cc:2376] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 24. Re-sending same reply.
I20260709 13:11:12.560335 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.561249 24385 raft_consensus.cc:1275] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:12.563817 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.564565 23702 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:12.564536 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.559670 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.566677 23593 leader_election.cc:400] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 21. Current term is 22.
I20260709 13:11:12.567950 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:12.568004 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:12.570412 23695 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 24: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.570369 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.570191 30855 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:12.573366 30855 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:12.573800 30855 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:12.575073 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.575915 23703 raft_consensus.cc:2393] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 24: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.576429 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.577247 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.584105 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.584981 23703 raft_consensus.cc:2393] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 23: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.601652 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:12.602674 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 102173us
I20260709 13:11:12.603300 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.603430 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:12.606220 23695 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:12.606050 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.567634 30636 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:12.568591 30861 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:12.612293 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.569034 30823 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:12.609169 24358 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:12.617700 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:11:12.618978 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49751.6us
I20260709 13:11:12.619887 23593 leader_election.cc:400] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18.
I20260709 13:11:12.620249 23593 leader_election.cc:403] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:12.565428 30864 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
W20260709 13:11:12.630000 30852 log.cc:927] Time spent T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.466s	user 0.003s	sys 0.000s
I20260709 13:11:12.634588 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.611342 30861 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:12.639029 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.639132 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.635632 30751 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.645828 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:12.646595 23625 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:12.657563 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:12.660861 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:12.646322 30861 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:12.664018 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 54915us
I20260709 13:11:12.669972 23625 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:11:12.646840 30760 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18.
I20260709 13:11:12.672936 24358 leader_election.cc:400] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 23 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 23. Current term is 24.
I20260709 13:11:12.673347 24358 leader_election.cc:403] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:12.678786 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 80813.9us
I20260709 13:11:12.680876 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:12.682191 23620 raft_consensus.cc:2410] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:11:12.688934 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:12.656571 30718 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:11:12.692706 23742 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:12.694811 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 75071us
I20260709 13:11:12.695474 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:12.696242 23593 leader_election.cc:400] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for earlier term 21. Current term is 22.
I20260709 13:11:12.702284 24358 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:12.704352 30751 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:12.688110 30775 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 23. Current term is 24.
I20260709 13:11:12.710047 30718 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:12.710494 30718 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:12.711380 30718 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:12.712849 30718 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.693692 30633 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:12.716969 23626 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:12.728986 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:12.739006 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:12.741705 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:12.738231 30751 raft_consensus.cc:2804] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:12.746652 30751 raft_consensus.cc:697] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:12.747761 30751 consensus_queue.cc:237] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:12.740761 30786 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:12.752069 30786 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:12.752511 30786 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:12.757799 30823 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:12.759699 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63576.3us
I20260709 13:11:12.760727 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:12.763386 23627 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:12.763304 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:12.767654 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:12.768992 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:12.778733 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:12.784075 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:12.788230 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:12.743193 30814 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:12.800238 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 61477.8us
I20260709 13:11:12.801522 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:12.765408 30827 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.774991 30869 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:12.782232 30698 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:12.774614 30825 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:12.818311 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:12.782012 30597 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:12.782382 30553 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:12.820045 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.820154 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:12.787566 30815 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:12.828233 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 137586us
W20260709 13:11:12.845491 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 57329.4us
I20260709 13:11:12.846668 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:12.842826 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:12.808314 30865 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:12.826174 30596 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:12.858736 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:12.826463 30698 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:12.825896 30760 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:12.795636 23620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:46526
W20260709 13:11:12.922479 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 59734.6us
I20260709 13:11:12.826314 30509 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:11:12.819546 30827 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:12.964419 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:12.851099 30799 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:12.963177 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 119214us
I20260709 13:11:12.854825 30638 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:12.969249 23620 raft_consensus.cc:606] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:12.969774 23620 raft_consensus.cc:614] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:12.952672 30760 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:12.967341 30596 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.903033 30868 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:12.961520 30553 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:12.970758 30638 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:12.978324 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:13.004921 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:12.980029 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 121409us
W20260709 13:11:12.997464 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 139184us
I20260709 13:11:12.943650 30698 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.861374 30734 consensus_queue.cc:1048] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.133s
W20260709 13:11:13.008159 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 147402us
I20260709 13:11:12.980634 30760 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:13.013609 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 193526us
I20260709 13:11:12.987501 30859 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:12.997711 30568 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:13.014557 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:12.997413 30868 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.022779 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.023110 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:13.025655 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:13.027086 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.009017 30638 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:13.028599 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 166995us
I20260709 13:11:13.036978 24386 raft_consensus.cc:1240] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:13.036809 23669 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.040971 23669 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:12.998924 30596 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.048977 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:13.007369 30690 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:11:13.008206 30775 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:11:13.021250 30568 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:13.035013 30553 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:13.026245 30868 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:13.022012 30421 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:11:13.039222 30877 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:13.058771 30445 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:13.026338 30874 consensus_queue.cc:1048] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:11:13.095836 30445 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:13.096372 30445 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:13.099465 30884 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:13.100402 30884 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:13.101547 30871 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:11:13.101377 30461 consensus_queue.cc:1059] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:13.105123 30815 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:13.060920 30883 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:13.109285 30858 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:13.109797 30858 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:13.110210 30858 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.090606 30553 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:13.081259 30864 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:13.114362 30864 raft_consensus.cc:3055] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:13.114770 30864 raft_consensus.cc:740] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:13.115705 30864 consensus_queue.cc:260] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.076609 30568 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:13.124840 30825 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:13.125593 30825 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:13.205155 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 192708us
I20260709 13:11:13.065578 30786 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:13.225265 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.216756 30751 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.252784 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 227203us
I20260709 13:11:13.253719 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:13.246490 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 221425us
I20260709 13:11:13.274279 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:13.275085 23772 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:13.216403 30868 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.293272 23772 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:13.292788 23592 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:13.293913 23742 leader_election.cc:400] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167) with higher term. Message: Invalid argument: T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15.
W20260709 13:11:13.295130 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 246228us
I20260709 13:11:13.221012 30825 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.297751 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:13.259263 30827 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:13.299901 30872 log.cc:927] Time spent T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.437s	user 0.042s	sys 0.065s
I20260709 13:11:13.254748 30751 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.333321 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.339900 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:13.349825 23669 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:13.341360 30718 consensus_meta.cc:287] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.628s	user 0.013s	sys 0.000s
I20260709 13:11:13.336416 30865 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:13.319844 30638 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.369182 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.336094 30597 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.375149 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.354996 30876 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
W20260709 13:11:13.401026 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47350.3us
W20260709 13:11:13.401275 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 61491.5us
W20260709 13:11:13.402073 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 107481us
W20260709 13:11:13.366329 30875 log.cc:927] Time spent T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:11:13.405602 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:13.403020 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 110317us
I20260709 13:11:13.359957 30877 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:13.365283 30888 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:13.406672 30509 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:13.338882 30823 consensus_queue.cc:1059] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:11:13.363153 30895 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:13.412163 30886 log.cc:927] Time spent T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:11:13.336639 30889 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
W20260709 13:11:13.418386 30861 consensus_meta.cc:287] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.011s
I20260709 13:11:13.422596 23626 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:13.432124 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:13.406912 30596 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:13.420696 30888 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.412468 30815 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:13.418237 30865 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:13.436226 30814 consensus_meta.cc:287] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 13:11:13.415238 30894 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.411561 30718 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:11:13.420255 30597 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.450217 30888 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.436136 30786 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:13.458257 23777 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:13.454834 30908 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:13.472301 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:13.464035 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 95022.7us
I20260709 13:11:13.477018 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.462711 30814 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:13.480639 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.444043 30861 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.483527 23777 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:11:13.494244 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:13.495196 23622 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 20: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:13.486428 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:13.489156 23776 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:13.490744 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.446377 30892 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:11:13.500929 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.505788 24386 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:13.506078 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49271.4us
I20260709 13:11:13.489423 30815 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:13.508574 30633 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:13.480315 30868 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:13.507956 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:13.510545 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.502669 30799 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:13.510995 30815 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:13.523151 30633 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:13.523981 23777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622"
dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:47404
I20260709 13:11:13.524575 23777 raft_consensus.cc:606] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:13.524888 23777 raft_consensus.cc:614] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:13.506479 30892 consensus_queue.cc:1243] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:13.526307 30633 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:13.511549 30887 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:11:13.511598 30751 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:13.514696 30864 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:13.530820 30899 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:11:13.532074 30732 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:13.532853 30904 raft_consensus.cc:3055] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:13.533324 30904 raft_consensus.cc:740] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:13.534327 30638 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:13.534188 30904 consensus_queue.cc:260] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.485055 30869 consensus_queue.cc:1059] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:11:13.535854 30901 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:11:13.536166 30869 raft_consensus.cc:3055] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:13.536625 30869 raft_consensus.cc:740] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:13.537547 30869 consensus_queue.cc:260] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.538861 30869 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:13.483955 30825 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:13.515707 30855 consensus_meta.cc:287] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.941s	user 0.016s	sys 0.002s
I20260709 13:11:13.486238 30854 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.054s
I20260709 13:11:13.488440 30861 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:13.540386 30855 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.461555 30891 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:11:13.510991 30903 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.541512 23629 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:13.541630 30903 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.542682 30855 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:13.494169 30884 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:13.542754 30858 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.485201 30898 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:13.544281 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.522015 30873 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.491s	user 0.004s	sys 0.000s
W20260709 13:11:13.522873 30760 consensus_meta.cc:287] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 13:11:13.545033 30858 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:13.545670 23778 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:13.465049 30894 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.488793 30902 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.058s
I20260709 13:11:13.539855 30881 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:11:13.547312 30568 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.547761 30894 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:13.545380 30760 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.549502 30568 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:13.550014 30760 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:13.550698 23625 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:13.553036 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:13.535477 30904 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:13.554515 23627 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:13.555610 23669 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:13.559736 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50221.5us
I20260709 13:11:13.564230 30799 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:11:13.566013 30907 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:13.573822 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:13.575274 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.559217 30815 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:13.554239 30884 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:13.583680 30897 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:13.584383 30897 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.584767 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:13.585145 23627 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:13.585403 23772 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:13.586506 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:13.586980 30897 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:13.587024 30718 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:13.559463 30445 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.588588 23624 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:13.588719 30880 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:13.589557 30880 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:13.589664 30445 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:13.588438 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:13.590492 30880 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:13.592424 30698 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 13:11:13.592669 30883 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:13.594521 30858 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:13.565227 30889 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:13.595914 30718 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:13.596380 30718 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:13.596122 30889 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.597419 30718 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.598477 30889 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:13.598539 30718 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:13.599243 30903 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:13.601364 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:13.578809 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 122002us
I20260709 13:11:13.609526 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:13.614598 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:13.576884 30638 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:13.630739 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:13.631424 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:13.664388 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 51405.9us
W20260709 13:11:13.663647 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47305.3us
I20260709 13:11:13.666332 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:13.676819 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:11:13.678591 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 76612.2us
W20260709 13:11:13.685175 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 78545.1us
I20260709 13:11:13.685334 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:13.616138 30884 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:13.724805 30884 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:13.725783 23703 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:13.725455 30884 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.616600 30880 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.693135 30461 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:13.735920 30865 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:13.693625 30596 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:13.695287 30909 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:13.695581 23593 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:11:13.701912 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.752408 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63959.7us
W20260709 13:11:13.752285 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 130563us
I20260709 13:11:13.664966 30732 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:13.759424 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:13.707110 30907 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:13.690467 30815 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:13.710973 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:13.792137 23773 raft_consensus.cc:1813] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Handling vote request from an unknown peer 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.617472 30885 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.096s
I20260709 13:11:13.713210 30855 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:13.713351 24357 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:13.715705 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:13.614140 30698 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.799408 23773 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:13.620447 30858 consensus_queue.cc:1048] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 13:11:13.799476 23625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:46526
I20260709 13:11:13.742343 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:13.743811 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:13.806064 23775 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:13.806201 23526 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 184) took 13843 ms (client timeout 15000 ms). Trace:
I20260709 13:11:13.752202 30786 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:13.757503 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:13.704670 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:13.702782 30910 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:13.811393 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:13.706467 30889 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.813316 23627 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20. Ops: [17.10-19.11]
I20260709 13:11:13.777652 23621 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:13.752574 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:13.789515 23519 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.716328 30597 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:13.691149 30902 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.799821 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:13.799506 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:13.804337 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:13.683256 30638 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.745033 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:13.807494 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 111971us
I20260709 13:11:13.806131 23700 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:13.823302 23701 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:13.810427 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.760178 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:13.815891 23625 raft_consensus.cc:606] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:13.824270 23625 raft_consensus.cc:614] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:13.815292 23696 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:13.806921 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 93660.6us
I20260709 13:11:13.823627 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:13.839419 23620 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:13.795137 30855 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:11:13.806723 23526 rpcz_store.cc:269] 0709 13:10:59.947809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.948024 (+   215us) service_pool.cc:224] Handling call
0709 13:11:13.791265 (+13843241us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:11.431441 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:11.432194 (+   753us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:11.432244 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:11:11.432256 (+    12us) tablet.cc:662] Decoding operations
0709 13:11:11.539356 (+107100us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:11.539470 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:11.539501 (+    31us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:11:11.626259 (+ 86758us) tablet.cc:701] Row locks acquired
0709 13:11:11.626316 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:11:11.626495 (+   179us) write_op.cc:270] Start()
0709 13:11:11.626678 (+   183us) write_op.cc:276] Timestamp: P: 1783602671626424 usec, L: 0
0709 13:11:11.626715 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:11:11.627534 (+   819us) log.cc:844] Serialized 8903 byte log entry
0709 13:11:12.077797 (+450263us) op_driver.cc:464] REPLICATION: finished
0709 13:11:12.289873 (+212076us) write_op.cc:301] APPLY: starting
0709 13:11:12.290004 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:12.600425 (+310421us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:12.614128 (+ 13703us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:12.725122 (+110994us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:12.725534 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:11:12.725585 (+    51us) write_op.cc:312] APPLY: finished
0709 13:11:12.726111 (+   526us) log.cc:844] Serialized 196 byte log entry
0709 13:11:12.726328 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:12.742375 (+ 16047us) write_op.cc:454] Released schema lock
0709 13:11:12.761558 (+ 19183us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:12.807768 (+ 46210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:12.819707 (+ 11939us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1177,"reported_tablets":51,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":181399,"apply.run_cpu_time_us":36626,"apply.run_wall_time_us":518484,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96219,"num_ops":22,"prepare.queue_time_us":195016,"prepare.run_cpu_time_us":16844,"prepare.run_wall_time_us":417932,"raft.queue_time_us":202788,"raft.run_cpu_time_us":17310,"raft.run_wall_time_us":178531,"replication_time_us":445676,"thread_start_us":502859,"threads_started":4,"wal-append.queue_time_us":215960,"wal-append.run_cpu_time_us":18371,"wal-append.run_wall_time_us":1883420}]]}
I20260709 13:11:13.847043 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:13.758962 30861 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:11:13.759042 30596 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.756132 30633 consensus_queue.cc:1048] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:11:13.813834 30910 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.814405 30903 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:13.855647 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:13.826460 30882 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:13.796016 30907 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.865788 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:13.799131 30815 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:13.873657 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54977.3us
I20260709 13:11:13.813395 30816 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:11:13.865207 30904 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:13.858960 30910 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:13.844174 30865 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:11:13.930771 23696 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:11:13.946813 30879 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.092s
I20260709 13:11:13.847139 30597 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:11:13.967170 23700 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:11:13.860854 30690 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:13.858793 30903 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:13.860479 30636 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:13.957384 23701 raft_consensus.cc:2468] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:11:13.847877 30786 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:13.837182 30889 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.989271 23699 raft_consensus.cc:2393] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:13.990278 30743 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.969209 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:13.990839 30743 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.991933 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:13.851159 30775 consensus_queue.cc:1059] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:11:13.971782 30877 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.993054 23700 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:13.993999 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:13.982617 30786 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:13.979158 30690 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:13.985764 30597 consensus_queue.cc:1243] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:14.000016 30855 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.001869 30690 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:13.986928 30815 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:13.987322 30884 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:13.940747 30897 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.992094 30898 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:14.003153 30897 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.003710 30898 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:14.004712 30898 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.005494 30897 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:14.005915 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:14.006172 30636 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:14.001895 30900 raft_consensus.cc:3055] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:14.007057 30823 raft_consensus.cc:3060] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:14.007221 30900 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:13.973194 30903 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:14.008261 30900 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.009544 30900 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:14.012876 30596 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.013602 30865 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.014123 30865 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.992844 30877 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:13.926131 23519 catalog_manager.cc:5697] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 9 to 20, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 20 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:14.016889 24358 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.017125 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:14.037680 23700 raft_consensus.cc:2376] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16. Re-sending same reply.
I20260709 13:11:13.981681 30907 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.017926 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:14.038856 23701 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:14.040896 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:13.969009 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:14.041594 23696 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:14.042645 23701 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:14.048321 30854 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:14.048897 30854 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:13.840683 30902 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.027510 23669 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:14.050020 30854 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.071242 23701 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:14.074263 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:14.074338 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:14.123929 23702 raft_consensus.cc:2393] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 19: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:14.082427 23696 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
W20260709 13:11:14.082585 24360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.084062 30638 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:14.084574 23519 catalog_manager.cc:5697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.990319 30889 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:14.089524 30865 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.015515 30823 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:14.093117 30743 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.093433 30877 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:14.095091 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 67732us
I20260709 13:11:14.095659 30907 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:14.141934 23704 raft_consensus.cc:1240] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:11:14.096362 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:14.097401 30902 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.095690 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:14.102095 30718 consensus_meta.cc:287] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
W20260709 13:11:14.059059 30888 consensus_meta.cc:287] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
I20260709 13:11:14.088986 23625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:46526
I20260709 13:11:14.124462 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:14.131626 23701 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 11. Current term is 12. Ops: [10.9-11.10]
I20260709 13:11:14.133925 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:14.135478 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.150413 23625 raft_consensus.cc:606] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:14.135948 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:14.136320 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.137192 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.139050 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.151567 23701 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:11:14.139309 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.143949 23699 raft_consensus.cc:1813] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Handling vote request from an unknown peer 9ab488f10c434878a749f261e99a8065
I20260709 13:11:14.144742 23519 catalog_manager.cc:5697] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.153491 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.153788 23667 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:14.155557 23701 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:14.152974 23773 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:14.158286 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.158556 23699 raft_consensus.cc:2393] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:14.177703 23667 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:14.184782 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:14.186041 30884 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:14.185457 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:14.152452 30854 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:14.132699 30596 consensus_queue.cc:1059] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:11:14.189139 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:14.200595 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.200914 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.188275 23700 raft_consensus.cc:1275] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:11:14.202277 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.202942 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:14.206418 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 400958us
I20260709 13:11:14.206897 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:14.207988 23776 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:14.173169 30877 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:14.207824 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.202864 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.201505 23626 pending_rounds.cc:85] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 10
I20260709 13:11:14.212596 23626 pending_rounds.cc:107] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:11:14.212880 23626 raft_consensus.cc:2889] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:14.173820 30907 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:14.209666 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:14.214236 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.218753 23770 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:14.273130 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.274464 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:14.277813 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 69352.4us
I20260709 13:11:14.279850 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:14.203719 30899 log.cc:927] Time spent T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:14.284516 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.187875 30638 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:14.283433 23772 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 20.
W20260709 13:11:14.289553 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 79981.7us
I20260709 13:11:14.204253 30884 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:14.288514 23629 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:11:14.300771 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:14.306032 24387 consensus_meta.cc:287] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 13:11:14.306737 24387 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:11:14.157892 30888 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.215209 30461 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:14.210685 30901 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:14.213222 30597 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:14.292821 30925 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:11:14.342796 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.342763 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:14.340986 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:14.312561 30884 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.345299 30890 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:14.345566 30932 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:14.346179 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:14.339090 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:14.347810 23698 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
I20260709 13:11:14.366080 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:14.366676 23698 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 20.
W20260709 13:11:14.361718 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 87357.4us
I20260709 13:11:14.367977 23669 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:14.212251 30903 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.362474 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.375437 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:14.308661 30909 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:11:14.384776 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 76958.9us
I20260709 13:11:14.383373 23699 pending_rounds.cc:85] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 8
I20260709 13:11:14.390942 23699 pending_rounds.cc:107] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:11:14.361718 30884 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:14.391278 23699 raft_consensus.cc:2889] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:14.385746 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:14.397020 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:14.385898 30461 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:14.378171 30901 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:14.421849 23742 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:14.386104 30636 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:14.422943 23742 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:14.423141 30825 raft_consensus.cc:2804] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:14.423913 30825 raft_consensus.cc:697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:14.390987 30877 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:14.425828 30877 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:14.425200 30825 consensus_queue.cc:237] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.423933 30633 raft_consensus.cc:2804] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:14.346724 30597 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.430089 30597 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.430467 30633 raft_consensus.cc:697] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:14.432265 30633 consensus_queue.cc:237] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.432894 30461 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:14.439402 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.443971 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 61604.5us
I20260709 13:11:14.457198 23620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 3973) took 1106 ms. Trace:
I20260709 13:11:14.421101 30553 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:14.460860 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:14.457691 23620 rpcz_store.cc:276] 0709 13:11:13.351220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.351416 (+   196us) service_pool.cc:224] Handling call
0709 13:11:13.351712 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.840164 (+488452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.456920 (+616756us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54003250d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:14.457135 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093231872}
I20260709 13:11:14.472837 23696 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:14.446372 30909 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:14.375074 30890 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.471544 30897 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.493144 23519 catalog_manager.cc:5697] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 18 to 20, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 20 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.504492 23519 catalog_manager.cc:5697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.480806 30926 raft_consensus.cc:3055] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:14.511795 23519 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.495821 30929 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:14.519857 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:14.520573 23703 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:14.524053 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.525837 30936 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:14.526505 30936 raft_consensus.cc:697] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:14.509618 30926 raft_consensus.cc:740] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:14.530391 30926 consensus_queue.cc:260] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.533335 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:14.536350 23519 catalog_manager.cc:5697] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:14.539167 23629 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:14.546321 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 351540us
I20260709 13:11:14.547346 30882 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:14.501638 30596 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.549520 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:14.566610 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:14.567765 30938 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:14.570060 30938 consensus_queue.cc:1048] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:14.570901 30957 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:14.571480 30957 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.572311 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:14.572885 23696 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:14.573167 23703 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:14.574488 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.574707 23593 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:14.575790 30636 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:14.576395 30636 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:14.577402 30636 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.566686 30908 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:11:14.578953 30775 raft_consensus.cc:3055] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:14.579416 30775 raft_consensus.cc:740] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:14.580963 30957 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:14.586139 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:14.552943 30858 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:14.598130 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:14.551302 30734 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
W20260709 13:11:14.599066 30934 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:11:14.547875 30882 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.616189 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:14.617370 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.622593 23703 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
I20260709 13:11:14.637022 30884 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.639173 30884 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.566880 30861 consensus_queue.cc:1059] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:11:14.641342 30861 consensus_queue.cc:1243] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer 9ab488f10c434878a749f261e99a8065 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:14.641829 30861 raft_consensus.cc:3055] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:14.642134 30861 raft_consensus.cc:740] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:14.644037 23592 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:14.645146 30931 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:11:14.626889 30858 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:14.647547 30858 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:14.648128 24387 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:11:14.649416 30882 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:14.649708 23592 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:14.650542 30891 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:14.651654 23592 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:14.652792 30891 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:14.653488 30891 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:14.654477 30854 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.654632 30891 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.655022 30854 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.657732 30854 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:14.658941 23703 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:14.514381 30901 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.616052 30888 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.615829 30909 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.664511 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 3100) took 1055 ms. Trace:
W20260709 13:11:14.666251 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.553506 30596 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.664997 23770 rpcz_store.cc:276] 0709 13:11:13.609083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.609262 (+   179us) service_pool.cc:224] Handling call
0709 13:11:14.664266 (+1055004us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54002ca6d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:11:14.664408 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153356160}
I20260709 13:11:14.679423 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.693567 23696 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:11:14.527422 30936 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:14.720677 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44317.6us
I20260709 13:11:14.721632 23703 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:14.643023 30861 consensus_queue.cc:260] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.728329 23626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
 from {username='slave'} at 127.0.0.1:46526
I20260709 13:11:14.634218 30903 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.730676 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:14.731643 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:14.726629 23703 raft_consensus.cc:1240] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:14.735818 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 187743us
I20260709 13:11:14.736828 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:14.740319 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:14.742110 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.726652 30869 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:14.756635 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 132242us
W20260709 13:11:14.740604 30910 consensus_meta.cc:287] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.763s	user 0.011s	sys 0.000s
I20260709 13:11:14.765457 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.761216 24358 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:14.768726 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.757256 30947 log.cc:927] Time spent T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:11:14.767067 30734 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:14.769472 30734 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:14.769898 30734 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:14.746495 30827 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:14.774577 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:14.780051 23770 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:14.750208 30861 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:14.758394 30906 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:14.786854 30937 log.cc:927] Time spent T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:14.759289 30869 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:14.790235 30869 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.792428 30961 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:14.792966 30961 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.793519 30961 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:14.794621 30858 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:14.793028 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3433) took 1067 ms. Trace:
I20260709 13:11:14.779397 30904 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:14.796768 30904 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.796556 23695 rpcz_store.cc:276] 0709 13:11:13.725445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.735867 (+ 10422us) service_pool.cc:224] Handling call
0709 13:11:13.736254 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.736532 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.736560 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.737010 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.186903 (+449893us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:14.287678 (+100775us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.343047 (+ 55369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.343117 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.726806 (+383689us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b4800190158. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:11:14.792743 (+ 65937us) raft_consensus.cc:1685] finished
0709 13:11:14.792831 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.792968 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55095,"prepare.queue_time_us":100466,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":73505,"raft.run_cpu_time_us":10686,"raft.run_wall_time_us":363340,"spinlock_wait_cycles":11552640,"thread_start_us":449482,"threads_started":1,"wal-append.queue_time_us":679368}
I20260709 13:11:14.802158 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.804112 30890 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.804404 30596 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.815025 30734 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:14.818092 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 78784.9us
I20260709 13:11:14.821141 23626 raft_consensus.cc:606] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Received request to transfer leadership to TS 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:14.821805 23626 raft_consensus.cc:614] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:14.824236 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 63107.9us
W20260709 13:11:14.829830 30900 consensus_meta.cc:287] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.820s	user 0.012s	sys 0.001s
I20260709 13:11:14.817909 30734 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:14.812640 30827 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:14.835574 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:14.835183 24357 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:14.813944 30869 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:14.810192 30904 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:14.844311 23770 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:14.770679 30910 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.850782 30910 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.857254 30698 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:14.857725 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:14.858544 23770 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:14.860286 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.859126 30827 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.872541 23770 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
W20260709 13:11:14.896881 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.897261 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:14.898828 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:14.899523 24386 raft_consensus.cc:1240] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:14.899869 30698 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:14.900386 30698 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:14.900324 24390 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:14.901638 30698 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:14.903075 30864 raft_consensus.cc:3055] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:14.903550 30864 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:11:14.903911 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 57817.9us
I20260709 13:11:14.904486 30864 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.905591 30864 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:14.906574 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:14.907408 30881 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:14.908162 30892 consensus_queue.cc:1059] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:14.913911 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:14.920186 23775 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 17. Current term is 18. Ops: []
W20260709 13:11:14.926790 30932 consensus_meta.cc:287] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.002s
I20260709 13:11:14.927302 30932 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.928522 23620 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:14.916193 30858 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:14.936002 30969 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:14.940122 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:14.919387 30882 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.944058 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:14.944298 30882 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.945487 30898 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:14.946270 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:14.948794 30874 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:14.949077 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:14.950019 23626 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
I20260709 13:11:14.951252 24359 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:14.962724 30911 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:14.959769 30892 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:14.963482 30911 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:14.976585 30935 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:14.956589 30874 consensus_queue.cc:1059] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:11:14.979842 30698 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.980177 30935 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.974588 30892 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:14.985072 30882 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:14.987309 30874 consensus_queue.cc:1243] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:11:15.022135 23777 raft_consensus.cc:2410] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:11:15.006369 30935 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:15.007411 30911 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:15.035267 30954 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.297s	user 0.004s	sys 0.000s
I20260709 13:11:15.009740 30698 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:15.045189 23742 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.033206 30827 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:15.068264 30957 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:15.068871 30957 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:15.069933 30957 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.071406 30957 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:15.072340 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.074664 30973 log.cc:927] Time spent T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260709 13:11:15.082597 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:15.076454 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.083943 30892 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:15.078226 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.088413 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:15.084323 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54670 (request call id 1026) took 1333 ms. Trace:
I20260709 13:11:15.085891 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2939) took 1160 ms. Trace:
W20260709 13:11:15.090381 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 327120us
W20260709 13:11:15.088855 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.090675 23698 rpcz_store.cc:276] 0709 13:11:13.925851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.381897 (+456046us) service_pool.cc:224] Handling call
0709 13:11:14.382199 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.388893 (+  6694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.388937 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.395433 (+  6496us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.488014 (+ 92581us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:14.519812 (+ 31798us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.085545 (+565733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.085639 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.085679 (+    40us) raft_consensus.cc:1685] finished
0709 13:11:15.085691 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.085824 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":587301,"prepare.queue_time_us":35598,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":610289,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":158,"thread_start_us":45823,"threads_started":1,"wal-append.queue_time_us":46298}
I20260709 13:11:15.062909 30827 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.093439 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2942) took 1166 ms. Trace:
I20260709 13:11:15.094359 30553 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.094944 30553 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:15.079519 30698 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:15.119364 30972 log.cc:927] Time spent T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.002s
I20260709 13:11:15.125696 30855 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:15.101406 30775 consensus_queue.cc:260] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.127856 30961 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.128541 30775 raft_consensus.cc:3060] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:15.102864 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.103638 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:15.093880 23699 rpcz_store.cc:276] 0709 13:11:13.926560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.382888 (+456328us) service_pool.cc:224] Handling call
0709 13:11:14.383179 (+   291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:14.442832 (+ 59653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.442878 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:14.447180 (+  4302us) log.cc:844] Serialized 52 byte log entry
0709 13:11:14.690668 (+243488us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:14.729947 (+ 39279us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.089809 (+359862us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.090038 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.090107 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.090148 (+    41us) raft_consensus.cc:1685] finished
0709 13:11:15.090160 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.093373 (+  3213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390445,"prepare.queue_time_us":43062,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":4508,"raft.queue_time_us":369042,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":4742,"thread_start_us":213653,"threads_started":1,"wal-append.queue_time_us":113794}
I20260709 13:11:15.105008 30553 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:11:15.106020 30926 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:15.105728 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 513618us
W20260709 13:11:15.101344 30976 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:11:15.110507 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:15.111696 23743 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:15.113216 23667 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:15.152235 23742 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:15.116858 30865 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:15.117162 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2931) took 1194 ms. Trace:
I20260709 13:11:15.157750 23701 rpcz_store.cc:276] 0709 13:11:13.922784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.181076 (+258292us) service_pool.cc:224] Handling call
0709 13:11:14.181473 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.356570 (+175097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.356619 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.365167 (+  8548us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.629877 (+264710us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:14.711936 (+ 82059us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.089281 (+377345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.116744 (+ 27463us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54001324d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:15.116797 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.116861 (+    64us) raft_consensus.cc:1685] finished
0709 13:11:15.116964 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.117101 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":395634,"prepare.queue_time_us":90118,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2397,"raft.queue_time_us":418651,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":9117,"spinlock_wait_cycles":356044160,"thread_start_us":181598,"threads_started":1,"wal-append.queue_time_us":255861}
I20260709 13:11:15.117436 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:15.090107 23704 rpcz_store.cc:276] 0709 13:11:13.750665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.142732 (+392067us) service_pool.cc:224] Handling call
0709 13:11:14.146496 (+  3764us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.146829 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.146856 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.147281 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.395216 (+247935us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:14.484706 (+ 89490us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.083694 (+598988us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18003b4880. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b3e221a40 00007f2b3e21c4e4 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287 00007f2b41327208
0709 13:11:15.083911 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.083985 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.084035 (+    50us) raft_consensus.cc:1685] finished
0709 13:11:15.084138 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.084264 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93258,"prepare.queue_time_us":104331,"prepare.run_cpu_time_us":639,"prepare.run_wall_time_us":4147,"raft.queue_time_us":602538,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":7070,"spinlock_wait_cycles":4092288,"thread_start_us":191368,"threads_started":1,"wal-append.queue_time_us":309140}
I20260709 13:11:15.119285 23626 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:15.056053 30911 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:15.144797 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:15.162333 23773 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:15.156948 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 43817.3us
I20260709 13:11:15.115836 30889 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.167018 23593 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:15.169418 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:15.176218 30889 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.178879 30889 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:15.181932 23626 raft_consensus.cc:1240] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20. Ops: [17.10-19.11]
I20260709 13:11:15.183179 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:15.183439 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 71826.4us
I20260709 13:11:15.183936 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.183970 23627 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:11:15.184435 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.184991 23620 raft_consensus.cc:2410] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:11:15.185141 23775 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:15.186842 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.187647 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:15.194077 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 76732.8us
I20260709 13:11:15.195109 23668 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:15.130848 30961 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 21 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:15.157117 30975 log.cc:927] Time spent T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:11:15.147857 30827 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:15.199644 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.200193 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.107452 30935 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.168182 30553 raft_consensus.cc:2804] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:15.220786 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:15.203775 23772 raft_consensus.cc:2410] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:11:15.208209 23771 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:15.211615 23622 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:15.202031 30889 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:15.214250 30878 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.201627 30883 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:15.215246 30948 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.215458 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:15.219086 30894 raft_consensus.cc:993] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:11:15.209551 30884 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:15.252547 23701 raft_consensus.cc:1240] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:11:15.214600 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:15.272380 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:15.201794 30936 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:15.265954 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:15.201886 30891 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:15.210827 23592 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:15.270792 24386 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:11:15.272948 23704 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:15.289881 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:15.290992 23695 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:15.250662 30926 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:15.293432 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 82720.6us
I20260709 13:11:15.267266 30883 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.316452 30883 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:15.268715 30878 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.318624 23592 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:15.296449 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 85002.9us
I20260709 13:11:15.335245 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:15.271309 30884 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:15.336114 30884 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.336313 23703 raft_consensus.cc:2393] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:15.338798 23703 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:15.276292 30948 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.295351 30891 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:15.342384 23698 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
I20260709 13:11:15.304255 30881 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:15.342996 30891 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.344065 30881 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.344472 30881 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:15.352763 30984 log.cc:927] Time spent T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:15.353597 23698 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:15.319175 30878 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:15.356990 30732 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:15.320909 30935 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:15.290776 30936 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:15.366174 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47642.6us
I20260709 13:11:15.366559 23696 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:15.366962 23592 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:15.290470 23699 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:15.367410 23697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2947) took 1394 ms. Trace:
I20260709 13:11:15.323446 30898 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:15.331854 30718 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:15.333395 30979 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
W20260709 13:11:15.333698 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.341760 30948 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:15.264976 30553 raft_consensus.cc:697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:15.358134 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:15.384066 23622 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:15.386705 30881 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.310240 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:15.389240 30881 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:15.361995 23701 raft_consensus.cc:1275] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:11:15.363773 23703 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:11:15.364727 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 165422us
I20260709 13:11:15.369639 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:15.370241 23696 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:15.393646 23704 raft_consensus.cc:3060] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:15.371279 30909 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:15.290517 30894 raft_consensus.cc:1081] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:11:15.375532 23775 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:11:15.365758 30934 log.cc:927] Time spent T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:11:15.292565 30597 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:15.371114 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:15.394819 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:15.401412 23622 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 20.
I20260709 13:11:15.405125 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:15.413568 24386 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:11:15.414842 24385 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 20: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:15.368472 30815 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:15.367851 23697 rpcz_store.cc:276] 0709 13:11:13.972719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.495537 (+522818us) service_pool.cc:224] Handling call
0709 13:11:14.505714 (+ 10177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.085148 (+579434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.085182 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.085714 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.237446 (+151732us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:15.271142 (+ 33696us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.289102 (+ 17960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.289748 (+   646us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.367204 (+ 77456us) raft_consensus.cc:1685] finished
0709 13:11:15.367225 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.367350 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":595542,"prepare.queue_time_us":38800,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":600504,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":23162,"spinlock_wait_cycles":952192,"thread_start_us":151207,"threads_started":1,"wal-append.queue_time_us":239738}
I20260709 13:11:15.368466 30936 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:15.369299 30864 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:15.412921 23777 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:15.415458 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 105347us
I20260709 13:11:15.423930 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:15.358343 30926 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.419142 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:15.429272 30945 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:15.394315 30827 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:11:15.376106 30898 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.406322 23695 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:15.474833 30898 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:15.448984 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2948) took 1422 ms. Trace:
I20260709 13:11:15.475481 23702 rpcz_store.cc:276] 0709 13:11:14.026998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.523541 (+496543us) service_pool.cc:224] Handling call
0709 13:11:14.523898 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.108070 (+584172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.108110 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.108582 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.164158 (+ 55576us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:15.165692 (+  1534us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.248257 (+ 82565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.307042 (+ 58785us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b180002e9c0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f522 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:11:15.411221 (+104179us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b180002e9c0. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e1ed2a6 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419
0709 13:11:15.448666 (+ 37445us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540040e054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:15.448742 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.448785 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:15.448797 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.448924 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":547267,"prepare.queue_time_us":211,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":475400,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":17045,"spinlock_wait_cycles":448078464,"thread_start_us":54993,"threads_started":1,"wal-append.queue_time_us":111140}
I20260709 13:11:15.447849 23777 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 24.
I20260709 13:11:15.451392 24386 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:15.447891 30596 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:15.479809 30882 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.480496 30882 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:15.481824 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 76073.5us
I20260709 13:11:15.417083 30597 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.486055 30597 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:15.418851 30948 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:15.487018 30882 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:15.436098 30858 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:11:15.453208 23668 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:15.525249 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 72140.2us
I20260709 13:11:15.458524 30799 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:15.459542 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:15.383064 30718 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.451138 30883 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.468231 30963 consensus_queue.cc:1048] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:15.468268 30895 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:15.472572 23773 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 21.
I20260709 13:11:15.441298 23704 raft_consensus.cc:2468] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 21.
I20260709 13:11:15.420042 30815 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.488046 30760 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:11:15.521283 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.535271 23696 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:11:15.521399 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 71971.1us
I20260709 13:11:15.521721 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.522583 23592 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:15.519994 30932 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:15.500963 30945 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.528815 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.576552 23627 raft_consensus.cc:2393] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 20: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:15.529923 23776 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:15.530795 30897 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:15.533227 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 73772.5us
I20260709 13:11:15.526592 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:15.572831 24359 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:15.574515 24357 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:15.575163 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:15.581248 23695 raft_consensus.cc:3060] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:15.531898 24387 raft_consensus.cc:1275] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:15.587091 23701 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 21: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:15.534968 30597 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:15.593259 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:15.565691 30760 consensus_queue.cc:1243] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer 4466bf6d6cf84ee89e84ea074e3964c9 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:15.539942 30799 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:15.600875 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:15.535905 30596 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:15.562760 30889 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:15.612792 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.538074 30893 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:11:15.616086 30718 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:15.617811 30883 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:15.525102 30553 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.618443 30799 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:15.621279 30827 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:15.621861 30827 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 24 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:15.587499 30897 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.624653 30905 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:15.625618 30905 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:15.625828 30815 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:15.578171 30932 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.624671 30897 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.635387 23695 raft_consensus.cc:2468] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 20.
I20260709 13:11:15.629773 23623 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:11:15.629799 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.644326 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.645172 23628 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:11:15.648272 30926 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:15.632542 30732 consensus_queue.cc:1048] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:11:15.649520 30932 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:15.568804 30509 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:11:15.622695 30827 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.641479 30889 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.653198 30889 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:15.603849 30939 raft_consensus.cc:2804] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:15.604801 30900 raft_consensus.cc:2804] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:15.685314 30945 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:15.630878 30596 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.690583 30596 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:15.691641 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:15.700177 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.700476 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.700730 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.701157 23773 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:11:15.701555 23777 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 17: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:15.702927 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.703581 23777 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:15.705214 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.706583 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:15.707959 23667 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:15.640669 30892 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.719940 30892 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.722563 30936 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.724092 23775 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:15.725047 30865 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:15.725589 30865 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:15.726074 30865 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:15.727797 30897 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.728814 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.729195 30892 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:15.783390 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:15.784188 30936 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:15.785305 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:15.786059 23698 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:15.736562 30815 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:15.717454 30884 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.737303 30897 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:15.736699 30939 raft_consensus.cc:697] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:15.794889 30855 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:15.795573 30939 consensus_queue.cc:237] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.797760 30888 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:15.800282 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:15.801054 24390 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.746528 30732 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.804593 30732 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.807207 30732 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:15.740693 30900 raft_consensus.cc:697] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:15.809567 30900 consensus_queue.cc:237] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:15.780994 30895 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:11:15.825520 30957 raft_consensus.cc:3055] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:15.826148 30957 raft_consensus.cc:740] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:15.862174 23698 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:15.872918 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:15.881424 23700 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:15.890645 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:15.891688 23700 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:15.895843 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:15.896713 23695 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
W20260709 13:11:15.898268 24357 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.860664 30815 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:15.906878 23700 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 24.
I20260709 13:11:15.912197 23701 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:15.905081 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:15.913919 23700 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:15.913201 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:15.919404 23703 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:15.922063 23700 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:11:15.924063 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:15.924907 23700 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
W20260709 13:11:15.927841 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 405310us
I20260709 13:11:15.905570 23695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45086
I20260709 13:11:15.933030 23695 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:15.933517 23695 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:15.935493 23776 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:15.936081 23770 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:15.936664 23701 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:11:15.937852 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 337064us
I20260709 13:11:15.940392 23701 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:15.940323 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.942997 23777 pending_rounds.cc:85] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 10
I20260709 13:11:15.943408 23777 pending_rounds.cc:107] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:11:15.940697 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:15.944469 23770 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:15.943696 23777 raft_consensus.cc:2889] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.949909 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:15.941318 23775 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:11:15.948737 30897 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:15.963901 30897 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.966303 30897 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:15.966923 30698 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:15.970283 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:15.971619 24390 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:15.960587 23695 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.919525 30936 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:15.981642 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.977228 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.968751 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:15.979110 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.980386 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.983660 23622 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 22: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:15.974196 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:15.910749 30815 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:15.986764 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.988227 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:15.992233 23623 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.992344 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:15.993067 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:15.967962 30945 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:15.974215 30889 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:16.008327 24391 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:11:16.010020 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:15.999958 30881 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:16.013522 23695 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:16.015710 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:16.015929 23703 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:16.012166 30889 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.022802 30889 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:16.004562 30888 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:11:16.036209 30892 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:16.037137 30888 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:15.983703 30894 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:11:16.038008 30933 raft_consensus.cc:3055] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:16.038493 30933 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:16.040059 30698 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:15.984447 30895 consensus_queue.cc:1059] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:11:16.040542 30698 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:16.007717 30936 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:16.041767 30698 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:16.042184 30936 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:16.044094 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:16.044888 23772 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:16.048622 24358 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:16.002750 30901 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:11:16.073199 30889 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:16.075527 30889 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:16.019155 30881 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.080080 30881 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:16.083244 30855 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:16.083813 30957 consensus_queue.cc:260] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:16.085107 30957 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:16.089979 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:16.090639 23775 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:11:16.090826 23668 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:16.039549 30933 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:16.092983 30933 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:16.093003 30760 consensus_queue.cc:1175] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" responder_term: 15 status { last_received { term: 15 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 15 index: 12 } }
I20260709 13:11:16.097198 30815 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:16.097780 30815 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:16.098214 30815 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:16.099053 30815 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:16.059886 30884 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:16.113129 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:16.128719 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:16.129103 23595 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.007s	sys 0.019s
W20260709 13:11:16.130123 23595 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.007s	sys 0.019s
I20260709 13:11:16.153506 23772 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:11:16.170687 23623 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:16.171041 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:16.172143 23743 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:16.172735 23621 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:16.174252 24385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.021s
W20260709 13:11:16.178234 24385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.005s	sys 0.021s
W20260709 13:11:16.176039 24387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.022s	sys 0.009s
I20260709 13:11:16.176544 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:16.170769 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:16.180224 23626 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
W20260709 13:11:16.188627 24387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.022s	sys 0.009s
W20260709 13:11:16.171684 30553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.035s
I20260709 13:11:16.218673 23701 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:16.222728 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:16.142778 30596 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:16.231122 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 59063.6us
W20260709 13:11:16.187952 30827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.015s	sys 0.015s
I20260709 13:11:16.252435 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:16.248576 23629 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:11:16.220764 30553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.010s	sys 0.036s
I20260709 13:11:16.215612 30882 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:16.274529 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 43940.9us
W20260709 13:11:16.251891 30827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.016s	sys 0.015s
I20260709 13:11:16.294705 23697 raft_consensus.cc:1240] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:16.262682 30865 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.000s
I20260709 13:11:16.299589 23775 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:11:16.269786 30597 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:16.356451 30597 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:16.326330 30889 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:16.271979 30963 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:11:16.311705 30891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.008s	sys 0.021s
I20260709 13:11:16.253962 30596 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:16.315634 30799 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:16.373929 23621 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:16.323758 30553 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.396705 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 375858us
W20260709 13:11:16.385897 30891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.008s	sys 0.021s
I20260709 13:11:16.359704 30597 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:16.391057 30509 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:16.318313 30865 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:16.455287 23702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.008s	sys 0.060s
I20260709 13:11:16.472218 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:16.454264 23626 raft_consensus.cc:1240] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:16.386121 30889 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:16.492722 23702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.010s	sys 0.061s
I20260709 13:11:16.497408 23696 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
I20260709 13:11:16.498225 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:16.498914 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:16.499473 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:16.420029 30966 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.422833 30926 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:16.497052 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 481394us
I20260709 13:11:16.500319 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:16.501271 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:16.505378 23620 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 21: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:16.488981 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:16.514624 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.492144 30597 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:16.423265 30553 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:16.529137 30989 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 13:11:16.453096 30991 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:11:16.456045 30894 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:11:16.472936 30901 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:11:16.547857 23620 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:16.555474 30882 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:11:16.569968 30945 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:16.577836 30698 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:16.545049 30893 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.580248 30893 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:16.550778 30892 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:11:16.584642 30827 consensus_queue.cc:1059] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:16.537457 30760 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.593068 30999 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:11:16.512494 30926 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:16.604410 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 115529us
I20260709 13:11:16.607540 23669 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:16.515707 30966 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:16.626178 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:16.627663 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:16.630858 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:16.611123 30900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.009s	sys 0.031s
I20260709 13:11:16.647396 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:16.623281 30858 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.642323 30997 log.cc:927] Time spent T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:11:16.600530 30827 consensus_queue.cc:1243] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer c885217113574e7489e6c3afb6950f76 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:11:16.648970 30900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.009s	sys 0.031s
I20260709 13:11:16.631764 30815 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:16.642293 30893 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:16.649420 30597 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:16.601950 30760 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:16.637131 23700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.008s	sys 0.024s
I20260709 13:11:16.635119 30945 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:16.642663 30936 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.762811 23700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.009s	sys 0.024s
I20260709 13:11:16.765858 23770 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:11:16.775876 23770 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:16.724807 31010 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.764268 30884 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:16.671983 30858 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:16.793416 24387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 1005) took 1148 ms. Trace:
I20260709 13:11:16.793884 24387 rpcz_store.cc:276] 0709 13:11:15.640528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.640717 (+   189us) service_pool.cc:224] Handling call
0709 13:11:15.648984 (+  8267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.649426 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.649468 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.649997 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.191356 (+541359us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:16.191415 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.194863 (+  3448us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.789068 (+594205us) raft_consensus.cc:1685] finished
0709 13:11:16.789094 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.789228 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6310,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":8077,"thread_start_us":540958,"threads_started":1,"wal-append.queue_time_us":845885}
I20260709 13:11:16.786928 30596 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:16.811527 23743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.041s	sys 0.079s
I20260709 13:11:16.778061 30936 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:16.785175 30945 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:11:16.813959 23743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.042s	sys 0.079s
I20260709 13:11:16.790331 30889 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:16.824069 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 554393us
W20260709 13:11:16.924013 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 85709.5us
I20260709 13:11:16.926631 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:11:16.831701 30881 consensus_meta.cc:287] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.004s
I20260709 13:11:16.790508 31010 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:16.797573 30882 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:16.987948 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 61421.4us
I20260709 13:11:16.825847 30945 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:16.825280 30553 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:17.040611 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 210036us
I20260709 13:11:17.026296 30732 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:11:17.061733 31001 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.477s	user 0.001s	sys 0.004s
I20260709 13:11:16.984529 30909 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:11:16.986845 30881 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.063133 30901 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.027199 30882 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.065754 30926 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.065564 30966 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:17.082912 31005 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.484s	user 0.000s	sys 0.002s
I20260709 13:11:17.073385 30732 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.105611 23622 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 22: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:11:17.112491 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 70402.8us
I20260709 13:11:17.074463 30932 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:11:17.086140 30895 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:11:17.108127 30732 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:17.116338 31008 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
W20260709 13:11:17.126454 31011 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:11:17.127267 31014 log.cc:927] Time spent T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:17.119653 30760 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.128580 30932 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:17.118570 31033 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:17.097148 30901 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:17.123644 31013 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
W20260709 13:11:17.122251 31002 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 13:11:17.131543 30945 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:17.122051 31007 log.cc:927] Time spent T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:11:17.132366 30858 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:17.132598 31010 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.166004 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2974) took 1242 ms. Trace:
I20260709 13:11:17.169093 30881 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.171028 30882 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:17.172212 23696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 3467) took 1457 ms (client timeout 1714 ms). Trace:
I20260709 13:11:17.166595 23699 rpcz_store.cc:276] 0709 13:11:15.923647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.926506 (+  2859us) service_pool.cc:224] Handling call
0709 13:11:15.926922 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.927810 (+   888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.927839 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.928264 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.103359 (+175095us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b4800190158. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:11:16.383979 (+280620us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:16.384033 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.384118 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.165627 (+781509us) raft_consensus.cc:1685] finished
0709 13:11:17.165656 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.165922 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":434,"raft.queue_time_us":1153,"raft.run_cpu_time_us":2319,"raft.run_wall_time_us":165816,"spinlock_wait_cycles":15153536,"thread_start_us":383353,"threads_started":1,"wal-append.queue_time_us":623069}
W20260709 13:11:17.135064 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 74546.5us
W20260709 13:11:17.118564 31012 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:11:17.149317 30933 consensus_meta.cc:287] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 1.056s	user 0.009s	sys 0.003s
I20260709 13:11:17.152187 23771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 3145) took 1222 ms. Trace:
I20260709 13:11:17.177634 23771 rpcz_store.cc:276] 0709 13:11:15.929494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.933228 (+  3734us) service_pool.cc:224] Handling call
0709 13:11:15.982317 (+ 49089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.986266 (+  3949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.986310 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.986863 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.386170 (+399307us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:16.386212 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.388525 (+  2313us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.151899 (+763374us) raft_consensus.cc:1685] finished
0709 13:11:17.151926 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.152120 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3466,"raft.queue_time_us":4358,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":11807,"thread_start_us":371369,"threads_started":1,"wal-append.queue_time_us":636560}
W20260709 13:11:17.167521 31003 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.583s	user 0.000s	sys 0.003s
I20260709 13:11:17.182302 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3470) took 1393 ms. Trace:
I20260709 13:11:17.182664 23704 rpcz_store.cc:276] 0709 13:11:15.789000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.789148 (+   148us) service_pool.cc:224] Handling call
0709 13:11:15.789600 (+   452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:15.829353 (+ 39753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.829401 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:15.841339 (+ 11938us) log.cc:844] Serialized 52 byte log entry
0709 13:11:16.317340 (+476001us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:16.623830 (+306490us) log.cc:844] Serialized 14 byte log entry
0709 13:11:16.624281 (+   451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.624425 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.166673 (+542248us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:11:17.181977 (+ 15304us) raft_consensus.cc:1685] finished
0709 13:11:17.182074 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.182237 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":479803,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":1437,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":8269,"spinlock_wait_cycles":25097600,"thread_start_us":664359,"threads_started":2,"wal-append.queue_time_us":698733}
I20260709 13:11:17.144611 31033 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.184829 31029 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:17.144197 30936 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:17.172780 23696 rpcz_store.cc:269] 0709 13:11:15.715319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.782996 (+ 67677us) service_pool.cc:224] Handling call
0709 13:11:17.171937 (+1388941us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b540026a7d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:11:17.172100 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639853312}
I20260709 13:11:17.185398 31029 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.190049 31029 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.210807 23621 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:17.212667 31035 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.213289 31035 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:17.197710 30898 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.142452 30932 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.215488 31035 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:17.225474 30932 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:17.218798 31006 log.cc:927] Time spent T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.686s	user 0.003s	sys 0.021s
I20260709 13:11:17.231402 24386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 1004) took 1657 ms. Trace:
I20260709 13:11:17.233155 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.231791 24386 rpcz_store.cc:276] 0709 13:11:15.574054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.574615 (+   561us) service_pool.cc:224] Handling call
0709 13:11:15.596214 (+ 21599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.000173 (+403959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.000214 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.000702 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.284363 (+283661us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:16.284400 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.284469 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.218249 (+933780us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:11:17.231131 (+ 12882us) raft_consensus.cc:1685] finished
0709 13:11:17.231152 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.231334 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4615,"raft.queue_time_us":28809,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":6226176,"thread_start_us":682134,"threads_started":2,"wal-append.queue_time_us":531434}
I20260709 13:11:17.217783 30732 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.242038 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:17.245491 23624 raft_consensus.cc:3055] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:17.245944 23624 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:17.249279 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:17.249974 23622 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:11:17.252055 30509 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:17.252580 30509 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:17.252843 31000 log.cc:927] Time spent T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.664s	user 0.013s	sys 0.004s
I20260709 13:11:17.254240 24385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46580 (request call id 1006) took 1598 ms. Trace:
I20260709 13:11:17.254632 24385 rpcz_store.cc:276] 0709 13:11:15.655946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.656086 (+   140us) service_pool.cc:224] Handling call
0709 13:11:15.656387 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.656729 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.656756 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.657144 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.178626 (+521482us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:16.178681 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.178757 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.252188 (+1073431us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:11:17.253922 (+  1734us) raft_consensus.cc:1685] finished
0709 13:11:17.253946 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.254179 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10840,"raft.queue_time_us":812,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10061,"spinlock_wait_cycles":25179008,"thread_start_us":521200,"threads_started":1,"wal-append.queue_time_us":876156}
I20260709 13:11:17.236455 30898 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.258905 30898 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:17.259383 23626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 4024) took 1043 ms. Trace:
I20260709 13:11:17.259812 23626 rpcz_store.cc:276] 0709 13:11:16.215935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.216152 (+   217us) service_pool.cc:224] Handling call
0709 13:11:16.216515 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.490627 (+274112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.259148 (+768521us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b540037ee54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:17.259326 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546294528}
I20260709 13:11:17.262458 23624 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.268247 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:17.263609 23624 raft_consensus.cc:3060] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:17.218463 30901 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:17.272805 31004 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.673s	user 0.009s	sys 0.005s
W20260709 13:11:17.275291 30698 consensus_meta.cc:287] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.697s	user 0.013s	sys 0.000s
I20260709 13:11:17.277359 31034 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.277963 31034 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.281420 30732 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:17.282007 30865 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:17.283490 30998 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.755s	user 0.007s	sys 0.014s
I20260709 13:11:17.285156 23777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 3149) took 1351 ms. Trace:
W20260709 13:11:17.301446 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.239946 31033 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.285727 23777 rpcz_store.cc:276] 0709 13:11:15.934143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.942339 (+  8196us) service_pool.cc:224] Handling call
0709 13:11:15.942728 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:15.974615 (+ 31887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.974661 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:15.975369 (+   708us) log.cc:844] Serialized 52 byte log entry
0709 13:11:16.388999 (+413630us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:16.389057 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.389152 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.272102 (+882950us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:11:17.284908 (+ 12806us) raft_consensus.cc:1685] finished
0709 13:11:17.284927 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.285099 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27603,"raft.queue_time_us":33325,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":24323456,"thread_start_us":413237,"threads_started":1,"wal-append.queue_time_us":623933}
I20260709 13:11:17.324980 23628 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 23.
I20260709 13:11:17.331604 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3474) took 1454 ms. Trace:
I20260709 13:11:17.331951 23702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3469) took 1543 ms. Trace:
I20260709 13:11:17.332062 23698 rpcz_store.cc:276] 0709 13:11:15.876872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.876997 (+   125us) service_pool.cc:224] Handling call
0709 13:11:15.921967 (+ 44970us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b580000ff98. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e7a22 00007f2b47100c09 00007f2b4625aee0 00007f2b463240ab 00007f2b46324131 00007f2b462e5fc0 00007f2b462d0929 00007f2b462d03d2 00007f2b3f847bd4
0709 13:11:15.922141 (+   174us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:15.922552 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.922579 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:15.945963 (+ 23384us) log.cc:844] Serialized 78 byte log entry
0709 13:11:16.391070 (+445107us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:16.820472 (+429402us) log.cc:844] Serialized 14 byte log entry
0709 13:11:16.830873 (+ 10401us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.182454 (+351581us) spinlock_profiling.cc:243] Waited 85.8 ms on lock 0x7b1800052540. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f522 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:11:17.331084 (+148630us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b1800052540. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e199c0a 00007f2b478d9219 00007f2b3e221a40 00007f2b3e21c4e4 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287 00007f2b41327208
0709 13:11:17.331286 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.331357 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.331396 (+    39us) raft_consensus.cc:1685] finished
0709 13:11:17.331408 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.331546 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10111,"prepare.queue_time_us":696245,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":104,"raft.queue_time_us":6889,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":17749,"spinlock_wait_cycles":312962432,"thread_start_us":776009,"threads_started":2,"wal-append.queue_time_us":679162}
I20260709 13:11:17.338645 30553 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:17.338900 31034 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.339336 30553 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.341645 30553 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.342201 30553 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:17.342679 30553 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.344370 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2976) took 1415 ms. Trace:
I20260709 13:11:17.315805 30698 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:17.353453 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:17.348654 23742 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.244.2:44167 timed out after 1.714s (SENT) [suppressed 38 similar messages]
I20260709 13:11:17.360832 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:17.344923 23700 rpcz_store.cc:276] 0709 13:11:15.928995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.930704 (+  1709us) service_pool.cc:224] Handling call
0709 13:11:15.931006 (+   302us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:15.957948 (+ 26942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.957992 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:15.989426 (+ 31434us) log.cc:844] Serialized 78 byte log entry
0709 13:11:16.770506 (+781080us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:17.029304 (+258798us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.344014 (+314710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.344092 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.344139 (+    47us) raft_consensus.cc:1685] finished
0709 13:11:17.344160 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.344308 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":340366,"prepare.queue_time_us":260973,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":36524,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":7249,"thread_start_us":952486,"threads_started":2,"wal-append.queue_time_us":941126}
I20260709 13:11:17.361665 24386 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 19: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:17.332705 23702 rpcz_store.cc:276] 0709 13:11:15.788485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.788653 (+   168us) service_pool.cc:224] Handling call
0709 13:11:15.840406 (+ 51753us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:15.840931 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.840971 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:15.843033 (+  2062us) log.cc:844] Serialized 52 byte log entry
0709 13:11:16.495762 (+652729us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:16.831308 (+335546us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.331438 (+500130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.331562 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.331621 (+    59us) raft_consensus.cc:1685] finished
0709 13:11:17.331642 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.331868 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":499820,"prepare.queue_time_us":522642,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":26005,"raft.queue_time_us":697,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":6480,"thread_start_us":967091,"threads_started":2,"wal-append.queue_time_us":827804}
I20260709 13:11:17.367614 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.367923 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.368327 23777 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:11:17.368697 23772 raft_consensus.cc:2393] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 23: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:17.369266 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:17.369613 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.370222 23777 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:17.370321 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.372367 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.373147 23776 raft_consensus.cc:2368] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:17.368575 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.381183 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:17.381258 23629 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:17.381841 23629 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:17.383934 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:17.384616 23623 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:17.380141 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:17.382535 23629 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.388521 23629 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.398746 23623 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 23.
I20260709 13:11:17.372452 30936 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.403316 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:11:17.389963 30891 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:11:17.391803 31026 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.407886 23667 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:17.408439 30865 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.400705 30799 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:17.408885 30596 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:17.408965 30936 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.409431 30815 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:17.409870 31023 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:17.410310 30926 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:17.540261 30926 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.412918 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.544533 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:17.360370 30698 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.547505 30698 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.509222 30799 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.416025 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:17.548064 30799 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:17.548452 23770 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 22: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:17.549522 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.550604 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.441923 30945 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:17.428990 23778 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:17.552279 30945 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:17.553170 30945 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.436144 23629 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:11:17.554960 23629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52050 (request call id 2823) took 1056 ms. Trace:
I20260709 13:11:17.555292 23629 rpcz_store.cc:276] 0709 13:11:16.498010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.499263 (+  1253us) service_pool.cc:224] Handling call
0709 13:11:17.381136 (+881873us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b5400178020. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41283dc0 00007f2b4130fe18 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:17.554864 (+173728us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113454848}
I20260709 13:11:17.435092 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:17.556977 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 122006us
I20260709 13:11:17.557282 31023 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.557677 23667 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:17.449187 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:17.558730 23699 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:17.450169 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:17.559821 23703 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:11:17.511155 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:17.522835 23704 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:17.438872 30553 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.560856 23696 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:17.525799 30936 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:17.516454 30893 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:17.514724 30596 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.509392 30865 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.551677 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.509229 30933 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:17.584124 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 235508us
W20260709 13:11:17.585901 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.588219 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:17.588850 23621 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:17.589870 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:17.590026 23623 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:17.596469 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.596755 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.592211 30889 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:17.621661 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.565515 30926 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.631595 30889 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 22 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:17.631937 30864 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:17.632454 30864 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.632663 30889 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.634586 30864 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.631623 30855 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:17.636597 30855 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.637704 30909 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:17.638221 30909 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.638814 30855 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.639814 30963 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:17.640303 30909 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.595708 30553 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:17.592221 30698 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.458909 31026 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.650085 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.615473 30894 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:17.624881 31015 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:17.697283 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.651675 30926 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:17.559204 30815 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:17.696507 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.699812 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.595559 30933 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.703827 30991 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:17.711410 23628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52042 (request call id 4021) took 1538 ms. Trace:
I20260709 13:11:17.667181 30698 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.714990 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:17.736491 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:17.628917 31025 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:17.650458 30553 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:17.736267 23628 rpcz_store.cc:276] 0709 13:11:16.173016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.173866 (+   850us) service_pool.cc:224] Handling call
0709 13:11:17.711231 (+1537365us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400064fd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:11:17.711349 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420425088}
I20260709 13:11:17.697929 31015 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:17.759109 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 46821.3us
I20260709 13:11:17.718945 30509 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.738734 30926 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.738847 31033 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:17.772826 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:17.757279 30553 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:17.764942 31015 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:17.737475 30894 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.809369 23778 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:17.810087 30957 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:17.754487 31025 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.754609 30991 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.804849 31033 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.822894 30597 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:17.824249 31023 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.823858 30957 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:11:17.865376 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 307765us
I20260709 13:11:17.880179 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:17.872887 23667 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:17.890638 23667 leader_election.cc:400] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:17.891083 23667 leader_election.cc:403] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:11:17.892405 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:17.869223 30893 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:17.871318 30865 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.870635 31023 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:17.869725 30596 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.924283 30926 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:17.925662 31054 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:11:17.932261 31050 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:11:17.938230 31026 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.939007 30957 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.943696 30509 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:17.945303 30894 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.946389 30933 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.947212 30596 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:17.948237 30815 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:17.867414 30597 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.952349 30909 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:17.953152 30909 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.953976 30597 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.955204 30893 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.905424 30993 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:17.962417 31033 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.963639 30509 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:17.964403 30509 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.967087 30509 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.967670 31025 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.969537 30799 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:17.972170 23776 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 22: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:17.922889 31023 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:17.975231 31023 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:17.910867 30945 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:17.978138 30945 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.978621 30945 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:17.986258 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:17.987027 23701 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 23.
I20260709 13:11:17.987952 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:17.991508 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:17.999475 30799 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:17.901181 30935 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:18.024387 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:17.935889 30991 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:18.026386 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 305837us
I20260709 13:11:18.030200 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:18.037355 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:18.052315 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.066236 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:18.072427 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.079687 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.085397 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.085264 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.035648 31023 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:18.049618 30909 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:18.062624 31025 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:18.036240 30935 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.160151 23698 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:18.161237 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.161557 23697 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:11:18.163326 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.165126 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.165489 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.166666 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.166877 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.161837 23698 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
W20260709 13:11:18.167870 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.163353 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:18.169808 31004 log.cc:927] Time spent T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:11:18.179898 23695 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:18.150733 30882 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:18.187786 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.188215 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.188489 24387 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:18.189383 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.191820 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.206683 30935 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:18.208786 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.186674 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.211402 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.212631 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.212963 30882 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.214303 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.215384 30882 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:18.097427 31023 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.221149 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.220186 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.144134 31025 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.223438 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.224752 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:18.232372 23773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.005s	sys 0.035s
I20260709 13:11:18.235467 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.239849 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.241482 23695 raft_consensus.cc:2468] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
W20260709 13:11:18.242395 23773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.005s	sys 0.035s
I20260709 13:11:18.245286 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.250201 23701 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:11:18.253368 31023 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:18.278815 31070 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.286211 31070 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.286731 30991 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:18.287642 30991 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.266971 30698 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:18.291366 30991 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:18.303562 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.320845 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:18.321444 23622 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
W20260709 13:11:18.235503 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 334854us
I20260709 13:11:18.292995 30596 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:18.325809 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:18.326700 23621 raft_consensus.cc:2368] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:18.331845 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.296113 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.335670 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.262184 30553 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:18.336714 23629 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:11:18.343641 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.345546 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.348387 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.349596 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.351964 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.353055 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.355504 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.356114 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.358289 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.359023 23695 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 21.
I20260709 13:11:18.353209 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.363682 23669 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:18.367223 23697 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
I20260709 13:11:18.369527 23695 raft_consensus.cc:1275] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:18.370770 23669 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.371479 23625 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:18.381614 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.382525 23695 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:18.384325 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.384850 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:18.386720 31015 consensus_meta.cc:287] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.002s
I20260709 13:11:18.387302 30865 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:18.387951 30865 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:18.390260 30865 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:18.390862 30865 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:11:18.387504 31061 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:11:18.393131 30553 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:18.391362 30865 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:18.397507 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:18.400259 30882 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:18.400707 30882 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:18.401090 30882 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:18.401839 30993 consensus_queue.cc:1048] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:18.405282 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:18.383769 31053 log.cc:927] Time spent T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:11:18.407619 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:18.408604 23623 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 21: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:18.409489 31025 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:18.357457 30596 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:18.410761 23775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43460 (request call id 3131) took 1044 ms. Trace:
I20260709 13:11:18.418143 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:18.380775 31023 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:18.395093 31060 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:11:18.411309 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:18.419039 23695 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.420468 30596 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.446419 23623 pending_rounds.cc:85] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Aborting all ops after (but not including) 9
I20260709 13:11:18.447504 23623 pending_rounds.cc:107] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:11:18.448064 23623 raft_consensus.cc:2889] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.394908 31056 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:18.418632 23775 rpcz_store.cc:276] 0709 13:11:17.366395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.366566 (+   171us) service_pool.cc:224] Handling call
0709 13:11:17.366864 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.367079 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.367103 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.375993 (+  8890us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.864788 (+488795us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:17.864835 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.864911 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.410555 (+545644us) raft_consensus.cc:1685] finished
0709 13:11:18.410580 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.410708 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":436333,"threads_started":1,"wal-append.queue_time_us":671941}
I20260709 13:11:18.481846 30865 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.387300 31015 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:18.484549 31066 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.255s	user 0.003s	sys 0.000s
I20260709 13:11:18.486459 31015 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:18.487231 31023 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:18.477138 31069 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:11:18.489121 30596 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:18.490028 23700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3484) took 1045 ms. Trace:
I20260709 13:11:18.420903 30945 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:18.490442 23700 rpcz_store.cc:276] 0709 13:11:17.445068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.454542 (+  9474us) service_pool.cc:224] Handling call
0709 13:11:17.454957 (+   415us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:17.516159 (+ 61202us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:17.616088 (+ 99929us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.870709 (+254621us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:17.892898 (+ 22189us) log.cc:844] Serialized 52 byte log entry
0709 13:11:17.893050 (+   152us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:17.897716 (+  4666us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.898091 (+   375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.898164 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.489802 (+591638us) raft_consensus.cc:1685] finished
0709 13:11:18.489825 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.489966 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4633,"prepare.queue_time_us":104470,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":3888,"raft.queue_time_us":106724,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":67060,"thread_start_us":224076,"threads_started":1,"wal-append.queue_time_us":449902}
I20260709 13:11:18.494045 23770 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 21: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:18.497730 23702 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 23.
I20260709 13:11:18.506753 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.502314 23695 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:18.507763 24385 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:18.509172 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.511188 23699 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 21: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:18.533118 30945 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:18.535219 31035 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:18.537876 30990 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:18.539050 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:18.542440 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.546772 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:18.548143 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:18.525096 31023 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.551035 31034 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:18.558852 31023 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:18.561578 23778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 3179) took 1119 ms. Trace:
I20260709 13:11:18.561740 31023 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:18.562304 23778 rpcz_store.cc:276] 0709 13:11:17.442572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.554318 (+111746us) service_pool.cc:224] Handling call
0709 13:11:17.554586 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.812416 (+257830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.561159 (+748743us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54002c9cd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:18.561474 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585313536}
I20260709 13:11:18.551390 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:18.551558 30698 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:18.552220 30991 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:18.554890 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:18.565997 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.566704 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:18.567371 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.568473 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:18.569386 23669 leader_election.cc:400] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:18.565557 23629 raft_consensus.cc:3060] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:18.527920 30882 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.570833 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.573544 30882 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:18.574551 24388 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:18.574482 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:18.574862 31034 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:18.575341 31034 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.575774 31034 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:18.575847 31055 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:18.576025 30698 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:18.576481 31055 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:18.577162 31055 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.575482 30891 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:18.587550 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.588922 31056 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:18.589195 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:18.590054 30945 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:18.592213 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.595326 23629 raft_consensus.cc:2468] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:11:18.597808 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:18.596597 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.600047 30864 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:18.604009 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.607374 23669 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:18.608364 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.620172 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.621109 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:18.623837 23593 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.604827 30865 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:11:18.629598 30891 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:18.619001 30698 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:18.626001 30864 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:18.640847 31034 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.618739 30911 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:18.665797 23668 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:18.672015 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 45604.9us
W20260709 13:11:18.675549 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 51843.9us
I20260709 13:11:18.675825 23624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.677054 23624 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:18.620028 30945 raft_consensus.cc:2804] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:18.676707 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.643464 31034 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:18.683974 31082 log.cc:927] Time spent T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:11:18.685050 31065 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:18.686887 30945 raft_consensus.cc:697] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:18.688766 31070 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:18.680111 30698 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:11:18.680367 30891 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:18.695097 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:18.703320 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:18.709575 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.713601 23623 raft_consensus.cc:2393] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 20: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:18.717129 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:18.716624 24359 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:18.720000 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.721185 31010 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:18.706979 31056 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:18.723110 30888 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:18.723573 30888 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:18.724479 30888 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:18.725817 30888 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.704249 31034 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:18.738519 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:18.740299 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:18.727809 30882 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:18.729331 31025 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.742327 30939 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:18.745306 31035 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:18.745172 30945 consensus_queue.cc:237] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:18.750639 30911 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:18.785372 23699 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:18.762503 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:18.764165 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.768842 24387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.789178 24387 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 12.
W20260709 13:11:18.768424 30957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.006s	sys 0.011s
I20260709 13:11:18.804056 24389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:18.772331 31034 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:18.776625 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:18.778561 23776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 3171) took 1366 ms. Trace:
I20260709 13:11:18.780224 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:18.807920 24386 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:18.805599 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:18.806314 23668 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:18.807138 23776 rpcz_store.cc:276] 0709 13:11:17.412540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.412662 (+   122us) service_pool.cc:224] Handling call
0709 13:11:18.778304 (+1365642us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540016c454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:11:18.778487 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983863552}
W20260709 13:11:18.804026 30957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.007s	sys 0.011s
W20260709 13:11:18.828135 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 510492us
I20260709 13:11:18.837900 24386 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:11:18.851110 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:18.781066 31035 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:18.859521 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:18.824499 30909 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:18.826306 30596 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:18.825843 30901 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:18.871074 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:18.875416 23626 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:18.780717 31025 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:18.877323 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:18.878180 23623 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 21: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:18.879375 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:18.804113 30939 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.863143 30891 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:18.866056 31035 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:18.903170 31071 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:18.873631 30596 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:18.924628 30509 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.873714 30909 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:18.922238 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:18.954624 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 73667us
I20260709 13:11:18.935673 30891 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:18.885481 30993 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:18.893878 31036 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.916975 23628 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:18.964982 31015 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:18.995311 31065 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:18.945554 30858 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:19.001183 23668 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:19.004240 31088 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:11:19.003218 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:11:19.005241 31084 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:18.996217 31034 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.981663 31071 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:18.997881 30509 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:18.981379 30596 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.046736 23742 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:18.998219 30909 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:19.012399 31090 log.cc:927] Time spent T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:11:19.013458 31085 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:11:19.014279 31092 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:19.020620 23668 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:19.014580 31015 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.044502 23770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43456 (request call id 3186) took 1446 ms. Trace:
I20260709 13:11:19.029793 30889 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:19.055471 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.054121 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:19.018062 31077 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:19.076244 23770 rpcz_store.cc:276] 0709 13:11:17.597888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.621390 (+ 23502us) service_pool.cc:224] Handling call
0709 13:11:19.044311 (+1422921us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54003ff7d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:11:19.044444 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1993431808}
I20260709 13:11:19.055150 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.080513 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.002424 30993 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.089133 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.105307 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.050451 30893 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:19.015872 31036 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.112257 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.135777 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:19.142247 23773 raft_consensus.cc:2368] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22.
I20260709 13:11:19.143355 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:19.158344 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 94792.3us
I20260709 13:11:19.140952 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.065505 30963 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:19.163460 23778 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 19: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:19.174443 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.030589 30858 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:19.203027 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 149026us
I20260709 13:11:19.203794 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:19.195098 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.195888 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.208781 23770 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:11:19.198204 31093 log.cc:927] Time spent T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 13:11:19.198642 31077 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:11:19.076340 31019 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:19.051092 31034 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.185729 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:19.160977 30945 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:19.216711 23771 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:19.223325 23777 raft_consensus.cc:2393] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 21: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:19.019462 31065 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.203430 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.175976 30963 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:19.175279 31025 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.227900 23626 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
W20260709 13:11:19.232788 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 176871us
W20260709 13:11:19.209074 31086 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:11:19.235023 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 214513us
W20260709 13:11:19.210801 31084 log.cc:927] Time spent T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:11:19.224359 31068 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:11:19.230394 31083 log.cc:927] Time spent T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:11:19.206826 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 99312.9us
I20260709 13:11:19.248167 30901 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.276384 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:19.110971 30891 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.176908 30893 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.247189 30963 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:19.265468 31113 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:19.282245 31091 log.cc:927] Time spent T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:11:19.287992 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:19.230212 30911 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.047s
I20260709 13:11:19.264838 30939 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:19.287370 31055 consensus_meta.cc:287] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.002s
I20260709 13:11:19.226226 31019 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.306352 31118 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:19.308408 31097 log.cc:927] Time spent T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:11:19.309962 30858 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:19.312072 31015 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:19.281042 30901 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:19.291677 31115 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:19.320103 31036 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:19.324220 31071 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.356161 23773 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
W20260709 13:11:19.368348 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 59355.1us
I20260709 13:11:19.421280 31034 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:19.422840 31126 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:19.423480 31126 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.425810 31126 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.426397 30957 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:19.427016 31019 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.428094 30509 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:19.430361 30509 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:19.430858 30509 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.433282 30993 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:19.442410 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 178655us
I20260709 13:11:19.307153 31118 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.427034 31065 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:19.471764 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 311150us
W20260709 13:11:19.473377 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 269688us
W20260709 13:11:19.468670 30882 consensus_meta.cc:287] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.002s
I20260709 13:11:19.370505 31055 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.297482 31120 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.173s
I20260709 13:11:19.478935 23620 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:19.292773 31113 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.427053 30957 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.492089 31119 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:19.513844 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:19.514644 23622 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:19.520576 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:19.473815 31100 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:19.481547 31034 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:19.537576 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:19.508580 31056 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:19.523077 31127 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:19.553448 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:19.538296 31126 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:19.554603 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 77998.2us
I20260709 13:11:19.524271 30596 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.545145 30893 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:19.568666 23703 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
I20260709 13:11:19.553521 31132 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:19.583280 23623 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:19.556272 30882 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:19.588563 31127 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.549787 30909 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:19.586481 31035 consensus_meta.cc:287] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.006s
I20260709 13:11:19.609223 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:19.583570 30509 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:19.619418 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 72026.6us
I20260709 13:11:19.605460 31118 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:19.576114 31119 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.603845 31126 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.604620 31034 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.589582 31056 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.635592 30993 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:19.635418 31015 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:19.620759 31114 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:19.616582 31035 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.612263 31132 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.661154 31015 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.661728 31055 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:19.659684 31121 log.cc:927] Time spent T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:11:19.661902 31127 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:19.681793 31015 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:19.682685 31035 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:19.679389 31132 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:19.685521 31126 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:19.732838 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 257620us
W20260709 13:11:19.751669 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 116324us
I20260709 13:11:19.752153 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:19.755568 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 294713us
I20260709 13:11:19.665392 30957 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:19.669682 31034 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.763558 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:19.765787 30698 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:19.768154 30911 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.768709 30963 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.769280 30911 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.772433 30936 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:19.667433 31056 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.772583 30909 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:19.773371 30936 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:19.767581 30698 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.778461 31065 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:19.780076 30911 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.784962 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:19.788913 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:19.792409 30596 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:19.792698 23620 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:19.793460 30865 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:19.817660 30865 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.794441 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:19.674369 31113 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.676365 31119 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:19.662281 31133 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:11:19.673231 31136 log.cc:927] Time spent T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:11:19.803994 23513 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 334c9018414947cabb4405ef47b8018e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9ab488f10c434878a749f261e99a8065 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:19.806191 31139 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:19.822723 31139 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.808979 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:19.795778 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:19.824215 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:19.812433 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 55532.7us
I20260709 13:11:19.836225 23698 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:19.840372 31065 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.840731 30936 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:19.841572 30698 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.843088 31065 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.843461 31139 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.844306 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:19.844683 30865 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:19.845038 23620 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:11:19.836697 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:11:19.858325 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 85449.2us
I20260709 13:11:19.859243 31148 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:19.860319 31148 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.863605 31148 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:19.864632 31036 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:19.865476 31036 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.872030 23621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52050 (request call id 2857) took 1101 ms. Trace:
I20260709 13:11:19.872639 23621 rpcz_store.cc:276] 0709 13:11:18.751845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.756113 (+  4268us) service_pool.cc:224] Handling call
0709 13:11:18.809396 (+ 53283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.436410 (+627014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.436445 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.436488 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:19.436520 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.852897 (+416377us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540037da54. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:19.852955 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.853176 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441511680}
I20260709 13:11:19.873543 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:19.874095 23742 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:19.874595 23625 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:11:19.885509 31036 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:19.896961 30963 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:19.899003 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:19.901695 23629 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:19.913044 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:19.924172 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:19.940693 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 66751.9us
I20260709 13:11:19.946702 24390 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
W20260709 13:11:19.951344 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45924.9us
I20260709 13:11:19.952888 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:19.954348 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:19.955156 30858 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:19.955977 31015 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:19.957732 30992 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:19.958608 30992 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:19.960098 31150 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:11:19.939344 30901 consensus_meta.cc:287] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.624s	user 0.026s	sys 0.011s
I20260709 13:11:19.981520 31100 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:19.982244 31100 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.008028 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.009271 23773 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:20.016983 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:20.019765 31087 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 1.068s	user 0.008s	sys 0.012s
I20260709 13:11:20.022650 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.025202 31055 raft_consensus.cc:493] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:20.026044 23696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 2981) took 1999 ms. Trace:
I20260709 13:11:20.026414 23772 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 3206) took 1059 ms. Trace:
I20260709 13:11:20.027782 24391 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:20.026577 23696 rpcz_store.cc:276] 0709 13:11:18.026704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.590363 (+563659us) service_pool.cc:224] Handling call
0709 13:11:18.590724 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.591069 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.591099 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:18.591601 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:11:18.706702 (+115101us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:18.706775 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.706897 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.966935 (+1260038us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4400022b4c. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e145c85 00007f2b3e1466a2 00007f2b40eb81db 00007f2b40eb3aaf 00007f2b40ea786e 00007f2b40ea6bb6 00007f2b40ea67d8 00007f2b40eb0221 00007f2b40eb01d9 00007f2b40eb0169
0709 13:11:20.025479 (+ 58544us) raft_consensus.cc:1685] finished
0709 13:11:20.025505 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.025825 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1325,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6193,"spinlock_wait_cycles":5160704,"thread_start_us":114614,"threads_started":1,"wal-append.queue_time_us":236215}
I20260709 13:11:20.029083 23703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54670 (request call id 1073) took 1339 ms. Trace:
W20260709 13:11:20.030447 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 76508.2us
I20260709 13:11:20.030201 23703 rpcz_store.cc:276] 0709 13:11:18.689858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.694740 (+  4882us) service_pool.cc:224] Handling call
0709 13:11:20.028694 (+1333954us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b540042b654. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:11:20.028912 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978584448}
I20260709 13:11:20.032953 30992 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:20.033143 24359 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:20.025998 31055 raft_consensus.cc:515] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:20.002200 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47348.4us
I20260709 13:11:20.034382 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.048036 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:19.986035 30901 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.052289 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:20.053808 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.054883 31148 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:20.056913 31063 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:20.057427 31148 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:20.057897 31148 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:20.060086 30993 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:20.061254 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:20.062094 23703 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:20.062997 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:20.063371 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:20.063867 23695 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
I20260709 13:11:20.064287 23699 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:20.064932 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:20.069303 31055 leader_election.cc:290] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:20.074832 23695 raft_consensus.cc:1240] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:20.057900 31063 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:20.094086 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.100298 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.119467 23704 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:20.128156 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:20.133846 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:20.087544 31063 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:11:20.144337 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 3010) took 1384 ms. Trace:
I20260709 13:11:20.144861 23701 rpcz_store.cc:276] 0709 13:11:18.759349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.763325 (+  3976us) service_pool.cc:224] Handling call
0709 13:11:18.763927 (+   602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.922970 (+159043us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:11:19.280847 (+357877us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.416006 (+135159us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.440504 (+ 24498us) log.cc:844] Serialized 26 byte log entry
0709 13:11:19.440638 (+   134us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:19.440839 (+   201us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.459062 (+ 18223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.858431 (+399369us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400357354. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:19.858545 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.088431 (+229886us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b180037c840. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b3e21f3f3 00007f2b3e2217c1 00007f2b3e221779 00007f2b3e221709 00007f2b3e2216d1 00007f2b3e2209cd 000000000038f354 000000000038f199 00007f2b3e20283a
0709 13:11:20.101802 (+ 13371us) raft_consensus.cc:1685] finished
0709 13:11:20.101826 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.144159 (+ 42333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72548,"prepare.queue_time_us":216365,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":90,"raft.queue_time_us":74049,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":19953,"spinlock_wait_cycles":375497728,"thread_start_us":362879,"threads_started":2,"wal-append.queue_time_us":131052}
W20260709 13:11:20.147881 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 114845us
I20260709 13:11:20.152858 30939 consensus_queue.cc:1059] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:20.154716 30990 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:20.155217 30990 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:20.155530 30939 raft_consensus.cc:3055] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:20.156211 30939 raft_consensus.cc:740] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
W20260709 13:11:20.156548 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 53816.7us
I20260709 13:11:20.157653 30939 consensus_queue.cc:260] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:20.159392 30939 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:20.159462 30509 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:20.160307 30509 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:20.160607 23770 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:20.161441 30509 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.172605 23621 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:11:20.138203 31055 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:11:20.188501 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:20.190580 24390 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:20.194751 23592 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:20.196588 23704 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:20.198571 31123 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:20.199235 31123 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.199602 31123 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.026849 23772 rpcz_store.cc:276] 0709 13:11:18.966906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.967053 (+   147us) service_pool.cc:224] Handling call
0709 13:11:18.967384 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.226337 (+258953us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:19.444365 (+218028us) log.cc:844] Serialized 14 byte log entry
0709 13:11:20.024824 (+580459us) spinlock_profiling.cc:243] Waited 940 us on lock 0x7b18004b0460. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b470e7de1 00007f2b470f45b1 00007f2b40eb44bc 00007f2b3e20248b 00007f2b4705cab9 00007f2b3e21e69b 00007f2b3e21c93f 00007f2b3e21c455 00007f2b41304060 00007f2b41316716 00007f2b41327287
0709 13:11:20.025002 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:20.025083 (+    81us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:20.025199 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.026073 (+   874us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54003412d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:20.026116 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.026251 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6652,"prepare.queue_time_us":47760,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":202952,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":492,"spinlock_wait_cycles":597255296,"thread_start_us":388395,"threads_started":3,"wal-append.queue_time_us":174766}
I20260709 13:11:20.199699 31010 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:20.201627 30989 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:20.202049 30989 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:20.211190 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.212884 31114 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:20.213466 31114 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:20.213608 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.215394 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.216207 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:20.215605 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.218432 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:20.221305 31153 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:20.221967 31153 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:20.223754 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.203059 30989 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.225577 30989 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:20.233443 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:20.234449 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:20.234882 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.236135 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.236333 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.199853 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:20.236984 24388 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 24.
I20260709 13:11:20.234467 24391 raft_consensus.cc:2368] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20.
I20260709 13:11:20.230082 30901 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:20.221962 23696 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:11:20.242524 23519 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 223) took 19668 ms (client timeout 15000 ms). Trace:
I20260709 13:11:20.242925 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:20.248796 31100 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.248821 31153 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:20.254803 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 56742.1us
W20260709 13:11:20.243093 23519 rpcz_store.cc:269] 0709 13:11:00.573947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.943382 (+2369435us) service_pool.cc:224] Handling call
0709 13:11:20.242160 (+17298778us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:14.828287 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:14.829058 (+   771us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:14.829089 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:11:14.829102 (+    13us) tablet.cc:662] Decoding operations
0709 13:11:14.830063 (+   961us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:14.830200 (+   137us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:14.830247 (+    47us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:11:14.832746 (+  2499us) tablet.cc:701] Row locks acquired
0709 13:11:14.832769 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:11:14.832918 (+   149us) write_op.cc:270] Start()
0709 13:11:14.833029 (+   111us) write_op.cc:276] Timestamp: P: 1783602674832868 usec, L: 0
0709 13:11:14.833051 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:11:14.892822 (+ 59771us) log.cc:844] Serialized 3219 byte log entry
0709 13:11:15.328350 (+435528us) op_driver.cc:464] REPLICATION: finished
0709 13:11:15.719156 (+390806us) write_op.cc:301] APPLY: starting
0709 13:11:15.719238 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:15.914879 (+195641us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:15.915068 (+   189us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:16.157225 (+242157us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:16.157530 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:11:16.157597 (+    67us) write_op.cc:312] APPLY: finished
0709 13:11:16.157965 (+   368us) log.cc:844] Serialized 81 byte log entry
0709 13:11:16.160239 (+  2274us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:16.160400 (+   161us) write_op.cc:454] Released schema lock
0709 13:11:16.160466 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:16.178586 (+ 18120us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:16.200721 (+ 22135us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37098,"reported_tablets":51,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":390480,"apply.run_cpu_time_us":16633,"apply.run_wall_time_us":450870,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37615,"num_ops":8,"prepare.queue_time_us":227793,"prepare.run_cpu_time_us":24267,"prepare.run_wall_time_us":169947,"raft.queue_time_us":266112,"raft.run_cpu_time_us":58336,"raft.run_wall_time_us":202828,"replication_time_us":495123,"thread_start_us":642010,"threads_started":4,"wal-append.queue_time_us":116265,"wal-append.run_cpu_time_us":22315,"wal-append.run_wall_time_us":2126336}]]}
I20260709 13:11:20.281127 23773 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:20.279572 24359 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:20.283915 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:20.296002 24390 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:20.286468 30901 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:20.292078 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:11:20.312181 31105 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.011s	sys 0.031s
I20260709 13:11:20.312810 30882 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:20.312608 30901 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:20.310738 31063 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:11:20.316704 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.317322 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:20.314916 23527 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 18 to 19, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 19 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.286752 31055 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:11:20.319128 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:20.319752 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.236716 30990 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:20.354815 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:20.312634 31105 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.011s	sys 0.031s
I20260709 13:11:20.333230 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:20.321758 31119 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:20.374815 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 64921.1us
I20260709 13:11:20.347965 30901 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:20.357297 31153 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:20.355259 31063 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:20.389259 30990 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:20.389739 31113 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:20.390360 31100 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:20.403100 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 142351us
W20260709 13:11:20.404700 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 115606us
I20260709 13:11:20.405510 23593 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:20.383492 30911 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:20.416491 30991 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:20.411218 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 78332.6us
I20260709 13:11:20.407611 23527 catalog_manager.cc:5697] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 17 to 20, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 20 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:20.417219 30991 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:20.438519 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 119500us
W20260709 13:11:20.446413 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.425418 31119 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:20.452558 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:20.454001 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:20.478596 31148 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.413596 30911 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.480473 23667 leader_election.cc:400] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22.
I20260709 13:11:20.480821 23667 leader_election.cc:403] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.446488 31116 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:20.487896 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:20.479640 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:20.481196 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:20.482697 23668 leader_election.cc:400] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20.
I20260709 13:11:20.453982 31119 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:20.491214 23668 leader_election.cc:403] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.494581 30891 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.498556 31055 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:20.499262 31055 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.517642 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:20.502023 31119 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:20.525202 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.526748 30865 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:20.529433 31055 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:20.529973 31148 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:20.532896 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:20.536265 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.536978 30911 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:20.486737 31063 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:11:20.540426 23775 raft_consensus.cc:1275] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:20.495337 30891 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.550307 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.518349 23527 catalog_manager.cc:5697] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 15 to 18, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 18 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.561971 31113 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:20.562806 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.555353 31010 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:20.564205 23623 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:20.564702 31055 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:20.517549 30990 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:20.595975 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.570550 31113 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:20.596578 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 124319us
I20260709 13:11:20.590001 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.572254 31010 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:20.607638 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:20.602873 31113 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:20.616477 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.616725 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.616883 31148 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:20.603235 31055 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:20.621141 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.626184 30865 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22.
I20260709 13:11:20.626426 30698 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:20.627204 30991 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:20.627704 23593 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:20.637337 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.649762 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:20.651949 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.652304 30911 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:20.655923 30698 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:20.581509 30990 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:20.658937 30698 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:20.659859 30990 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:20.660512 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.660802 30865 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767) with higher term. Message: Invalid argument: T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20.
I20260709 13:11:20.663486 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.664434 31055 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:20.644217 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:20.666944 23623 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:11:20.674357 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.639444 31063 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:20.675860 31063 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:20.665863 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 192818us
I20260709 13:11:20.677410 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.683112 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.685359 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.627221 31010 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.687383 31010 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.692993 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:20.697479 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:20.704213 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:20.707365 23527 catalog_manager.cc:5697] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 12 to 15, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 15 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.717144 30891 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:20.635315 31114 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.719925 31114 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:20.723008 31123 consensus_meta.cc:287] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.005s
I20260709 13:11:20.726095 31154 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:20.728528 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:20.728932 23770 raft_consensus.cc:1240] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:20.726943 31154 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.737113 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:20.747960 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.678364 31055 raft_consensus.cc:3055] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:20.723457 31123 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.679950 31063 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.757228 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:20.734376 30989 consensus_meta.cc:287] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.005s
I20260709 13:11:20.763782 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:20.763911 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 311131us
I20260709 13:11:20.754357 30911 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:20.772868 23626 raft_consensus.cc:2393] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 19: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:20.758370 30891 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:20.756723 31055 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:20.772526 23667 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:20.795187 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:20.799996 23622 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:20.801198 23620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:20.803215 31055 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:20.804581 31055 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:20.808516 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50372.4us
I20260709 13:11:20.810573 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:20.787097 30990 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.814716 30990 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.816045 23624 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:11:20.817943 30865 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:20.818715 30865 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:20.832345 31119 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:20.834532 31119 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:20.835223 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.784375 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.841032 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 361452us
I20260709 13:11:20.774708 30989 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:20.845990 23625 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
I20260709 13:11:20.860932 23667 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:20.872781 31154 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:20.873905 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:20.874883 24385 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:20.872623 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:20.851819 31116 consensus_queue.cc:1059] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:11:20.884637 23669 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:20.885473 23667 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:20.854457 31113 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:20.888008 31113 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:20.896158 31114 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:20.897816 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:20.897938 31114 consensus_queue.cc:1059] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:20.899220 31114 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:20.900128 30963 raft_consensus.cc:3055] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:20.900605 30963 raft_consensus.cc:740] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:20.901677 30963 consensus_queue.cc:260] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.905967 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.899720 31114 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:20.908610 31114 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.888195 30911 raft_consensus.cc:3055] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:20.914973 30911 raft_consensus.cc:740] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:20.852041 30989 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:20.890918 23527 catalog_manager.cc:5697] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 13 to 14, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 14 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.899324 23743 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:20.920974 24385 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 25.
I20260709 13:11:20.926795 23668 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:20.932032 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
W20260709 13:11:20.931802 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 52835us
I20260709 13:11:20.916103 30963 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:20.935804 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50484.3us
I20260709 13:11:20.943960 31138 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:20.935777 31169 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:20.938822 23527 catalog_manager.cc:5697] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 18 to 19, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 19 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.952237 31119 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:20.953315 31123 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:20.953931 31153 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:20.954658 31153 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:20.963515 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 64304us
I20260709 13:11:20.965225 23743 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:20.941689 30865 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:20.968400 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:20.958465 31170 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:20.972406 23774 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.945205 31169 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:20.978220 31100 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:20.982575 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:20.980435 30865 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 25 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:20.968019 30990 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.013581 30989 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:20.988849 31169 raft_consensus.cc:3060] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:21.021135 31171 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:21.016496 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:21.031355 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 51799.1us
I20260709 13:11:20.941310 30911 consensus_queue.cc:260] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.041404 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.047515 24391 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:21.047482 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:21.015687 31114 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.050695 31114 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:21.051458 31025 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:11:21.053095 31173 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:21.055866 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:21.056819 30882 raft_consensus.cc:2764] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:11:21.058310 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:21.058499 31171 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:21.059605 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:21.059379 31171 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.062933 31123 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:21.063472 31123 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.063863 31172 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:21.064091 31170 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:21.065778 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:21.063921 31123 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:21.068396 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:21.069106 24391 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:11:21.070473 23668 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:21.068014 31171 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:21.073657 31171 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:21.076030 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.077636 23775 raft_consensus.cc:1240] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:21.072793 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:21.077822 31171 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:21.084040 31171 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:21.067076 23593 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:21.093813 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:21.102421 31172 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:21.102274 31115 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:21.103067 31172 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:21.103430 31115 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:21.104048 31115 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.105455 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:21.106930 23667 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:21.103242 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:21.107932 31025 consensus_queue.cc:1048] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:21.102269 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:21.108193 30865 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.109454 31025 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:21.110306 31025 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:21.118256 23774 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
W20260709 13:11:21.131978 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 154261us
I20260709 13:11:21.117079 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:21.100085 30911 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:21.103530 31172 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:21.097960 31170 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:21.151263 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.113796 31113 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:21.195567 23667 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:21.148334 30990 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:21.195502 31173 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:21.201957 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 49561.7us
I20260709 13:11:21.132232 31131 consensus_queue.cc:1059] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:11:21.119470 31105 consensus_queue.cc:1059] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:11:21.204109 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:21.204924 31101 consensus_queue.cc:1059] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.091s
W20260709 13:11:21.206108 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 52536.4us
I20260709 13:11:21.206890 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:21.208016 23627 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:21.209728 31170 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:21.212110 23623 raft_consensus.cc:1240] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:11:21.212224 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:21.213318 23626 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:11:21.244060 31139 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:21.246491 31025 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:21.247134 31025 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.247709 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.247977 31055 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:21.248638 31055 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.250608 31119 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:21.251684 31119 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.253032 30990 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:21.253578 30990 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:21.260097 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.262509 31105 raft_consensus.cc:3055] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:21.262991 31105 raft_consensus.cc:740] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:21.263917 31105 consensus_queue.cc:260] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.265269 31105 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:21.268251 31116 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:21.268383 31101 raft_consensus.cc:3055] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:21.269044 31101 raft_consensus.cc:740] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:21.269969 31101 consensus_queue.cc:260] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.271425 31101 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:21.219868 30799 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:11:21.220683 31063 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:21.231313 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 114331us
I20260709 13:11:21.217193 23620 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:21.272574 31131 raft_consensus.cc:3055] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:21.236093 31153 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:21.222698 31138 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:21.280943 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:21.233065 31173 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:21.281567 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 50472.7us
I20260709 13:11:21.341107 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.290757 23702 raft_consensus.cc:2468] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
I20260709 13:11:21.292280 31171 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.297360 31172 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.298158 31116 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.299319 31123 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:21.339346 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 196801us
I20260709 13:11:21.343914 23592 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:21.358450 31173 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:21.358979 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.340332 31131 raft_consensus.cc:740] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:21.386039 31123 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.338171 31115 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.386605 31131 consensus_queue.cc:260] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.388115 31131 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:21.388614 31115 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.338512 31170 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:21.389484 31170 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.377462 31169 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.380087 23703 raft_consensus.cc:1240] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:21.393272 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 49476.2us
I20260709 13:11:21.381287 31172 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:21.382956 31063 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.400864 23743 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:21.401515 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:21.403060 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 51007.5us
I20260709 13:11:21.409667 23704 raft_consensus.cc:1240] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:21.391567 31170 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:21.407900 31115 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:21.411479 31173 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.431669 23667 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:21.433266 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:21.437354 30990 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.415946 30963 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:11:21.440081 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.440428 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.440723 23700 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:11:21.441092 23702 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:21.441634 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:21.441931 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.442337 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:21.442530 23702 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:21.442890 23699 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:21.442340 23700 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 23: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
W20260709 13:11:21.444941 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 93328.2us
I20260709 13:11:21.437752 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:21.420795 31114 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:21.499455 23699 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
W20260709 13:11:21.513375 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.518262 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.535262 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.506408 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:21.460633 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:21.507069 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:21.456084 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 52468.9us
I20260709 13:11:21.506857 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.540812 23700 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
W20260709 13:11:21.535840 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 71042.8us
I20260709 13:11:21.534782 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:21.480161 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:21.543006 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 62965us
I20260709 13:11:21.543671 23667 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:21.458555 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:21.505384 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.424317 30509 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:21.498199 31169 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.576588 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:21.577737 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 158253us
I20260709 13:11:21.578748 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:21.576730 23697 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:21.464469 31148 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.584388 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:21.471830 31114 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:21.596769 31114 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.597324 31063 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:21.598070 31063 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.464277 30990 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.545212 31170 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:21.601289 23667 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:21.508682 31116 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.608101 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:21.608935 23697 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 19: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:21.609345 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:21.609988 23702 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:21.471127 31115 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:21.587209 23621 raft_consensus.cc:1240] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:11:21.614826 31119 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.616111 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.616786 23778 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:21.617687 31115 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.619369 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.620043 23695 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:21.621320 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:21.621585 31063 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:21.581570 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 135829us
I20260709 13:11:21.572708 31172 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:21.453016 31173 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.625173 23704 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:21.626335 31173 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.518002 31025 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.626953 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.580865 30799 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:21.593513 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:21.595679 24388 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 22: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:21.511049 31055 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:21.456123 31123 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:21.603158 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.607441 31170 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:21.587797 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:11:21.630993 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.632349 23702 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
I20260709 13:11:21.633721 31154 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:21.634250 31154 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:21.634640 31154 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:21.636821 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.637641 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.637753 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:21.637181 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.639050 23777 raft_consensus.cc:1240] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:11:21.633605 31105 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:11:21.633630 31123 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.456439 30865 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:21.652318 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.657620 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.659242 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.657593 23775 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 25.
I20260709 13:11:21.661072 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:21.661361 23773 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 24: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:21.663483 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.665602 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.673579 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.679172 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:21.601747 31148 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.685789 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:21.681578 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:21.661006 31153 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:21.670722 31123 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.696763 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.697674 23700 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:21.697916 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.682052 31171 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:21.703125 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.707830 23743 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:21.708534 23667 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:21.711603 23620 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:21.713792 23743 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:21.715960 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.719687 31148 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:21.726761 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:21.727558 24388 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:21.718086 31183 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:21.731537 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:21.732149 31183 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:21.732554 31148 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:21.733207 31148 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.733899 31148 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:21.733180 31183 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.705320 31153 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.717648 30963 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:21.760288 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.762538 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:21.726019 31169 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:21.763773 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.711337 31025 consensus_queue.cc:1059] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:11:21.763303 30690 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:21.717937 31101 consensus_queue.cc:1059] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:11:21.776026 31025 raft_consensus.cc:3055] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:21.776098 31153 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.776614 31025 raft_consensus.cc:740] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:21.777549 31025 consensus_queue.cc:260] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.777992 31101 raft_consensus.cc:3055] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:21.778498 31101 raft_consensus.cc:740] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:21.778949 31025 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.788905 24392 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 14.
I20260709 13:11:21.779353 31101 consensus_queue.cc:260] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.791124 23769 raft_consensus.cc:2468] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 23.
I20260709 13:11:21.795313 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.790267 30690 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.802597 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:21.803633 23627 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 17: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:21.809746 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:21.813934 31195 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:21.818544 30690 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:21.811775 23668 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:21.820672 31195 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:21.821244 31195 raft_consensus.cc:697] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:11:21.821868 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 59371.2us
I20260709 13:11:21.822319 31195 consensus_queue.cc:237] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:21.832710 23667 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:21.846431 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:21.849685 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 212363us
I20260709 13:11:21.845872 31186 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:21.884166 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:21.856009 31101 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:21.859920 30865 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:21.902429 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:21.840509 31154 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.904371 23697 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:21.905081 31154 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:21.906802 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:21.907429 23702 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 13:11:21.896282 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 181613us
I20260709 13:11:21.911111 23667 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:21.915059 30865 raft_consensus.cc:2804] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:21.915591 30865 raft_consensus.cc:697] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:21.916443 23703 raft_consensus.cc:1240] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 25 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:21.916538 30865 consensus_queue.cc:237] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.917776 23698 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:21.917717 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:21.919535 23695 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.924010 30799 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:21.925076 30799 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:21.925463 30799 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:21.926321 30799 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:21.930250 24392 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 13:11:21.934437 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.940586 23772 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:11:21.945860 23702 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:21.960399 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:11:21.945549 31205 log.cc:927] Time spent T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 13:11:21.949554 30799 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:21.989203 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.017701 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.940671 31055 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.024s
I20260709 13:11:22.024525 23695 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:22.029245 23701 raft_consensus.cc:1240] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:22.023397 31195 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.008s
I20260709 13:11:22.030975 31148 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:22.087217 31211 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:11:22.099638 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.116606 23626 raft_consensus.cc:1240] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:22.118296 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:22.119472 23625 raft_consensus.cc:2393] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:11:22.143187 24359 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.146965 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:22.147842 23626 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 24.
I20260709 13:11:22.149322 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:22.151151 23620 raft_consensus.cc:1240] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:22.152581 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.153964 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:22.154852 23629 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:22.148787 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:22.156917 23626 raft_consensus.cc:2368] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:22.151196 23622 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23. Ops: []
W20260709 13:11:22.184782 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 44735.1us
I20260709 13:11:22.185842 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:22.188604 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:22.193318 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 55122.5us
I20260709 13:11:22.187378 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:11:22.198581 31208 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:11:22.138015 23627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:46526
I20260709 13:11:22.255906 23627 raft_consensus.cc:606] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.256460 23627 raft_consensus.cc:614] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:22.224174 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
W20260709 13:11:22.245813 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 47161.4us
I20260709 13:11:22.257664 23625 raft_consensus.cc:2393] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 23: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:11:22.258944 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.223812 30990 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:22.223517 31139 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:22.263108 31139 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:22.266887 31139 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.196529 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:11:22.272253 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 175361us
W20260709 13:11:22.270895 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 74467.2us
I20260709 13:11:22.276461 24358 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.275315 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:22.261308 30990 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:22.252157 31183 consensus_queue.cc:1059] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:11:22.290786 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.274199 31153 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:22.292439 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:22.303049 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:22.306927 23628 raft_consensus.cc:2393] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 14: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
W20260709 13:11:22.307713 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.282827 30990 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:22.296051 30882 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:22.373888 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 60296us
I20260709 13:11:22.379783 23669 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:22.377381 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.297132 31153 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:22.299705 31148 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:22.290360 31138 consensus_queue.cc:1059] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
W20260709 13:11:22.387190 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 70392.9us
W20260709 13:11:22.395828 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 122654us
W20260709 13:11:22.402115 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 137321us
I20260709 13:11:22.403820 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:22.373404 31115 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:22.390010 31153 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.441295 31193 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:22.442337 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:22.398275 31186 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:22.446151 31138 raft_consensus.cc:3055] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:22.447405 31138 raft_consensus.cc:740] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:22.464640 31138 consensus_queue.cc:260] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.465940 31138 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:22.468849 31215 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:22.475594 31114 raft_consensus.cc:3055] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:22.476151 31114 raft_consensus.cc:740] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:22.477234 31114 consensus_queue.cc:260] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.478809 31114 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.486158 31153 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.483424 31139 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:22.490469 31139 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:22.495635 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 187526us
W20260709 13:11:22.501792 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 59567us
I20260709 13:11:22.518594 31186 consensus_queue.cc:1059] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:22.519565 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:22.519932 31193 raft_consensus.cc:3055] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:22.520418 31193 raft_consensus.cc:740] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:22.520650 31169 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:22.521114 31169 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:22.521180 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:22.521616 31169 raft_consensus.cc:3060] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:22.521445 31193 consensus_queue.cc:260] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:22.522878 31171 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:22.523062 31193 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.524857 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:22.525728 31186 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:22.526319 23669 leader_election.cc:400] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:22.526715 23669 leader_election.cc:403] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:22.527964 31025 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:11:22.528892 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:22.529881 30865 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:22.531569 31171 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:22.543375 31025 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537) with higher term. Message: Invalid argument: T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 22. Current term is 23.
I20260709 13:11:22.545264 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.540901 31195 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:22.563762 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 155717us
I20260709 13:11:22.572499 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:22.579945 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 200279us
I20260709 13:11:22.562659 31183 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:22.589776 23621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:46526
I20260709 13:11:22.593578 23621 raft_consensus.cc:606] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
W20260709 13:11:22.592314 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 61544.2us
I20260709 13:11:22.594915 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:22.601222 23669 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:22.601487 23772 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:22.604031 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.604276 31055 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:22.604730 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.604943 31055 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:22.605788 31138 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.606273 31138 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:22.607995 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.608582 31138 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:22.603282 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:11:22.620187 31217 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:11:22.608659 23703 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:11:22.586515 31148 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.592507 31131 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:22.578343 30990 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.634445 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.635103 23703 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:22.593549 30963 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:11:22.637838 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.639039 30990 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:22.626645 31154 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.640095 31154 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:22.642277 31154 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:22.645727 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:22.663241 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 73226.3us
I20260709 13:11:22.664345 23593 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:22.667017 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.667920 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.674327 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:22.675354 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.675783 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:22.676419 23695 raft_consensus.cc:2410] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:11:22.675405 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.675815 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.678083 23700 raft_consensus.cc:2393] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 16: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:22.679478 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:22.680147 23702 raft_consensus.cc:2376] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19. Re-sending same reply.
I20260709 13:11:22.631443 31148 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.690498 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.691949 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:11:22.693011 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 284979us
I20260709 13:11:22.682288 31116 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:22.666534 31169 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.696059 31232 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:22.700481 31232 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:22.703642 31232 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:22.704101 31115 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:22.697777 31186 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:22.708993 23699 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:22.710480 31218 consensus_queue.cc:1059] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:22.710947 31116 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:22.712845 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:22.715134 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 125198us
I20260709 13:11:22.688213 31153 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:22.717839 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.718544 23700 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:11:22.726106 23621 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:22.699937 31148 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:22.730448 31229 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:22.716511 31236 raft_consensus.cc:3055] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:22.731443 31236 raft_consensus.cc:740] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:22.727907 23696 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:22.698523 31169 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:22.727970 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:22.725870 30990 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:22.728653 31241 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:22.734177 31241 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.735355 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:22.736733 31241 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:22.729143 23621 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:22.740279 24358 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.742070 31116 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.747895 31232 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.748782 30882 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.749343 30882 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:22.750317 31232 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:22.754153 31236 consensus_queue.cc:260] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:22.755760 31236 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:22.760115 31186 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:22.760731 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5bb39aaf4940fb9d34ec725193ca2c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.760761 31186 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:22.761878 30882 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:22.764019 30990 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:22.764484 30990 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:22.764891 30990 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.765723 23593 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.766968 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:22.767021 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:22.767431 31154 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:22.767795 23627 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 14.
I20260709 13:11:22.768162 31154 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:22.768510 31154 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:22.768927 31154 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:22.770749 31123 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:22.763396 31186 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:22.785001 23625 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:22.786767 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:22.787266 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:22.790123 23621 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:22.791030 23627 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:11:22.794073 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:22.794689 23769 raft_consensus.cc:2393] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 24: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:22.795922 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:22.797122 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:22.798935 23774 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:22.802076 23621 raft_consensus.cc:1275] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:22.803844 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:22.807619 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 56927.6us
I20260709 13:11:22.809762 23621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b55528b161184b85a266eb8c58844016"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:46526
I20260709 13:11:22.804013 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:22.810628 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:22.811326 23769 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 15.
I20260709 13:11:22.812002 23621 raft_consensus.cc:606] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.812530 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:22.818328 23593 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:11:22.825922 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 85714.8us
I20260709 13:11:22.826932 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:22.803086 31241 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.834539 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.835125 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:22.807492 31171 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:22.841781 30690 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:22.803256 31218 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:22.806519 31228 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:22.850863 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.846446 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:22.855858 24392 raft_consensus.cc:1275] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:11:22.857030 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:22.842607 31219 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:22.859791 31219 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:22.860263 31219 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.846594 30690 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.863670 30690 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:22.867213 31169 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:22.837654 31241 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:22.869709 31241 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:22.842621 30963 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:22.842706 31171 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:22.871621 31171 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.872982 31171 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:22.876365 23621 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:22.879688 23628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:46526
I20260709 13:11:22.880328 23628 raft_consensus.cc:606] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.880241 23627 raft_consensus.cc:2468] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 24.
I20260709 13:11:22.885619 31219 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:22.885666 30690 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:22.890568 31174 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:22.891265 31174 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:22.897464 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:22.899921 31195 consensus_queue.cc:1048] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:22.855686 31115 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:22.902139 31195 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:22.902354 31169 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:22.910959 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.912758 23669 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:22.918049 23698 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 13: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:22.849261 31228 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:22.920960 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 70160.8us
W20260709 13:11:22.921731 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 70022.3us
I20260709 13:11:22.921756 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.926844 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:22.933468 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:22.934172 31148 raft_consensus.cc:993] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:11:22.934387 23627 raft_consensus.cc:2393] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 17: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:22.934772 31148 raft_consensus.cc:1081] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:11:22.935755 31238 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:22.936372 31238 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:22.938025 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:22.938661 31238 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:22.938843 23629 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:11:22.940368 30690 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:22.943982 31240 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.944672 31240 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.926707 31195 raft_consensus.cc:2804] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:22.912740 30963 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:22.946977 31240 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:22.952059 31169 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:22.955775 31169 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.957969 31169 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:22.924562 31228 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:22.930932 23772 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 13.
I20260709 13:11:22.960801 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:22.952894 31154 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.923811 31239 consensus_queue.cc:1048] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:11:22.869735 30990 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:22.974043 23627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c"
dest_uuid: "9ab488f10c434878a749f261e99a8065"
mode: GRACEFUL
new_leader_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:46526
I20260709 13:11:22.974737 23627 raft_consensus.cc:606] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Received request to transfer leadership to TS c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.975128 23627 raft_consensus.cc:614] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:22.919684 30865 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:22.961602 23769 raft_consensus.cc:3060] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:22.963829 30509 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:22.926319 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.948483 31195 raft_consensus.cc:697] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 24 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:22.908468 31174 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:22.912475 31115 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:11:22.979115 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 57428.7us
I20260709 13:11:22.990485 23622 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:22.990917 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.982926 31116 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:22.983157 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 56968.4us
I20260709 13:11:22.985646 24357 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.994225 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.994935 23769 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:11:22.987162 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:22.989464 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:22.998152 31123 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:22.999634 31219 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:23.004603 31227 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:11:23.005848 31154 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:23.007987 31174 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:23.008671 31174 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:23.009253 31174 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:23.011425 30990 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:23.012917 24357 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:11:23.008018 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 94056.2us
I20260709 13:11:22.996117 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:23.017030 23626 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:22.977880 31195 consensus_queue.cc:237] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.028280 30882 raft_consensus.cc:2804] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:23.028918 30882 raft_consensus.cc:697] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:23.029801 30882 consensus_queue.cc:237] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:23.030323 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:23.031318 31025 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:23.032048 31100 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:23.031950 31025 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.032435 31100 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.032792 31100 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:23.034183 31025 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:23.035223 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:23.038780 31223 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:22.984063 30963 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:11:23.057336 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.057683 23742 leader_election.cc:304] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:23.058786 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.059607 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:23.060177 24388 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:23.061699 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:23.065573 23629 raft_consensus.cc:2468] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 16.
I20260709 13:11:23.068482 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.056236 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:23.070032 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:23.070704 24392 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:23.071274 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:23.076503 23696 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:11:23.079113 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:23.080044 23700 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:11:23.083143 23700 pending_rounds.cc:85] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 10
I20260709 13:11:23.080422 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:23.050663 30990 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:23.030479 31238 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:23.083410 23700 pending_rounds.cc:107] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:11:23.099020 23700 raft_consensus.cc:2889] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:23.068428 30963 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:11:23.093124 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:23.093504 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:22.989820 31183 consensus_queue.cc:1059] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:11:23.098099 23593 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:22.988055 30865 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:23.102833 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:23.071879 31180 raft_consensus.cc:2749] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:23.113699 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:23.114339 31154 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.120750 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:23.123253 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:23.025408 31227 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:11:23.069195 31114 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:11:23.132507 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:23.059911 30799 consensus_queue.cc:1059] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:11:23.072927 31101 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:11:23.146329 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:23.147210 23697 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:23.140610 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:23.133224 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 62828us
I20260709 13:11:23.148085 23703 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:23.155578 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:23.156243 23699 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:23.158640 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.162546 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:23.162964 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:23.163539 23699 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:23.131922 31235 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:23.173772 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:23.172494 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:23.151913 30698 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:23.205359 31235 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:23.206451 31235 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:23.208164 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:23.161762 31193 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:23.218462 24388 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:23.218585 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:23.130688 31238 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.164628 31055 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:23.201524 30698 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.250917 23669 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:23.135205 31115 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.258904 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:23.256999 23696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45086
I20260709 13:11:23.257591 30698 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:23.219400 31227 consensus_queue.cc:1059] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:11:23.282862 30865 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:23.284701 31259 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:23.286548 31236 consensus_meta.cc:287] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.002s
I20260709 13:11:23.286623 31253 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:23.304342 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 231177us
I20260709 13:11:23.268596 31232 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:23.243744 31193 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.283571 30865 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:23.257365 31055 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:23.321280 24388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:23.292335 31195 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:23.322718 30963 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:23.325616 31232 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:11:23.393687 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 276030us
W20260709 13:11:23.390085 31248 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:11:23.400931 23698 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:23.391458 30963 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:23.437595 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.285584 31259 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.287463 31253 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.436431 31264 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:23.467871 31105 raft_consensus.cc:3055] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:23.468386 31105 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:23.468042 31264 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.469338 31105 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.470902 31264 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:23.447172 31238 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:23.445084 31265 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:23.472213 31265 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.473363 31259 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:23.474994 31265 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:23.475499 31100 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:23.477895 31100 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:23.479835 31174 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:23.450309 31232 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:23.466440 31193 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:23.481020 31105 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:23.481215 31253 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:23.482357 23592 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:23.483172 31228 consensus_meta.cc:287] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 13:11:23.465416 31055 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:23.477952 31223 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:23.483198 23697 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
W20260709 13:11:23.488440 31171 consensus_meta.cc:287] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.001s
I20260709 13:11:23.489444 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:23.490085 31138 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:23.491891 30963 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.576860 23702 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:11:23.504920 30698 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:23.579226 30698 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:23.505064 23526 catalog_manager.cc:5697] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 13, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 13 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.478026 31101 raft_consensus.cc:3055] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:23.580369 31101 raft_consensus.cc:740] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:23.580686 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:23.581256 31101 consensus_queue.cc:260] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.582275 31101 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:23.577071 31138 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:23.585346 23526 catalog_manager.cc:5697] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 16 to 19, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 19 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:23.587067 23526 catalog_manager.cc:5697] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:23.589414 23526 catalog_manager.cc:5697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:23.595178 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 112885us
I20260709 13:11:23.512411 30865 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:23.612849 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 175271us
I20260709 13:11:23.616977 23667 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:23.618268 31269 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.619915 30509 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.620399 23696 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:23.620904 23696 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:23.620546 30509 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.622852 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.625594 30509 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:23.626917 23772 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:11:23.629526 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.630162 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.630601 23622 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:23.631213 23777 raft_consensus.cc:2410] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:11:23.593334 23526 catalog_manager.cc:5697] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 5 to 12, term changed from 15 to 18, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted, no longer has a pending config: VOTER c885217113574e7489e6c3afb6950f76 (127.21.244.2), VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3), VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 18 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.635016 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.642824 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.643184 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:23.643823 23622 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 24.
I20260709 13:11:23.609480 31055 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.645494 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:23.611294 30698 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.646811 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:23.648867 31271 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:23.649394 31271 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.649770 31271 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:23.652275 23621 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:23.657900 31154 raft_consensus.cc:993] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:11:23.609018 31228 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.634686 30865 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:23.669508 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.643716 31237 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:11:23.676148 23626 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:23.654239 31055 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:23.681648 30865 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:23.683128 31055 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:23.684443 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:23.685319 31228 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:23.685420 24390 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:23.687615 23668 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:23.688588 31055 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:23.689081 31055 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.689471 31055 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:23.676769 31267 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.690677 31267 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.691644 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.698241 23622 raft_consensus.cc:1240] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:23.698271 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:23.704329 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 453472us
I20260709 13:11:23.705638 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:23.716571 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:23.678399 30990 raft_consensus.cc:1081] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:11:23.731304 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:23.732183 23769 raft_consensus.cc:2368] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14.
I20260709 13:11:23.693572 31114 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:23.736217 23593 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:23.726132 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 95480.1us
I20260709 13:11:23.679392 31174 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:23.744696 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:23.745669 24390 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:23.678788 23696 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:23.693212 31267 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:23.718578 30865 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:23.738412 31114 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:11:23.788614 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.797575 23625 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:23.796798 23776 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:11:23.755976 31232 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:11:23.770960 31262 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:23.849085 31191 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:23.851073 31114 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.852622 31114 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:23.856379 31138 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.866556 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:23.867321 24385 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:23.869318 23696 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:23.842644 30911 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:23.873416 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 137280us
I20260709 13:11:23.874311 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:23.876660 23593 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:23.878309 23593 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:23.881603 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
W20260709 13:11:23.885607 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 103521us
I20260709 13:11:23.889043 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:11:23.870085 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 100376us
I20260709 13:11:23.891592 24357 leader_election.cc:400] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14.
I20260709 13:11:23.892766 24357 leader_election.cc:403] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:23.893678 23593 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:23.844707 31262 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.896530 31283 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:23.896958 30911 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:23.887137 31240 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:23.883837 31154 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:23.879303 31286 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:23.904721 24385 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:11:23.951797 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:23.952678 23623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:23.913617 24390 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:11:23.924746 23526 catalog_manager.cc:5697] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 17 to 18, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 18 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:23.957036 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:23.970386 23698 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:23.973896 23593 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:23.975972 23625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:23.959631 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:23.940112 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:23.954739 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:23.946774 23773 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:11:23.978869 23773 pending_rounds.cc:85] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 11
I20260709 13:11:23.979146 23773 pending_rounds.cc:107] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:11:23.979561 23773 raft_consensus.cc:2889] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:23.915133 23770 raft_consensus.cc:1275] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:23.941833 23667 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:23.964653 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:23.981313 31240 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:23.981989 31240 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:23.982123 30865 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:23.982688 30865 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:23.951421 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:23.978036 23700 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:23.983317 30865 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:23.983227 31240 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.936326 30963 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:23.948401 31225 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:23.986049 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:23.987067 23622 raft_consensus.cc:2393] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 19: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:23.987440 23699 raft_consensus.cc:2393] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 13: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:23.990648 23623 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:23.985114 23701 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:11:23.911998 31154 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:24.006024 23668 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:24.009366 23627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:24.000216 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:23.906162 31241 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:23.951442 31269 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:24.002349 23628 raft_consensus.cc:1275] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:11:23.928279 31138 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:23.908571 30911 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:24.010073 23627 raft_consensus.cc:3055] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:24.018962 23627 raft_consensus.cc:740] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:24.019950 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:24.020407 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:24.014199 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:23.914480 31271 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:23.911134 31055 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:24.020912 23701 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 23.
I20260709 13:11:24.022532 23627 consensus_queue.cc:260] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:24.011415 31154 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:24.028695 23698 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 24.
I20260709 13:11:24.034869 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdbb7d679eb4d0d935669cb839c12c0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:24.035966 23704 raft_consensus.cc:3060] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:24.037508 23627 raft_consensus.cc:3060] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:24.002452 31227 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:11:24.015524 31195 raft_consensus.cc:2804] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:24.021916 30911 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:24.019129 31269 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.046810 31296 consensus_queue.cc:1048] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:24.047199 31262 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:24.048247 31195 raft_consensus.cc:697] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:24.050730 23621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:24.006250 31225 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:24.093737 23623 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Rejecting Update request from peer b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:24.090461 23704 raft_consensus.cc:2468] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 14.
I20260709 13:11:24.096164 23704 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:24.097483 23699 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 23.
I20260709 13:11:24.123525 31290 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e for earlier term 13. Current term is 14.
I20260709 13:11:24.125385 31225 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:24.126010 31225 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:24.126931 31225 raft_consensus.cc:3055] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:24.127326 31225 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:24.132647 31269 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:24.132761 31195 consensus_queue.cc:237] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:24.138206 31225 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:24.140296 31055 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:24.141202 31225 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:24.138747 31267 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.141923 31267 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.144302 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:24.145205 23771 raft_consensus.cc:2368] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 24. Current term is 25.
I20260709 13:11:24.149870 23526 catalog_manager.cc:5697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:24.151283 31115 raft_consensus.cc:993] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: : Instructing follower c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:11:24.152210 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:24.152916 23770 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:24.157282 31115 raft_consensus.cc:1081] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Signalling peer c885217113574e7489e6c3afb6950f76 to start an election
I20260709 13:11:24.172660 24385 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
W20260709 13:11:24.159691 23527 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52058 (request call id 193) took 25490 ms (client timeout 15000 ms). Trace:
W20260709 13:11:24.180804 31293 log.cc:927] Time spent T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:24.192494 23770 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:24.216624 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:24.221311 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.233145 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:24.234030 24390 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:24.235356 23667 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:24.237146 31055 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:24.237679 31055 raft_consensus.cc:697] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:24.238550 31055 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:24.199555 31291 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:11:24.176957 23527 rpcz_store.cc:269] 0709 13:10:58.707959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.710234 (+  2275us) service_pool.cc:224] Handling call
0709 13:11:24.159601 (+25449367us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:21.492170 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:21.492921 (+   751us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:21.492991 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:11:21.493026 (+    35us) tablet.cc:662] Decoding operations
0709 13:11:21.494079 (+  1053us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:21.494185 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:21.494226 (+    41us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:21.495066 (+   840us) tablet.cc:701] Row locks acquired
0709 13:11:21.495127 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:11:21.495335 (+   208us) write_op.cc:270] Start()
0709 13:11:21.495514 (+   179us) write_op.cc:276] Timestamp: P: 1783602681495251 usec, L: 0
0709 13:11:21.495560 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:11:21.687405 (+191845us) log.cc:844] Serialized 2455 byte log entry
0709 13:11:22.303470 (+616065us) op_driver.cc:464] REPLICATION: finished
0709 13:11:22.543507 (+240037us) write_op.cc:301] APPLY: starting
0709 13:11:22.543616 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:22.638297 (+ 94681us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:22.638422 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:22.642178 (+  3756us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:22.642463 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:11:22.642509 (+    46us) write_op.cc:312] APPLY: finished
0709 13:11:22.642829 (+   320us) log.cc:844] Serialized 65 byte log entry
0709 13:11:22.643056 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:22.643166 (+   110us) write_op.cc:454] Released schema lock
0709 13:11:22.643236 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:22.643670 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:22.643697 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50286,"reported_tablets":51,"spinlock_wait_cycles":179840,"child_traces":[["op",{"apply.queue_time_us":236422,"apply.run_cpu_time_us":10761,"apply.run_wall_time_us":100164,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":207514,"prepare.run_cpu_time_us":14916,"prepare.run_wall_time_us":300828,"raft.queue_time_us":277358,"raft.run_cpu_time_us":23073,"raft.run_wall_time_us":190878,"replication_time_us":807726,"spinlock_wait_cycles":38272,"thread_start_us":592968,"threads_started":4,"wal-append.queue_time_us":92582,"wal-append.run_cpu_time_us":28362,"wal-append.run_wall_time_us":1924912}]]}
I20260709 13:11:24.242566 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:24.243806 23622 raft_consensus.cc:2393] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 17: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:24.087281 31183 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:24.245127 31183 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:24.246083 31183 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.247373 31183 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:24.151496 23526 catalog_manager.cc:5697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 18, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 18 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.263818 24390 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:24.265347 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:24.268980 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54722.6us
I20260709 13:11:24.279206 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:24.279934 23696 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:11:24.286422 23697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45086
I20260709 13:11:24.286974 23697 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:24.287302 23697 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:24.290557 23669 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:24.301347 23700 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:24.302608 23700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b55528b161184b85a266eb8c58844016"
dest_uuid: "c885217113574e7489e6c3afb6950f76"
 from {username='slave'} at 127.0.0.1:45086
I20260709 13:11:24.303351 23700 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:24.303874 23700 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:24.312176 23669 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:24.312258 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 47008us
I20260709 13:11:24.313813 23742 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:24.316454 23526 catalog_manager.cc:5697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 18, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 18 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.319324 31183 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:24.320101 31269 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.320611 31269 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.321801 23742 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:24.322705 31269 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:24.322891 23696 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:24.323988 31191 raft_consensus.cc:2804] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:24.323904 31273 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:24.325209 31273 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.325593 31273 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:24.327417 31261 consensus_queue.cc:1059] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:24.327921 31191 raft_consensus.cc:697] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:24.328708 30509 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:24.329170 30509 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:24.330132 30509 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:24.332410 31263 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.333113 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:24.333288 31263 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:24.332561 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 62605us
I20260709 13:11:24.334728 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:24.333858 31171 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:24.336182 31171 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:24.337553 31254 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:24.339227 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:24.328891 31191 consensus_queue.cc:237] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:24.341679 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.345865 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:24.346776 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:24.347569 23629 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:24.349114 23626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:24.350040 23626 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:24.352012 23743 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:24.356400 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:24.357831 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:24.358291 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 322277us
W20260709 13:11:24.371984 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.371114 23526 catalog_manager.cc:5697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:24.353401 23697 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.387087 23702 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:24.389318 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 89041.3us
I20260709 13:11:24.275259 23627 raft_consensus.cc:2468] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
W20260709 13:11:24.395538 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 43655.6us
W20260709 13:11:24.428042 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 67506.8us
I20260709 13:11:24.434721 23667 leader_election.cc:400] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 24. Current term is 25.
I20260709 13:11:24.435258 23667 leader_election.cc:403] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:24.428967 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:24.390776 23593 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:24.441742 23526 catalog_manager.cc:5697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 19 to 20, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 20 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:24.355012 31254 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.447368 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:24.379629 31114 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:24.449380 23629 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 25.
I20260709 13:11:24.456537 23743 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:24.394870 31186 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:24.459502 23526 catalog_manager.cc:5697] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 17 to 20, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 20 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:24.395107 31269 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:24.427100 31236 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:24.432827 31100 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:24.479049 23526 catalog_manager.cc:5697] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:24.442241 31239 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:24.486691 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 96014.3us
W20260709 13:11:24.492389 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 46812.5us
I20260709 13:11:24.495064 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:24.498127 23624 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:24.459208 31237 raft_consensus.cc:3060] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:11:24.461268 31242 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:24.462462 31105 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:24.443958 31232 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:11:24.478220 31123 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:24.513679 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:24.481254 31100 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.482887 31236 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:24.524586 23700 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.539716 23526 catalog_manager.cc:5697] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 14, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 14 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.464258 31114 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.578387 31105 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.498013 31263 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:24.506285 31269 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.527038 31223 raft_consensus.cc:2804] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:24.584364 31242 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:24.600723 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 87121.5us
I20260709 13:11:24.505451 31186 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:24.601660 23526 catalog_manager.cc:5697] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:24.542590 23703 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:24.460762 31254 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.528311 31100 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:24.622828 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 166367us
I20260709 13:11:24.503307 31239 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:24.621460 31301 log.cc:927] Time spent T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:11:24.503386 31055 consensus_queue.cc:1048] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.089s
I20260709 13:11:24.527168 31283 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:11:24.531865 31236 raft_consensus.cc:3060] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:24.630682 31273 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:24.631371 31138 consensus_meta.cc:287] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.608s	user 0.002s	sys 0.006s
I20260709 13:11:24.620505 31300 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:24.617435 31123 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 24 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:11:24.633893 30963 consensus_meta.cc:287] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.000s
I20260709 13:11:24.638396 23700 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:24.657428 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 222908us
I20260709 13:11:24.656991 23526 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 16, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 16 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:11:24.709522 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 204680us
I20260709 13:11:24.653568 31253 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:24.652706 31223 raft_consensus.cc:697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:11:24.731045 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 74441.5us
I20260709 13:11:24.720351 23526 catalog_manager.cc:5697] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 16 to 17, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 17 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.775081 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:24.775859 23773 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:24.775779 23526 catalog_manager.cc:5697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 18 to 19, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 19 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.777315 23526 catalog_manager.cc:5697] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 15, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 15 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:24.778466 23526 catalog_manager.cc:5697] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 16 to 18, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 18 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:24.779345 23526 catalog_manager.cc:5697] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 18, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 18 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.781050 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:24.781847 23700 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:24.720000 31300 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:24.712571 31311 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:11:24.652932 31242 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 13:11:24.784494 31232 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.789261 30911 consensus_meta.cc:287] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.001s
I20260709 13:11:24.812628 23526 catalog_manager.cc:5697] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:24.816221 23526 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 19 to 22, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 22 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:24.817642 23526 catalog_manager.cc:5697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 16 to 18, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 18 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:11:24.820163 23628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
W20260709 13:11:24.825778 31308 log.cc:927] Time spent T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:11:24.832908 31186 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:24.833137 31300 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:24.833568 31186 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:24.835079 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.811852 31232 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.835147 31269 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:24.836879 23628 raft_consensus.cc:2393] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 23: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:24.837329 31232 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:24.838896 23773 raft_consensus.cc:2468] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 24.
I20260709 13:11:24.838285 31223 consensus_queue.cc:237] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.842288 23622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065" is_pre_election: true
I20260709 13:11:24.843781 31123 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.842236 31236 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:24.843844 31186 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:24.847806 23629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9ab488f10c434878a749f261e99a8065"
I20260709 13:11:24.822927 23526 catalog_manager.cc:5697] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 9 to 12, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 12 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.859254 23526 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 22 to 24, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 24 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.811573 30911 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.859839 22480 tablet_server.cc:179] TabletServer@127.21.244.1:0 shutting down...
W20260709 13:11:24.869463 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 56218.8us
W20260709 13:11:24.861609 31154 consensus_meta.cc:287] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.817s	user 0.012s	sys 0.000s
I20260709 13:11:24.871001 23667 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:24.874127 30865 consensus_meta.cc:287] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Time spent flushing consensus metadata: real 0.871s	user 0.004s	sys 0.015s
I20260709 13:11:24.874603 30865 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.875823 31154 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.878114 23620 raft_consensus.cc:1240] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:24.878288 31154 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:24.879122 23704 raft_consensus.cc:1240] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:24.880344 31305 log.cc:927] Time spent T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:11:24.881897 31236 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:24.882577 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:24.888458 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:24.889568 23769 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:11:24.865057 31114 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:24.901520 23695 raft_consensus.cc:2468] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 17.
I20260709 13:11:24.902352 23625 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:24.892347 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:24.895162 23770 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:24.899554 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:24.903790 23778 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:11:24.903662 23776 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:24.884063 31239 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:24.902972 31055 raft_consensus.cc:2804] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:24.913486 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:24.922195 23743 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:11:24.894093 30963 consensus_queue.cc:1059] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:11:24.922927 31254 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:24.930456 31239 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:24.930764 31055 raft_consensus.cc:697] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 24 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:24.946092 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:24.947088 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:11:24.947381 31318 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:11:24.944500 31319 log.cc:927] Time spent T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:11:24.944662 31316 log.cc:927] Time spent T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:11:24.931509 31186 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:11:24.944891 31242 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:24.961865 30911 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:24.962194 31237 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959) with higher term. Message: Invalid argument: T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 for earlier term 24. Current term is 25.
I20260709 13:11:24.942279 31100 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.964407 23775 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 20: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:24.965646 31100 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:24.954883 31239 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:24.969007 31239 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:24.973301 23777 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:11:24.977775 31055 consensus_queue.cc:237] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.979959 31262 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:24.980957 31242 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:24.981348 31242 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:24.982148 31242 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:24.983649 23697 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:24.986833 31105 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:24.999173 23699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45072 (request call id 3557) took 1041 ms. Trace:
I20260709 13:11:24.999640 23699 rpcz_store.cc:276] 0709 13:11:23.958174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.020170 (+ 61996us) service_pool.cc:224] Handling call
0709 13:11:24.998979 (+978809us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b5400405454. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b413102fa 00007f2b462d1b17 00007f2b3f84c6d4 00007f2b3f84c662 00007f2b3f84c591 00007f2b3f84c50c 00007f2b3f84b7c2 00007f2b3f64748c 00007f2b3f6468c6 00007f2b3f64626f
0709 13:11:24.999077 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175523072}
I20260709 13:11:25.003250 31267 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:25.005700 31323 raft_consensus.cc:3055] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:25.006143 31323 raft_consensus.cc:740] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:25.006975 31323 consensus_queue.cc:260] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.008966 30911 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.009359 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.009537 30911 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:25.010054 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.012578 23744 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.987922 24358 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:25.014345 31242 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:25.015491 30865 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:25.016487 31252 raft_consensus.cc:2804] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:25.016800 23624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52042 (request call id 4123) took 1037 ms. Trace:
I20260709 13:11:25.017020 31252 raft_consensus.cc:697] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:25.017160 31261 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:25.017776 31261 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.018088 31252 consensus_queue.cc:237] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:25.021899 31261 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:25.023624 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.024887 23701 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:11:25.026678 31273 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:25.017189 23624 rpcz_store.cc:276] 0709 13:11:23.979270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.979636 (+   366us) service_pool.cc:224] Handling call
0709 13:11:24.000345 (+ 20709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.502998 (+502653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.016594 (+513596us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54000dacd4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:25.016742 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144341760}
I20260709 13:11:25.032107 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:25.042459 23703 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:11:25.049052 24385 raft_consensus.cc:1275] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:25.055195 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:25.061336 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:25.062177 23771 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:25.058260 30911 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:25.073010 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:25.073841 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:25.074443 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:25.078835 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.079634 23695 raft_consensus.cc:2410] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:11:25.059228 31273 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.082050 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:25.067066 31218 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:25.074870 31323 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:25.054569 31123 consensus_queue.cc:1059] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:11:25.060712 31228 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:11:25.078368 30911 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.069020 30698 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.020s
I20260709 13:11:25.100298 30911 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.092679 31218 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:25.088506 31273 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.117570 31273 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:25.118100 23772 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:25.125191 23772 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:25.111563 30911 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:25.137006 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 65857.2us
I20260709 13:11:25.126176 31218 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:25.152132 23771 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:25.152935 23775 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:25.153383 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.153970 23695 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
W20260709 13:11:25.164268 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 94295.3us
I20260709 13:11:25.174574 31228 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:25.175282 31228 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:25.174660 31331 log.cc:927] Time spent T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:11:25.180097 30911 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.214944 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 117850us
I20260709 13:11:25.202328 30911 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:25.210520 31228 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:25.220307 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:25.227330 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:25.213979 31261 raft_consensus.cc:493] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:25.233780 24390 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:11:25.235018 23741 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.230175 31169 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:25.257575 31169 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:25.257988 31169 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:25.235998 23667 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:25.238662 31055 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:25.261452 31055 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:25.261885 31055 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:25.262428 31239 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.239477 31253 consensus_queue.cc:1048] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:25.263698 31289 raft_consensus.cc:3055] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:25.264325 31289 raft_consensus.cc:740] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:25.265316 31324 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:25.265120 31289 consensus_queue.cc:260] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.265915 31324 raft_consensus.cc:697] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:25.266130 31289 raft_consensus.cc:3060] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:25.266813 31324 consensus_queue.cc:237] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.246788 31271 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:25.249420 30509 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:25.268592 31239 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:25.269448 23667 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:25.255659 31261 raft_consensus.cc:515] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:25.232297 23743 leader_election.cc:336] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:25.270346 23704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45072 (request call id 3553) took 1313 ms. Trace:
I20260709 13:11:25.253319 30911 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:25.273918 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:25.272517 23704 rpcz_store.cc:276] 0709 13:11:23.957115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.099005 (+141890us) service_pool.cc:224] Handling call
0709 13:11:24.128142 (+ 29137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.879573 (+751431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.270102 (+390529us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54003b4054. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b4130ce01 00007f2b4130b83e 00007f2b462d0419 00007f2b3f847bd4 00007f2b3f847b62 00007f2b3f847a91 00007f2b3f847a0c 00007f2b3f846cc2 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:25.270281 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726625152}
W20260709 13:11:25.273933 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 44334.3us
I20260709 13:11:25.281401 23777 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
W20260709 13:11:25.280537 23743 leader_election.cc:336] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:25.287859 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:25.286214 23778 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:25.288232 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.290467 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.291752 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:25.291638 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.292213 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:25.293386 23700 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:25.283596 31310 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:25.298187 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.291061 23702 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 23.
I20260709 13:11:25.298852 23701 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:25.315510 30990 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:25.316397 30990 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:25.319957 30990 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:25.273595 30865 raft_consensus.cc:2804] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:25.364949 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:25.299824 23743 consensus_peers.cc:597] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.369720 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 69961.2us
I20260709 13:11:25.365504 23742 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:25.367676 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:25.370633 23743 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:25.381204 31261 leader_election.cc:290] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:25.384093 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:25.376374 31263 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:25.373925 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:25.397002 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:25.397670 23773 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:25.397905 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:25.399528 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:25.400228 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:25.401252 23773 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:11:25.363186 31252 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.403594 23743 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:25.414214 31344 log.cc:927] Time spent T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:11:25.415845 31286 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:25.416649 31286 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:25.420542 31252 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:25.421085 31263 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:25.421607 31263 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:25.424800 23769 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:11:25.422469 23770 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
W20260709 13:11:25.432108 23669 leader_election.cc:336] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:25.405527 30990 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:11:25.422034 31263 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:25.371407 31315 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 13:11:25.432523 23667 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:25.377187 30865 raft_consensus.cc:697] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
W20260709 13:11:25.433632 23669 consensus_peers.cc:597] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.441808 23699 raft_consensus.cc:2468] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 25.
W20260709 13:11:25.447949 23669 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:25.448160 23699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.452471 23700 raft_consensus.cc:2468] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:25.452461 23592 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:25.448590 23669 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:25.419637 31286 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:25.474073 30865 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.476096 31256 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:25.476768 31256 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:25.477888 31256 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.461585 31237 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:25.487320 31237 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:25.489864 31237 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:25.496846 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:25.500916 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:25.501125 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:11:25.502662 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 54752.6us
W20260709 13:11:25.503325 23669 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:25.504133 23669 leader_election.cc:336] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:25.504868 23669 consensus_peers.cc:597] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.505337 23669 consensus_peers.cc:597] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.465111 31232 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:25.512233 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:25.439698 31055 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.517630 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:25.464165 30698 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:25.522116 31310 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:25.506851 30911 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:25.597218 30911 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:25.597785 31252 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:25.506196 31232 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.534047 23769 raft_consensus.cc:1275] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:11:25.599617 31232 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:25.539662 23743 consensus_peers.cc:597] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.540714 31314 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:25.520666 31286 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:25.601459 31286 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.554885 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:25.562489 23775 raft_consensus.cc:1240] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:11:25.565263 23776 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:11:25.604416 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 64808.5us
I20260709 13:11:25.542164 31169 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.572937 31300 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:25.607136 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:11:25.574718 24359 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.574810 23592 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:25.575271 31055 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:25.588903 23669 consensus_peers.cc:597] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.610419 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 97160.8us
W20260709 13:11:25.611277 23669 leader_election.cc:336] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:25.594610 31241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.107s	user 0.042s	sys 0.052s
I20260709 13:11:25.595865 30698 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.567127 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:11:25.594915 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 77098.8us
W20260709 13:11:25.612509 23669 leader_election.cc:336] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:25.614493 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:11:25.608389 24359 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.619000 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 212360us
I20260709 13:11:25.618913 23592 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
W20260709 13:11:25.607879 23743 consensus_peers.cc:597] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.623118 23669 leader_election.cc:336] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:25.623873 23669 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:25.624179 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:25.581995 31263 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:25.613169 31241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.043s	sys 0.052s
W20260709 13:11:25.621824 23743 consensus_peers.cc:597] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.594666 31289 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:25.651922 24390 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:25.662243 23593 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:25.663220 23775 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
W20260709 13:11:25.652606 23669 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:25.665143 23669 leader_election.cc:336] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:25.666288 23669 consensus_peers.cc:597] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.669909 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:25.665377 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:25.648890 30990 consensus_queue.cc:1059] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:11:25.671869 31320 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:25.626142 31283 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:25.646827 31348 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:25.678171 31348 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.677909 31320 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:25.678566 31348 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:25.654294 31171 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:25.649387 31262 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:25.624904 31310 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:25.713210 31310 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:25.714509 31310 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.698802 31311 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.617085 31314 consensus_queue.cc:1048] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:11:25.702899 31169 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:25.704528 31138 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:11:25.707140 23669 consensus_peers.cc:597] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.680576 30509 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:25.722993 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 60864.9us
W20260709 13:11:25.735742 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 68749.2us
I20260709 13:11:25.731448 31115 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:25.744623 31320 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:11:25.687148 31253 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:25.739262 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:25.751643 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:25.743103 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:25.693128 31262 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.752723 23776 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:11:25.759143 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:25.763509 23703 raft_consensus.cc:1275] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:25.765955 23700 raft_consensus.cc:1275] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:25.767402 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b889a8b97443f781c7eef38dba2f96" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.768046 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:25.767791 30911 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:25.772297 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.675572 31289 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.778425 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.731710 31283 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:25.779354 23703 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
I20260709 13:11:25.779369 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:25.787156 23703 raft_consensus.cc:1240] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 24 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:25.787976 23742 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:25.790817 23702 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:25.793561 23775 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:25.796540 23703 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:11:25.767508 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:25.757830 31320 raft_consensus.cc:493] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:25.757601 31237 raft_consensus.cc:493] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:25.772940 31262 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:25.806385 23702 raft_consensus.cc:1275] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:25.772023 30509 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:25.774381 31115 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.774008 31253 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:25.735662 31311 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.813364 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:25.849783 23697 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 18.
I20260709 13:11:25.755718 31240 consensus_queue.cc:1059] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:11:25.782927 31138 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:25.784955 31300 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:25.805333 31273 raft_consensus.cc:2804] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:25.782821 30911 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:11:25.836994 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 69596.3us
W20260709 13:11:25.835413 24359 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.774850 31232 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:25.856971 23594 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.860630 30990 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:25.861301 30990 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:25.866420 31273 raft_consensus.cc:697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:25.867545 31273 consensus_queue.cc:237] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.850466 31237 raft_consensus.cc:515] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:25.870054 30698 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:25.848851 31324 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:25.870817 31324 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:25.871232 31324 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:25.871680 31237 leader_election.cc:290] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:25.856721 30911 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:25.843081 31320 raft_consensus.cc:515] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:25.874222 31320 leader_election.cc:290] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:25.851899 31115 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.876304 31283 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.877454 31263 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:25.857151 31314 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:25.885864 31253 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:25.886584 31314 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:25.878769 24359 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.889096 24359 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.892185 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:25.895576 24359 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.878283 31286 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:25.915241 23742 leader_election.cc:304] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:25.911756 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:25.900030 24359 leader_election.cc:336] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:25.914606 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:25.929275 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 274226us
W20260709 13:11:25.929387 24359 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.945751 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:25.949148 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:25.944146 24359 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:25.928256 30963 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:25.931931 31236 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:25.979984 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:25.968042 24359 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:25.983225 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:25.932629 31138 raft_consensus.cc:2749] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:25.914537 31296 consensus_queue.cc:1048] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:11:25.944164 31237 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:25.941452 31191 consensus_queue.cc:1048] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:11:25.931690 31323 consensus_queue.cc:1048] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:11:25.969729 31263 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.965775 31315 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:26.011786 23700 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 23.
W20260709 13:11:26.013379 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 69289.8us
I20260709 13:11:25.986011 30865 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:25.987803 31236 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:26.017652 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 278509us
W20260709 13:11:26.017933 24359 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:26.020439 24359 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:26.020362 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:25.989360 30698 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
W20260709 13:11:26.037127 24359 leader_election.cc:336] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:25.973433 31300 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:11:25.967646 31241 consensus_queue.cc:1059] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:11:26.016806 31290 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:26.040624 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:26.023265 31236 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.009867 31354 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.033252 31289 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:26.016215 31237 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.038446 30865 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:26.024333 31315 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.089918 31289 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:26.025126 31263 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.094754 31314 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:26.124200 31357 log.cc:927] Time spent T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:11:26.125471 31232 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:26.127518 31115 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:26.130935 31360 log.cc:927] Time spent T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:26.079568 30698 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:26.085213 31354 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:26.121424 31359 log.cc:927] Time spent T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:11:26.103022 31348 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:26.127339 31324 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:26.120450 31286 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:26.178172 31286 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:26.195915 24390 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.012s	sys 0.010s
W20260709 13:11:26.196986 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 464041us
W20260709 13:11:26.203418 24390 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.013s	sys 0.011s
I20260709 13:11:26.221104 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee650b0b99c4413293e36b0fa9631151" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:26.231420 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7479a1f927d94d5e873a594847f4ee10" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:26.172897 30865 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.264635 31115 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:26.265394 31115 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:26.266192 30990 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:26.266721 30990 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:26.269454 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:26.267271 30990 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:26.273407 30990 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:26.271575 31240 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:26.280529 31240 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:26.276070 31123 raft_consensus.cc:3055] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:26.285571 31123 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:26.286621 31123 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.312917 31311 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:26.279553 31323 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:26.317553 31323 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:26.263553 31116 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:26.329779 31240 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:26.332027 31123 raft_consensus.cc:3060] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:26.336278 31115 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:26.318842 31323 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.321077 31116 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:26.357577 31237 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:26.250828 31366 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:26.366750 31236 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:26.391521 30911 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:26.367506 31366 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:26.367581 31354 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:26.369247 31286 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:26.369930 30698 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:26.370499 31263 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:26.376462 31358 log.cc:927] Time spent T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:11:26.394574 31366 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:26.374275 31262 consensus_meta.cc:287] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.001s
I20260709 13:11:26.379938 31116 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:26.377811 31348 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:26.376807 31315 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:26.377811 31324 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:11:26.425474 31262 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.496192 31262 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:26.506218 31236 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:26.542483 31289 raft_consensus.cc:3055] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:26.542953 31289 raft_consensus.cc:740] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:26.543846 31289 consensus_queue.cc:260] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:26.573832 31353 log.cc:927] Time spent T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.554s	user 0.000s	sys 0.003s
W20260709 13:11:26.620061 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 345266us
W20260709 13:11:26.622088 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 317633us
I20260709 13:11:26.622236 31291 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:26.625876 31291 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:26.626075 31323 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:26.626757 31323 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.628976 31323 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:26.629557 31323 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.630095 31323 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.631705 31105 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:26.632385 31323 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:26.632263 31105 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.634315 31105 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:26.638543 31386 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.639079 31386 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.641008 31386 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:26.645931 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:26.648358 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.648989 23769 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:11:26.649792 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.650442 23769 raft_consensus.cc:2393] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 19: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:26.652743 23772 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:11:26.656040 23769 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:11:26.677299 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 271993us
I20260709 13:11:26.696993 23775 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:11:26.701391 23777 raft_consensus.cc:1240] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
W20260709 13:11:26.746070 23592 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.018s	sys 0.013s
W20260709 13:11:26.746506 23592 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.019s	sys 0.014s
W20260709 13:11:26.746819 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 704881us
I20260709 13:11:26.758419 30509 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:26.759119 30509 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.765820 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.765826 30509 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:26.770079 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:26.770350 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.771010 23769 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:26.771486 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.772744 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.773382 23769 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
I20260709 13:11:26.773630 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.775645 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.776878 23770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.777486 23770 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 15.
I20260709 13:11:26.778685 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.784873 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:26.786235 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.786995 23769 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:26.787938 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.799309 30990 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:26.800992 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.801677 23778 raft_consensus.cc:2468] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 19.
I20260709 13:11:26.807952 31380 consensus_queue.cc:1059] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:11:26.803566 30990 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:26.809425 30509 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.809926 30509 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.811231 30990 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:26.811708 30509 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:26.814030 23769 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 20.
W20260709 13:11:26.816100 23743 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:26.822781 31380 raft_consensus.cc:3055] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:26.827522 23743 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:26.829074 23743 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:26.831000 23743 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:26.831714 23743 leader_election.cc:336] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:26.832418 23743 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:26.832882 31380 raft_consensus.cc:740] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
W20260709 13:11:26.833040 23743 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:26.833885 23743 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:26.824031 23592 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:26.834031 31380 consensus_queue.cc:260] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.836509 23592 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:26.838464 23592 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:26.836169 31283 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:26.842756 31380 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:26.841924 31283 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.843593 31283 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:26.840692 31386 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:26.844305 31386 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.844687 31386 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:26.840596 31300 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:26.847465 31300 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.847890 31300 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:26.856529 31386 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.861356 31386 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:26.870486 31116 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.870113 23592 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:26.871690 31116 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.878383 23592 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:26.875784 31300 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.882241 31300 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:26.882400 31283 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.875844 31348 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.891024 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:26.891618 23769 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:26.894299 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:26.894873 23775 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:26.878041 31387 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.880412 31366 raft_consensus.cc:2804] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:26.899619 23769 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:26.901269 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.902179 23592 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:26.889482 31379 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:26.900981 31366 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.916042 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.917487 23776 raft_consensus.cc:2393] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 20: Already voted for candidate 9ab488f10c434878a749f261e99a8065 in this term.
I20260709 13:11:26.896479 31348 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:26.931041 23775 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:26.914117 30990 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:26.936102 23773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43456 (request call id 3368) took 1382 ms. Trace:
I20260709 13:11:26.901955 31387 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.912163 31116 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:26.916296 31366 raft_consensus.cc:3060] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:26.913563 31379 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:26.937587 23773 rpcz_store.cc:276] 0709 13:11:25.553723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.557904 (+  4181us) service_pool.cc:224] Handling call
0709 13:11:25.558244 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:25.558633 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.558664 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:25.559205 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:11:25.923230 (+364025us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:25.923294 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.925517 (+  2223us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.935872 (+1010355us) raft_consensus.cc:1685] finished
0709 13:11:26.935890 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.936045 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1130,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":126,"thread_start_us":363606,"threads_started":1,"wal-append.queue_time_us":628179}
W20260709 13:11:26.944521 24390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.013s	sys 0.009s
W20260709 13:11:26.944932 24390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.014s	sys 0.009s
I20260709 13:11:26.960675 24386 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:26.960098 24390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46566 (request call id 1182) took 1273 ms. Trace:
I20260709 13:11:26.963006 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:26.965453 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:26.962241 24390 rpcz_store.cc:276] 0709 13:11:25.672502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.690407 (+ 17905us) service_pool.cc:224] Handling call
0709 13:11:25.690791 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.691081 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 13:11:26.204790 (+513709us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.945232 (+740442us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:26.945300 (+    68us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:11:26.945394 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.945463 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.945555 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":676668,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":45645,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":1252979,"threads_started":3,"wal-append.queue_time_us":306381}
I20260709 13:11:26.966090 24386 raft_consensus.cc:2468] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:11:26.971874 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:26.959367 30990 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:26.971879 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:26.965560 31380 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.974727 23592 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:26.978745 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:26.980538 24390 raft_consensus.cc:2468] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 14.
I20260709 13:11:26.980427 31379 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:26.982065 31116 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:26.984220 31116 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:26.985409 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:26.986649 31116 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.992027 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:26.995961 23743 consensus_peers.cc:597] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:26.992309 31283 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.004518 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:27.006304 30990 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:26.980449 31380 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.014148 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:27.014719 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.015007 24390 raft_consensus.cc:2468] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:27.022490 31348 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:27.024236 24392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:27.025115 24392 raft_consensus.cc:2468] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 13.
I20260709 13:11:27.029605 31387 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.034605 31340 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:27.035189 23698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.013s	sys 0.012s
W20260709 13:11:27.035712 23698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.013s	sys 0.012s
I20260709 13:11:27.035207 31340 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.031598 31380 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:27.036897 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 47154.5us
I20260709 13:11:27.042505 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:27.042711 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.043151 23775 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.044960 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.045503 23774 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:27.048954 23773 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:27.052316 31283 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:27.078259 23775 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 18.
W20260709 13:11:27.085202 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.081216 23592 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:27.088181 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:27.081205 31310 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:11:27.088831 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:27.092576 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:27.095969 31310 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:27.096601 31310 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:27.098198 23593 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:27.098268 31273 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.113405 31273 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.114279 31300 raft_consensus.cc:2804] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:27.114765 31300 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:27.115053 31300 raft_consensus.cc:3060] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.098632 31348 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.097596 31310 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.106352 31408 consensus_queue.cc:1059] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:27.117244 31273 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:27.116739 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:27.122515 31348 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:27.121876 23743 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:27.127349 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:27.129715 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:27.130985 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:27.128751 31408 consensus_queue.cc:1243] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer b1e32a12daf44ebbbd71cc3ce41d7d8e log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:11:27.135006 31408 raft_consensus.cc:2804] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:27.135591 31408 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
W20260709 13:11:27.137135 31409 log.cc:927] Time spent T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:27.136144 31408 raft_consensus.cc:3060] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.136354 31348 raft_consensus.cc:3055] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:27.142314 31348 raft_consensus.cc:740] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:27.143368 31348 consensus_queue.cc:260] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.144965 31348 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.153218 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.154002 23700 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 24.
I20260709 13:11:27.155192 23701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 3139) took 1377 ms. Trace:
I20260709 13:11:27.156695 31289 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:27.155632 23701 rpcz_store.cc:276] 0709 13:11:25.777573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.777734 (+   161us) service_pool.cc:224] Handling call
0709 13:11:25.786458 (+  8724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.086478 (+300020us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:11:26.360155 (+273677us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b4800190158. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:11:26.546828 (+186673us) log.cc:844] Serialized 14 byte log entry
0709 13:11:27.149004 (+602176us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.149478 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.149629 (+   151us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:11:27.149661 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.149727 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.154888 (+  5161us) raft_consensus.cc:1685] finished
0709 13:11:27.155000 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.155132 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":604242,"prepare.queue_time_us":25657,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2192,"raft.queue_time_us":651322,"raft.run_cpu_time_us":5686,"raft.run_wall_time_us":518438,"spinlock_wait_cycles":15469440,"thread_start_us":740019,"threads_started":3,"wal-append.queue_time_us":2832}
I20260709 13:11:27.157523 31300 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.167129 31340 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.168015 31411 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.168154 30698 raft_consensus.cc:2804] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:27.182489 30698 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:27.182610 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:27.183028 30698 raft_consensus.cc:3060] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.169883 31291 raft_consensus.cc:2804] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:27.170822 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.189389 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.171397 31283 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:27.172921 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.197990 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.159061 31408 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.184751 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.202884 23697 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:11:27.186555 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.187387 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.187588 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.200302 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:27.201439 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.201921 23696 raft_consensus.cc:1275] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:27.209551 23702 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:27.212085 23703 raft_consensus.cc:3060] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.204427 23697 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:27.233599 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:27.241519 23743 consensus_peers.cc:597] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:27.244750 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.246444 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.250157 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.202553 31283 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.255474 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:27.256557 31283 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.257136 31171 raft_consensus.cc:476] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Not starting pre-election -- already a leader
I20260709 13:11:27.258769 31171 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.260437 31237 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:27.260911 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.260977 31237 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.196750 31291 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:27.264303 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:27.264880 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:27.265599 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.269181 23704 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:27.266397 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.270040 23667 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:27.267102 23703 raft_consensus.cc:2468] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
I20260709 13:11:27.271173 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:27.199847 31340 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.273433 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.259267 31171 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.282349 23775 raft_consensus.cc:1275] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:27.285907 23703 raft_consensus.cc:1240] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:27.273767 31291 raft_consensus.cc:3060] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:27.268834 31237 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:27.295969 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.284332 31365 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.299054 31256 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.299577 31365 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.274011 31370 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.293915 31055 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.302160 31365 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.302675 31171 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.300810 31370 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.305251 31370 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.299690 31256 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.306252 31300 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:27.307466 31256 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.293162 31371 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:27.308288 31371 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:27.309244 31371 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:27.314301 31315 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:27.315953 31315 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:27.317799 23704 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 24.
I20260709 13:11:27.316102 31237 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.318822 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:27.318822 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:27.340119 23771 raft_consensus.cc:1240] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:27.342447 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3473b09c073142659e12a365e9aed3f3" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.288168 31324 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:27.349892 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.357074 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.358234 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.359066 23769 raft_consensus.cc:1240] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:11:27.361713 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.361984 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:27.301044 31408 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:27.368707 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.373432 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.376593 23773 raft_consensus.cc:2393] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 24: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:27.378846 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.281504 31340 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.356644 31370 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.301787 31055 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.357452 31324 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.365795 31405 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:27.365710 31253 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.343783 31237 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.404762 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.383899 31171 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.430162 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.344538 31330 consensus_queue.cc:1048] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:11:27.431314 23700 raft_consensus.cc:1240] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:11:27.366899 31365 consensus_queue.cc:1059] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:11:27.410881 31315 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:27.432570 31340 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:27.432837 31315 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.383364 31239 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:27.378605 31314 consensus_queue.cc:1059] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:11:27.435505 31314 raft_consensus.cc:3055] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:27.435938 31314 raft_consensus.cc:740] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:27.436820 31314 consensus_queue.cc:260] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.436995 31239 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.437801 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.411962 31253 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.393894 31370 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.439996 31253 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.425333 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:27.400200 31324 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:27.441445 23697 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:27.442350 23696 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.444129 31370 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.445530 31315 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:27.419229 31055 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.430415 31171 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.427168 31237 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.447773 31171 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.432570 31365 raft_consensus.cc:3055] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:27.448408 31365 raft_consensus.cc:740] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:27.449211 31365 consensus_queue.cc:260] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.450348 31365 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:27.440189 31256 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.452105 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:27.438004 31314 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:27.452594 23698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45086 (request call id 3135) took 1686 ms. Trace:
I20260709 13:11:27.453015 23698 rpcz_store.cc:276] 0709 13:11:25.766106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.766231 (+   125us) service_pool.cc:224] Handling call
0709 13:11:25.766535 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:26.066291 (+299756us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:26.090113 (+ 23822us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.288082 (+197969us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b4800190158. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b46235aa1 00007f2b4622cb37 00007f2b4622c9ca 00007f2b4632426f 00007f2b46323f37 00007f2b4633855c 00007f2b46338508 00007f2b46338488 00007f2b46338443 00007f2b463376ec 00007f2b45261a96
0709 13:11:27.162715 (+874633us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:27.164537 (+  1822us) log.cc:844] Serialized 52 byte log entry
0709 13:11:27.164734 (+   197us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:27.164795 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.164908 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.452277 (+287369us) raft_consensus.cc:1685] finished
0709 13:11:27.452379 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.452535 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":223891,"prepare.queue_time_us":25112,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":282298,"raft.run_cpu_time_us":5372,"raft.run_wall_time_us":455111,"spinlock_wait_cycles":18033536,"thread_start_us":1206598,"threads_started":2,"wal-append.queue_time_us":421564}
I20260709 13:11:27.457525 31291 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.458087 23773 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:27.459264 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.432616 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.452121 31256 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.429867 30698 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:27.462841 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 76049.3us
I20260709 13:11:27.461956 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:27.468122 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:27.464004 23769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.464507 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.471303 23696 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:27.480595 23697 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:27.494414 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:27.496898 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:27.500792 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:27.501154 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:27.503326 31300 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:27.503926 31411 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:11:27.507009 31366 consensus_meta.cc:287] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: Time spent flushing consensus metadata: real 0.562s	user 0.005s	sys 0.007s
I20260709 13:11:27.511292 23772 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:27.462625 31291 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 14 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:27.520105 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.493039 31169 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.543896 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.538872 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.548034 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:27.550284 23704 raft_consensus.cc:2393] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 in current term 20: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:27.554415 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.517082 31366 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.565974 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:27.566730 23593 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.532061 31228 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:11:27.579838 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:27.543443 31169 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:27.583591 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.582202 23669 consensus_peers.cc:597] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:27.612663 23697 raft_consensus.cc:2410] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:11:27.603909 23668 leader_election.cc:304] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:27.619356 23668 leader_election.cc:304] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:27.619891 31315 raft_consensus.cc:2749] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:27.620427 31237 raft_consensus.cc:2749] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:27.590121 31371 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.622288 31371 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.658360 23668 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:27.672011 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.672732 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.677963 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:27.666358 30698 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:27.665967 31365 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.671247 31253 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:27.674599 31256 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:27.690979 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 98055.3us
I20260709 13:11:27.677618 31371 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:27.692601 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 63254.7us
I20260709 13:11:27.698467 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:27.688292 31365 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:27.703665 23669 leader_election.cc:336] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:27.705370 31365 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.707793 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:27.708999 31138 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:27.709962 23700 raft_consensus.cc:2410] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ab488f10c434878a749f261e99a8065 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:11:27.710536 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.709406 31138 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.712890 31131 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:27.715552 31138 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:27.715818 31131 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.713476 31105 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:27.724143 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.719910 31236 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:27.726395 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:27.725339 31236 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.729241 31131 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:27.741320 24358 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.742270 31340 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.742965 24358 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:27.743889 31340 raft_consensus.cc:2804] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:27.744357 31340 raft_consensus.cc:697] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 LEADER]: Becoming Leader. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Running, Role: LEADER
I20260709 13:11:27.745270 31340 consensus_queue.cc:237] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.736058 31366 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.750380 31324 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:27.756119 31428 log.cc:927] Time spent T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:11:27.760779 30509 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:27.761284 30509 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.761664 30509 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:27.736835 31105 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.765838 31105 consensus_queue.cc:1048] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:27.773008 31239 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:27.777760 31324 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.781410 31236 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:27.779395 31169 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:27.789387 23592 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.792673 23771 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:27.793692 23774 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:11:27.834373 24359 leader_election.cc:336] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:27.796345 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.834824 23704 raft_consensus.cc:3055] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:27.835135 23697 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 23.
I20260709 13:11:27.798457 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:27.801323 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.836226 23696 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:11:27.836644 23696 pending_rounds.cc:85] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 12
I20260709 13:11:27.836890 23696 pending_rounds.cc:107] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:11:27.801481 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
W20260709 13:11:27.824638 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 97145.5us
I20260709 13:11:27.828454 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.837167 23696 raft_consensus.cc:2889] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.836259 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.830664 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:27.831589 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:27.833165 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:27.834416 23695 raft_consensus.cc:3055] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:27.838505 31366 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.797411 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:27.838603 23695 raft_consensus.cc:740] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:27.838878 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:27.835250 23704 raft_consensus.cc:740] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:27.843612 23695 consensus_queue.cc:260] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.844419 31105 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:27.844857 23695 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.844913 31105 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:27.845335 23593 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.845584 31105 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:27.846200 31366 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:27.847340 23702 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:11:27.847795 23702 pending_rounds.cc:85] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 9
I20260709 13:11:27.848254 23702 pending_rounds.cc:107] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:11:27.848554 23702 raft_consensus.cc:2889] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.848419 23593 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.840286 23704 consensus_queue.cc:260] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:27.849647 31366 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:27.849787 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.850307 23704 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:27.850713 31437 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:27.852141 23526 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 185) took 10445 ms. Trace:
I20260709 13:11:27.852301 31437 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:27.852535 23593 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:27.854719 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.855800 31437 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.855897 31366 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:27.856508 31366 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 24 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:27.857161 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.857465 31366 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:27.853106 23526 rpcz_store.cc:276] 0709 13:11:17.406918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.407150 (+   232us) service_pool.cc:224] Handling call
0709 13:11:27.852030 (+10444880us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:25.138512 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:25.155364 (+ 16852us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:25.155415 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:11:25.155438 (+    23us) tablet.cc:662] Decoding operations
0709 13:11:25.158186 (+  2748us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:25.158278 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:25.158303 (+    25us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:11:25.176102 (+ 17799us) tablet.cc:701] Row locks acquired
0709 13:11:25.176124 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:11:25.176270 (+   146us) write_op.cc:270] Start()
0709 13:11:25.176404 (+   134us) write_op.cc:276] Timestamp: P: 1783602685176225 usec, L: 0
0709 13:11:25.176426 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:11:25.177182 (+   756us) log.cc:844] Serialized 10153 byte log entry
0709 13:11:25.523620 (+346438us) op_driver.cc:464] REPLICATION: finished
0709 13:11:26.013076 (+489456us) write_op.cc:301] APPLY: starting
0709 13:11:26.017261 (+  4185us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:26.542545 (+525284us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:26.542651 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:26.564947 (+ 22296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:26.565305 (+   358us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 13:11:26.565381 (+    76us) write_op.cc:312] APPLY: finished
0709 13:11:26.566031 (+   650us) log.cc:844] Serialized 228 byte log entry
0709 13:11:26.572822 (+  6791us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:26.573046 (+   224us) write_op.cc:454] Released schema lock
0709 13:11:26.573121 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:26.576317 (+  3196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:26.576343 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3300974,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":448623,"apply.run_cpu_time_us":43999,"apply.run_wall_time_us":586891,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112963,"num_ops":26,"prepare.queue_time_us":113305,"prepare.run_cpu_time_us":24619,"prepare.run_wall_time_us":71974,"raft.queue_time_us":268339,"raft.run_cpu_time_us":48214,"raft.run_wall_time_us":213741,"replication_time_us":347022,"thread_start_us":420453,"threads_started":5,"wal-append.queue_time_us":43553,"wal-append.run_cpu_time_us":35718,"wal-append.run_wall_time_us":2177143}]]}
I20260709 13:11:27.865451 23695 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:11:27.866248 31437 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.867566 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:11:27.869290 23513 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 52353.1us
I20260709 13:11:27.869809 30509 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:27.871575 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 125283us
I20260709 13:11:27.865913 23695 pending_rounds.cc:85] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 9
I20260709 13:11:27.950857 23695 pending_rounds.cc:107] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:11:27.951249 23695 raft_consensus.cc:2889] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.873508 31116 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:27.873663 23704 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:11:27.952821 23704 pending_rounds.cc:85] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Aborting all ops after (but not including) 14
I20260709 13:11:27.953154 23704 pending_rounds.cc:107] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:11:27.953410 23704 raft_consensus.cc:2889] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:27.953476 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 54794.2us
I20260709 13:11:27.886157 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:27.886047 30698 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:27.889374 31138 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:27.870698 24359 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:27.953722 23769 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:27.885778 31228 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:27.959800 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 73705.5us
W20260709 13:11:27.955361 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 84691.5us
W20260709 13:11:27.954710 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 83105.5us
I20260709 13:11:27.963066 31361 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.964154 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.965929 31348 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:27.969336 31300 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:27.970579 31291 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:27.972283 23593 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.973523 31361 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:27.973837 31310 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:27.974156 31361 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:27.975297 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.976161 31310 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:27.976555 23593 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.977139 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:27.959002 30509 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:27.977903 23701 raft_consensus.cc:1240] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
W20260709 13:11:27.960608 24359 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:27.987011 23773 raft_consensus.cc:1240] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:27.986178 23593 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.990525 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.991055 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.992322 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.976675 31361 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:27.999176 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:27.997406 31399 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:27.983587 31310 raft_consensus.cc:3060] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.013450 31138 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:27.995098 31105 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:28.015590 31440 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.994622 31366 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:27.998986 31423 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:28.044485 31105 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:28.039659 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d67625249f734ae3b71d554b7a2ba33b: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:11:28.004545 31386 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:28.035178 31131 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:11:28.063048 31432 log.cc:927] Time spent T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:11:28.069396 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 53998.1us
I20260709 13:11:28.029742 31300 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.016798 31387 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:28.079326 24415 debug-util.cc:398] Leaking SignalData structure 0x7b08003060c0 after lost signal to thread 22483
W20260709 13:11:28.131549 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 132239us
W20260709 13:11:28.133055 24415 debug-util.cc:398] Leaking SignalData structure 0x7b08003065e0 after lost signal to thread 23561
I20260709 13:11:28.095554 30698 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:28.107849 31116 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:28.111312 23772 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:28.113365 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:28.138020 23775 raft_consensus.cc:1240] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Rejecting Update request from peer c885217113574e7489e6c3afb6950f76 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:28.123557 31423 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:28.124645 23513 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 85637.2us
I20260709 13:11:28.128623 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:28.134539 24415 debug-util.cc:398] Leaking SignalData structure 0x7b08003061c0 after lost signal to thread 23653
W20260709 13:11:28.139489 24415 debug-util.cc:398] Leaking SignalData structure 0x7b0800306120 after lost signal to thread 23654
I20260709 13:11:28.139858 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:28.140686 23773 raft_consensus.cc:2393] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 21: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:28.134550 30698 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:28.120988 31440 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:28.141091 24415 debug-util.cc:398] Leaking SignalData structure 0x7b0800310600 after lost signal to thread 23728
W20260709 13:11:28.141569 24415 debug-util.cc:398] Leaking SignalData structure 0x7b0800335520 after lost signal to thread 23729
W20260709 13:11:28.141974 24415 debug-util.cc:398] Leaking SignalData structure 0x7b0800376b40 after lost signal to thread 23743
W20260709 13:11:28.143756 24415 debug-util.cc:398] Leaking SignalData structure 0x7b0800136c80 after lost signal to thread 23802
W20260709 13:11:28.144156 24415 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb3c0 after lost signal to thread 23803
W20260709 13:11:28.145753 24415 debug-util.cc:398] Leaking SignalData structure 0x7b080036d260 after lost signal to thread 24418
W20260709 13:11:28.145848 23669 leader_election.cc:336] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:28.146344 24415 debug-util.cc:398] Leaking SignalData structure 0x7b08000e79e0 after lost signal to thread 24419
I20260709 13:11:28.146641 23669 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:28.147684 24415 debug-util.cc:398] Leaking SignalData structure 0x7b08002261a0 after lost signal to thread 31355
W20260709 13:11:28.150733 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.152225 23593 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:28.129711 31310 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.154248 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:28.157943 30698 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:28.159462 30698 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:28.160648 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:28.149262 31423 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:28.170732 23669 consensus_peers.cc:597] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:28.126566 31380 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:11:28.132085 31348 consensus_queue.cc:1059] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:11:28.151625 31437 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:28.156983 31105 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:28.136430 31300 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:28.178849 23669 consensus_peers.cc:597] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:28.184300 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 227415us
W20260709 13:11:28.193624 23669 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:28.194749 23669 leader_election.cc:336] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:28.195650 23669 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.177301 31169 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:28.176944 31291 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:11:28.152522 31116 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:28.195947 31310 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:11:28.214695 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.197885 23669 consensus_peers.cc:597] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:28.225325 31300 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:28.198321 31436 consensus_queue.cc:1059] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:11:28.188840 31437 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:28.232169 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.232707 23669 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:28.238600 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.197224 31387 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:28.245422 23669 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.246376 23669 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:28.262218 23669 leader_election.cc:336] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.264668 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:28.188215 31105 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:28.274935 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 122510us
I20260709 13:11:28.251886 31387 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:28.287698 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:28.287916 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 68472.7us
I20260709 13:11:28.272351 31171 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.290565 23771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:28.294265 23771 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 24.
I20260709 13:11:28.292680 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:28.296263 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:28.275849 31237 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:28.299305 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
W20260709 13:11:28.304821 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 152660us
I20260709 13:11:28.305930 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:28.307863 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.313784 23695 raft_consensus.cc:1275] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:28.316771 31437 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:28.321763 31116 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:28.321983 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:28.303330 31105 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:28.329471 31440 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:28.331879 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:28.337406 23700 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:28.372779 23700 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:11:28.375552 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:28.375937 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:28.377003 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:28.383693 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:28.386082 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:28.389899 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:28.405727 23704 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:28.410856 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:28.429251 23669 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.430634 30698 raft_consensus.cc:493] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.344213 31300 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:11:28.432945 23593 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:28.432160 23669 consensus_peers.cc:597] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:28.352093 31116 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
W20260709 13:11:28.434993 23743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 95135.7us
I20260709 13:11:28.431226 30698 raft_consensus.cc:515] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:28.437167 23669 leader_election.cc:336] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.439081 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:28.439633 23669 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:28.444978 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 159533us
I20260709 13:11:28.462674 30698 leader_election.cc:290] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:28.463356 30698 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.366910 31387 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:28.463855 30698 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:28.467489 23669 leader_election.cc:336] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.468500 31169 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:28.440730 31457 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:28.479658 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:28.496233 30698 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:28.497757 23669 leader_election.cc:336] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.498327 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:28.499946 23669 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.500976 23669 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:28.500706 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 52735.8us
I20260709 13:11:28.492120 31387 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:28.391806 31455 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.107s
I20260709 13:11:28.437558 31451 consensus_queue.cc:1048] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.066s
W20260709 13:11:28.547201 23669 leader_election.cc:336] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.548549 23592 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:28.501221 31462 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:28.551955 23669 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:28.553200 31300 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:28.502194 31463 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:28.564970 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 59245.7us
I20260709 13:11:28.565826 23777 raft_consensus.cc:3055] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:28.573041 23777 raft_consensus.cc:740] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
W20260709 13:11:28.573237 23669 leader_election.cc:336] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.573753 23669 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:28.572098 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:28.575095 23774 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
W20260709 13:11:28.576972 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 138726us
I20260709 13:11:28.577860 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:28.583194 31457 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.584859 23592 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
I20260709 13:11:28.573942 23777 consensus_queue.cc:260] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:28.574368 31237 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:28.585960 31457 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:28.586573 31457 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.587040 31457 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:28.570369 31300 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.588164 31300 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:28.591832 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:28.547863 31314 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:28.596031 23669 leader_election.cc:336] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.597102 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:28.598191 31169 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:28.622619 23669 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.623142 23669 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:28.624861 23669 leader_election.cc:336] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.633267 23669 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:28.640584 23669 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.624277 31314 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:28.624497 31461 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:28.623397 31169 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:28.640079 31315 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.652518 31423 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:28.655362 31423 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:28.642987 23743 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.659363 31283 raft_consensus.cc:3055] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:28.642776 23669 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:28.669029 31283 raft_consensus.cc:740] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:28.672086 31283 consensus_queue.cc:260] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:28.673645 31239 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:28.694139 23777 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:28.702471 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.670449 23669 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.704879 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:28.716414 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45992.5us
W20260709 13:11:28.717718 23669 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.718214 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:28.725659 23669 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.726423 23669 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:28.738303 23777 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:11:28.739094 23777 pending_rounds.cc:85] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 13
I20260709 13:11:28.739611 23777 pending_rounds.cc:107] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 23.14
W20260709 13:11:28.739540 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 147813us
I20260709 13:11:28.740237 23777 raft_consensus.cc:2889] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:28.740983 30509 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 13:11:28.742468 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:28.746569 23593 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:28.748404 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:28.731314 31365 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:28.750926 23669 leader_election.cc:336] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.751993 23669 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:28.735040 31314 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:28.761127 23778 raft_consensus.cc:1240] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:28.764228 23669 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.764834 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:28.768965 30698 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:11:28.769361 23669 leader_election.cc:336] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.770190 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:28.752266 31169 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:28.751667 31474 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.751384 31116 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:28.771087 31463 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:28.797857 24359 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:28.798269 31474 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:28.801767 31474 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:28.782276 31291 consensus_queue.cc:1059] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:11:28.766172 31315 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:28.811053 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:28.813038 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:28.799348 24359 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:28.820031 22480 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 23654)
I20260709 13:11:28.751356 31387 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:11:28.768276 31461 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.773308 31365 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:28.828245 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:28.835228 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb27ed2f4a5b46d5a40126f9893f0c3c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:28.841645 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:28.842082 23699 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:11:28.842555 31437 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:28.843148 31437 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:28.850039 31411 raft_consensus.cc:3055] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:28.850545 31411 raft_consensus.cc:740] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:28.855224 31411 consensus_queue.cc:260] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:28.856851 31411 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:28.865528 23595 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.866905 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 48192.9us
I20260709 13:11:28.932781 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:28.844113 31437 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:28.932691 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 98050.8us
I20260709 13:11:28.912381 31462 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:28.945683 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 170816us
I20260709 13:11:28.895449 31457 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:28.943427 31314 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:28.943444 31451 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:28.973266 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:28.974155 23775 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:28.975555 31169 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.977705 31314 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:28.981559 31300 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:28.968564 31457 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:28.994647 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet da6c8d6f775147c1807ebd5917f806a8: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:28.994709 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:28.995421 23774 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:28.996420 31283 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:11:29.016458 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet 737154dff44a498f96f906fc83416830: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:29.017032 23774 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 25.
I20260709 13:11:29.020365 23775 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
W20260709 13:11:29.021190 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 68040.4us
I20260709 13:11:29.021579 23592 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:11:29.024418 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 81541.4us
I20260709 13:11:29.004911 31300 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:29.027297 23592 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: 
W20260709 13:11:29.024225 23743 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:29.033814 31485 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:29.035883 31485 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 25 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:29.036067 31116 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:29.036808 31116 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:29.036893 31485 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:29.037806 31116 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:29.041404 23743 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.043965 31436 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:11:29.053980 23743 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:29.057817 24385 raft_consensus.cc:1240] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Rejecting Update request from peer 9ab488f10c434878a749f261e99a8065 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:29.061877 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.064754 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:29.065451 23743 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:29.074977 23593 leader_election.cc:304] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.058192 31361 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:29.067762 23743 leader_election.cc:336] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:29.078125 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:29.079552 23743 leader_election.cc:336] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:29.080552 23743 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.079977 23701 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
W20260709 13:11:29.088858 23743 leader_election.cc:336] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:29.090209 23743 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.098481 23702 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:11:29.066341 31436 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:29.077236 31457 raft_consensus.cc:2749] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:29.077507 31300 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.103178 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:29.103454 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:29.104375 23702 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:29.106154 23593 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.083282 31453 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:29.113365 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:29.091881 31437 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:29.096791 31469 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:29.116134 23775 raft_consensus.cc:2393] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 25: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:29.089198 31314 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:29.087631 31310 consensus_queue.cc:1059] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.030s
I20260709 13:11:29.088651 31361 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.130117 23702 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 25.
I20260709 13:11:29.136454 31361 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:29.131114 31380 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:29.160640 31494 log.cc:927] Time spent T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:29.173144 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:29.113629 31300 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.210028 31380 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:29.210598 31380 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.212839 31380 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:29.224718 31491 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.144s	user 0.002s	sys 0.000s
I20260709 13:11:29.228330 23774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:29.252738 23669 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:29.242781 31361 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:11:29.259625 31300 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:29.261296 31310 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.264726 31310 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.267081 31310 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:29.274712 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:29.276978 30698 raft_consensus.cc:3055] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:29.277395 30698 raft_consensus.cc:740] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:29.278148 30698 consensus_queue.cc:260] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.279322 30698 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:29.281363 31237 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:29.285185 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:29.286226 31458 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:29.286805 31458 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.288096 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.288296 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.289465 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:29.289490 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.297369 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.301599 31458 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:29.313195 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet ce71536613184c6d869077ae232876cc: Illegal state: Replica 4466bf6d6cf84ee89e84ea074e3964c9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.313340 23593 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:29.314184 31478 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:29.316190 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.317006 31283 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.324739 23593 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:29.326350 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:29.328510 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.337411 31283 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:29.338383 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet a0d6af36909c4398a1ec8496f1dde507: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:29.342331 23743 consensus_peers.cc:597] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:29.346748 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:29.367564 31283 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:29.355399 31237 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:29.375178 23592 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:29.377679 31411 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.389353 31283 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:29.390089 31283 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:29.392654 31283 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:29.406719 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:29.416244 24359 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:29.434422 31477 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.435577 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab3e50aa3864da9beb30247f660a030" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:29.435880 31477 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:29.443977 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:29.444645 23700 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 21.
I20260709 13:11:29.447844 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:29.445853 23592 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:29.454789 23518 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 222) took 45549 ms (client timeout 15000 ms). Trace:
W20260709 13:11:29.472529 23518 rpcz_store.cc:269] 0709 13:10:43.905009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.905659 (+   650us) service_pool.cc:224] Handling call
0709 13:10:44.370780 (+465121us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000b90d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41276090 00007f2b41314f3a 00007f2b470cb1cc 00007f2b471c937e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc 00007f2b45689392 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:29.454658 (+45083878us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":402,"reported_tablets":51,"spinlock_wait_cycles":324689792}
W20260709 13:11:29.474442 24359 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:29.475903 31283 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:29.476650 31283 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:29.477023 31283 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.477084 23703 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:29.477421 31283 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:29.485350 30698 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.486208 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:29.485329 23703 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:29.486042 30698 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.488880 30698 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:29.490442 24359 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:29.491712 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.494792 30698 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:29.456921 31477 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:29.499027 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:29.502429 23592 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:29.505762 30698 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:29.512676 31310 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.513285 31310 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.518031 31310 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:29.518939 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.524065 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:29.525454 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.528488 30698 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:29.538918 23743 consensus_peers.cc:597] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:29.542876 23777 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:29.544718 31477 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:29.546701 31477 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:29.547258 31477 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.548646 31283 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:29.550736 31283 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:29.550143 31477 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:29.551621 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.552290 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:29.552870 23703 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:29.555176 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:29.557807 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:29.560927 23703 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 22.
I20260709 13:11:29.561856 23700 raft_consensus.cc:1240] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Rejecting Update request from peer 4466bf6d6cf84ee89e84ea074e3964c9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:29.562175 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:29.563014 31477 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:29.565974 31138 consensus_queue.cc:1059] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:29.567034 31437 raft_consensus.cc:3055] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:29.567404 31437 raft_consensus.cc:740] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:29.568404 31437 consensus_queue.cc:260] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:29.569784 31437 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:29.571650 23593 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9
I20260709 13:11:29.573158 31477 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:29.573673 31477 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:29.574427 31477 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:29.607272 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d67625249f734ae3b71d554b7a2ba33b: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:11:29.612804 23778 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:11:29.619808 23703 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:11:29.616096 31283 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:11:29.630954 31411 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:11:29.637239 31478 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.637890 31478 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:29.643947 31478 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:29.645917 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:29.648629 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:29.652964 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.653729 31283 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:29.699496 23521 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 220) took 93624 ms (client timeout 15000 ms). Trace:
W20260709 13:11:29.712132 23743 consensus_peers.cc:597] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:29.715160 31485 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:29.710556 23521 rpcz_store.cc:269] 0709 13:09:56.075774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.076116 (+   342us) service_pool.cc:224] Handling call
0709 13:11:29.699399 (+93623283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85959,"reported_tablets":51}
I20260709 13:11:29.721094 31485 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:29.727973 31485 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:29.729028 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:29.731273 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:29.733070 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.734766 31477 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:29.736089 24359 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:29.758761 31485 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.759393 31485 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.762790 31485 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:29.764681 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.766099 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:29.767985 23743 consensus_peers.cc:597] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:29.768945 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.770457 31485 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:29.787529 23518 catalog_manager.cc:5697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 14 to 21, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 21 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.789788 23518 catalog_manager.cc:5697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 16 to 18, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 18 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
W20260709 13:11:29.797158 24359 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:29.798237 23518 catalog_manager.cc:5697] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 17, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 17 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:11:29.821275 22480 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 23654)
I20260709 13:11:29.801204 23518 catalog_manager.cc:5697] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 20 to 25, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 25 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.825719 31485 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:29.826536 31485 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.829854 31485 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:29.831566 23518 catalog_manager.cc:5697] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 16 to 17, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 17 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.832190 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.833264 23518 catalog_manager.cc:5697] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 18 to 20, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 20 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } }
W20260709 13:11:29.836203 23520 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 123) took 71868 ms (client timeout 15000 ms). Trace:
W20260709 13:11:29.836730 23520 rpcz_store.cc:269] 0709 13:10:17.970968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.971455 (+   487us) service_pool.cc:224] Handling call
0709 13:10:18.424951 (+453496us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b54000b90d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41276090 00007f2b41314f3a 00007f2b470cb1cc 00007f2b471c937e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc 00007f2b45689392 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:29.836108 (+71411157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":291393,"reported_tablets":27,"spinlock_wait_cycles":14637824}
I20260709 13:11:29.834939 23518 catalog_manager.cc:5697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.838812 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:29.840521 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.840907 31283 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.841382 31283 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.841922 31477 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:29.844046 24359 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:29.845511 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:29.849491 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:29.850672 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67625249f734ae3b71d554b7a2ba33b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.856895 23593 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.858351 31310 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:29.858449 31455 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:29.859122 31455 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:29.861595 31455 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:29.847447 31283 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:29.863910 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:29.866370 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:29.871800 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:29.874367 31485 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:29.857348 23518 catalog_manager.cc:5697] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 20 to 22, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 22 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.879344 23518 catalog_manager.cc:5697] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 18 to 19, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 19 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.881029 23518 catalog_manager.cc:5697] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.882470 23518 catalog_manager.cc:5697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 14 to 17, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 17 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.953760 23518 catalog_manager.cc:5697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.957922 23518 catalog_manager.cc:5697] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.960081 23518 catalog_manager.cc:5697] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 19 to 20, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 20 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.962432 23518 catalog_manager.cc:5697] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 22 to 23, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 23 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.966529 23518 catalog_manager.cc:5697] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.968880 23518 catalog_manager.cc:5697] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 23 to 24, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 24 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.971980 23518 catalog_manager.cc:5697] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.974560 23518 catalog_manager.cc:5697] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 16 to 21, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 21 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.977025 23518 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 18 to 21, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 21 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.979070 23518 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 24 to 25, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 25 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:29.981612 23518 catalog_manager.cc:5697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 16 to 19, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 19 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.984475 23518 catalog_manager.cc:5697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 14 to 16, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 16 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:29.986613 23518 catalog_manager.cc:5697] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:29.988584 23518 catalog_manager.cc:5697] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.990947 23518 catalog_manager.cc:5697] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:30.020116 31478 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:30.021288 31478 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:30.037258 24359 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 208 similar messages]
W20260709 13:11:30.044318 23743 consensus_peers.cc:597] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:30.045954 31485 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.046902 31485 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:30.047099 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:30.072507 24359 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:30.101939 31478 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:30.129012 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:30.129004 31485 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:30.130661 23700 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:30.142648 31485 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.143571 31485 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:30.145799 24359 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:30.146420 31485 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:30.158852 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:30.162076 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa103a3f5c4452b91dd335e0c94373" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:30.169068 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55528b161184b85a266eb8c58844016" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:30.166496 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:30.171711 31478 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:30.172394 23777 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 16.
I20260709 13:11:30.171145 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:30.173451 31478 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:30.177757 31478 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:30.188378 31478 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:30.188862 31478 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.189368 31478 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:30.194204 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:30.206498 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:30.207248 23776 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:11:30.207818 23776 pending_rounds.cc:85] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting all ops after (but not including) 14
I20260709 13:11:30.208115 23776 pending_rounds.cc:107] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:11:30.208503 23776 raft_consensus.cc:2889] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:30.217368 23696 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:30.214993 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:30.225375 31485 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.003s
W20260709 13:11:30.242820 24359 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:30.244053 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:30.245133 31485 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:30.280525 31478 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:30.294219 31478 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:30.295969 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:30.297147 23703 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:30.330399 23592 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:30.331599 23743 consensus_peers.cc:597] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:30.332058 31485 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:30.332803 23592 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:30.333667 31485 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:30.333822 23703 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:30.335209 23593 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:30.342540 31361 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:30.343389 31455 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:11:30.348297 31361 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:30.350029 31361 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:30.355455 30698 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.356246 30698 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:30.362368 23669 consensus_peers.cc:597] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:30.365676 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:30.366057 30698 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:30.372575 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:30.372979 30698 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:30.373202 23777 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:30.373662 30698 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:30.375936 30698 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:30.376406 30698 raft_consensus.cc:493] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.377403 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:30.379863 30698 raft_consensus.cc:515] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:30.381426 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:30.382719 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:30.384832 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:30.383647 30698 leader_election.cc:290] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:30.388144 30698 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:30.423708 23777 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 17.
I20260709 13:11:30.426769 31515 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:30.427613 31515 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:30.431921 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:30.432930 24391 raft_consensus.cc:2393] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 24: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:30.433851 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:30.434399 31515 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:30.434643 23778 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 25.
I20260709 13:11:30.444247 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1000e2c5e53d429ba2126c263f2e8a6d" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:30.452925 23669 consensus_peers.cc:597] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:30.461738 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:30.463961 31310 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:30.464426 31310 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.464783 31310 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:30.464187 23592 leader_election.cc:304] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:30.466662 30698 raft_consensus.cc:2749] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:30.474699 31310 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:30.479163 31411 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:30.488340 31411 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:30.490731 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:30.490869 31411 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:30.491519 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:30.489954 31310 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 26 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:30.508383 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:30.509177 23777 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:30.516465 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:30.520438 23669 consensus_peers.cc:597] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:30.526552 23777 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 26.
I20260709 13:11:30.539697 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:30.540781 31411 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:30.542093 31411 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.542816 31411 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:30.545804 23592 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:30.550927 31485 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:30.551544 31485 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 26 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:30.552662 31485 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:30.564070 23669 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:30.564119 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:30.565335 23669 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:30.565706 23700 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 23.
I20260709 13:11:30.564493 30698 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:30.566618 23669 consensus_peers.cc:597] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:30.566733 30698 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:30.567420 31514 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:30.569672 23669 consensus_peers.cc:597] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:30.570281 23669 consensus_peers.cc:597] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:30.576094 23669 consensus_peers.cc:597] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:30.578593 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:30.580072 31455 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:30.580488 31455 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.580822 31455 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:30.585566 30698 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:30.588816 31411 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:30.589404 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:30.590090 24391 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 24.
I20260709 13:11:30.599524 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:30.605129 31455 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:30.606564 31514 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:30.614593 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fcdc335ab6748159bae3d8308e238ae" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:30.617609 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:30.618260 24391 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:30.624742 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:30.625447 23703 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:30.618208 31455 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:30.628931 23669 consensus_peers.cc:597] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:30.629746 23592 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:30.633395 24391 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 25.
I20260709 13:11:30.636051 31528 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:30.637185 23593 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:30.638846 31485 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:30.639350 31485 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 25 LEADER]: Becoming Leader. State: Replica: 9ab488f10c434878a749f261e99a8065, State: Running, Role: LEADER
I20260709 13:11:30.640415 31485 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:30.651363 23703 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab488f10c434878a749f261e99a8065 in term 25.
W20260709 13:11:30.704833 23669 consensus_peers.cc:597] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:30.710803 23669 consensus_peers.cc:597] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:30.728528 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 54819.3us
W20260709 13:11:30.741858 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d67625249f734ae3b71d554b7a2ba33b: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:11:30.749396 23777 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:30.755492 31485 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:30.777226 23518 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52072 (request call id 186) took 1467 ms. Trace:
W20260709 13:11:30.802225 23669 consensus_peers.cc:597] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:30.828883 22480 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 23654)
I20260709 13:11:30.777844 23518 rpcz_store.cc:276] 0709 13:11:29.309350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.500206 (+190856us) service_pool.cc:224] Handling call
0709 13:11:30.777083 (+1276877us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:30.190657 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:30.191398 (+   741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:30.191462 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:11:30.191499 (+    37us) tablet.cc:662] Decoding operations
0709 13:11:30.216370 (+ 24871us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:30.216508 (+   138us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:30.216539 (+    31us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:11:30.221545 (+  5006us) tablet.cc:701] Row locks acquired
0709 13:11:30.221607 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:11:30.221815 (+   208us) write_op.cc:270] Start()
0709 13:11:30.222009 (+   194us) write_op.cc:276] Timestamp: P: 1783602690221743 usec, L: 0
0709 13:11:30.222054 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:11:30.247600 (+ 25546us) log.cc:844] Serialized 10135 byte log entry
0709 13:11:30.455014 (+207414us) op_driver.cc:464] REPLICATION: finished
0709 13:11:30.484709 (+ 29695us) write_op.cc:301] APPLY: starting
0709 13:11:30.484816 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:30.542637 (+ 57821us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:30.542816 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:30.651140 (+108324us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:30.651581 (+   441us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 13:11:30.651647 (+    66us) write_op.cc:312] APPLY: finished
0709 13:11:30.652254 (+   607us) log.cc:844] Serialized 228 byte log entry
0709 13:11:30.655975 (+  3721us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:30.656187 (+   212us) write_op.cc:454] Released schema lock
0709 13:11:30.656266 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:30.694128 (+ 37862us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:30.694170 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13906,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":29267,"apply.run_cpu_time_us":39252,"apply.run_wall_time_us":209248,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112963,"num_ops":26,"prepare.queue_time_us":5782,"prepare.run_cpu_time_us":22863,"prepare.run_wall_time_us":146882,"raft.queue_time_us":73909,"raft.run_cpu_time_us":6624,"raft.run_wall_time_us":45174,"replication_time_us":232752,"spinlock_wait_cycles":282752,"thread_start_us":135997,"threads_started":4,"wal-append.queue_time_us":92806}]]}
I20260709 13:11:30.894718 23701 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:30.898501 31528 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:11:30.920897 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet 4a97c483343c425ea75f1f6632924819: Illegal state: Replica c885217113574e7489e6c3afb6950f76 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:30.924165 31528 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.924917 31528 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:30.927419 31528 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:30.927533 23703 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:11:30.928669 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:30.932823 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a8de42d0d8417f9ad5486f22fdbf73" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:30.936082 23592 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:30.938400 31485 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:30.953148 23522 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 221) took 70144 ms (client timeout 15000 ms). Trace:
W20260709 13:11:30.955901 23522 rpcz_store.cc:269] 0709 13:10:20.808558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.832903 (+ 24345us) service_pool.cc:224] Handling call
0709 13:10:21.687016 (+854113us) spinlock_profiling.cc:243] Waited 9.87 ms on lock 0x7b5400002210. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e7b71 00007f2b3e1e80b2 00007f2b47161a89 00007f2b470f9da6 00007f2b470cb088 00007f2b471c937e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc
0709 13:10:22.724744 (+1037728us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54000b90d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41276090 00007f2b41314f3a 00007f2b470cb1cc 00007f2b471c937e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc 00007f2b45689392 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:30.952898 (+68228154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":565059,"reported_tablets":51,"spinlock_wait_cycles":542119296}
I20260709 13:11:30.956085 23518 catalog_manager.cc:5697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 18 to 25, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 25 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:30.965197 23776 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:11:30.969765 23668 consensus_peers.cc:597] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f80c880e2784395811b9b9ab65aaf82. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.973817 31169 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:30.981585 23518 catalog_manager.cc:5697] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
W20260709 13:11:30.989692 23669 consensus_peers.cc:597] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.992977 23518 catalog_manager.cc:5697] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 21 to 22, leader changed from 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 22 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:31.000412 23777 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:11:31.007480 31455 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:31.016842 23518 catalog_manager.cc:5697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:31.017899 31514 raft_consensus.cc:2955] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:11:31.028146 23776 raft_consensus.cc:2955] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
W20260709 13:11:31.036712 24359 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:31.049098 23703 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:31.060428 23525 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 219) took 114469 ms (client timeout 15000 ms). Trace:
I20260709 13:11:31.063253 31485 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:31.064033 23525 rpcz_store.cc:269] 0709 13:09:36.590481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.590678 (+   197us) service_pool.cc:224] Handling call
0709 13:11:31.060218 (+114469540us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24795,"reported_tablets":51,"spinlock_wait_cycles":1792}
I20260709 13:11:31.066901 31485 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:31.070428 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:31.072386 23703 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:11:31.070732 31485 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:31.074257 31485 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:31.076117 31310 raft_consensus.cc:493] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:31.076746 31310 raft_consensus.cc:515] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:31.078419 31310 leader_election.cc:290] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:31.079301 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet aff661e739d84f06b43002ae9d8ae607: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:31.079411 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:31.080969 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:31.083253 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet 819369bff57548ee8188f19ea4e8f622: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:31.084378 23592 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:31.084830 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de67ca6156e842db9c8994e493d241ca" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:31.086397 31528 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:31.087666 23592 leader_election.cc:304] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:31.089425 31528 raft_consensus.cc:2749] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:31.112560 31310 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:31.113197 31310 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:31.121155 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:31.120213 31310 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:31.138046 23701 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:11:31.125101 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:31.140419 31411 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:11:31.141814 23592 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:31.155678 31411 raft_consensus.cc:493] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:31.156358 31411 raft_consensus.cc:515] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:31.155491 31528 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:31.158509 31411 leader_election.cc:290] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:31.160881 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:31.163378 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b7b7e4ddb143138d48247cb9feb2d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:31.165505 23592 leader_election.cc:304] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:31.166330 31528 raft_consensus.cc:2749] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:31.170495 24385 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Refusing update from remote peer 9ab488f10c434878a749f261e99a8065: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:11:31.226534 31528 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 13:11:31.443903 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 58657.5us
W20260709 13:11:31.484709 23593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 128640us
I20260709 13:11:31.485044 23518 catalog_manager.cc:5697] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 19 to 26, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 26 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } }
I20260709 13:11:31.486305 23518 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 14, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 22 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:11:31.491283 23524 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 19 to 20, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 20 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:31.508423 23592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 157732us
I20260709 13:11:31.516346 31455 raft_consensus.cc:493] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.516984 31455 raft_consensus.cc:515] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:31.519165 31455 leader_election.cc:290] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:31.528502 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:31.530877 31528 raft_consensus.cc:493] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.531560 31528 raft_consensus.cc:515] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:31.533828 31528 leader_election.cc:290] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:31.555120 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ba611dbb174024a86916a09b17660c" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:31.558195 23524 catalog_manager.cc:5697] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 14 to 15, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 15 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:31.568374 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:31.572022 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7656d11fa2f4f27beac8e46f9f20be9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:31.583039 31553 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.588634 31553 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:31.590890 31553 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:31.595978 31550 raft_consensus.cc:493] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:31.596408 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:31.596627 31550 raft_consensus.cc:515] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:31.601864 31550 leader_election.cc:290] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:31.602362 23593 leader_election.cc:304] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:31.605322 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80466d92afe9453b9cd96ab9f7f593dc" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:31.611128 31455 raft_consensus.cc:2749] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:31.618443 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:31.620414 23593 leader_election.cc:304] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:31.627780 31455 raft_consensus.cc:2749] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:31.628821 23526 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 20 to 23, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to 9ab488f10c434878a749f261e99a8065 (127.21.244.1). New cstate: current_term: 23 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:31.630673 23526 catalog_manager.cc:5697] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 16 to 20, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 20 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.631827 23593 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:31.640633 23686 tablet_service.cc:1558] Processing DeleteTablet for tablet d5fa82982f53411c84a07a2fb3918888 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:57370
I20260709 13:11:31.655557 31528 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:31.657903 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f8fde8107545d5a59c6b12b0822584" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:31.660758 23743 consensus_peers.cc:597] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:31.661453 23593 leader_election.cc:304] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:31.663184 31455 raft_consensus.cc:2749] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:31.670018 23523 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52058 (request call id 191) took 76084 ms (client timeout 15000 ms). Trace:
W20260709 13:11:31.670477 24359 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:31.644483 23524 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 126) took 21949 ms (client timeout 15000 ms). Trace:
I20260709 13:11:31.684792 31554 ts_tablet_manager.cc:933] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:31.687294 23512 catalog_manager.cc:5028] TS c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): tablet d5fa82982f53411c84a07a2fb3918888 (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
W20260709 13:11:31.681017 23524 rpcz_store.cc:269] 0709 13:11:09.695770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.286071 (+590301us) service_pool.cc:224] Handling call
0709 13:11:10.813956 (+527885us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b5400002210. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b3e0a7db1 00007f2b3e1e8640 00007f2b470bfb76 00007f2b471c9c3e 00007f2b4568a2a4 00007f2b4568a232 00007f2b4568a161 00007f2b4568a0dc 00007f2b45689392 00007f2b3f64748c 00007f2b3f6468c6
0709 13:11:31.644369 (+20830413us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:31.572796 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:31.573396 (+   600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:31.573442 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:11:31.573464 (+    22us) tablet.cc:662] Decoding operations
0709 13:11:31.573897 (+   433us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:31.573968 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:31.573998 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:31.574357 (+   359us) tablet.cc:701] Row locks acquired
0709 13:11:31.574379 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:11:31.574525 (+   146us) write_op.cc:270] Start()
0709 13:11:31.574646 (+   121us) write_op.cc:276] Timestamp: P: 1783602691574475 usec, L: 0
0709 13:11:31.574670 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:11:31.575336 (+   666us) log.cc:844] Serialized 913 byte log entry
0709 13:11:31.577877 (+  2541us) op_driver.cc:464] REPLICATION: finished
0709 13:11:31.578349 (+   472us) write_op.cc:301] APPLY: starting
0709 13:11:31.578460 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:31.579863 (+  1403us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:31.579963 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:31.581380 (+  1417us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:31.581559 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:11:31.581610 (+    51us) write_op.cc:312] APPLY: finished
0709 13:11:31.581829 (+   219us) log.cc:844] Serialized 33 byte log entry
0709 13:11:31.582006 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:31.582099 (+    93us) write_op.cc:454] Released schema lock
0709 13:11:31.582140 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:31.582505 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:31.582535 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":78105,"reported_tablets":24,"spinlock_wait_cycles":58398976,"child_traces":[["op",{"apply.queue_time_us":243,"apply.run_cpu_time_us":4032,"apply.run_wall_time_us":4113,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8372,"num_ops":2,"prepare.queue_time_us":8519,"prepare.run_cpu_time_us":2811,"prepare.run_wall_time_us":2830,"replication_time_us":3094}]]}
W20260709 13:11:31.670579 23523 rpcz_store.cc:269] 0709 13:10:15.585617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.586243 (+   626us) service_pool.cc:224] Handling call
0709 13:11:31.669742 (+76083499us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1697821,"reported_tablets":51}
I20260709 13:11:31.691344 23526 catalog_manager.cc:5697] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 16 to 21, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 21 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:31.716158 31554 tablet_copy_client.cc:323] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.2:44167
I20260709 13:11:31.720849 23714 tablet_copy_service.cc:140] P c885217113574e7489e6c3afb6950f76: Received BeginTabletCopySession request for tablet 8f80c880e2784395811b9b9ab65aaf82 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:54670)
I20260709 13:11:31.721494 23714 tablet_copy_service.cc:161] P c885217113574e7489e6c3afb6950f76: Beginning new tablet copy session on tablet 8f80c880e2784395811b9b9ab65aaf82 from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:54670: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-8f80c880e2784395811b9b9ab65aaf82
I20260709 13:11:31.725636 23526 catalog_manager.cc:5697] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 15 to 17, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 17 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.739919 23526 catalog_manager.cc:5697] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 13 to 14, leader changed from b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 14 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:31.741511 23714 tablet_copy_source_session.cc:215] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:31.752043 31554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f80c880e2784395811b9b9ab65aaf82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.787176 31554 tablet_copy_client.cc:806] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
W20260709 13:11:31.829408 22480 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 23654)
I20260709 13:11:31.836040 31455 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.838441 31554 tablet_copy_client.cc:670] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:31.838527 31455 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:31.841683 31550 raft_consensus.cc:493] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:31.842144 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:31.842383 31455 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:31.842293 31550 raft_consensus.cc:515] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:31.845821 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fa82982f53411c84a07a2fb3918888" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:31.846027 31550 leader_election.cc:290] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:31.846580 31550 raft_consensus.cc:493] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:31.847088 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:31.847675 24359 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:31.849625 23593 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:31.850808 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:31.852838 31528 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:31.854246 23593 leader_election.cc:304] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:31.857142 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334c9018414947cabb4405ef47b8018e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:31.858477 31528 raft_consensus.cc:2749] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:31.862314 23526 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34376 (request call id 127) took 6292 ms. Trace:
I20260709 13:11:31.862725 23526 rpcz_store.cc:276] 0709 13:11:25.569916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.890362 (+2320446us) service_pool.cc:224] Handling call
0709 13:11:31.862239 (+3971877us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:31.771040 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:31.771612 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:31.771648 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:11:31.771667 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:31.772405 (+   738us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:31.772463 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:31.772493 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:11:31.773069 (+   576us) tablet.cc:701] Row locks acquired
0709 13:11:31.773088 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:31.773226 (+   138us) write_op.cc:270] Start()
0709 13:11:31.773337 (+   111us) write_op.cc:276] Timestamp: P: 1783602691773184 usec, L: 0
0709 13:11:31.773361 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:11:31.774018 (+   657us) log.cc:844] Serialized 2054 byte log entry
0709 13:11:31.777040 (+  3022us) op_driver.cc:464] REPLICATION: finished
0709 13:11:31.778853 (+  1813us) write_op.cc:301] APPLY: starting
0709 13:11:31.778954 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:31.782103 (+  3149us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:31.782210 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:31.785854 (+  3644us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:31.786086 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:11:31.786142 (+    56us) write_op.cc:312] APPLY: finished
0709 13:11:31.786443 (+   301us) log.cc:844] Serialized 57 byte log entry
0709 13:11:31.787299 (+   856us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:31.787413 (+   114us) write_op.cc:454] Released schema lock
0709 13:11:31.787465 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:31.787876 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:31.787909 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6817,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":1588,"apply.run_cpu_time_us":8072,"apply.run_wall_time_us":8969,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20930,"num_ops":5,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":3292,"prepare.run_wall_time_us":12851,"replication_time_us":3527}]]}
I20260709 13:11:31.847101 31550 raft_consensus.cc:515] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:31.953207 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:31.946743 31554 tablet_copy_client.cc:538] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:31.966661 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa38658745b04f268c400fe20554d483" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:31.967866 31550 leader_election.cc:290] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:31.973452 23593 leader_election.cc:304] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:32.064271 31553 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.065147 31553 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:32.072139 31549 raft_consensus.cc:493] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:32.073125 31553 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:32.072908 31549 raft_consensus.cc:515] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:32.080984 31549 leader_election.cc:290] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:32.082528 31550 raft_consensus.cc:2749] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:32.084945 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:32.086529 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:32.089996 23527 catalog_manager.cc:5697] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 12 to 16, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 16 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.099551 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ec1d400f174350acc92722149e02d4" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:32.124890 31554 tablet_bootstrap.cc:492] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:11:32.124935 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a325d91f6c384021a7930b39886904d2" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:32.140806 31557 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:32.141536 31557 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:32.145028 31557 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:32.150177 23593 leader_election.cc:304] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
W20260709 13:11:32.153900 24359 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:32.157078 31550 raft_consensus.cc:2749] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:32.160528 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:32.165755 23592 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:32.177213 31559 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:32.194857 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:32.222133 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 51196.8us
W20260709 13:11:32.229782 24359 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:32.255842 23592 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:32.282307 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 44638.2us
I20260709 13:11:32.284658 31557 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:32.362607 24359 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:32.392233 23527 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52058 (request call id 194) took 10088 ms. Trace:
W20260709 13:11:32.386324 23743 consensus_peers.cc:597] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:32.409163 23743 consensus_peers.cc:597] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:32.392750 23527 rpcz_store.cc:276] 0709 13:11:22.303621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.241761 (+1938140us) service_pool.cc:224] Handling call
0709 13:11:32.392134 (+8150373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:32.163467 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:32.164088 (+   621us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:32.164128 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:11:32.164146 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:32.164518 (+   372us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:32.164580 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:32.164614 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:32.164815 (+   201us) tablet.cc:701] Row locks acquired
0709 13:11:32.164835 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:11:32.164980 (+   145us) write_op.cc:270] Start()
0709 13:11:32.165114 (+   134us) write_op.cc:276] Timestamp: P: 1783602692164934 usec, L: 0
0709 13:11:32.165135 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:11:32.216154 (+ 51019us) log.cc:844] Serialized 533 byte log entry
0709 13:11:32.219327 (+  3173us) op_driver.cc:464] REPLICATION: finished
0709 13:11:32.219958 (+   631us) write_op.cc:301] APPLY: starting
0709 13:11:32.220474 (+   516us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:32.221555 (+  1081us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:32.221685 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:32.223656 (+  1971us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:32.223832 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:11:32.223875 (+    43us) write_op.cc:312] APPLY: finished
0709 13:11:32.224070 (+   195us) log.cc:844] Serialized 25 byte log entry
0709 13:11:32.224248 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:32.224327 (+    79us) write_op.cc:454] Released schema lock
0709 13:11:32.224376 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:32.239748 (+ 15372us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x7b54000b90d4. stack: 00007f2b3e1ed343 00007f2b3e1ed240 00007f2b3db7c1d4 00007f2b478ba304 00007f2b478ba299 00007f2b41275571 00007f2b41307e28 00007f2b44d42581 00007f2b44d41d58 00007f2b44d469f1 00007f2b44d469a9 00007f2b44d46939 00007f2b44d46901 00007f2b44d45b2d 000000000038f354 000000000038f199
0709 13:11:32.257761 (+ 18013us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:32.257802 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":324,"apply.run_cpu_time_us":3293,"apply.run_wall_time_us":7048,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":25964,"prepare.run_cpu_time_us":10801,"prepare.run_wall_time_us":94259,"replication_time_us":54017,"spinlock_wait_cycles":17411840}]]}
W20260709 13:11:32.433794 24359 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:32.440399 24359 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:32.440248 23526 catalog_manager.cc:5697] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 16 to 19, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4). New cstate: current_term: 19 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.473572 23526 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "9ab488f10c434878a749f261e99a8065" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:32.487788 31559 raft_consensus.cc:493] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:32.488442 31559 raft_consensus.cc:515] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:32.490934 31559 leader_election.cc:290] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:32.502238 23519 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52048 (request call id 224) took 10604 ms. Trace:
I20260709 13:11:32.502689 23519 rpcz_store.cc:276] 0709 13:11:21.898190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.900742 (+  2552us) service_pool.cc:224] Handling call
0709 13:11:32.502031 (+10601289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8532,"reported_tablets":51}
I20260709 13:11:32.504101 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:32.505559 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36da9377816744739720cb01b6191368" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:32.508948 23593 leader_election.cc:304] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:32.510109 31553 raft_consensus.cc:2749] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:32.512758 23743 consensus_peers.cc:597] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:32.521598 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:32.531769 22480 tablet_replica.cc:333] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
W20260709 13:11:32.557260 23669 consensus_peers.cc:597] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:32.562839 31550 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:32.563879 31550 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:32.564568 22480 raft_consensus.cc:2243] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:32.566403 31550 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:32.567503 22480 raft_consensus.cc:2272] T 9e3b7e5b938d488e915e4b83c40e6e1d P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.568359 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:32.572230 31553 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.572944 31553 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:32.574846 22480 tablet_replica.cc:333] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.575312 31553 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:32.576380 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:32.579195 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1999cb30f49b981475a62d0d0feb9" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:32.596438 23593 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:32.606107 31549 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:32.604596 22480 raft_consensus.cc:2243] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:32.609503 22480 raft_consensus.cc:2272] T 01ec1d400f174350acc92722149e02d4 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.612792 22480 tablet_replica.cc:333] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.614168 22480 raft_consensus.cc:2243] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:32.614841 22480 raft_consensus.cc:2272] T 37a8de42d0d8417f9ad5486f22fdbf73 P 9ab488f10c434878a749f261e99a8065 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.615815 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:32.622668 23593 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
W20260709 13:11:32.624816 24359 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:32.625399 31549 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:32.653358 31553 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:32.654047 31553 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:32.662899 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:32.661022 31553 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:32.668148 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2906fc04ac3a43e5a91763bfbd1ff990" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:32.673998 22480 tablet_replica.cc:333] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.675802 22480 raft_consensus.cc:2243] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:32.677102 22480 raft_consensus.cc:2272] T 5499c62f40a046f2a8efb671c77f08b3 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.680406 31554 tablet_bootstrap.cc:492] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.681556 31554 tablet_bootstrap.cc:492] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:11:32.682296 31554 ts_tablet_manager.cc:1403] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.558s	user 0.065s	sys 0.017s
I20260709 13:11:32.701887 31554 raft_consensus.cc:359] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:11:32.702817 31554 raft_consensus.cc:740] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:11:32.709898 22480 tablet_replica.cc:333] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.711042 23593 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:32.712949 31550 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:32.703504 31554 consensus_queue.cc:260] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:11:32.728289 31554 ts_tablet_manager.cc:1434] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:11:32.711293 22480 raft_consensus.cc:2243] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:32.757941 22480 raft_consensus.cc:2272] T de67ca6156e842db9c8994e493d241ca P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.760995 22480 tablet_replica.cc:333] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.761940 22480 raft_consensus.cc:2243] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:32.773701 23714 tablet_copy_service.cc:342] P c885217113574e7489e6c3afb6950f76: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-8f80c880e2784395811b9b9ab65aaf82 received from {username='slave'} at 127.0.0.1:54670
I20260709 13:11:32.774268 23714 tablet_copy_service.cc:434] P c885217113574e7489e6c3afb6950f76: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-8f80c880e2784395811b9b9ab65aaf82 on tablet 8f80c880e2784395811b9b9ab65aaf82 with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:32.777221 24359 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:32.785638 23743 consensus_peers.cc:597] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:32.762847 22480 raft_consensus.cc:2272] T 55436fc3614f4f558828ea5de361e5f0 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.792876 22480 tablet_replica.cc:333] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.793840 22480 raft_consensus.cc:2243] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:11:32.795047 22480 raft_consensus.cc:2272] T 0c9e0e43fe5147ef802644460230dc6f P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.801035 22480 tablet_replica.cc:333] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.804490 22480 raft_consensus.cc:2243] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:32.805253 22480 raft_consensus.cc:2272] T 8f80c880e2784395811b9b9ab65aaf82 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.808230 22480 tablet_replica.cc:333] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.812547 22480 raft_consensus.cc:2243] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:32.818210 22480 raft_consensus.cc:2272] T 0ab3e50aa3864da9beb30247f660a030 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.821776 22480 tablet_replica.cc:333] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.825949 22480 raft_consensus.cc:2243] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:32.827217 22480 raft_consensus.cc:2272] T f0854ca8274d49df9583c253583ec3d7 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.837582 22480 tablet_replica.cc:333] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.838752 22480 raft_consensus.cc:2243] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:32.847971 22480 raft_consensus.cc:2272] T 8126e5c9a36b4a6e859566d2a92590e6 P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.851392 22480 tablet_replica.cc:333] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.852546 22480 raft_consensus.cc:2243] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:32.853479 22480 raft_consensus.cc:2272] T 3eff2185a07540f08c005b02304d15ad P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.856423 22480 tablet_replica.cc:333] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.863538 22480 raft_consensus.cc:2243] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:32.871033 22480 raft_consensus.cc:2272] T 80466d92afe9453b9cd96ab9f7f593dc P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:32.873862 23669 consensus_peers.cc:597] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:32.877734 23513 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 48450.1us
I20260709 13:11:32.878170 22480 tablet_replica.cc:333] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
W20260709 13:11:32.882545 23669 consensus_peers.cc:597] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:32.883808 22480 raft_consensus.cc:2243] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:32.886240 22480 raft_consensus.cc:2272] T 36da9377816744739720cb01b6191368 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.889577 22480 tablet_replica.cc:333] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.893291 22480 raft_consensus.cc:2243] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:32.906931 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d67625249f734ae3b71d554b7a2ba33b: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:11:32.915899 22480 raft_consensus.cc:2272] T f7ba611dbb174024a86916a09b17660c P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.921254 22480 tablet_replica.cc:333] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.922158 22480 raft_consensus.cc:2243] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:32.922669 22480 raft_consensus.cc:2272] T e8c18a99e9414e39bff9dea9564bd61b P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.925909 22480 tablet_replica.cc:333] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.926776 22480 raft_consensus.cc:2243] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:32.927461 22480 raft_consensus.cc:2272] T d67625249f734ae3b71d554b7a2ba33b P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.930531 22480 tablet_replica.cc:333] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.931457 22480 raft_consensus.cc:2243] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:32.932121 22480 raft_consensus.cc:2272] T 1000e2c5e53d429ba2126c263f2e8a6d P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.934976 22480 tablet_replica.cc:333] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.935851 22480 raft_consensus.cc:2243] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:32.936995 22480 raft_consensus.cc:2272] T e65f1370869c4d4eb4d8f7be8a50f45f P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.942166 22480 tablet_replica.cc:333] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.943128 22480 raft_consensus.cc:2243] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:11:32.944386 22480 raft_consensus.cc:2272] T 38286c47d38c4f9084acbb510661dcfa P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.947362 22480 tablet_replica.cc:333] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.948547 22480 raft_consensus.cc:2243] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:32.949935 22480 raft_consensus.cc:2272] T 2033291a683e4f2b8c99fb6fa6d479f8 P 9ab488f10c434878a749f261e99a8065 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.953097 22480 tablet_replica.cc:333] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.953888 22480 raft_consensus.cc:2243] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:32.955370 22480 raft_consensus.cc:2272] T f5cd55b231da4c27b7547a2714bb43d9 P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:32.968745 22480 tablet_replica.cc:333] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:32.970283 22480 raft_consensus.cc:2243] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:32.984148 23669 consensus_peers.cc:597] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:32.996030 22480 raft_consensus.cc:2272] T eb27ed2f4a5b46d5a40126f9893f0c3c P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.002624 22480 tablet_replica.cc:333] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.004704 22480 raft_consensus.cc:2243] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.005417 22480 raft_consensus.cc:2272] T 0fcdc335ab6748159bae3d8308e238ae P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.024382 22480 tablet_replica.cc:333] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.026255 22480 raft_consensus.cc:2243] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.031549 22480 raft_consensus.cc:2272] T 2906fc04ac3a43e5a91763bfbd1ff990 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.044785 23669 consensus_peers.cc:597] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:33.034854 22480 tablet_replica.cc:333] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.064970 22480 raft_consensus.cc:2243] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.066254 22480 raft_consensus.cc:2272] T d5fa82982f53411c84a07a2fb3918888 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.069998 22480 tablet_replica.cc:333] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.073791 22480 raft_consensus.cc:2243] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.080152 22480 raft_consensus.cc:2272] T 6baa103a3f5c4452b91dd335e0c94373 P 9ab488f10c434878a749f261e99a8065 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.093045 22480 tablet_replica.cc:333] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.094213 22480 raft_consensus.cc:2243] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.094808 22480 raft_consensus.cc:2272] T a325d91f6c384021a7930b39886904d2 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.101526 24391 raft_consensus.cc:1217] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 LEARNER]: Deduplicated request from leader. Original: 22.13->[22.14-22.14]   Dedup: 22.14->[]
I20260709 13:11:33.108340 31528 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.108999 31528 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:33.111222 31528 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:33.113361 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:33.113423 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17c243311054979a1c285f2ef18d20e" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:33.118332 23593 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76
I20260709 13:11:33.119977 31528 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:33.124397 22480 tablet_replica.cc:333] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.135955 22480 raft_consensus.cc:2243] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.136695 22480 raft_consensus.cc:2272] T b55528b161184b85a266eb8c58844016 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.164053 23669 consensus_peers.cc:597] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:33.164747 23669 consensus_peers.cc:597] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:33.177587 23669 consensus_peers.cc:597] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:33.168121 22480 tablet_replica.cc:333] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.179661 31549 raft_consensus.cc:493] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b1e32a12daf44ebbbd71cc3ce41d7d8e)
I20260709 13:11:33.180646 22480 raft_consensus.cc:2243] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.180327 31549 raft_consensus.cc:515] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:33.189148 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:33.191488 31549 leader_election.cc:290] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:33.193030 22480 raft_consensus.cc:2272] T 71fc75ce25404089ad5bf00f9dd40cbd P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.192888 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf8733dc7d947f08af2274d90145039" candidate_uuid: "9ab488f10c434878a749f261e99a8065" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:33.195076 23593 leader_election.cc:304] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ab488f10c434878a749f261e99a8065; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:33.196362 31549 raft_consensus.cc:2749] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:33.196548 22480 tablet_replica.cc:333] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.197609 22480 raft_consensus.cc:2243] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.235493 22480 raft_consensus.cc:2272] T 819369bff57548ee8188f19ea4e8f622 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.245762 22480 tablet_replica.cc:333] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.246747 22480 raft_consensus.cc:2243] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.247579 22480 raft_consensus.cc:2272] T 44b7b7e4ddb143138d48247cb9feb2d4 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.250548 22480 tablet_replica.cc:333] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.267387 22480 raft_consensus.cc:2243] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.268574 22480 raft_consensus.cc:2272] T 161b847a6eca457eb80fb6cb57531127 P 9ab488f10c434878a749f261e99a8065 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.299217 23669 consensus_peers.cc:597] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:33.301087 22480 tablet_replica.cc:333] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.302126 22480 raft_consensus.cc:2243] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.302865 22480 raft_consensus.cc:2272] T 2cf8733dc7d947f08af2274d90145039 P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.305927 22480 tablet_replica.cc:333] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.306787 22480 raft_consensus.cc:2243] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.307507 22480 raft_consensus.cc:2272] T 2de1999cb30f49b981475a62d0d0feb9 P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.321630 22480 tablet_replica.cc:333] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.322451 22480 raft_consensus.cc:2243] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.323103 22480 raft_consensus.cc:2272] T aa38658745b04f268c400fe20554d483 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.341316 22480 tablet_replica.cc:333] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.342120 22480 raft_consensus.cc:2243] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.352303 22480 raft_consensus.cc:2272] T 1614a6a9a62040cab19c65c57018c05e P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.364555 22480 tablet_replica.cc:333] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.376495 22480 raft_consensus.cc:2243] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.377382 22480 raft_consensus.cc:2272] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 9ab488f10c434878a749f261e99a8065 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.386531 22480 tablet_replica.cc:333] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.387424 22480 raft_consensus.cc:2243] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.388584 22480 raft_consensus.cc:2272] T 4a97c483343c425ea75f1f6632924819 P 9ab488f10c434878a749f261e99a8065 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.398447 22480 tablet_replica.cc:333] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.404081 22480 raft_consensus.cc:2243] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.405328 22480 raft_consensus.cc:2272] T c455a888f1c64ea3a1c2ae56502f7432 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.408216 22480 tablet_replica.cc:333] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.409147 22480 raft_consensus.cc:2243] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.410117 22480 raft_consensus.cc:2272] T 88d337bff4764c8591ac46843de3fa91 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.425442 24359 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:33.426994 22480 tablet_replica.cc:333] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.427992 22480 raft_consensus.cc:2243] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.430346 22480 raft_consensus.cc:2272] T ce71536613184c6d869077ae232876cc P 9ab488f10c434878a749f261e99a8065 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.458760 22480 tablet_replica.cc:333] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.464358 22480 raft_consensus.cc:2243] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.465574 22480 raft_consensus.cc:2272] T 737154dff44a498f96f906fc83416830 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.469530 23669 consensus_peers.cc:597] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:33.474073 22480 tablet_replica.cc:333] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.477347 22480 raft_consensus.cc:2243] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.481887 22480 pending_rounds.cc:70] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Trying to abort 1 pending ops.
I20260709 13:11:33.485258 22480 pending_rounds.cc:77] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065: Aborting op as it isn't in flight: id { term: 18 index: 13 } timestamp: 7305636598100926464 op_type: NO_OP noop_request { }
I20260709 13:11:33.491410 22480 raft_consensus.cc:2889] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:33.493304 22480 raft_consensus.cc:2272] T b7656d11fa2f4f27beac8e46f9f20be9 P 9ab488f10c434878a749f261e99a8065 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.500928 22480 tablet_replica.cc:333] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.501847 22480 raft_consensus.cc:2243] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.502859 22480 raft_consensus.cc:2272] T 334c9018414947cabb4405ef47b8018e P 9ab488f10c434878a749f261e99a8065 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.513242 23669 consensus_peers.cc:597] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:33.519101 22480 tablet_replica.cc:333] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.520146 22480 raft_consensus.cc:2243] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.535789 22480 raft_consensus.cc:2272] T 2d951ceae2c04062b838b8fec5fbcc9f P 9ab488f10c434878a749f261e99a8065 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.542582 22480 tablet_replica.cc:333] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.543479 22480 raft_consensus.cc:2243] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.544186 22480 raft_consensus.cc:2272] T a17c243311054979a1c285f2ef18d20e P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.547052 22480 tablet_replica.cc:333] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.554440 31560 raft_consensus.cc:1064] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:11:33.565497 31560 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:33.570945 22480 raft_consensus.cc:2243] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.573072 22480 raft_consensus.cc:2272] T a0d6af36909c4398a1ec8496f1dde507 P 9ab488f10c434878a749f261e99a8065 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.580986 22480 tablet_replica.cc:333] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.588358 22480 raft_consensus.cc:2243] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.595753 22480 raft_consensus.cc:2272] T da6c8d6f775147c1807ebd5917f806a8 P 9ab488f10c434878a749f261e99a8065 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.606289 22480 tablet_replica.cc:333] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.607368 22480 raft_consensus.cc:2243] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.610394 23777 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:33.612190 31567 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:33.612502 22480 raft_consensus.cc:2272] T e1f8fde8107545d5a59c6b12b0822584 P 9ab488f10c434878a749f261e99a8065 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.617959 24391 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 LEARNER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:11:33.620733 23669 consensus_peers.cc:597] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:33.621528 31568 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:33.624838 22480 tablet_replica.cc:333] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065: stopping tablet replica
I20260709 13:11:33.640295 31568 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:33.640885 31568 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:33.642936 31568 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:33.644600 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:33.645413 22480 raft_consensus.cc:2243] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:11:33.649933 22480 raft_consensus.cc:2272] T aff661e739d84f06b43002ae9d8ae607 P 9ab488f10c434878a749f261e99a8065 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:33.653782 23669 leader_election.cc:336] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:33.654457 23669 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:33.656349 31568 raft_consensus.cc:2749] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:33.682032 31568 raft_consensus.cc:2955] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:33.699352 23777 raft_consensus.cc:2955] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:33.726475 23519 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 14 to 15, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:33.736364 31519 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:33.737046 31519 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:33.742834 31519 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:33.745889 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:33.748457 23743 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:33.749095 23743 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:33.752825 31571 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:33.789674 24391 raft_consensus.cc:2955] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } attrs { replace: true } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:33.827373 31519 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:33.828131 31519 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:33.830596 31519 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:33.834117 23743 leader_election.cc:336] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:33.835636 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:33.836297 23701 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:11:33.838182 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:33.843001 31571 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:33.843430 31571 raft_consensus.cc:493] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:33.845435 31571 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:33.872994 31571 raft_consensus.cc:515] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:33.882092 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3b7e5b938d488e915e4b83c40e6e1d" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:33.882802 23701 raft_consensus.cc:3060] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:33.883949 23743 leader_election.cc:336] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:33.893596 23701 raft_consensus.cc:2468] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:33.895539 23742 leader_election.cc:304] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:33.896528 31570 raft_consensus.cc:2804] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:33.897143 31570 raft_consensus.cc:697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:33.898388 31570 consensus_queue.cc:237] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:33.912009 31576 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:33.894183 31571 leader_election.cc:290] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:33.916365 31576 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:33.932420 31519 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:33.933159 31519 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:33.942099 31567 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:33.942699 31567 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:33.945089 31567 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:33.941215 31575 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:33.946336 31575 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:33.946931 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:33.948491 31575 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:33.949775 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:33.951849 31519 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:33.958521 23669 leader_election.cc:336] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:33.959400 23669 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:33.960711 23669 leader_election.cc:336] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:33.960858 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:33.961244 23669 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:33.962152 31567 raft_consensus.cc:2749] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:33.962427 31560 raft_consensus.cc:2749] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:33.965546 23743 leader_election.cc:336] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:33.958798 31576 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:33.970326 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:33.988816 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:33.991317 31570 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:33.989287 23669 leader_election.cc:336] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:33.996275 23669 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:33.998608 31576 raft_consensus.cc:2749] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:34.000010 31562 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.000730 31562 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:34.003065 31562 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:34.005806 23669 connection.cc:573] client connection to 127.21.244.1:37537 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:11:34.007361 24359 leader_election.cc:336] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.021538 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.021831 31582 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.022557 31582 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:34.030299 23776 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in term 19.
I20260709 13:11:34.029703 31576 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.031342 31576 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.034128 31582 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:34.035408 31576 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.046213 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:34.047349 24391 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:34.046213 24357 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.072992 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:34.073303 31583 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:34.073746 31583 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.073922 31582 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:34.074151 31583 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.074381 31582 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.074819 31582 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.081111 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.081786 23776 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:34.086263 23667 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.087462 31576 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:34.087880 31576 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.088268 31576 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:34.091468 23743 leader_election.cc:336] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.093369 31583 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:34.096118 31583 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.099920 31570 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.100515 31570 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.104863 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.105494 23701 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
I20260709 13:11:34.107686 31582 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:34.109992 31582 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:34.112119 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.112987 31570 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.114126 23701 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:34.114567 31570 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:34.115219 31570 raft_consensus.cc:493] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.115859 31570 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:34.131309 23669 leader_election.cc:336] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.136462 23776 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:34.131783 31576 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.143872 31575 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:11:34.146286 23743 leader_election.cc:336] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.147136 23743 leader_election.cc:336] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.148228 23526 catalog_manager.cc:5697] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 16 to 17, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 17 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.160575 31576 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.162808 24391 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:34.163386 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8126e5c9a36b4a6e859566d2a92590e6" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:34.161824 31560 raft_consensus.cc:2955] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:34.164108 23776 raft_consensus.cc:3060] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:34.168937 31575 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.169584 31575 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:34.176836 23669 leader_election.cc:336] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.181185 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:34.184662 23777 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in current term 20: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:34.186872 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:34.187630 24391 raft_consensus.cc:2393] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 20: Already voted for candidate b1e32a12daf44ebbbd71cc3ce41d7d8e in this term.
I20260709 13:11:34.190091 23776 raft_consensus.cc:2468] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 18.
I20260709 13:11:34.190915 31567 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:34.191515 31575 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.192113 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, b1e32a12daf44ebbbd71cc3ce41d7d8e
I20260709 13:11:34.193328 31579 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.193418 31571 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.193907 31579 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.194216 31571 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.195042 31571 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.196161 31579 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.196278 23777 raft_consensus.cc:2955] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:34.197814 31571 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.200706 23667 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.202340 31567 raft_consensus.cc:2804] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:34.202883 31567 raft_consensus.cc:697] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:34.205564 31567 consensus_queue.cc:237] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.211362 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.211987 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.212745 23703 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 25.
W20260709 13:11:34.211987 24359 leader_election.cc:336] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.215790 31570 raft_consensus.cc:515] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.215153 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.222055 31590 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.224316 23742 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.225355 23512 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8f80c880e2784395811b9b9ab65aaf82 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:11:34.231127 23743 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.231633 23743 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:34.231772 31519 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.232373 31571 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:34.233027 31561 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.232394 31519 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.233624 31561 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:34.235504 31519 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.236272 24391 raft_consensus.cc:2955] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:34.240404 31561 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.241549 31570 leader_election.cc:290] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.242221 31570 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:34.242589 31570 raft_consensus.cc:493] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:34.242702 23743 leader_election.cc:336] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.242990 31570 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:34.247829 31560 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.248423 31560 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:34.250038 24359 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.251194 31519 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.252417 31519 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.254606 31519 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.251632 31560 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.259135 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.223418 31582 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.260104 31582 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.260310 23526 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 15 to 16, VOTER 9ab488f10c434878a749f261e99a8065 (127.21.244.1) evicted. New cstate: current_term: 22 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:34.261296 23777 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
W20260709 13:11:34.267163 23669 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.270459 31567 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:34.272377 23743 leader_election.cc:336] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.272994 23743 leader_election.cc:336] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.274238 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.275137 31576 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:34.275545 31576 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.275962 31576 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:34.282546 31582 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.283635 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.284442 23776 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:11:34.290100 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.291339 31575 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:34.291796 31575 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.271020 31567 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.292171 31575 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:34.293723 31567 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.302681 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033291a683e4f2b8c99fb6fa6d479f8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:34.303273 23696 raft_consensus.cc:3060] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:34.303334 23701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.304106 23703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.304713 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.306252 31575 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.307636 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:34.309016 23743 leader_election.cc:336] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.311807 31575 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:34.314333 24359 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:34.320050 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.321033 23777 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:11:34.328107 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0854ca8274d49df9583c253583ec3d7" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:34.328828 23776 raft_consensus.cc:3060] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:34.329082 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.329908 31567 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:34.330327 31567 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.330734 31567 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:34.332377 23743 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.335857 31576 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.323484 31570 raft_consensus.cc:515] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.337190 23700 raft_consensus.cc:2393] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 21: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:34.341049 23527 catalog_manager.cc:5697] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 17 to 18, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 18 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.343132 31519 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.343772 31519 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.346215 31519 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:34.346736 23743 consensus_peers.cc:597] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:34.347941 31576 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.346041 31567 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.351513 23696 raft_consensus.cc:2468] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
I20260709 13:11:34.352669 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55436fc3614f4f558828ea5de361e5f0" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:34.353317 23777 raft_consensus.cc:3060] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:34.352087 23743 leader_election.cc:336] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.354456 31560 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.355043 31560 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.357286 31560 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.351094 31570 leader_election.cc:290] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:34.358018 23743 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.361032 31567 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.361713 23776 raft_consensus.cc:2468] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 23.
I20260709 13:11:34.363801 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd55b231da4c27b7547a2714bb43d9" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:34.364398 23772 raft_consensus.cc:3060] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:34.368312 23669 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.369216 23777 raft_consensus.cc:2468] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
I20260709 13:11:34.370995 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9e0e43fe5147ef802644460230dc6f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:34.371265 23696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.371556 23700 raft_consensus.cc:3060] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:34.364840 23667 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.364867 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:34.373764 24358 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:34.375854 23696 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:34.376711 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:34.377683 23667 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.379249 31571 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:34.379271 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:34.380437 31571 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:34.380824 23742 leader_election.cc:304] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.381762 31571 raft_consensus.cc:2804] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:11:34.382318 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8f80c880e2784395811b9b9ab65aaf82: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.382503 31582 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:34.382850 31590 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:34.384370 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.384883 23776 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:34.386559 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.388104 23772 raft_consensus.cc:2468] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 23.
W20260709 13:11:34.391327 23669 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.392109 23669 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.393011 23669 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.393695 31575 raft_consensus.cc:2804] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:34.394321 31575 raft_consensus.cc:697] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:34.395354 31575 consensus_queue.cc:237] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.383543 31560 raft_consensus.cc:2804] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:34.400389 31560 raft_consensus.cc:697] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:34.401435 31560 consensus_queue.cc:237] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:34.409772 24359 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:34.411262 31576 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.411900 31576 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.414178 31576 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.385857 23667 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.416036 31571 raft_consensus.cc:697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:34.418114 31571 consensus_queue.cc:237] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.419634 31519 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:34.420066 31519 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.420428 31519 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:34.421039 23667 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.421864 31568 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:34.422281 31568 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.422654 31568 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:34.422945 23700 raft_consensus.cc:2468] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 26.
I20260709 13:11:34.424741 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:34.416538 23669 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.432107 31579 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.435614 31579 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.438051 31579 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:34.442078 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 66867.2us
I20260709 13:11:34.429008 31576 raft_consensus.cc:2804] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:11:34.453275 23743 leader_election.cc:336] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.456110 23743 consensus_peers.cc:597] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.457188 31576 raft_consensus.cc:697] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:34.476636 31576 consensus_queue.cc:237] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.492188 31519 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.496080 31580 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.496619 31580 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.498994 31580 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.498842 31568 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.500010 31519 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:34.501189 23743 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.503094 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:34.503849 23772 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c885217113574e7489e6c3afb6950f76 in current term 18: Already voted for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in this term.
I20260709 13:11:34.508123 31575 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.508762 31575 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:34.509945 23743 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.512187 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:34.512882 24391 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 25.
I20260709 13:11:34.514120 23668 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.515414 31596 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:34.515974 31596 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.516585 31596 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:34.515925 23527 catalog_manager.cc:5697] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 21 to 22, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 22 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.519095 31575 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:34.519618 31568 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:34.520792 23669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 127027us
W20260709 13:11:34.521293 23669 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.526309 23742 leader_election.cc:304] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.532034 31580 raft_consensus.cc:2804] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:34.532593 31580 raft_consensus.cc:697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:34.532724 31568 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.533349 31568 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.533519 31580 consensus_queue.cc:237] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.535923 31568 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.536444 31519 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.537068 31519 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:34.539609 31519 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.539753 23700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.541548 23700 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:34.540465 23702 raft_consensus.cc:1275] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:34.543993 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:34.550112 23704 raft_consensus.cc:2393] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4466bf6d6cf84ee89e84ea074e3964c9 in current term 18: Already voted for candidate c885217113574e7489e6c3afb6950f76 in this term.
I20260709 13:11:34.553335 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.553063 23526 catalog_manager.cc:5697] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 20 to 21, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 21 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.553277 31560 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.556231 31560 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.556632 23742 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.557700 31519 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:34.558075 31519 raft_consensus.cc:493] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.558446 31519 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.558729 31560 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.562199 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:34.563177 31571 consensus_queue.cc:1048] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:11:34.565279 31582 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:34.580896 23669 leader_election.cc:336] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.581621 23669 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.583652 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.584528 23772 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 24.
I20260709 13:11:34.584769 31560 raft_consensus.cc:2749] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:34.588824 31596 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:34.583825 23669 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.592196 23669 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.592383 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.595408 31596 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 26 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:34.596459 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161b847a6eca457eb80fb6cb57531127" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:34.597059 24391 raft_consensus.cc:3060] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:34.597824 31596 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:34.600230 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.600493 31580 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:34.601476 23669 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.601158 31580 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.604614 31580 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.601171 31596 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:34.605475 31596 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:34.608345 23743 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.605875 31596 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:34.609189 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.610468 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
W20260709 13:11:34.614745 23743 leader_election.cc:336] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.617022 24391 raft_consensus.cc:2468] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 26.
I20260709 13:11:34.617924 23526 catalog_manager.cc:5697] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 25 to 26, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 26 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.621758 23668 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.622599 31568 raft_consensus.cc:2804] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:34.623075 31568 raft_consensus.cc:697] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 26 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:34.623951 31568 consensus_queue.cc:237] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:34.628242 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:34.629544 31580 raft_consensus.cc:2749] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:34.630254 23776 raft_consensus.cc:1275] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:34.618494 31519 raft_consensus.cc:515] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.631601 31560 consensus_queue.cc:1048] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:34.634169 31519 leader_election.cc:290] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.640525 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:34.641552 24359 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:34.641697 31580 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.643045 23742 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:34.644214 31580 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:34.645525 23669 leader_election.cc:336] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.654027 31560 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:34.655340 23669 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.655850 23669 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:34.656049 23743 leader_election.cc:336] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.655495 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65f1370869c4d4eb4d8f7be8a50f45f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:34.656847 23704 raft_consensus.cc:3060] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.644203 31596 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:34.660400 23669 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.665285 31519 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.666790 31519 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.654588 31560 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.670194 31560 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.671617 31596 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.664341 31576 raft_consensus.cc:2749] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.672596 31596 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.673100 31596 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:34.674317 24359 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:34.675271 31596 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.667299 31567 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.680073 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.679912 31567 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.680801 23702 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 15.
I20260709 13:11:34.682150 31519 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.685684 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.688421 31580 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:34.688907 31580 raft_consensus.cc:493] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.689327 31580 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:34.690806 23669 leader_election.cc:336] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.691466 23669 leader_election.cc:336] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.695312 23669 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.687120 31519 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.696121 31519 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.698882 31519 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.701292 31567 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.704111 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.704820 23702 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:34.711225 23704 raft_consensus.cc:2468] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:34.714061 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
W20260709 13:11:34.715060 23669 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.714062 31580 raft_consensus.cc:515] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.721752 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38286c47d38c4f9084acbb510661dcfa" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:34.721745 31519 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:34.722482 23772 raft_consensus.cc:3060] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:34.722529 31519 raft_consensus.cc:493] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.723096 31519 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.721371 23742 leader_election.cc:304] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.724817 23777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.725441 23777 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:34.725651 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.726605 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.727205 23778 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 26.
I20260709 13:11:34.730353 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819369bff57548ee8188f19ea4e8f622" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:34.730510 31580 leader_election.cc:290] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.730962 23702 raft_consensus.cc:3060] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:34.740482 31596 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.741061 31596 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.743199 31596 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.747004 31582 raft_consensus.cc:2804] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:34.747632 31582 raft_consensus.cc:697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:34.748607 31582 consensus_queue.cc:237] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.761209 23772 raft_consensus.cc:2468] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 25.
W20260709 13:11:34.763669 23669 leader_election.cc:336] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.770431 23702 raft_consensus.cc:2468] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 16.
I20260709 13:11:34.771423 23742 leader_election.cc:304] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.772234 31579 raft_consensus.cc:2804] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:34.772738 31579 raft_consensus.cc:697] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:34.773623 31579 consensus_queue.cc:237] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.775955 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.773699 23526 catalog_manager.cc:5697] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 22 to 23, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 23 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.777184 31568 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:34.777622 31568 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.777786 31580 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.778039 31568 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:34.778370 31580 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.778002 23526 catalog_manager.cc:5697] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 22 to 23, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 23 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.781229 31580 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.782799 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.783449 23698 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 24.
I20260709 13:11:34.784715 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.785404 23667 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.785573 31580 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:34.786160 31580 raft_consensus.cc:493] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.786522 31567 raft_consensus.cc:2749] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:34.786571 31580 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:34.783083 23526 catalog_manager.cc:5697] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 25 to 26, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 26 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.795540 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.797251 31567 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.797865 31567 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.798547 31596 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:34.798991 31596 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.771394 31519 raft_consensus.cc:515] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.799476 31596 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:34.800344 31567 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.812711 31580 raft_consensus.cc:515] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.815243 31580 leader_election.cc:290] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.818017 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c455a888f1c64ea3a1c2ae56502f7432" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:34.818670 23704 raft_consensus.cc:3060] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:34.796555 23743 leader_election.cc:336] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.821450 31519 leader_election.cc:290] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.822253 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1614a6a9a62040cab19c65c57018c05e" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:34.823045 23698 raft_consensus.cc:3060] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:34.823216 23667 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.826649 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.827260 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.828256 23704 raft_consensus.cc:2468] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:34.829869 23742 leader_election.cc:304] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.827873 23778 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 19.
I20260709 13:11:34.832873 23667 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.835258 23667 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.838032 31575 raft_consensus.cc:2749] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:34.833894 31560 raft_consensus.cc:2804] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:34.839171 31560 raft_consensus.cc:697] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 25 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:34.836416 31576 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:34.840540 31576 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.840967 31576 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.845263 31596 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.848193 31560 consensus_queue.cc:237] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:34.854475 23743 leader_election.cc:336] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.834559 31580 raft_consensus.cc:2804] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:34.858691 31576 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.861984 31610 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.863445 31610 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.865957 23698 raft_consensus.cc:2468] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 25.
I20260709 13:11:34.868024 31610 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.865615 31580 raft_consensus.cc:697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:34.871351 31580 consensus_queue.cc:237] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.878877 31579 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.879760 31579 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.882167 31579 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.872975 23527 catalog_manager.cc:5697] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 19 to 20, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 20 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.884419 31568 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.885087 23527 catalog_manager.cc:5697] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 15 to 16, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 16 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.886862 31568 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.888046 31596 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 27 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:34.890724 23743 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.891000 31596 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
W20260709 13:11:34.891763 23743 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.892635 23743 leader_election.cc:336] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.893205 23743 leader_election.cc:336] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.877089 31576 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:34.896426 23742 leader_election.cc:304] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
W20260709 13:11:34.883471 23669 consensus_peers.cc:597] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:34.897615 23669 leader_election.cc:336] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.901535 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:34.902966 23669 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.903419 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.891651 31596 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:34.905110 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737154dff44a498f96f906fc83416830" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:34.905784 23775 raft_consensus.cc:3060] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.905900 31596 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:11:34.906622 31579 raft_consensus.cc:2804] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:34.907171 31579 raft_consensus.cc:697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:34.908136 31579 consensus_queue.cc:237] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.915058 23775 raft_consensus.cc:2468] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:34.916538 23772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fc75ce25404089ad5bf00f9dd40cbd" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:34.916803 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a97c483343c425ea75f1f6632924819" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:34.917163 23772 raft_consensus.cc:3060] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:34.917479 23778 raft_consensus.cc:3060] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:34.918320 23667 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.919332 23776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:34.919983 23776 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 20.
I20260709 13:11:34.921561 31582 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.922078 31582 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.923434 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.925005 31568 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:34.925405 31568 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.925815 31568 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:34.930433 23743 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.920009 31576 raft_consensus.cc:2749] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:34.931708 31582 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:34.933076 23772 raft_consensus.cc:2468] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 17.
I20260709 13:11:34.935206 23667 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.936264 31560 raft_consensus.cc:2804] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:34.936817 31560 raft_consensus.cc:697] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 20 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:34.937812 31560 consensus_queue.cc:237] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.940210 23778 raft_consensus.cc:2468] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 27.
W20260709 13:11:34.941541 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 45214us
I20260709 13:11:34.942692 23667 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:34.943590 31576 raft_consensus.cc:2804] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:34.944123 31576 raft_consensus.cc:697] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:34.944995 31576 consensus_queue.cc:237] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.955106 23698 raft_consensus.cc:1275] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:34.955026 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:34.956852 23704 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
W20260709 13:11:34.960784 23669 leader_election.cc:336] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.961691 23669 leader_election.cc:336] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.962430 23669 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:34.962502 23743 leader_election.cc:336] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:34.963315 23742 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:34.964226 31580 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:34.968483 23667 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.969657 31610 raft_consensus.cc:2804] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:11:34.970191 31610 raft_consensus.cc:697] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 27 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:34.970680 31579 consensus_queue.cc:1048] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:34.971717 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:34.971221 31610 consensus_queue.cc:237] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:34.978696 24359 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:34.984763 31579 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:34.985508 31579 raft_consensus.cc:493] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.985898 31579 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:34.990449 23526 catalog_manager.cc:5697] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 19 to 20, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 20 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.991683 23526 catalog_manager.cc:5697] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 24 to 25, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 25 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.996876 31596 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:34.997458 31596 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:34.999775 31567 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:35.013393 31567 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:35.017198 31596 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:35.015652 31567 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:35.018692 24359 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:35.020236 23743 consensus_peers.cc:597] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:35.023773 31568 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
W20260709 13:11:35.038676 22480 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23650)
W20260709 13:11:35.038750 23743 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111) [suppressed 332 similar messages]
I20260709 13:11:35.040795 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:35.040928 23775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:35.041574 23775 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 22.
I20260709 13:11:35.042223 23772 raft_consensus.cc:1275] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:35.034934 31568 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Requested vote from peers 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959), 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537)
I20260709 13:11:35.049109 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d337bff4764c8591ac46843de3fa91" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:35.050063 23773 raft_consensus.cc:3060] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:35.043282 31596 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:35.051570 31596 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:35.053580 31596 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:35.091477 23667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 52928us
I20260709 13:11:35.103820 31579 raft_consensus.cc:515] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:35.105984 31579 leader_election.cc:290] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:35.108246 23773 raft_consensus.cc:2468] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 21.
W20260709 13:11:35.111047 23743 consensus_peers.cc:597] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:35.112196 23743 consensus_peers.cc:597] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.112656 23743 consensus_peers.cc:597] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.117843 31579 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:35.118103 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:35.110721 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:35.118919 23773 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 15.
I20260709 13:11:35.119225 23772 raft_consensus.cc:1275] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:35.120236 31579 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:35.122669 31579 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:35.123543 24391 raft_consensus.cc:1275] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
W20260709 13:11:35.126696 24359 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:35.131628 23772 raft_consensus.cc:1275] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:35.131445 23526 catalog_manager.cc:5697] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 24 to 25, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 25 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.132800 23526 catalog_manager.cc:5697] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 16 to 17, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 17 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.133817 23526 catalog_manager.cc:5697] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 19 to 20, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 20 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.135293 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce71536613184c6d869077ae232876cc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:35.130924 23667 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:35.135852 23704 raft_consensus.cc:3060] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:35.135023 23526 catalog_manager.cc:5697] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 26 to 27, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 27 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.136646 23667 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:35.140139 31568 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:35.140558 31568 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:35.140324 31610 consensus_queue.cc:1048] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 13:11:35.140815 31560 raft_consensus.cc:2804] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:35.141487 31560 raft_consensus.cc:697] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:35.141960 31576 consensus_queue.cc:1048] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:35.142370 31560 consensus_queue.cc:237] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:35.140981 31568 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:35.145030 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:35.129670 31575 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:35.136884 31619 consensus_queue.cc:1048] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:11:35.147787 31618 consensus_queue.cc:1048] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:35.148522 23702 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 12.
I20260709 13:11:35.155857 31575 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:35.156397 31575 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:35.159360 23704 raft_consensus.cc:2468] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:35.129142 31580 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:35.166958 31580 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:35.170174 31580 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:35.145315 23743 consensus_peers.cc:597] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:35.173310 23743 leader_election.cc:336] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:35.176903 23704 raft_consensus.cc:1275] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:11:35.183096 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:35.183862 23702 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 24.
I20260709 13:11:35.188719 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:35.189596 23742 leader_election.cc:304] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:35.195940 31519 raft_consensus.cc:2804] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:11:35.199347 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 64145us
I20260709 13:11:35.200083 31571 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:35.207789 23526 catalog_manager.cc:5697] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 20 to 21, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 21 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:35.224548 23743 leader_election.cc:336] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:35.211766 31571 raft_consensus.cc:493] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:35.225986 31571 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:35.241899 31519 raft_consensus.cc:697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:35.242986 31519 consensus_queue.cc:237] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:35.255343 23743 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:35.230993 31568 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:35.273106 23743 consensus_peers.cc:597] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.274910 24359 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:35.280773 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 76654.3us
I20260709 13:11:35.282085 31625 consensus_queue.cc:1048] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:35.283540 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:35.287607 31580 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:35.288036 31580 raft_consensus.cc:493] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9ab488f10c434878a749f261e99a8065)
I20260709 13:11:35.288408 31580 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:35.289223 23702 raft_consensus.cc:1275] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:35.299329 31568 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:35.299211 31580 raft_consensus.cc:515] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:35.300949 31575 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:35.301762 31570 consensus_queue.cc:1048] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:11:35.302129 31622 log.cc:927] Time spent T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:35.303198 31575 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:35.319878 31571 raft_consensus.cc:515] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:35.322788 31571 leader_election.cc:290] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:35.324136 23778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d951ceae2c04062b838b8fec5fbcc9f" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:35.324811 23778 raft_consensus.cc:3060] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:35.334095 23743 leader_election.cc:336] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:35.339450 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d6af36909c4398a1ec8496f1dde507" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:35.345299 23704 raft_consensus.cc:3060] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:35.353403 23704 raft_consensus.cc:2468] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 13.
I20260709 13:11:35.359987 31580 leader_election.cc:290] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:35.358659 23742 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:35.364504 31571 raft_consensus.cc:2804] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:35.365453 23697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff661e739d84f06b43002ae9d8ae607" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:35.341831 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6c8d6f775147c1807ebd5917f806a8" candidate_uuid: "c885217113574e7489e6c3afb6950f76" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9"
I20260709 13:11:35.366106 23697 raft_consensus.cc:3060] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:35.366379 23773 raft_consensus.cc:3060] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:35.373440 23697 raft_consensus.cc:2468] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 25.
I20260709 13:11:35.365056 31571 raft_consensus.cc:697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:35.377435 31571 consensus_queue.cc:237] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:35.356190 23743 consensus_peers.cc:597] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.382615 23742 leader_election.cc:304] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:35.398516 31580 raft_consensus.cc:2804] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:35.384085 23704 raft_consensus.cc:1275] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:35.384729 23778 raft_consensus.cc:2468] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 23.
I20260709 13:11:35.402434 23527 catalog_manager.cc:5697] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 18 to 19, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 19 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.402410 31580 raft_consensus.cc:697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:35.404626 31580 consensus_queue.cc:237] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:35.417495 23775 raft_consensus.cc:1275] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:11:35.420128 31628 consensus_queue.cc:1048] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:35.424171 23698 raft_consensus.cc:1275] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:35.426417 31582 consensus_queue.cc:1048] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:11:35.417318 23743 leader_election.cc:336] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:35.429651 23667 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:35.430676 31568 raft_consensus.cc:2804] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:35.387763 23773 raft_consensus.cc:2468] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c885217113574e7489e6c3afb6950f76 in term 16.
I20260709 13:11:35.441957 23777 raft_consensus.cc:1275] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 27 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:11:35.442984 31568 raft_consensus.cc:697] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:35.448086 31618 consensus_queue.cc:1048] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:35.444072 31568 consensus_queue.cc:237] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:35.476466 23743 consensus_peers.cc:597] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.478257 23667 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:35.472561 31619 consensus_queue.cc:1048] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:11:35.487088 23778 raft_consensus.cc:1275] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:35.499554 23704 raft_consensus.cc:1275] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:11:35.507859 23743 consensus_peers.cc:597] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:35.508584 23777 raft_consensus.cc:1275] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:35.499981 31618 raft_consensus.cc:2804] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:35.512741 31580 consensus_queue.cc:1048] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:11:35.511341 31619 consensus_queue.cc:1048] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:11:35.536320 31618 raft_consensus.cc:697] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Becoming Leader. State: Replica: c885217113574e7489e6c3afb6950f76, State: Running, Role: LEADER
I20260709 13:11:35.535264 23519 catalog_manager.cc:5697] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 22 to 23, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 23 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.516953 31560 consensus_queue.cc:1048] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:11:35.540042 31618 consensus_queue.cc:237] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:35.568302 23526 catalog_manager.cc:5697] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 12 to 13, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 13 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:35.570323 24359 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:35.572275 23526 catalog_manager.cc:5697] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 24 to 25, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 25 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.607467 23772 raft_consensus.cc:1275] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:11:35.608620 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet 71fc75ce25404089ad5bf00f9dd40cbd: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:35.610376 31619 consensus_queue.cc:1048] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:11:35.638767 23702 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
W20260709 13:11:35.652671 23743 consensus_peers.cc:597] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.717865 23526 catalog_manager.cc:5697] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 reported cstate change: term changed from 15 to 16, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to c885217113574e7489e6c3afb6950f76 (127.21.244.2). New cstate: current_term: 16 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:35.758204 23668 consensus_peers.cc:597] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a0f95eab8184aa59b6fcef0d9f32b0f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.759671 23773 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:35.761175 31620 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:35.763952 23702 raft_consensus.cc:1275] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:35.765816 31582 consensus_queue.cc:1048] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:35.773695 23513 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 45780.2us
W20260709 13:11:35.777621 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8f80c880e2784395811b9b9ab65aaf82: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:35.800891 23743 consensus_peers.cc:597] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.802440 23743 consensus_peers.cc:597] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.828951 31560 raft_consensus.cc:2955] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:11:35.838871 31519 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.839476 31519 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:35.842038 31519 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:35.843848 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:35.844663 24391 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 20.
I20260709 13:11:35.848356 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:35.853173 23772 raft_consensus.cc:1275] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:11:35.855382 23575 auto_rebalancer.cc:629] Failed to schedule move for tablet da6c8d6f775147c1807ebd5917f806a8: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:35.856594 31620 consensus_queue.cc:1048] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:35.857023 31570 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:35.857460 31570 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.857825 31570 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:35.860208 23697 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
W20260709 13:11:35.868209 23743 leader_election.cc:336] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:35.873133 23526 catalog_manager.cc:5697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index -1 to 11, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 17 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.880466 31570 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:35.883777 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5499c62f40a046f2a8efb671c77f08b3" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:35.884434 24391 raft_consensus.cc:3060] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:35.884572 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.887410 23773 raft_consensus.cc:2955] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
W20260709 13:11:35.891929 23743 consensus_peers.cc:597] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.896229 23743 leader_election.cc:336] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:35.905211 24391 raft_consensus.cc:2468] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 21.
W20260709 13:11:35.906113 23668 consensus_peers.cc:597] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 -> Peer b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767): Couldn't send request to peer b1e32a12daf44ebbbd71cc3ce41d7d8e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8c18a99e9414e39bff9dea9564bd61b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.906616 23742 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065
I20260709 13:11:35.907490 31519 raft_consensus.cc:2804] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:35.908038 31519 raft_consensus.cc:697] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:35.909204 31519 consensus_queue.cc:237] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:35.913046 23778 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:35.921958 31618 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:35.923894 31570 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:35.968065 23697 raft_consensus.cc:1275] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:35.973064 23773 raft_consensus.cc:2955] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Committing config change with OpId 17.9: config changed from index -1 to 9, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:11:35.969635 31576 raft_consensus.cc:2955] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Committing config change with OpId 17.9: config changed from index -1 to 9, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:11:35.975554 23519 catalog_manager.cc:5697] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 19 to 21, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 21 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.982378 23772 raft_consensus.cc:1275] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:35.984731 31618 consensus_queue.cc:1048] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:11:35.997745 23669 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:35.998607 23669 consensus_peers.cc:597] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.001509 31519 consensus_queue.cc:1048] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:36.003669 23697 raft_consensus.cc:1275] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:11:36.039645 22480 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23650)
W20260709 13:11:36.071766 23669 consensus_peers.cc:597] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.072497 23669 consensus_peers.cc:597] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.072902 23669 consensus_peers.cc:597] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.073352 23669 consensus_peers.cc:597] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.073742 23669 consensus_peers.cc:597] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.074226 23669 consensus_peers.cc:597] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.074741 23669 consensus_peers.cc:597] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.077798 31571 consensus_queue.cc:1048] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:11:36.107987 23669 consensus_peers.cc:597] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.108945 23669 consensus_peers.cc:597] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.109637 23669 leader_election.cc:336] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:36.110040 23669 leader_election.cc:304] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c885217113574e7489e6c3afb6950f76; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:36.111025 23669 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:36.111822 23669 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:36.112686 23669 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:36.113507 23669 consensus_peers.cc:597] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:36.113948 23669 consensus_peers.cc:597] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.115864 31620 raft_consensus.cc:2749] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:36.116277 23669 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:36.119207 23669 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:36.120126 23669 consensus_peers.cc:597] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:36.120601 23669 consensus_peers.cc:597] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.138763 23526 catalog_manager.cc:5697] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index -1 to 9, NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) added. New cstate: current_term: 17 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } } }
I20260709 13:11:36.156723 31571 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.157341 31571 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:36.159706 31571 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:36.190800 23698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76" is_pre_election: true
I20260709 13:11:36.191603 23698 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
W20260709 13:11:36.197295 23669 consensus_peers.cc:597] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.209822 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:36.210788 31570 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:36.211222 31570 raft_consensus.cc:493] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.211623 31570 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:36.222754 31570 raft_consensus.cc:515] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:36.241472 23669 consensus_peers.cc:597] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:36.242503 23669 consensus_peers.cc:597] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:36.252900 31570 leader_election.cc:290] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Requested vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:36.254890 23743 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:36.257336 23669 consensus_peers.cc:597] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:36.259222 23702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eff2185a07540f08c005b02304d15ad" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c885217113574e7489e6c3afb6950f76"
I20260709 13:11:36.260190 23702 raft_consensus.cc:3060] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:36.269642 23702 raft_consensus.cc:2468] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 19.
I20260709 13:11:36.272146 23742 leader_election.cc:304] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76; no voters: 
I20260709 13:11:36.273051 31579 raft_consensus.cc:2804] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:36.273524 31579 raft_consensus.cc:697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:36.274884 31579 consensus_queue.cc:237] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:36.275895 24359 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:36.283812 23669 consensus_peers.cc:597] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:36.283896 23743 leader_election.cc:336] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:36.332369 23669 consensus_peers.cc:597] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:36.329897 24385 consensus_queue.cc:237] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:36.354831 23743 consensus_peers.cc:597] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.371651 24391 raft_consensus.cc:1275] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:36.374519 31582 consensus_queue.cc:1048] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:36.386420 23526 catalog_manager.cc:5697] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 17 to 19, leader changed from 9ab488f10c434878a749f261e99a8065 (127.21.244.1) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 19 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.404755 31666 ts_tablet_manager.cc:933] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:36.412204 24359 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.420254 31666 tablet_copy_client.cc:323] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.2:44167
I20260709 13:11:36.428414 23702 raft_consensus.cc:1275] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Refusing update from remote peer b1e32a12daf44ebbbd71cc3ce41d7d8e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:36.432103 23714 tablet_copy_service.cc:140] P c885217113574e7489e6c3afb6950f76: Received BeginTabletCopySession request for tablet 8a0f95eab8184aa59b6fcef0d9f32b0f from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:54670)
I20260709 13:11:36.432753 23714 tablet_copy_service.cc:161] P c885217113574e7489e6c3afb6950f76: Beginning new tablet copy session on tablet 8a0f95eab8184aa59b6fcef0d9f32b0f from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:54670: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-8a0f95eab8184aa59b6fcef0d9f32b0f
I20260709 13:11:36.441356 31621 consensus_queue.cc:1048] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:36.447597 23714 tablet_copy_source_session.cc:215] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:11:36.475980 23669 consensus_peers.cc:597] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:36.498880 24358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 59705.1us
I20260709 13:11:36.501945 31666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0f95eab8184aa59b6fcef0d9f32b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.534950 31673 ts_tablet_manager.cc:933] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Initiating tablet copy from peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:36.539705 31673 tablet_copy_client.cc:323] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.244.2:44167
I20260709 13:11:36.541842 31666 tablet_copy_client.cc:806] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:36.544898 31666 tablet_copy_client.cc:670] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:36.547703 23714 tablet_copy_service.cc:140] P c885217113574e7489e6c3afb6950f76: Received BeginTabletCopySession request for tablet e8c18a99e9414e39bff9dea9564bd61b from peer b1e32a12daf44ebbbd71cc3ce41d7d8e ({username='slave'} at 127.0.0.1:54670)
I20260709 13:11:36.548332 23714 tablet_copy_service.cc:161] P c885217113574e7489e6c3afb6950f76: Beginning new tablet copy session on tablet e8c18a99e9414e39bff9dea9564bd61b from peer b1e32a12daf44ebbbd71cc3ce41d7d8e at {username='slave'} at 127.0.0.1:54670: session id = b1e32a12daf44ebbbd71cc3ce41d7d8e-e8c18a99e9414e39bff9dea9564bd61b
I20260709 13:11:36.552762 31670 raft_consensus.cc:2955] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 5 to 12, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:36.554605 23702 raft_consensus.cc:2955] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 5 to 12, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:36.556494 31666 tablet_copy_client.cc:538] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:36.565819 23714 tablet_copy_source_session.cc:215] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:36.577085 31673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c18a99e9414e39bff9dea9564bd61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.577296 23512 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 334c9018414947cabb4405ef47b8018e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:11:36.590598 23526 catalog_manager.cc:5697] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e reported cstate change: config changed from index 5 to 12, VOTER 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3) evicted. New cstate: current_term: 16 leader_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.601135 31666 tablet_bootstrap.cc:492] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:11:36.604161 31673 tablet_copy_client.cc:806] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:36.604847 31673 tablet_copy_client.cc:670] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:36.609226 31673 tablet_copy_client.cc:538] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:36.612213 23768 tablet_service.cc:1558] Processing DeleteTablet for tablet 334c9018414947cabb4405ef47b8018e with delete_type TABLET_DATA_TOMBSTONED (TS 4466bf6d6cf84ee89e84ea074e3964c9 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:49186
I20260709 13:11:36.655157 31676 tablet_replica.cc:333] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:36.656663 31676 raft_consensus.cc:2243] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.656649 31673 tablet_bootstrap.cc:492] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap starting.
I20260709 13:11:36.674994 31676 raft_consensus.cc:2272] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:36.705670 31676 ts_tablet_manager.cc:1916] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:36.804018 31676 ts_tablet_manager.cc:1929] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:11:36.804546 31676 log.cc:1199] T 334c9018414947cabb4405ef47b8018e P 4466bf6d6cf84ee89e84ea074e3964c9: Deleting WAL directory at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/wals/334c9018414947cabb4405ef47b8018e
I20260709 13:11:36.817253 23511 catalog_manager.cc:5028] TS 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): tablet 334c9018414947cabb4405ef47b8018e (table test-workload [id=f97dd27cebde439b932c69ce5e91597a]) successfully deleted
W20260709 13:11:36.819778 24359 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.848683 23743 consensus_peers.cc:597] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.883386 31666 tablet_bootstrap.cc:492] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:36.912566 31666 tablet_bootstrap.cc:492] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:11:36.913398 31666 ts_tablet_manager.cc:1403] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.313s	user 0.036s	sys 0.018s
I20260709 13:11:36.923274 23697 raft_consensus.cc:1275] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:36.937451 31666 raft_consensus.cc:359] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:11:36.937371 31519 consensus_queue.cc:1048] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:11:36.938508 31666 raft_consensus.cc:740] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
W20260709 13:11:37.001174 23513 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 100978us
I20260709 13:11:36.978909 31666 consensus_queue.cc:260] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
W20260709 13:11:37.040617 22480 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 23650)
I20260709 13:11:37.045050 31666 ts_tablet_manager.cc:1434] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.131s	user 0.010s	sys 0.000s
W20260709 13:11:37.069430 23743 consensus_peers.cc:597] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:37.100823 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d67625249f734ae3b71d554b7a2ba33b: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:37.110054 23714 tablet_copy_service.cc:342] P c885217113574e7489e6c3afb6950f76: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-8a0f95eab8184aa59b6fcef0d9f32b0f received from {username='slave'} at 127.0.0.1:54670
I20260709 13:11:37.110644 23714 tablet_copy_service.cc:434] P c885217113574e7489e6c3afb6950f76: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-8a0f95eab8184aa59b6fcef0d9f32b0f on tablet 8a0f95eab8184aa59b6fcef0d9f32b0f with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:37.136807 24359 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:37.197315 23743 consensus_peers.cc:597] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.200235 24359 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:37.233469 31673 tablet_bootstrap.cc:492] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=2 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:37.247496 31673 tablet_bootstrap.cc:492] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Bootstrap complete.
I20260709 13:11:37.253630 31673 ts_tablet_manager.cc:1403] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent bootstrapping tablet: real 0.597s	user 0.047s	sys 0.005s
I20260709 13:11:37.257486 31673 raft_consensus.cc:359] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:11:37.275874 31673 raft_consensus.cc:740] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: b1e32a12daf44ebbbd71cc3ce41d7d8e, State: Initialized, Role: LEARNER
I20260709 13:11:37.276762 31673 consensus_queue.cc:260] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: NON_VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: true } }
I20260709 13:11:37.309137 31673 ts_tablet_manager.cc:1434] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.004s
I20260709 13:11:37.320710 23714 tablet_copy_service.cc:342] P c885217113574e7489e6c3afb6950f76: Request end of tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-e8c18a99e9414e39bff9dea9564bd61b received from {username='slave'} at 127.0.0.1:54670
I20260709 13:11:37.321382 23714 tablet_copy_service.cc:434] P c885217113574e7489e6c3afb6950f76: ending tablet copy session b1e32a12daf44ebbbd71cc3ce41d7d8e-e8c18a99e9414e39bff9dea9564bd61b on tablet e8c18a99e9414e39bff9dea9564bd61b with peer b1e32a12daf44ebbbd71cc3ce41d7d8e
W20260709 13:11:37.372170 23743 consensus_peers.cc:597] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:37.392817 24359 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:37.410548 24385 raft_consensus.cc:1217] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
W20260709 13:11:37.502590 23743 consensus_peers.cc:597] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.520568 23743 consensus_peers.cc:597] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.543942 24359 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:37.548766 24359 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:37.583637 23743 consensus_peers.cc:597] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:37.602584 24385 raft_consensus.cc:1217] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEARNER]: Deduplicated request from leader. Original: 17.8->[17.9-17.9]   Dedup: 17.9->[]
W20260709 13:11:37.614043 23743 consensus_peers.cc:597] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.628006 24359 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:37.654883 23669 consensus_peers.cc:597] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.694969 23743 consensus_peers.cc:597] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:37.784034 23743 consensus_peers.cc:597] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:37.916412 23743 consensus_peers.cc:597] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:37.938527 31690 raft_consensus.cc:1064] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:11:37.941483 31690 consensus_queue.cc:237] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:37.972321 23743 consensus_peers.cc:597] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:37.974013 23773 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:37.977430 31690 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:37.979914 24391 raft_consensus.cc:1275] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEARNER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:11:37.981925 23669 consensus_peers.cc:597] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:37.983803 31618 consensus_queue.cc:1048] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:38.015837 31620 raft_consensus.cc:2955] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:38.018183 23773 raft_consensus.cc:2955] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:11:38.046270 22480 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 23650)
I20260709 13:11:38.048416 24391 raft_consensus.cc:2955] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:38.054545 23526 catalog_manager.cc:5697] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 reported cstate change: config changed from index 11 to 12, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.070808 31690 raft_consensus.cc:1064] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: attempting to promote NON_VOTER b1e32a12daf44ebbbd71cc3ce41d7d8e to VOTER
I20260709 13:11:38.073531 31690 consensus_queue.cc:237] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 7, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:38.136013 23743 consensus_peers.cc:597] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:38.144806 23773 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:38.146114 24391 raft_consensus.cc:1275] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEARNER]: Refusing update from remote peer c885217113574e7489e6c3afb6950f76: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:38.153556 31620 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:11:38.162227 31618 consensus_queue.cc:1048] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:38.190821 23669 consensus_peers.cc:597] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:38.197754 23743 consensus_peers.cc:597] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.247696 23669 consensus_peers.cc:597] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.261135 24359 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:38.265021 23668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:36767, user_credentials={real_user=slave}} blocked reactor thread for 82639us
I20260709 13:11:38.283502 31576 raft_consensus.cc:2955] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index 9 to 10, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:11:38.298408 23669 consensus_peers.cc:597] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:38.297783 23772 raft_consensus.cc:2955] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index 9 to 10, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:11:38.328594 23669 consensus_peers.cc:597] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.331277 23743 consensus_peers.cc:597] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.334765 23743 consensus_peers.cc:597] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.334235 23669 consensus_peers.cc:597] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.349013 23669 consensus_peers.cc:597] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.359491 23669 consensus_peers.cc:597] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:38.378865 23527 catalog_manager.cc:5697] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: config changed from index 9 to 10, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "c885217113574e7489e6c3afb6950f76" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
I20260709 13:11:38.400959 24391 raft_consensus.cc:2955] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index 9 to 10, b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } } }
W20260709 13:11:38.423278 23669 consensus_peers.cc:597] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.423898 23669 consensus_peers.cc:597] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.429524 23669 consensus_peers.cc:597] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.448530 23669 consensus_peers.cc:597] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.473315 23669 consensus_peers.cc:597] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:38.513859 23669 consensus_peers.cc:597] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:38.549289 23669 consensus_peers.cc:597] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.621946 23669 consensus_peers.cc:597] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:38.715245 23669 consensus_peers.cc:597] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:38.785244 23743 consensus_peers.cc:597] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.807307 23669 consensus_peers.cc:597] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:38.896122 23669 consensus_peers.cc:597] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.944192 24359 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:38.954986 23669 consensus_peers.cc:597] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:39.022140 24359 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:39.134562 23669 consensus_peers.cc:597] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:39.215296 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8f80c880e2784395811b9b9ab65aaf82: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:39.386356 23743 consensus_peers.cc:597] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:39.474263 23743 consensus_peers.cc:597] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.538723 24359 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.551247 24359 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.604789 24359 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:39.668757 22480 tablet_server.cc:196] TabletServer@127.21.244.1:0 shutdown complete.
W20260709 13:11:39.808694 24359 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.900856 23743 consensus_peers.cc:597] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:39.901607 23743 consensus_peers.cc:597] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:39.908347 22480 tablet_server.cc:179] TabletServer@127.21.244.2:0 shutting down...
W20260709 13:11:39.921366 23743 consensus_peers.cc:597] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.930259 23742 consensus_peers.cc:597] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:39.979557 23742 consensus_peers.cc:597] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:39.981941 24358 consensus_peers.cc:597] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:39.997160 23743 consensus_peers.cc:597] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.007047 23742 consensus_peers.cc:597] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.009081 24358 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.017608 23742 consensus_peers.cc:597] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.044014 24357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:45959, user_credentials={real_user=slave}} blocked reactor thread for 52074.7us
W20260709 13:11:40.049015 24359 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:40.054203 24358 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 476 similar messages]
W20260709 13:11:40.054389 23742 consensus_peers.cc:597] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.056602 23742 consensus_peers.cc:597] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.060505 23742 consensus_peers.cc:597] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.194283 24358 consensus_peers.cc:597] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.220213 24358 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.245184 24359 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:40.246021 24359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:37537, user_credentials={real_user=slave}} blocked reactor thread for 43631.1us
W20260709 13:11:40.253880 24358 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.254941 24358 consensus_peers.cc:597] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.256031 23725 debug-util.cc:398] Leaking SignalData structure 0x7b08003170c0 after lost signal to thread 22483
W20260709 13:11:40.258461 23725 debug-util.cc:398] Leaking SignalData structure 0x7b0800334580 after lost signal to thread 23561
W20260709 13:11:40.262897 23725 debug-util.cc:398] Leaking SignalData structure 0x7b08000fc0a0 after lost signal to thread 23728
W20260709 13:11:40.264873 23725 debug-util.cc:398] Leaking SignalData structure 0x7b080015ff80 after lost signal to thread 23802
W20260709 13:11:40.269253 23743 consensus_peers.cc:597] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.269943 23743 consensus_peers.cc:597] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:40.270502 23743 consensus_peers.cc:597] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:40.274061 23725 debug-util.cc:398] Leaking SignalData structure 0x7b080022d100 after lost signal to thread 24418
W20260709 13:11:40.281008 24359 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:40.299755 23742 consensus_peers.cc:597] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.330341 24358 consensus_peers.cc:597] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.339996 24358 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.341925 23742 consensus_peers.cc:597] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.350008 23742 consensus_peers.cc:597] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.351872 23742 consensus_peers.cc:597] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.359122 23742 consensus_peers.cc:597] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.360584 23742 consensus_peers.cc:597] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.365947 23743 consensus_peers.cc:597] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:40.369072 23742 consensus_peers.cc:597] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.393622 24358 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.401732 23742 consensus_peers.cc:597] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.442577 23742 consensus_peers.cc:597] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.453604 23743 consensus_peers.cc:597] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:40.497056 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:40.502640 22480 tablet_replica.cc:333] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.508394 22480 raft_consensus.cc:2243] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.510387 22480 raft_consensus.cc:2272] T 01ec1d400f174350acc92722149e02d4 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.519542 22480 tablet_replica.cc:333] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.534034 22480 raft_consensus.cc:2243] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.544706 22480 raft_consensus.cc:2272] T 9e3b7e5b938d488e915e4b83c40e6e1d P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.564145 22480 tablet_replica.cc:333] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.565181 22480 raft_consensus.cc:2243] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.566239 22480 raft_consensus.cc:2272] T a0d6af36909c4398a1ec8496f1dde507 P c885217113574e7489e6c3afb6950f76 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.570035 22480 tablet_replica.cc:333] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.584584 22480 raft_consensus.cc:2243] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.591842 22480 raft_consensus.cc:2272] T da6c8d6f775147c1807ebd5917f806a8 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.607467 22480 tablet_replica.cc:333] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.608685 22480 raft_consensus.cc:2243] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.610878 22480 raft_consensus.cc:2272] T 80466d92afe9453b9cd96ab9f7f593dc P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.623502 22480 tablet_replica.cc:333] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76: stopping tablet replica
W20260709 13:11:40.629276 23743 consensus_peers.cc:597] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:40.633365 22480 raft_consensus.cc:2243] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.636782 22480 raft_consensus.cc:2272] T f7ba611dbb174024a86916a09b17660c P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.649744 22480 tablet_replica.cc:333] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.650933 22480 raft_consensus.cc:2243] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.655251 22480 raft_consensus.cc:2272] T 36da9377816744739720cb01b6191368 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.671679 22480 tablet_replica.cc:333] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.673740 22480 raft_consensus.cc:2243] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:40.676816 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.677440 22480 raft_consensus.cc:2272] T 0c9e0e43fe5147ef802644460230dc6f P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.684752 22480 tablet_replica.cc:333] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.685851 22480 raft_consensus.cc:2243] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.686805 22480 raft_consensus.cc:2272] T ce71536613184c6d869077ae232876cc P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.701668 22480 tablet_replica.cc:333] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.702965 22480 raft_consensus.cc:2243] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.704263 22480 raft_consensus.cc:2272] T 737154dff44a498f96f906fc83416830 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:40.709103 23743 consensus_peers.cc:597] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:40.715257 22480 tablet_replica.cc:333] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.717348 22480 raft_consensus.cc:2243] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.734220 22480 raft_consensus.cc:2272] T ec11dcde267d48f4b479e4ffb468a0bc P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.737969 22480 tablet_replica.cc:333] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.752542 22480 raft_consensus.cc:2243] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.753517 22480 raft_consensus.cc:2272] T 3eff2185a07540f08c005b02304d15ad P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.757126 22480 tablet_replica.cc:333] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.764415 22480 raft_consensus.cc:2243] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.765816 22480 raft_consensus.cc:2272] T f0854ca8274d49df9583c253583ec3d7 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.770027 22480 tablet_replica.cc:333] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.774243 22480 raft_consensus.cc:2243] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.775192 22480 raft_consensus.cc:2272] T ee650b0b99c4413293e36b0fa9631151 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.778628 22480 tablet_replica.cc:333] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
W20260709 13:11:40.786041 24359 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:40.790122 22480 raft_consensus.cc:2243] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.795408 22480 raft_consensus.cc:2272] T 8f80c880e2784395811b9b9ab65aaf82 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.799646 22480 tablet_replica.cc:333] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.800508 22480 raft_consensus.cc:2243] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.801712 22480 raft_consensus.cc:2272] T 0ab3e50aa3864da9beb30247f660a030 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:40.803386 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.804754 22480 tablet_replica.cc:333] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.805691 22480 raft_consensus.cc:2243] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.806524 22480 raft_consensus.cc:2272] T e65f1370869c4d4eb4d8f7be8a50f45f P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.825142 22480 tablet_replica.cc:333] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.826490 22480 raft_consensus.cc:2243] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.830188 22480 raft_consensus.cc:2272] T 55436fc3614f4f558828ea5de361e5f0 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.834290 22480 tablet_replica.cc:333] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.835325 22480 raft_consensus.cc:2243] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.838131 22480 raft_consensus.cc:2272] T e8c18a99e9414e39bff9dea9564bd61b P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.842336 22480 tablet_replica.cc:333] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.843393 22480 raft_consensus.cc:2243] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.846168 22480 raft_consensus.cc:2272] T d67625249f734ae3b71d554b7a2ba33b P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.849787 22480 tablet_replica.cc:333] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.850807 22480 raft_consensus.cc:2243] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.852308 22480 raft_consensus.cc:2272] T 8126e5c9a36b4a6e859566d2a92590e6 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.856032 22480 tablet_replica.cc:333] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.857172 22480 raft_consensus.cc:2243] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.858069 22480 raft_consensus.cc:2272] T b8b889a8b97443f781c7eef38dba2f96 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.861487 22480 tablet_replica.cc:333] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.862923 22480 raft_consensus.cc:2243] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.863876 22480 raft_consensus.cc:2272] T 1000e2c5e53d429ba2126c263f2e8a6d P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.867326 22480 tablet_replica.cc:333] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.868516 22480 raft_consensus.cc:2243] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.870247 22480 raft_consensus.cc:2272] T 38286c47d38c4f9084acbb510661dcfa P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.874620 22480 tablet_replica.cc:333] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.875938 22480 raft_consensus.cc:2243] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.877230 22480 raft_consensus.cc:2272] T 2033291a683e4f2b8c99fb6fa6d479f8 P c885217113574e7489e6c3afb6950f76 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.881217 22480 tablet_replica.cc:333] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.882272 22480 raft_consensus.cc:2243] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.884109 22480 raft_consensus.cc:2272] T f5cd55b231da4c27b7547a2714bb43d9 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.887678 22480 tablet_replica.cc:333] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.888916 22480 raft_consensus.cc:2243] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.890038 22480 raft_consensus.cc:2272] T eb27ed2f4a5b46d5a40126f9893f0c3c P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.893816 22480 tablet_replica.cc:333] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.894969 22480 raft_consensus.cc:2243] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.896413 22480 raft_consensus.cc:2272] T 0fcdc335ab6748159bae3d8308e238ae P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.900192 22480 tablet_replica.cc:333] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.901412 22480 raft_consensus.cc:2243] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.902446 22480 raft_consensus.cc:2272] T b7656d11fa2f4f27beac8e46f9f20be9 P c885217113574e7489e6c3afb6950f76 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.906284 22480 tablet_replica.cc:333] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.907359 22480 raft_consensus.cc:2243] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.908697 22480 raft_consensus.cc:2272] T 2906fc04ac3a43e5a91763bfbd1ff990 P c885217113574e7489e6c3afb6950f76 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.912264 22480 tablet_replica.cc:333] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.913370 22480 raft_consensus.cc:2243] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.914433 22480 raft_consensus.cc:2272] T dbdbb7d679eb4d0d935669cb839c12c0 P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.917821 22480 tablet_replica.cc:333] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.918963 22480 raft_consensus.cc:2243] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.922426 22480 raft_consensus.cc:2272] T bc5bb39aaf4940fb9d34ec725193ca2c P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.926064 22480 tablet_replica.cc:333] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.927121 22480 raft_consensus.cc:2243] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.928568 22480 raft_consensus.cc:2272] T 6baa103a3f5c4452b91dd335e0c94373 P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.932358 22480 tablet_replica.cc:333] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.933498 22480 raft_consensus.cc:2243] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.935285 22480 raft_consensus.cc:2272] T 4a97c483343c425ea75f1f6632924819 P c885217113574e7489e6c3afb6950f76 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.938910 22480 tablet_replica.cc:333] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.940042 22480 raft_consensus.cc:2243] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.941082 22480 raft_consensus.cc:2272] T 3473b09c073142659e12a365e9aed3f3 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.944437 22480 tablet_replica.cc:333] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.945523 22480 raft_consensus.cc:2243] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.947253 22480 raft_consensus.cc:2272] T c455a888f1c64ea3a1c2ae56502f7432 P c885217113574e7489e6c3afb6950f76 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.950764 22480 tablet_replica.cc:333] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.951938 22480 raft_consensus.cc:2243] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.953708 22480 raft_consensus.cc:2272] T 88d337bff4764c8591ac46843de3fa91 P c885217113574e7489e6c3afb6950f76 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.957581 22480 tablet_replica.cc:333] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.958720 22480 raft_consensus.cc:2243] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.960788 22480 raft_consensus.cc:2272] T 8a0f95eab8184aa59b6fcef0d9f32b0f P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.964685 22480 tablet_replica.cc:333] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.965945 22480 raft_consensus.cc:2243] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.967777 22480 raft_consensus.cc:2272] T 1614a6a9a62040cab19c65c57018c05e P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.972612 22480 tablet_replica.cc:333] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.973826 22480 raft_consensus.cc:2243] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.975625 22480 raft_consensus.cc:2272] T d52390cad487467d9b1b0b951d9300b7 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.980012 22480 tablet_replica.cc:333] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.981057 22480 raft_consensus.cc:2243] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.982656 22480 raft_consensus.cc:2272] T a325d91f6c384021a7930b39886904d2 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.986425 22480 tablet_replica.cc:333] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.987493 22480 raft_consensus.cc:2243] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.989321 22480 raft_consensus.cc:2272] T b55528b161184b85a266eb8c58844016 P c885217113574e7489e6c3afb6950f76 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.992841 22480 tablet_replica.cc:333] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:40.993963 22480 raft_consensus.cc:2243] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.995536 22480 raft_consensus.cc:2272] T 71fc75ce25404089ad5bf00f9dd40cbd P c885217113574e7489e6c3afb6950f76 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.999646 22480 tablet_replica.cc:333] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:41.001065 22480 raft_consensus.cc:2243] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.002411 22480 raft_consensus.cc:2272] T 819369bff57548ee8188f19ea4e8f622 P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.006117 22480 tablet_replica.cc:333] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:41.007164 22480 raft_consensus.cc:2243] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.008867 22480 raft_consensus.cc:2272] T 161b847a6eca457eb80fb6cb57531127 P c885217113574e7489e6c3afb6950f76 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.012706 22480 tablet_replica.cc:333] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:41.013701 22480 raft_consensus.cc:2243] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.014648 22480 raft_consensus.cc:2272] T 7479a1f927d94d5e873a594847f4ee10 P c885217113574e7489e6c3afb6950f76 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.018258 22480 tablet_replica.cc:333] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:41.019290 22480 raft_consensus.cc:2243] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.021026 22480 raft_consensus.cc:2272] T 2d951ceae2c04062b838b8fec5fbcc9f P c885217113574e7489e6c3afb6950f76 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.024379 22480 tablet_replica.cc:333] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:41.025365 22480 raft_consensus.cc:2243] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.026342 22480 raft_consensus.cc:2272] T aff661e739d84f06b43002ae9d8ae607 P c885217113574e7489e6c3afb6950f76 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.029845 22480 tablet_replica.cc:333] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:41.030803 22480 raft_consensus.cc:2243] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.031875 22480 raft_consensus.cc:2272] T 334c9018414947cabb4405ef47b8018e P c885217113574e7489e6c3afb6950f76 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.035586 22480 tablet_replica.cc:333] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76: stopping tablet replica
I20260709 13:11:41.036470 22480 raft_consensus.cc:2243] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.037750 22480 raft_consensus.cc:2272] T a17c243311054979a1c285f2ef18d20e P c885217113574e7489e6c3afb6950f76 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:41.077525 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.078065 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.078472 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.078845 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.098057 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.098836 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.142913 23667 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.160069 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.160589 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.160914 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.161214 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.161468 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.161700 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.161957 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.162276 23668 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.178890 23743 consensus_peers.cc:597] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:41.179548 23743 consensus_peers.cc:597] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:41.180415 23743 consensus_peers.cc:597] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:41.186887 23670 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.263229 23742 connection.cc:573] client connection to 127.21.244.2:44167 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:11:41.270269 24358 connection.cc:573] client connection to 127.21.244.2:44167 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:11:41.655390 24359 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:41.691252 23743 consensus_peers.cc:597] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:41.708384 24359 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:41.778656 31733 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.779338 31733 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:41.786895 31734 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.787515 31734 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:41.795454 24358 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:41.796336 24359 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:41.805254 24358 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:41.805764 24358 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.807003 31714 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:41.808940 31734 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:41.811154 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:41.813340 24359 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.819852 24359 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.814452 31733 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:41.822324 23558 debug-util.cc:398] Leaking SignalData structure 0x7b08003363e0 after lost signal to thread 22483
W20260709 13:11:41.823607 23558 debug-util.cc:398] Leaking SignalData structure 0x7b080033cb60 after lost signal to thread 23561
W20260709 13:11:41.824301 23558 debug-util.cc:398] Leaking SignalData structure 0x7b08001488c0 after lost signal to thread 23728
W20260709 13:11:41.825364 23558 debug-util.cc:398] Leaking SignalData structure 0x7b08002160e0 after lost signal to thread 23802
W20260709 13:11:41.826699 23558 debug-util.cc:398] Leaking SignalData structure 0x7b08002d52e0 after lost signal to thread 24418
I20260709 13:11:41.828222 31737 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:41.847653 31728 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.848052 31727 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.848342 31728 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
I20260709 13:11:41.848657 31727 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:41.850688 31728 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:41.851419 31728 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.851890 31728 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:41.853952 31728 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:41.859825 31728 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.860316 31734 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.860445 31728 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:41.861464 23742 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:41.862028 23742 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:41.861122 31734 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:41.865872 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
W20260709 13:11:41.866811 23743 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.850688 31727 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:41.869697 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:41.872205 24385 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:41.863402 31728 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:41.871466 23743 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:41.874527 23743 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.875324 23743 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:41.872238 23742 leader_election.cc:336] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:41.875852 31730 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:11:41.876686 31733 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.877471 31733 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:41.879606 31727 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:41.880151 31734 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:41.881125 31733 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:41.887969 23742 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:41.882783 23743 leader_election.cc:336] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.888718 23743 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.889597 31727 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:41.892627 23743 consensus_peers.cc:597] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:41.894982 24358 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:41.898506 24358 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.900902 31727 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.901670 31727 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:41.903766 31728 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.904143 31727 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:41.904424 31728 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:41.905778 31733 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:41.906626 24359 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.906700 31728 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:41.900231 23743 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.907848 23743 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.908653 31728 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:41.916657 31733 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.917409 31733 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:41.921011 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:41.920334 31733 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:41.923022 24358 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:41.923484 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.924685 31733 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:41.921156 23742 leader_election.cc:336] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:41.926504 23742 leader_election.cc:336] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:41.927502 31728 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.928128 31728 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:41.930424 31728 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:41.935149 31728 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.935707 31728 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:41.936102 23742 leader_election.cc:336] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:41.936944 31727 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:41.927999 23743 leader_election.cc:336] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.937419 31727 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:41.937942 31728 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:41.938037 23743 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.939101 31728 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:41.939319 23743 leader_election.cc:336] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.939616 31727 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:41.943928 23743 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:41.942992 24358 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:41.944974 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.945930 31727 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:41.949029 31733 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:11:41.953051 23742 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:41.954161 23742 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:41.970450 31733 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.971076 31733 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:41.971942 23743 leader_election.cc:336] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.972409 23743 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.973122 31727 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:41.973415 31733 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:41.974090 23743 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.975618 23743 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.976452 31727 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:41.977553 23743 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.978076 23743 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.978879 31727 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:41.983620 24358 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:41.984598 24359 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:41.985049 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:41.985831 31733 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:41.995117 31733 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:41.995808 31733 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:41.998320 31733 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:42.007997 31734 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.010955 31734 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:42.010109 24358 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:42.013183 24359 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:42.018591 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:42.015398 24359 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:42.026250 31733 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:42.028048 31734 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:42.028635 24358 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.029405 24358 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:42.030458 31734 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:42.034260 24359 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:42.036151 31727 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.036753 31727 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:42.039047 31727 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:42.044528 23743 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:42.049396 23742 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.050753 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:42.049975 31727 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.052043 31727 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:42.052413 31728 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:42.054816 31727 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:42.057058 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:42.058879 24385 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 25.
I20260709 13:11:42.061262 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:42.069949 31727 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:42.070508 31727 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.072891 31727 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:42.074517 23742 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.081080 31728 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.081686 31728 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:42.083856 31728 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:42.088765 23743 leader_election.cc:336] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:42.099784 23742 leader_election.cc:336] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.107267 31728 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.108009 31728 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:42.110194 31728 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:42.115274 23743 leader_election.cc:336] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:42.115362 24359 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:42.116425 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:42.117301 31728 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:42.133088 31730 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.133759 31730 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:42.134466 31728 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.135075 31728 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:42.136346 31730 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:42.137980 31728 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:42.144543 23743 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:42.150736 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:42.151418 24385 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:42.152697 31728 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.153379 31728 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:42.155045 24359 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:42.158336 31728 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:42.146538 31727 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:42.163326 31730 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.164674 31730 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:42.167484 31730 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:42.170351 31727 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:42.171409 23742 leader_election.cc:336] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.175305 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:42.172047 23743 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:42.179852 31730 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:42.186686 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:42.187500 24385 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:42.192812 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52390cad487467d9b1b0b951d9300b7" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:42.194741 24385 raft_consensus.cc:3060] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:42.202582 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:42.204226 24385 raft_consensus.cc:2468] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 26.
W20260709 13:11:42.211520 23743 leader_election.cc:336] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:42.211829 31727 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:42.212260 31727 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.212682 31727 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:42.211548 23742 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:42.216282 31741 raft_consensus.cc:2804] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:42.216866 31741 raft_consensus.cc:697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:42.222739 31727 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:42.225438 31727 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
I20260709 13:11:42.223394 31741 consensus_queue.cc:237] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:42.230794 31727 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.231421 31727 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:42.232703 31734 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.233302 31734 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:42.233963 31727 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:42.237402 23743 consensus_peers.cc:597] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:42.235459 31734 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:42.244979 24358 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.245743 31741 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.246598 31741 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:42.248662 31741 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:42.249415 23773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" is_pre_election: true
I20260709 13:11:42.251525 24357 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:42.252874 31734 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:42.252740 23527 catalog_manager.cc:5697] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 25 to 26, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 26 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:42.227547 23742 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.254654 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:42.255698 23742 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.257470 31742 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:42.249044 23743 leader_election.cc:336] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:42.265048 23743 leader_election.cc:336] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:42.270512 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec11dcde267d48f4b479e4ffb468a0bc" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:42.271272 24385 raft_consensus.cc:3060] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:42.281383 22480 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23725)
I20260709 13:11:42.283918 31741 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.284633 31741 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:42.286970 31741 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:42.287403 23742 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.296267 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:42.297214 31741 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:42.297505 23742 leader_election.cc:336] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.298090 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:42.298959 31741 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:42.294369 24385 raft_consensus.cc:2468] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 18.
W20260709 13:11:42.299089 23742 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.315143 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
I20260709 13:11:42.316004 24385 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 22.
I20260709 13:11:42.321975 31742 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.322618 31742 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:42.325985 31742 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:42.329016 23742 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
I20260709 13:11:42.329908 31742 raft_consensus.cc:2804] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:42.330792 31742 raft_consensus.cc:697] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:42.331897 31742 consensus_queue.cc:237] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:42.333007 24359 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:42.334643 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 
W20260709 13:11:42.335192 23743 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:42.338716 23742 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.338920 31741 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:11:42.340256 23742 leader_election.cc:336] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.343173 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:42.344236 31743 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:42.345729 23742 leader_election.cc:336] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.346876 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:42.348721 31743 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:42.349427 24359 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:42.342931 31741 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:42.350401 31741 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:42.358892 23742 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.364435 31741 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:42.366778 31741 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Requested vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:42.364477 23742 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.367933 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:42.369817 31741 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:42.372812 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f80c880e2784395811b9b9ab65aaf82" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e"
I20260709 13:11:42.373440 24385 raft_consensus.cc:3060] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:42.381417 23742 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:42.395428 24385 raft_consensus.cc:2468] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 23.
I20260709 13:11:42.407779 23742 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: c885217113574e7489e6c3afb6950f76
I20260709 13:11:42.409876 23527 catalog_manager.cc:5697] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 17 to 18, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 18 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.412331 31741 raft_consensus.cc:2804] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:42.413998 31741 raft_consensus.cc:697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 LEADER]: Becoming Leader. State: Replica: 4466bf6d6cf84ee89e84ea074e3964c9, State: Running, Role: LEADER
I20260709 13:11:42.415022 31741 consensus_queue.cc:237] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:42.423046 23742 consensus_peers.cc:597] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:42.470769 23527 catalog_manager.cc:5697] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 reported cstate change: term changed from 22 to 23, leader changed from c885217113574e7489e6c3afb6950f76 (127.21.244.2) to 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3). New cstate: current_term: 23 leader_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:42.472537 23742 consensus_peers.cc:597] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.493861 23743 consensus_peers.cc:597] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:42.620649 23742 consensus_peers.cc:597] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:42.623746 24359 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:42.633337 24358 consensus_peers.cc:597] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.643366 24358 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.669015 24358 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.689565 23742 consensus_peers.cc:597] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.692108 24358 consensus_peers.cc:597] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.693454 23742 consensus_peers.cc:597] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.708357 23743 consensus_peers.cc:597] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:42.717549 23742 consensus_peers.cc:597] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:42.726121 23743 consensus_peers.cc:597] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:42.732007 23743 consensus_peers.cc:597] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:42.766806 23743 consensus_peers.cc:597] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:42.767431 23743 consensus_peers.cc:597] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:42.799001 24359 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:42.850888 24385 raft_consensus.cc:1275] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:11:42.852667 31741 consensus_queue.cc:1048] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:11:42.875880 24386 raft_consensus.cc:1275] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:11:42.876947 24359 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:42.882332 31743 consensus_queue.cc:1048] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:11:42.884696 23743 consensus_peers.cc:597] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:42.934331 24385 raft_consensus.cc:1275] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Refusing update from remote peer 4466bf6d6cf84ee89e84ea074e3964c9: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:11:42.952383 31742 consensus_queue.cc:1048] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:11:42.959296 24358 consensus_peers.cc:597] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.018708 24358 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.044266 23743 consensus_peers.cc:597] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:43.115475 24358 consensus_peers.cc:597] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.198315 24358 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.256202 23743 consensus_peers.cc:597] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:43.275700 23743 consensus_peers.cc:597] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:43.282094 22480 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23725)
W20260709 13:11:43.314293 24358 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.388522 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8f80c880e2784395811b9b9ab65aaf82: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:43.447669 23743 consensus_peers.cc:597] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:43.477506 24359 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:43.495678 23743 consensus_peers.cc:597] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:43.537389 31741 raft_consensus.cc:493] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.537952 31741 raft_consensus.cc:515] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:43.541478 31741 leader_election.cc:290] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:43.544646 23743 leader_election.cc:336] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:43.593914 31741 raft_consensus.cc:493] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.594491 31741 raft_consensus.cc:515] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:43.596695 31741 leader_election.cc:290] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:43.601713 23743 leader_election.cc:336] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:43.616516 23743 consensus_peers.cc:597] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:43.618427 31741 raft_consensus.cc:493] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.618988 31741 raft_consensus.cc:515] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:43.621351 31741 leader_election.cc:290] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:43.628261 23743 leader_election.cc:336] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:43.693573 31741 raft_consensus.cc:493] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.694108 31741 raft_consensus.cc:515] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:43.696393 31741 leader_election.cc:290] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:43.702862 23743 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:43.715044 23743 consensus_peers.cc:597] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:43.717253 31734 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.717931 31734 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:43.735596 31734 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:43.733129 24358 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:43.749402 31741 raft_consensus.cc:493] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.750092 31741 raft_consensus.cc:515] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } }
W20260709 13:11:43.751901 24359 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:43.752462 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:43.752506 31741 leader_election.cc:290] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:43.758574 31761 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:11:43.764858 23742 consensus_peers.cc:597] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.768123 23743 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:43.776875 23742 consensus_peers.cc:597] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.784649 23742 consensus_peers.cc:597] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.785310 23742 consensus_peers.cc:597] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.785787 23742 consensus_peers.cc:597] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:43.786329 23742 consensus_peers.cc:597] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.787146 23742 leader_election.cc:336] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:43.787460 23742 leader_election.cc:304] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:43.788614 23742 leader_election.cc:336] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:43.788910 23742 leader_election.cc:304] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
W20260709 13:11:43.789506 23742 leader_election.cc:336] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:43.789794 23742 leader_election.cc:304] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:43.792285 31743 raft_consensus.cc:2749] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:43.795876 31743 raft_consensus.cc:2749] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:43.796553 31743 raft_consensus.cc:493] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.796980 31743 raft_consensus.cc:515] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:43.792095 31741 raft_consensus.cc:2749] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:43.806730 31743 leader_election.cc:290] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:43.813457 31741 raft_consensus.cc:493] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.814004 31741 raft_consensus.cc:515] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:43.818066 23743 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:43.824626 31741 leader_election.cc:290] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:43.828794 23743 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:43.843992 23742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:44167, user_credentials={real_user=slave}} blocked reactor thread for 54489.7us
W20260709 13:11:43.845201 23742 leader_election.cc:336] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:43.845695 23742 leader_election.cc:304] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:43.847927 31762 raft_consensus.cc:2749] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:43.854823 23742 consensus_peers.cc:597] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.855444 23742 consensus_peers.cc:597] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:43.855989 23742 consensus_peers.cc:597] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.856498 23742 consensus_peers.cc:597] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.857338 23742 consensus_peers.cc:597] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.858345 31762 raft_consensus.cc:493] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.858904 31762 raft_consensus.cc:515] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:43.861294 31762 leader_election.cc:290] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:43.865314 23743 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:43.867790 23742 leader_election.cc:336] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:43.871891 23742 leader_election.cc:304] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:43.874926 31762 raft_consensus.cc:2749] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:43.876288 23742 leader_election.cc:336] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:43.876865 23742 leader_election.cc:304] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:43.877681 31762 raft_consensus.cc:2749] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:43.878857 23742 leader_election.cc:336] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:43.879352 23742 leader_election.cc:304] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:43.880460 31741 raft_consensus.cc:2749] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:43.886387 23742 leader_election.cc:336] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:43.887809 23742 leader_election.cc:304] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:43.888808 31741 raft_consensus.cc:2749] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:11:43.891319 31741 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.891948 31741 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:43.898051 31743 raft_consensus.cc:493] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.898662 31743 raft_consensus.cc:515] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:43.900867 31743 leader_election.cc:290] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:43.921955 31741 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:43.920964 23743 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:43.927582 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c18a99e9414e39bff9dea9564bd61b" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:43.928067 23743 leader_election.cc:336] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:43.928453 24386 raft_consensus.cc:2468] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:43.929945 31762 raft_consensus.cc:493] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.930517 31762 raft_consensus.cc:515] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:43.932859 31762 leader_election.cc:290] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:43.938308 23743 leader_election.cc:336] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:43.942028 31734 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.942708 31734 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:43.957005 24358 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:43.958148 24359 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:43.959244 24359 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:43.960114 31762 raft_consensus.cc:493] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:43.960661 31762 raft_consensus.cc:515] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:43.958674 31734 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:43.965647 31733 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:43.970885 23743 leader_election.cc:336] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:43.980924 31762 leader_election.cc:290] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:43.998746 23742 leader_election.cc:336] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:43.999497 23742 leader_election.cc:304] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.000669 31762 raft_consensus.cc:2749] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:44.000934 23742 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:44.001529 23742 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.002830 31762 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:44.007825 31734 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:44.008472 31734 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:44.010934 31734 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:44.023880 24359 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:44.026788 24358 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:44.027913 24358 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.030747 31734 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:44.056178 31762 raft_consensus.cc:493] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:44.056838 31762 raft_consensus.cc:515] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:44.059015 31762 leader_election.cc:290] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:44.064798 23743 leader_election.cc:336] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:44.070401 31734 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:44.071053 31734 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:44.073371 31734 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:44.080631 23742 leader_election.cc:336] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:44.087821 23742 leader_election.cc:304] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.089277 31743 raft_consensus.cc:2749] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:11:44.086757 24359 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:44.090855 24358 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:44.091768 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.095403 31734 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:44.097651 31762 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
W20260709 13:11:44.098469 23742 leader_election.cc:336] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:44.098228 31762 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:44.098981 23742 leader_election.cc:304] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.099669 31763 raft_consensus.cc:2749] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:44.103072 31762 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), b1e32a12daf44ebbbd71cc3ce41d7d8e (127.21.244.4:36767)
W20260709 13:11:44.110050 23743 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:44.111446 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0f95eab8184aa59b6fcef0d9f32b0f" candidate_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" is_pre_election: true
W20260709 13:11:44.111809 23742 leader_election.cc:336] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:44.112214 24386 raft_consensus.cc:2468] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4466bf6d6cf84ee89e84ea074e3964c9 in term 17.
I20260709 13:11:44.113765 23742 leader_election.cc:304] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.118577 31762 raft_consensus.cc:2749] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:44.126835 23742 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:44.133504 23742 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9, b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.135943 31762 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:44.146438 23742 consensus_peers.cc:597] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:44.182914 31762 raft_consensus.cc:493] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:44.183534 31762 raft_consensus.cc:515] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:44.185949 31762 leader_election.cc:290] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:44.233428 24359 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:44.235852 23743 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:44.238085 23742 leader_election.cc:336] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:44.246598 23742 leader_election.cc:304] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.252252 31762 raft_consensus.cc:2749] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:44.305517 23742 consensus_peers.cc:597] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:44.308729 22480 tablet_server.cc:196] TabletServer@127.21.244.2:0 shutdown complete.
W20260709 13:11:44.309396 23743 consensus_peers.cc:597] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:44.325822 31743 raft_consensus.cc:493] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:44.326520 31743 raft_consensus.cc:515] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:44.329427 31743 leader_election.cc:290] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:44.358927 23743 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:44.364034 23743 consensus_peers.cc:597] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:44.366914 23742 leader_election.cc:336] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:44.369134 23742 leader_election.cc:304] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.396900 31762 raft_consensus.cc:2749] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:44.414018 31762 raft_consensus.cc:493] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:44.414599 31762 raft_consensus.cc:515] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
W20260709 13:11:44.421319 23743 leader_election.cc:336] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:44.422509 31762 leader_election.cc:290] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:44.428654 23742 leader_election.cc:336] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:44.429401 23742 leader_election.cc:304] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.430439 31762 raft_consensus.cc:2749] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:44.452162 31762 raft_consensus.cc:493] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:44.452762 31762 raft_consensus.cc:515] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } }
I20260709 13:11:44.455165 31762 leader_election.cc:290] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:44.461866 23743 leader_election.cc:336] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:44.462531 23742 leader_election.cc:336] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:44.463063 23742 leader_election.cc:304] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4466bf6d6cf84ee89e84ea074e3964c9; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:44.463903 31762 raft_consensus.cc:2749] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:44.490727 24359 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:44.642797 22480 tablet_server.cc:179] TabletServer@127.21.244.3:0 shutting down...
W20260709 13:11:44.658371 24359 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.693893 24357 consensus_peers.cc:597] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:44.705758 24359 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.724319 24359 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.747519 24357 consensus_peers.cc:597] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:44.788807 24357 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:44.789296 23743 consensus_peers.cc:597] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.808126 24357 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:44.819993 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:44.823069 22480 tablet_replica.cc:333] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
W20260709 13:11:44.823467 24357 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:44.824301 22480 raft_consensus.cc:2243] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:44.835889 22480 raft_consensus.cc:2272] T 5499c62f40a046f2a8efb671c77f08b3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.839367 22480 tablet_replica.cc:333] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.840451 22480 raft_consensus.cc:2243] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:11:44.841085 24357 consensus_peers.cc:597] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:44.848368 22480 raft_consensus.cc:2272] T 37a8de42d0d8417f9ad5486f22fdbf73 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.851717 22480 tablet_replica.cc:333] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.853080 22480 raft_consensus.cc:2243] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.862653 22480 raft_consensus.cc:2272] T de67ca6156e842db9c8994e493d241ca P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:44.864629 24359 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:44.865869 22480 tablet_replica.cc:333] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.867113 22480 raft_consensus.cc:2243] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:44.872898 22480 raft_consensus.cc:2272] T 9e3b7e5b938d488e915e4b83c40e6e1d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.876091 22480 tablet_replica.cc:333] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.880409 22480 raft_consensus.cc:2243] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.881191 22480 raft_consensus.cc:2272] T f0854ca8274d49df9583c253583ec3d7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.890862 22480 tablet_replica.cc:333] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.891945 22480 raft_consensus.cc:2243] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.892753 22480 raft_consensus.cc:2272] T ee650b0b99c4413293e36b0fa9631151 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.898598 22480 tablet_replica.cc:333] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.902313 22480 raft_consensus.cc:2243] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:11:44.903630 22480 raft_consensus.cc:2272] T 0c9e0e43fe5147ef802644460230dc6f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.918319 22480 tablet_replica.cc:333] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.919504 22480 raft_consensus.cc:2243] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:11:44.922047 22480 raft_consensus.cc:2272] T 8f80c880e2784395811b9b9ab65aaf82 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.933533 22480 tablet_replica.cc:333] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.934643 22480 raft_consensus.cc:2243] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.935431 22480 raft_consensus.cc:2272] T 0ab3e50aa3864da9beb30247f660a030 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.938446 22480 tablet_replica.cc:333] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.946976 22480 raft_consensus.cc:2243] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.947819 22480 raft_consensus.cc:2272] T 55436fc3614f4f558828ea5de361e5f0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.950896 22480 tablet_replica.cc:333] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.951876 22480 raft_consensus.cc:2243] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:44.956892 22480 raft_consensus.cc:2272] T 3eff2185a07540f08c005b02304d15ad P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.961874 22480 tablet_replica.cc:333] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
W20260709 13:11:44.969920 23743 consensus_peers.cc:597] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.973520 24359 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:44.978037 22480 raft_consensus.cc:2243] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:11:44.979545 22480 raft_consensus.cc:2272] T f7ba611dbb174024a86916a09b17660c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:44.980101 24357 consensus_peers.cc:597] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:44.982664 22480 tablet_replica.cc:333] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.983688 22480 raft_consensus.cc:2243] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.984874 22480 raft_consensus.cc:2272] T e8c18a99e9414e39bff9dea9564bd61b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.992937 22480 tablet_replica.cc:333] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:44.993891 22480 raft_consensus.cc:2243] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.001434 22480 raft_consensus.cc:2272] T d67625249f734ae3b71d554b7a2ba33b P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.004575 22480 tablet_replica.cc:333] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
W20260709 13:11:45.005033 24357 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.006991 22480 raft_consensus.cc:2243] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.010257 22480 raft_consensus.cc:2272] T 1000e2c5e53d429ba2126c263f2e8a6d P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.018926 22480 tablet_replica.cc:333] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
W20260709 13:11:45.020139 23743 consensus_peers.cc:597] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:45.025151 22480 raft_consensus.cc:2243] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.031337 22480 raft_consensus.cc:2272] T e65f1370869c4d4eb4d8f7be8a50f45f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.039639 22480 tablet_replica.cc:333] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.041404 22480 raft_consensus.cc:2243] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.048527 22480 raft_consensus.cc:2272] T 8126e5c9a36b4a6e859566d2a92590e6 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.062721 22480 tablet_replica.cc:333] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.065762 22480 raft_consensus.cc:2243] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:45.066737 24358 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111) [suppressed 611 similar messages]
I20260709 13:11:45.066826 22480 raft_consensus.cc:2272] T b8b889a8b97443f781c7eef38dba2f96 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.070338 22480 tablet_replica.cc:333] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.071341 22480 raft_consensus.cc:2243] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.072546 22480 raft_consensus.cc:2272] T 38286c47d38c4f9084acbb510661dcfa P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.083595 22480 tablet_replica.cc:333] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.084731 22480 raft_consensus.cc:2243] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.096486 22480 raft_consensus.cc:2272] T 2033291a683e4f2b8c99fb6fa6d479f8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.107136 22480 tablet_replica.cc:333] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.108448 22480 raft_consensus.cc:2243] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.109928 22480 raft_consensus.cc:2272] T ce71536613184c6d869077ae232876cc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.129731 22480 tablet_replica.cc:333] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.131022 22480 raft_consensus.cc:2243] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.132702 22480 raft_consensus.cc:2272] T ec11dcde267d48f4b479e4ffb468a0bc P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.133993 24359 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:45.136086 22480 tablet_replica.cc:333] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.139528 22480 raft_consensus.cc:2243] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.143769 22480 raft_consensus.cc:2272] T 737154dff44a498f96f906fc83416830 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.145985 24358 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:45.156216 22480 tablet_replica.cc:333] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.159890 22480 raft_consensus.cc:2243] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.160826 22480 raft_consensus.cc:2272] T f5cd55b231da4c27b7547a2714bb43d9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.163686 22480 tablet_replica.cc:333] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.164556 22480 raft_consensus.cc:2243] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.165161 22480 raft_consensus.cc:2272] T 0fcdc335ab6748159bae3d8308e238ae P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.173188 22480 tablet_replica.cc:333] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.174094 22480 raft_consensus.cc:2243] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.175318 22480 raft_consensus.cc:2272] T d5fa82982f53411c84a07a2fb3918888 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.183633 22480 tablet_replica.cc:333] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.184535 22480 raft_consensus.cc:2243] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.196421 22480 raft_consensus.cc:2272] T bc5bb39aaf4940fb9d34ec725193ca2c P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.199218 24357 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.199271 22480 tablet_replica.cc:333] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.207034 22480 raft_consensus.cc:2243] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.207707 22480 raft_consensus.cc:2272] T 6baa103a3f5c4452b91dd335e0c94373 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.208724 24358 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:45.212543 22480 tablet_replica.cc:333] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.213532 22480 raft_consensus.cc:2243] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.215327 22480 raft_consensus.cc:2272] T 4a97c483343c425ea75f1f6632924819 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.218129 22480 tablet_replica.cc:333] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.218977 22480 raft_consensus.cc:2243] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.220199 22480 raft_consensus.cc:2272] T 3473b09c073142659e12a365e9aed3f3 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.222899 22480 tablet_replica.cc:333] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.223830 22480 raft_consensus.cc:2243] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.225062 22480 raft_consensus.cc:2272] T c455a888f1c64ea3a1c2ae56502f7432 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.228096 22480 tablet_replica.cc:333] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.229050 22480 raft_consensus.cc:2243] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.229750 22480 raft_consensus.cc:2272] T 88d337bff4764c8591ac46843de3fa91 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.233031 22480 tablet_replica.cc:333] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.233819 22480 raft_consensus.cc:2243] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.234691 22480 raft_consensus.cc:2272] T 8a0f95eab8184aa59b6fcef0d9f32b0f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.240099 22480 tablet_replica.cc:333] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.241097 22480 raft_consensus.cc:2243] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.242273 22480 raft_consensus.cc:2272] T 1614a6a9a62040cab19c65c57018c05e P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.244958 22480 tablet_replica.cc:333] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.245823 22480 raft_consensus.cc:2243] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.246658 22480 raft_consensus.cc:2272] T aa38658745b04f268c400fe20554d483 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.249408 22480 tablet_replica.cc:333] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.250253 22480 raft_consensus.cc:2243] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.251451 22480 raft_consensus.cc:2272] T 2de1999cb30f49b981475a62d0d0feb9 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.254009 22480 tablet_replica.cc:333] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.254837 22480 raft_consensus.cc:2243] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.256042 22480 raft_consensus.cc:2272] T 819369bff57548ee8188f19ea4e8f622 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.259797 22480 tablet_replica.cc:333] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.265105 22480 raft_consensus.cc:2243] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.265882 22480 raft_consensus.cc:2272] T 71fc75ce25404089ad5bf00f9dd40cbd P 4466bf6d6cf84ee89e84ea074e3964c9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.268877 22480 tablet_replica.cc:333] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.269750 22480 raft_consensus.cc:2243] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.270413 22480 raft_consensus.cc:2272] T 2d951ceae2c04062b838b8fec5fbcc9f P 4466bf6d6cf84ee89e84ea074e3964c9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.273373 22480 tablet_replica.cc:333] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.274865 22480 raft_consensus.cc:2243] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.275626 22480 raft_consensus.cc:2272] T 44b7b7e4ddb143138d48247cb9feb2d4 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.302538 24358 consensus_peers.cc:597] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:45.335955 24358 consensus_peers.cc:597] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:45.341588 24358 consensus_peers.cc:597] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:45.362067 24358 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:45.377677 22480 tablet_replica.cc:333] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.386520 22480 raft_consensus.cc:2243] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.390205 22480 raft_consensus.cc:2272] T 2cf8733dc7d947f08af2274d90145039 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.397697 24359 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:45.407475 22480 tablet_replica.cc:333] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.408600 22480 raft_consensus.cc:2243] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.409577 22480 raft_consensus.cc:2272] T b55528b161184b85a266eb8c58844016 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.412447 22480 tablet_replica.cc:333] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
W20260709 13:11:45.413751 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d67625249f734ae3b71d554b7a2ba33b: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:45.415122 22480 raft_consensus.cc:2243] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.416278 22480 raft_consensus.cc:2272] T d52390cad487467d9b1b0b951d9300b7 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.435879 22480 tablet_replica.cc:333] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.436947 22480 raft_consensus.cc:2243] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.437691 22480 raft_consensus.cc:2272] T a325d91f6c384021a7930b39886904d2 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.440660 22480 tablet_replica.cc:333] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.452365 22480 raft_consensus.cc:2243] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.453147 22480 raft_consensus.cc:2272] T 7479a1f927d94d5e873a594847f4ee10 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.456080 22480 tablet_replica.cc:333] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.456890 22480 raft_consensus.cc:2243] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.458125 22480 raft_consensus.cc:2272] T a0d6af36909c4398a1ec8496f1dde507 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.463115 22480 tablet_replica.cc:333] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.476431 22480 raft_consensus.cc:2243] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.477203 22480 raft_consensus.cc:2272] T da6c8d6f775147c1807ebd5917f806a8 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.479909 22480 tablet_replica.cc:333] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.480665 22480 raft_consensus.cc:2243] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.481356 22480 raft_consensus.cc:2272] T e1f8fde8107545d5a59c6b12b0822584 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.484308 22480 tablet_replica.cc:333] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.485199 22480 raft_consensus.cc:2243] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.486524 22480 raft_consensus.cc:2272] T aff661e739d84f06b43002ae9d8ae607 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.489478 22480 tablet_replica.cc:333] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9: stopping tablet replica
I20260709 13:11:45.493840 22480 raft_consensus.cc:2243] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.499607 22480 raft_consensus.cc:2272] T dbdbb7d679eb4d0d935669cb839c12c0 P 4466bf6d6cf84ee89e84ea074e3964c9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.618060 24358 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:45.669090 31767 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:45.670089 31767 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:45.682461 24359 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:45.689613 31767 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:45.693835 24358 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:45.694483 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:45.695873 31767 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:45.782819 24358 consensus_peers.cc:597] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:45.813961 24358 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:45.841075 31764 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:45.841684 31764 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:45.857869 31764 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:45.865723 24359 leader_election.cc:336] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:45.875837 24357 leader_election.cc:336] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:45.878943 24357 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:45.881273 31764 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:45.882256 24359 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:45.900512 31764 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:45.901230 31764 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:45.919993 24359 leader_election.cc:336] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:45.920931 24357 leader_election.cc:336] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:45.922168 24357 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:45.921663 31764 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:45.923287 31767 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:46.011973 31764 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:46.012579 31764 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:46.025640 24357 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
W20260709 13:11:46.026685 24358 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:46.027110 24358 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:46.027926 31764 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:46.028682 31767 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:46.154850 31764 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:46.155587 31764 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:46.170711 24358 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:46.171868 31764 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:46.181315 24357 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:46.182341 24357 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:46.183832 31764 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:46.287030 31764 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:46.287618 31764 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:46.290002 31764 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:46.295778 24359 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:46.301926 24357 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:46.302510 24357 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:46.303355 31764 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:46.319624 31764 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:46.320254 31764 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:46.327970 24358 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:46.329553 31764 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:46.343827 24357 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:46.344417 24357 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:46.366292 31764 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:46.373600 31767 raft_consensus.cc:493] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:46.374477 31767 raft_consensus.cc:515] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:46.377110 31767 leader_election.cc:290] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:46.383140 24359 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:46.390668 24358 leader_election.cc:336] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:46.391284 24358 leader_election.cc:304] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:46.393559 31764 raft_consensus.cc:2749] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:46.406477 31764 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:46.407078 31764 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:46.409487 31764 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:46.422434 24359 leader_election.cc:336] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:46.440909 24357 leader_election.cc:336] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:46.445081 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:46.446519 31764 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:46.448287 24359 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:46.491876 31764 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:46.492888 31764 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:46.497334 31764 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:46.503700 24358 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:46.509711 24357 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:46.510468 24357 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:46.511546 31764 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:46.521332 24359 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:46.617159 31764 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:46.617884 31764 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:46.624680 31767 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:46.625345 31767 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:46.627614 31767 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:46.639278 24358 leader_election.cc:336] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:46.642254 24357 leader_election.cc:336] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:46.646275 24357 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:46.648152 31767 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:46.649413 24358 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:46.650684 31764 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:46.656002 24357 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:46.657292 24357 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:46.659684 31764 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:11:46.729640 22480 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23799)
I20260709 13:11:46.761907 31774 raft_consensus.cc:493] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:46.762669 31774 raft_consensus.cc:515] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:46.788344 24358 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:46.789288 24359 leader_election.cc:336] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:46.789832 24359 leader_election.cc:304] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:46.790674 31764 raft_consensus.cc:2749] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:46.791851 31774 leader_election.cc:290] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:46.976336 31774 raft_consensus.cc:493] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:46.977049 31774 raft_consensus.cc:515] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:46.978363 24357 consensus_peers.cc:597] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.986471 31774 leader_election.cc:290] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:46.993396 24359 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:46.995383 24358 leader_election.cc:336] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:47.003683 24357 leader_election.cc:336] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:47.004352 24357 leader_election.cc:304] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:47.005239 31774 raft_consensus.cc:2749] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:47.121850 24357 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.187975 24359 consensus_peers.cc:597] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:47.193296 24357 consensus_peers.cc:597] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.242856 24359 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:47.264918 31774 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:47.265615 31774 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:47.269227 31774 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:47.277277 24359 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:47.284207 24358 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:47.287848 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:47.290151 31774 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:47.301222 24357 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.304585 31764 raft_consensus.cc:493] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:47.305159 31764 raft_consensus.cc:515] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:47.307394 31764 leader_election.cc:290] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
W20260709 13:11:47.315124 24359 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:47.316045 24359 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:47.322396 24358 leader_election.cc:336] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:47.323316 24358 leader_election.cc:304] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:47.325614 31774 raft_consensus.cc:2749] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:47.336176 24357 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.348376 31774 raft_consensus.cc:493] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:47.349200 31774 raft_consensus.cc:515] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:47.364329 24359 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:47.367583 24357 consensus_peers.cc:597] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.371048 24357 consensus_peers.cc:597] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.372440 31774 leader_election.cc:290] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:47.385119 24358 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:47.385876 24358 leader_election.cc:304] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:47.387151 31774 raft_consensus.cc:2749] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:47.388037 24357 leader_election.cc:336] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
W20260709 13:11:47.416770 24359 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:47.438149 24357 consensus_peers.cc:597] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.481666 31774 raft_consensus.cc:493] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:47.482401 31774 raft_consensus.cc:515] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:47.484790 31774 leader_election.cc:290] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:47.521456 24357 leader_election.cc:336] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
W20260709 13:11:47.524099 24359 leader_election.cc:336] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:47.524720 24359 leader_election.cc:304] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:47.526571 31774 raft_consensus.cc:2749] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:47.630615 24358 consensus_peers.cc:597] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:47.649766 31774 raft_consensus.cc:493] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:47.652034 31774 raft_consensus.cc:515] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:47.662256 24357 leader_election.cc:336] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
W20260709 13:11:47.687595 24358 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:47.692890 24357 consensus_peers.cc:597] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Couldn't send request to peer 4466bf6d6cf84ee89e84ea074e3964c9. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.690804 31774 leader_election.cc:290] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:47.708967 24359 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:47.712884 24359 leader_election.cc:336] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:47.714005 24359 leader_election.cc:304] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
W20260709 13:11:47.713516 24358 consensus_peers.cc:597] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:47.715288 31774 raft_consensus.cc:2749] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:47.730154 22480 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23799)
W20260709 13:11:47.807356 24358 consensus_peers.cc:597] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:47.862445 24359 consensus_peers.cc:597] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:47.890487 24359 consensus_peers.cc:597] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:47.961593 24358 consensus_peers.cc:597] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:48.013440 31774 raft_consensus.cc:493] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:48.014008 31774 raft_consensus.cc:515] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:48.023314 24358 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:48.024099 24357 leader_election.cc:336] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:48.024510 24357 leader_election.cc:304] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:48.026095 31764 raft_consensus.cc:2749] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:48.032873 31774 leader_election.cc:290] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:48.036320 24358 consensus_peers.cc:597] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:48.049340 24358 consensus_peers.cc:597] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:48.054270 31774 raft_consensus.cc:493] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:48.054831 31774 raft_consensus.cc:515] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:48.066744 24359 leader_election.cc:336] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:48.068421 31774 leader_election.cc:290] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:48.073776 24357 leader_election.cc:336] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:48.074298 24357 leader_election.cc:304] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:48.075461 31774 raft_consensus.cc:2749] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:48.121781 31774 raft_consensus.cc:493] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:48.122496 31774 raft_consensus.cc:515] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } attrs { replace: true } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
W20260709 13:11:48.137405 24358 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:48.138092 24359 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:48.138669 24359 leader_election.cc:304] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:48.146008 31764 raft_consensus.cc:2749] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:48.146911 24357 leader_election.cc:336] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:48.150919 31774 leader_election.cc:290] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:48.201701 31774 raft_consensus.cc:493] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:48.202458 31774 raft_consensus.cc:515] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:48.209808 31764 raft_consensus.cc:493] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:48.210453 31764 raft_consensus.cc:515] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:48.213053 31764 leader_election.cc:290] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:48.223598 24357 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
W20260709 13:11:48.235242 24357 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
W20260709 13:11:48.236238 24359 leader_election.cc:336] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:11:48.240401 24359 leader_election.cc:304] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, 9ab488f10c434878a749f261e99a8065
I20260709 13:11:48.239886 31774 leader_election.cc:290] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:48.245146 24358 leader_election.cc:336] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:48.247303 31764 raft_consensus.cc:2749] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:48.248986 24358 leader_election.cc:304] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:48.252174 31764 raft_consensus.cc:2749] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:48.257702 24358 consensus_peers.cc:597] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:48.338048 31764 raft_consensus.cc:493] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:48.338766 31764 raft_consensus.cc:515] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:48.341979 31764 leader_election.cc:290] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:48.350181 24357 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
W20260709 13:11:48.379973 24358 leader_election.cc:336] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:48.381330 24358 leader_election.cc:304] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:48.390719 31764 raft_consensus.cc:2749] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:48.443557 24359 consensus_peers.cc:597] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Couldn't send request to peer 9ab488f10c434878a749f261e99a8065. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:48.509227 31764 raft_consensus.cc:493] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:48.510018 31764 raft_consensus.cc:515] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:48.514945 31764 leader_election.cc:290] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
W20260709 13:11:48.522773 24358 leader_election.cc:336] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
W20260709 13:11:48.528261 24357 leader_election.cc:336] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:48.528925 24357 leader_election.cc:304] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:48.530206 31764 raft_consensus.cc:2749] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:48.598743 22480 tablet_server.cc:196] TabletServer@127.21.244.3:0 shutdown complete.
W20260709 13:11:48.619457 24358 consensus_peers.cc:597] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e -> Peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Couldn't send request to peer c885217113574e7489e6c3afb6950f76. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:48.760216 22480 tablet_server.cc:179] TabletServer@127.21.244.4:0 shutting down...
I20260709 13:11:48.821826 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:48.822862 22480 tablet_replica.cc:333] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.823863 31764 raft_consensus.cc:493] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 4466bf6d6cf84ee89e84ea074e3964c9)
I20260709 13:11:48.824602 31764 raft_consensus.cc:515] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "4466bf6d6cf84ee89e84ea074e3964c9" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45959 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:48.826539 31764 leader_election.cc:290] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167), 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959)
I20260709 13:11:48.824002 22480 raft_consensus.cc:2243] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.828715 31764 raft_consensus.cc:493] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c885217113574e7489e6c3afb6950f76)
I20260709 13:11:48.829291 31764 raft_consensus.cc:515] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9ab488f10c434878a749f261e99a8065" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 37537 } } peers { permanent_uuid: "c885217113574e7489e6c3afb6950f76" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 44167 } } peers { permanent_uuid: "b1e32a12daf44ebbbd71cc3ce41d7d8e" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 36767 } attrs { promote: false } }
I20260709 13:11:48.832226 31764 leader_election.cc:290] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537), c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167)
I20260709 13:11:48.828377 22480 raft_consensus.cc:2272] T e8c18a99e9414e39bff9dea9564bd61b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.837001 22480 tablet_replica.cc:333] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.838030 22480 raft_consensus.cc:2243] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:48.838269 24357 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 4466bf6d6cf84ee89e84ea074e3964c9 (127.21.244.3:45959): Network error: Client connection negotiation failed: client connection to 127.21.244.3:45959: connect: Connection refused (error 111)
I20260709 13:11:48.838740 22480 raft_consensus.cc:2272] T 8a0f95eab8184aa59b6fcef0d9f32b0f P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:48.842265 24359 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:48.843461 24358 leader_election.cc:336] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:48.843884 24358 leader_election.cc:304] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 4466bf6d6cf84ee89e84ea074e3964c9, c885217113574e7489e6c3afb6950f76
I20260709 13:11:48.842306 22480 tablet_replica.cc:333] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.845112 22480 raft_consensus.cc:2243] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.845156 31774 raft_consensus.cc:2749] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:48.845902 22480 raft_consensus.cc:2272] T 8f80c880e2784395811b9b9ab65aaf82 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:48.849063 24358 leader_election.cc:336] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c885217113574e7489e6c3afb6950f76 (127.21.244.2:44167): Network error: Client connection negotiation failed: client connection to 127.21.244.2:44167: connect: Connection refused (error 111)
I20260709 13:11:48.849623 22480 tablet_replica.cc:333] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.849529 24358 leader_election.cc:304] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e32a12daf44ebbbd71cc3ce41d7d8e; no voters: 9ab488f10c434878a749f261e99a8065, c885217113574e7489e6c3afb6950f76
I20260709 13:11:48.850301 31774 raft_consensus.cc:2749] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:48.850741 22480 raft_consensus.cc:2243] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.851532 22480 raft_consensus.cc:2272] T d67625249f734ae3b71d554b7a2ba33b P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.853825 22480 tablet_replica.cc:333] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.854470 22480 raft_consensus.cc:2243] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.854913 22480 raft_consensus.cc:2272] T ec11dcde267d48f4b479e4ffb468a0bc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.856992 22480 tablet_replica.cc:333] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.857568 22480 raft_consensus.cc:2243] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.858100 22480 raft_consensus.cc:2272] T dbdbb7d679eb4d0d935669cb839c12c0 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.860383 22480 tablet_replica.cc:333] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.861176 22480 raft_consensus.cc:2243] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.861730 22480 raft_consensus.cc:2272] T 2906fc04ac3a43e5a91763bfbd1ff990 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.865417 22480 tablet_replica.cc:333] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.866104 22480 raft_consensus.cc:2243] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.867028 22480 raft_consensus.cc:2272] T 7479a1f927d94d5e873a594847f4ee10 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.869184 22480 tablet_replica.cc:333] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.869796 22480 raft_consensus.cc:2243] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.870296 22480 raft_consensus.cc:2272] T 3473b09c073142659e12a365e9aed3f3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.872442 22480 tablet_replica.cc:333] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.873054 22480 raft_consensus.cc:2243] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.873935 22480 raft_consensus.cc:2272] T 36da9377816744739720cb01b6191368 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.876296 22480 tablet_replica.cc:333] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.876904 22480 raft_consensus.cc:2243] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.877374 22480 raft_consensus.cc:2272] T 37a8de42d0d8417f9ad5486f22fdbf73 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.879583 22480 tablet_replica.cc:333] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.880174 22480 raft_consensus.cc:2243] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.881034 22480 raft_consensus.cc:2272] T de67ca6156e842db9c8994e493d241ca P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.883229 22480 tablet_replica.cc:333] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.883786 22480 raft_consensus.cc:2243] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.884546 22480 raft_consensus.cc:2272] T aa38658745b04f268c400fe20554d483 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.886596 22480 tablet_replica.cc:333] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.887151 22480 raft_consensus.cc:2243] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.888027 22480 raft_consensus.cc:2272] T 01ec1d400f174350acc92722149e02d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.889988 22480 tablet_replica.cc:333] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.890532 22480 raft_consensus.cc:2243] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.891342 22480 raft_consensus.cc:2272] T 44b7b7e4ddb143138d48247cb9feb2d4 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.893568 22480 tablet_replica.cc:333] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.894119 22480 raft_consensus.cc:2243] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.894980 22480 raft_consensus.cc:2272] T 2cf8733dc7d947f08af2274d90145039 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.897038 22480 tablet_replica.cc:333] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.897586 22480 raft_consensus.cc:2243] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.898114 22480 raft_consensus.cc:2272] T 80466d92afe9453b9cd96ab9f7f593dc P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.900193 22480 tablet_replica.cc:333] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.900789 22480 raft_consensus.cc:2243] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.901335 22480 raft_consensus.cc:2272] T 161b847a6eca457eb80fb6cb57531127 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.903329 22480 tablet_replica.cc:333] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.903896 22480 raft_consensus.cc:2243] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.904837 22480 raft_consensus.cc:2272] T eb27ed2f4a5b46d5a40126f9893f0c3c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.906847 22480 tablet_replica.cc:333] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.907433 22480 raft_consensus.cc:2243] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.907943 22480 raft_consensus.cc:2272] T d52390cad487467d9b1b0b951d9300b7 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.909965 22480 tablet_replica.cc:333] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.910516 22480 raft_consensus.cc:2243] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.912335 22480 raft_consensus.cc:2272] T e1f8fde8107545d5a59c6b12b0822584 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.915154 22480 tablet_replica.cc:333] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.916122 22480 raft_consensus.cc:2243] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.916780 22480 raft_consensus.cc:2272] T a17c243311054979a1c285f2ef18d20e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.919481 22480 tablet_replica.cc:333] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.920217 22480 raft_consensus.cc:2243] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.921303 22480 raft_consensus.cc:2272] T 334c9018414947cabb4405ef47b8018e P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.924099 22480 tablet_replica.cc:333] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.924629 22480 raft_consensus.cc:2243] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.925100 22480 raft_consensus.cc:2272] T 2de1999cb30f49b981475a62d0d0feb9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.927165 22480 tablet_replica.cc:333] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.927708 22480 raft_consensus.cc:2243] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.928615 22480 raft_consensus.cc:2272] T ee650b0b99c4413293e36b0fa9631151 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.930737 22480 tablet_replica.cc:333] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.931279 22480 raft_consensus.cc:2243] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.932121 22480 raft_consensus.cc:2272] T b8b889a8b97443f781c7eef38dba2f96 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.934296 22480 tablet_replica.cc:333] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.934813 22480 raft_consensus.cc:2243] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.935271 22480 raft_consensus.cc:2272] T d5fa82982f53411c84a07a2fb3918888 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.937933 22480 tablet_replica.cc:333] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.938581 22480 raft_consensus.cc:2243] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.939581 22480 raft_consensus.cc:2272] T bc5bb39aaf4940fb9d34ec725193ca2c P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.942150 22480 tablet_replica.cc:333] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.942735 22480 raft_consensus.cc:2243] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.943885 22480 raft_consensus.cc:2272] T b7656d11fa2f4f27beac8e46f9f20be9 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.946199 22480 tablet_replica.cc:333] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e: stopping tablet replica
I20260709 13:11:48.946785 22480 raft_consensus.cc:2243] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.947376 22480 raft_consensus.cc:2272] T 5499c62f40a046f2a8efb671c77f08b3 P b1e32a12daf44ebbbd71cc3ce41d7d8e [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.998252 22480 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24415)
I20260709 13:11:50.888396 22480 tablet_server.cc:196] TabletServer@127.21.244.4:0 shutdown complete.
I20260709 13:11:50.995144 22480 master.cc:562] Master@127.21.244.62:36967 shutting down...
W20260709 13:11:51.034677 23575 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:11:51.034950 23575 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:11:51.035233 23575 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:11:51.634632 23513 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111) [suppressed 283 similar messages]
W20260709 13:11:51.638368 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8f80c880e2784395811b9b9ab65aaf82: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:11:56.353025 23558 debug-util.cc:398] Leaking SignalData structure 0x7b080019fe20 after lost signal to thread 22483
W20260709 13:11:56.353588 23558 debug-util.cc:398] Leaking SignalData structure 0x7b0800318720 after lost signal to thread 23561
W20260709 13:12:01.841953 23513 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
W20260709 13:12:01.846230 23513 catalog_manager.cc:4755] TS 9ab488f10c434878a749f261e99a8065 (127.21.244.1:37537): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d67625249f734ae3b71d554b7a2ba33b: Network error: Client connection negotiation failed: client connection to 127.21.244.1:37537: connect: Connection refused (error 111)
I20260709 13:12:01.959309 22480 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:01.960554 22480 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.961007 22480 tablet_replica.cc:333] T 00000000000000000000000000000000 P 446420ed83784f0ea35de949dc9242f4: stopping tablet replica
I20260709 13:12:02.128475 22480 master.cc:584] Master@127.21.244.62:36967 shutdown complete.
I20260709 13:12:02.183998 22480 test_util.cc:182] -----------------------------------------------
I20260709 13:12:02.184216 22480 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602440417847-22480-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (254962 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:12:02.188475 22480 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.244.62:44861
I20260709 13:12:02.189715 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:02.196502 31784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:02.196770 31786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:02.197139 31783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:02.197973 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:02.201934 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:02.202162 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:02.202309 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602722202297 us; error 0 us; skew 500 ppm
I20260709 13:12:02.202775 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:02.205579 22480 webserver.cc:533] Webserver started at http://127.21.244.62:43755/ using document root <none> and password file <none>
I20260709 13:12:02.206066 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:02.206229 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:02.206496 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:02.207857 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/master-0-root/instance:
uuid: "9c70f72e2da24b5f869af8f58d656fc7"
format_stamp: "Formatted at 2026-07-09 13:12:02 on dist-test-slave-j314"
I20260709 13:12:02.212621 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:12:02.216346 31791 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.217345 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:12:02.217694 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/master-0-root
uuid: "9c70f72e2da24b5f869af8f58d656fc7"
format_stamp: "Formatted at 2026-07-09 13:12:02 on dist-test-slave-j314"
I20260709 13:12:02.218055 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:02.244067 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:02.245472 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:02.291965 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.62:44861
I20260709 13:12:02.292094 31842 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.62:44861 every 8 connection(s)
I20260709 13:12:02.296543 31843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.311095 31843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7: Bootstrap starting.
I20260709 13:12:02.316732 31843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:02.322007 31843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7: No bootstrap required, opened a new log
I20260709 13:12:02.324723 31843 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c70f72e2da24b5f869af8f58d656fc7" member_type: VOTER }
I20260709 13:12:02.325240 31843 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:02.325568 31843 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c70f72e2da24b5f869af8f58d656fc7, State: Initialized, Role: FOLLOWER
I20260709 13:12:02.326287 31843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c70f72e2da24b5f869af8f58d656fc7" member_type: VOTER }
I20260709 13:12:02.326826 31843 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:02.327080 31843 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:02.327422 31843 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:02.333030 31843 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c70f72e2da24b5f869af8f58d656fc7" member_type: VOTER }
I20260709 13:12:02.333705 31843 leader_election.cc:304] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c70f72e2da24b5f869af8f58d656fc7; no voters: 
I20260709 13:12:02.335071 31843 leader_election.cc:290] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:02.335551 31846 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:02.337370 31846 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [term 1 LEADER]: Becoming Leader. State: Replica: 9c70f72e2da24b5f869af8f58d656fc7, State: Running, Role: LEADER
I20260709 13:12:02.338256 31846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c70f72e2da24b5f869af8f58d656fc7" member_type: VOTER }
I20260709 13:12:02.338548 31843 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:02.349212 31847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c70f72e2da24b5f869af8f58d656fc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c70f72e2da24b5f869af8f58d656fc7" member_type: VOTER } }
I20260709 13:12:02.349786 31847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:02.351336 31848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c70f72e2da24b5f869af8f58d656fc7. Latest consensus state: current_term: 1 leader_uuid: "9c70f72e2da24b5f869af8f58d656fc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c70f72e2da24b5f869af8f58d656fc7" member_type: VOTER } }
I20260709 13:12:02.351773 31856 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:02.351853 31848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:02.360821 31856 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:02.362107 22480 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:02.371515 31856 catalog_manager.cc:1383] Generated new cluster ID: 1bea9762c1d946f2a38992d4a00a00cf
I20260709 13:12:02.371865 31856 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:02.401618 31856 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:02.403214 31856 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:02.417868 31856 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7: Generated new TSK 0
I20260709 13:12:02.418576 31856 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:02.429177 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:02.436178 31864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:02.437325 31865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:02.439369 31867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:02.441039 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:02.443133 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:02.443337 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:02.443456 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602722443445 us; error 0 us; skew 500 ppm
I20260709 13:12:02.444033 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:02.446475 22480 webserver.cc:533] Webserver started at http://127.21.244.1:43737/ using document root <none> and password file <none>
I20260709 13:12:02.446938 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:02.447093 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:02.447362 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:02.448616 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/instance:
uuid: "936b035f23a5449fb43db3fd5f757325"
format_stamp: "Formatted at 2026-07-09 13:12:02 on dist-test-slave-j314"
I20260709 13:12:02.454001 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:12:02.458184 31872 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.459151 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:12:02.459631 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-0-root
uuid: "936b035f23a5449fb43db3fd5f757325"
format_stamp: "Formatted at 2026-07-09 13:12:02 on dist-test-slave-j314"
I20260709 13:12:02.460072 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:02.478545 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:02.479933 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:02.481477 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:02.484050 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:02.484310 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.484553 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:02.484745 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.532052 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.1:33269
I20260709 13:12:02.532184 31934 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.1:33269 every 8 connection(s)
I20260709 13:12:02.537595 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:02.547504 31939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:02.548735 31940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:02.552445 31942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:02.552896 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:02.556113 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:02.556473 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:02.556716 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602722556695 us; error 0 us; skew 500 ppm
I20260709 13:12:02.557569 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:02.559681 31935 heartbeater.cc:344] Connected to a master server at 127.21.244.62:44861
I20260709 13:12:02.560149 31935 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:02.561035 22480 webserver.cc:533] Webserver started at http://127.21.244.2:38733/ using document root <none> and password file <none>
I20260709 13:12:02.561260 31935 heartbeater.cc:507] Master 127.21.244.62:44861 requested a full tablet report, sending...
I20260709 13:12:02.561898 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:02.562175 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:02.562772 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:02.564265 31808 ts_manager.cc:194] Registered new tserver with Master: 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:02.564424 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/instance:
uuid: "ab61be703111416d9fba543ea97b2224"
format_stamp: "Formatted at 2026-07-09 13:12:02 on dist-test-slave-j314"
I20260709 13:12:02.566651 31808 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38580
I20260709 13:12:02.570469 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:02.575459 31947 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.576402 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:02.576761 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-1-root
uuid: "ab61be703111416d9fba543ea97b2224"
format_stamp: "Formatted at 2026-07-09 13:12:02 on dist-test-slave-j314"
I20260709 13:12:02.577080 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:02.598181 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:02.599478 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:02.601208 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:02.603515 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:02.603787 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.604044 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:02.604225 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.651510 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.2:45831
I20260709 13:12:02.651648 32009 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.2:45831 every 8 connection(s)
I20260709 13:12:02.656435 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:02.664633 32013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:02.666543 32014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:02.670128 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:02.670182 32010 heartbeater.cc:344] Connected to a master server at 127.21.244.62:44861
I20260709 13:12:02.670858 32010 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:02.671136 32016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:02.671718 32010 heartbeater.cc:507] Master 127.21.244.62:44861 requested a full tablet report, sending...
I20260709 13:12:02.672441 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:02.672736 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:02.672924 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602722672908 us; error 0 us; skew 500 ppm
I20260709 13:12:02.673700 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:02.674304 31808 ts_manager.cc:194] Registered new tserver with Master: ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:02.676064 31808 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38582
I20260709 13:12:02.676690 22480 webserver.cc:533] Webserver started at http://127.21.244.3:36657/ using document root <none> and password file <none>
I20260709 13:12:02.677340 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:02.677613 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:02.677887 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:02.679217 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/instance:
uuid: "27177ca9073b4128b8844b7cb37db32a"
format_stamp: "Formatted at 2026-07-09 13:12:02 on dist-test-slave-j314"
I20260709 13:12:02.684073 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:12:02.687952 32021 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.688822 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:12:02.689152 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-2-root
uuid: "27177ca9073b4128b8844b7cb37db32a"
format_stamp: "Formatted at 2026-07-09 13:12:02 on dist-test-slave-j314"
I20260709 13:12:02.689471 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:02.716645 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:02.718057 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:02.719619 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:02.722411 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:02.722681 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.722986 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:02.723181 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.769604 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.3:34161
I20260709 13:12:02.769682 32083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.3:34161 every 8 connection(s)
I20260709 13:12:02.774785 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:02.783651 32087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:02.786118 32088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:02.787370 32090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:02.790169 32084 heartbeater.cc:344] Connected to a master server at 127.21.244.62:44861
I20260709 13:12:02.790671 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:02.790856 32084 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:02.791939 32084 heartbeater.cc:507] Master 127.21.244.62:44861 requested a full tablet report, sending...
I20260709 13:12:02.792001 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:02.792392 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:02.792596 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602722792573 us; error 0 us; skew 500 ppm
I20260709 13:12:02.793421 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:02.794332 31808 ts_manager.cc:194] Registered new tserver with Master: 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:02.796386 31808 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38586
I20260709 13:12:02.796624 22480 webserver.cc:533] Webserver started at http://127.21.244.4:41927/ using document root <none> and password file <none>
I20260709 13:12:02.797315 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:02.797569 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:02.797902 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:02.799027 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-3-root/instance:
uuid: "eacc546e751240eb804795d98213a57c"
format_stamp: "Formatted at 2026-07-09 13:12:02 on dist-test-slave-j314"
I20260709 13:12:02.803545 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:02.807504 32095 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.808352 22480 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:02.808689 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-3-root
uuid: "eacc546e751240eb804795d98213a57c"
format_stamp: "Formatted at 2026-07-09 13:12:02 on dist-test-slave-j314"
I20260709 13:12:02.809005 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:02.818413 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:02.819890 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:02.821497 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:02.823884 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:02.824129 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.824374 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:02.824558 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:02.871665 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.4:43793
I20260709 13:12:02.871822 32157 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.4:43793 every 8 connection(s)
I20260709 13:12:02.888530 32158 heartbeater.cc:344] Connected to a master server at 127.21.244.62:44861
I20260709 13:12:02.888899 32158 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:02.889853 32158 heartbeater.cc:507] Master 127.21.244.62:44861 requested a full tablet report, sending...
I20260709 13:12:02.892381 31808 ts_manager.cc:194] Registered new tserver with Master: eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:02.892803 22480 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017110998s
I20260709 13:12:02.894124 31808 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38598
I20260709 13:12:02.924791 31808 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38602:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:12:03.162933 32049 tablet_service.cc:1511] Processing CreateTablet for tablet aaedd9866a6e4923a483d1268ac000ea (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:03.163089 32048 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4c0d34f8964520b2dfcb86f12a18b6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:03.164608 32049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaedd9866a6e4923a483d1268ac000ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.165441 32048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4c0d34f8964520b2dfcb86f12a18b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.170372 32047 tablet_service.cc:1511] Processing CreateTablet for tablet f9b84cbd41b64e929eaab29437b49118 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:03.179107 32047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b84cbd41b64e929eaab29437b49118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.182927 32046 tablet_service.cc:1511] Processing CreateTablet for tablet bc70b216d7234eca9b4c4eaadc8ef7e7 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:03.185006 32046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc70b216d7234eca9b4c4eaadc8ef7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.189740 32045 tablet_service.cc:1511] Processing CreateTablet for tablet c923d9fd0eba46a5bd77f4b0359907ad (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:03.191960 32045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c923d9fd0eba46a5bd77f4b0359907ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.195119 32044 tablet_service.cc:1511] Processing CreateTablet for tablet 2a24126e79904519a77414eb98380575 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:03.198760 32044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a24126e79904519a77414eb98380575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.211406 32123 tablet_service.cc:1511] Processing CreateTablet for tablet f82695c4f13842c1a0e66c48751f9025 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:03.213191 32123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82695c4f13842c1a0e66c48751f9025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.213737 32119 tablet_service.cc:1511] Processing CreateTablet for tablet c923d9fd0eba46a5bd77f4b0359907ad (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:03.215394 32119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c923d9fd0eba46a5bd77f4b0359907ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.217149 32122 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4c0d34f8964520b2dfcb86f12a18b6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:03.218854 32122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4c0d34f8964520b2dfcb86f12a18b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.221151 32118 tablet_service.cc:1511] Processing CreateTablet for tablet 2a24126e79904519a77414eb98380575 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:03.222884 32118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a24126e79904519a77414eb98380575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.222536 32120 tablet_service.cc:1511] Processing CreateTablet for tablet a78fc46a6c3f474cacfa16b058f035cd (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:03.223111 32048 tablet_service.cc:1511] Processing CreateTablet for tablet 858cfa025ea0471a97b28dd8a9d61990 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:03.224493 32048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858cfa025ea0471a97b28dd8a9d61990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.225131 32043 tablet_service.cc:1511] Processing CreateTablet for tablet 25e1c9b1a299481d9675857f807393c6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:03.226770 32043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e1c9b1a299481d9675857f807393c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.221151 32121 tablet_service.cc:1511] Processing CreateTablet for tablet f9b84cbd41b64e929eaab29437b49118 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:03.228348 32117 tablet_service.cc:1511] Processing CreateTablet for tablet 2effe556ccc642379972492cef9bf0a0 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:03.229594 32121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b84cbd41b64e929eaab29437b49118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.230928 32042 tablet_service.cc:1511] Processing CreateTablet for tablet b358dd69e0a54cdf8e94474ade4e7046 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:03.232240 32120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78fc46a6c3f474cacfa16b058f035cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.232565 32042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b358dd69e0a54cdf8e94474ade4e7046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.236246 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2effe556ccc642379972492cef9bf0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.238900 32041 tablet_service.cc:1511] Processing CreateTablet for tablet 9d653047328d4dd8b77f83bfc9318562 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:03.241044 32041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d653047328d4dd8b77f83bfc9318562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.241873 32116 tablet_service.cc:1511] Processing CreateTablet for tablet 858cfa025ea0471a97b28dd8a9d61990 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:03.243584 32116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858cfa025ea0471a97b28dd8a9d61990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.249930 32115 tablet_service.cc:1511] Processing CreateTablet for tablet b358dd69e0a54cdf8e94474ade4e7046 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:03.254726 32114 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6829450035496cad51a237b822114a (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:03.257686 32115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b358dd69e0a54cdf8e94474ade4e7046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.260176 32114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6829450035496cad51a237b822114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.271070 32049 tablet_service.cc:1511] Processing CreateTablet for tablet bdf375d76dea417eaf6400807194cf2d (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:03.298843 32047 tablet_service.cc:1511] Processing CreateTablet for tablet e98700f72c2d466b951e6776bdc74e2f (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:03.304679 32047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98700f72c2d466b951e6776bdc74e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.311784 32048 tablet_service.cc:1511] Processing CreateTablet for tablet 762054515f9846129075d921ceefcd1f (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:03.316864 32040 tablet_service.cc:1511] Processing CreateTablet for tablet 95d018ee52cc46cebe51e75edec5abe5 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:03.319135 32177 tablet_bootstrap.cc:492] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:03.338864 32049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf375d76dea417eaf6400807194cf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.344165 32040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d018ee52cc46cebe51e75edec5abe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.345225 31975 tablet_service.cc:1511] Processing CreateTablet for tablet aaedd9866a6e4923a483d1268ac000ea (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:03.346854 31975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaedd9866a6e4923a483d1268ac000ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.348145 32048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762054515f9846129075d921ceefcd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.349134 31974 tablet_service.cc:1511] Processing CreateTablet for tablet f82695c4f13842c1a0e66c48751f9025 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:03.350752 31974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82695c4f13842c1a0e66c48751f9025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.362201 31970 tablet_service.cc:1511] Processing CreateTablet for tablet 2a24126e79904519a77414eb98380575 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:03.370029 31970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a24126e79904519a77414eb98380575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.360224 31971 tablet_service.cc:1511] Processing CreateTablet for tablet a78fc46a6c3f474cacfa16b058f035cd (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:03.373157 31971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78fc46a6c3f474cacfa16b058f035cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.354652 31972 tablet_service.cc:1511] Processing CreateTablet for tablet bc70b216d7234eca9b4c4eaadc8ef7e7 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:03.353091 31973 tablet_service.cc:1511] Processing CreateTablet for tablet f9b84cbd41b64e929eaab29437b49118 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:03.377556 31973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b84cbd41b64e929eaab29437b49118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.383102 32044 tablet_service.cc:1511] Processing CreateTablet for tablet decee8d0520647f5a637ec4bc4237722 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:03.416471 32041 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcab21f469948228159fc838c35005b (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:03.386775 32122 tablet_service.cc:1511] Processing CreateTablet for tablet bdf375d76dea417eaf6400807194cf2d (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:03.388159 31972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc70b216d7234eca9b4c4eaadc8ef7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.391036 31969 tablet_service.cc:1511] Processing CreateTablet for tablet 25e1c9b1a299481d9675857f807393c6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:03.394608 31968 tablet_service.cc:1511] Processing CreateTablet for tablet 2effe556ccc642379972492cef9bf0a0 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:03.396623 31967 tablet_service.cc:1511] Processing CreateTablet for tablet b358dd69e0a54cdf8e94474ade4e7046 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:03.409979 32121 tablet_service.cc:1511] Processing CreateTablet for tablet fd01da40464a4c3e907fbd4a05e7cf08 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:03.397586 32177 tablet_bootstrap.cc:654] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:03.353214 31855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:03.398581 31966 tablet_service.cc:1511] Processing CreateTablet for tablet 9d653047328d4dd8b77f83bfc9318562 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:03.417110 32044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet decee8d0520647f5a637ec4bc4237722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.425269 32121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd01da40464a4c3e907fbd4a05e7cf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.454362 32048 tablet_service.cc:1511] Processing CreateTablet for tablet cb7c99a3ac8c469995be8be36b6b8cf1 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:03.455969 32048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7c99a3ac8c469995be8be36b6b8cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.425541 32114 tablet_service.cc:1511] Processing CreateTablet for tablet decee8d0520647f5a637ec4bc4237722 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:03.457273 32114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet decee8d0520647f5a637ec4bc4237722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.458640 32118 tablet_service.cc:1511] Processing CreateTablet for tablet 24a52eeb653346c286bc79d5ee09d7b5 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:03.460152 32118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a52eeb653346c286bc79d5ee09d7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.426781 31891 tablet_service.cc:1511] Processing CreateTablet for tablet 9d653047328d4dd8b77f83bfc9318562 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:03.461472 31891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d653047328d4dd8b77f83bfc9318562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.410651 31900 tablet_service.cc:1511] Processing CreateTablet for tablet aaedd9866a6e4923a483d1268ac000ea (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:03.440430 32047 tablet_service.cc:1511] Processing CreateTablet for tablet be3e38a5bb6f4fd48b4bd695694eb7d9 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:03.463394 31900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaedd9866a6e4923a483d1268ac000ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.463968 32047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be3e38a5bb6f4fd48b4bd695694eb7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.412377 32119 tablet_service.cc:1511] Processing CreateTablet for tablet 95d018ee52cc46cebe51e75edec5abe5 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:03.465127 32119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d018ee52cc46cebe51e75edec5abe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.423069 31894 tablet_service.cc:1511] Processing CreateTablet for tablet 25e1c9b1a299481d9675857f807393c6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:03.422797 31899 tablet_service.cc:1511] Processing CreateTablet for tablet f82695c4f13842c1a0e66c48751f9025 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:03.412983 31898 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4c0d34f8964520b2dfcb86f12a18b6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:03.414882 31897 tablet_service.cc:1511] Processing CreateTablet for tablet bc70b216d7234eca9b4c4eaadc8ef7e7 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:03.471812 32117 tablet_service.cc:1511] Processing CreateTablet for tablet cb7c99a3ac8c469995be8be36b6b8cf1 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:03.416821 31896 tablet_service.cc:1511] Processing CreateTablet for tablet a78fc46a6c3f474cacfa16b058f035cd (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:03.424957 31892 tablet_service.cc:1511] Processing CreateTablet for tablet 858cfa025ea0471a97b28dd8a9d61990 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:03.421520 31893 tablet_service.cc:1511] Processing CreateTablet for tablet 2effe556ccc642379972492cef9bf0a0 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:03.423460 31968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2effe556ccc642379972492cef9bf0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.418735 31895 tablet_service.cc:1511] Processing CreateTablet for tablet c923d9fd0eba46a5bd77f4b0359907ad (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:03.478595 31894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e1c9b1a299481d9675857f807393c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.469099 32115 tablet_service.cc:1511] Processing CreateTablet for tablet be3e38a5bb6f4fd48b4bd695694eb7d9 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:03.490661 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7c99a3ac8c469995be8be36b6b8cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.508208 32122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf375d76dea417eaf6400807194cf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.508315 31969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e1c9b1a299481d9675857f807393c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.512238 31966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d653047328d4dd8b77f83bfc9318562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.513892 31967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b358dd69e0a54cdf8e94474ade4e7046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.515426 31893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2effe556ccc642379972492cef9bf0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.516938 31897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc70b216d7234eca9b4c4eaadc8ef7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.518692 31896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78fc46a6c3f474cacfa16b058f035cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.520430 31898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4c0d34f8964520b2dfcb86f12a18b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.522022 31892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 858cfa025ea0471a97b28dd8a9d61990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.401966 32120 tablet_service.cc:1511] Processing CreateTablet for tablet e98700f72c2d466b951e6776bdc74e2f (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:03.523586 31895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c923d9fd0eba46a5bd77f4b0359907ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.525933 32115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be3e38a5bb6f4fd48b4bd695694eb7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.536103 31899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82695c4f13842c1a0e66c48751f9025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.538161 32116 tablet_service.cc:1511] Processing CreateTablet for tablet ced69c1fedef46c1a15fcea51cc970f4 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:03.541533 32044 tablet_service.cc:1511] Processing CreateTablet for tablet 2af6353e4b694dc58ca636af51b7f1eb (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:03.542891 32044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af6353e4b694dc58ca636af51b7f1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.563562 32116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced69c1fedef46c1a15fcea51cc970f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.566641 32120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98700f72c2d466b951e6776bdc74e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.570461 31935 heartbeater.cc:499] Master 127.21.244.62:44861 was elected leader, sending a full tablet report...
I20260709 13:12:03.569156 32180 tablet_bootstrap.cc:492] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:03.589720 31972 tablet_service.cc:1511] Processing CreateTablet for tablet 762054515f9846129075d921ceefcd1f (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:03.591461 31972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762054515f9846129075d921ceefcd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.603929 31967 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6829450035496cad51a237b822114a (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:03.604769 32041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcab21f469948228159fc838c35005b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.610191 32047 tablet_service.cc:1511] Processing CreateTablet for tablet 101f0f9b51684b15a3f577bf4685bb9c (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:03.612692 32122 tablet_service.cc:1511] Processing CreateTablet for tablet 101f0f9b51684b15a3f577bf4685bb9c (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:03.624428 32178 tablet_bootstrap.cc:492] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:03.626474 32177 tablet_bootstrap.cc:492] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:03.627117 32177 ts_tablet_manager.cc:1403] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.308s	user 0.011s	sys 0.017s
I20260709 13:12:03.628140 32122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101f0f9b51684b15a3f577bf4685bb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.636475 32047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101f0f9b51684b15a3f577bf4685bb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.645717 32177 raft_consensus.cc:359] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:03.646576 32177 raft_consensus.cc:385] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.646899 32177 raft_consensus.cc:740] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.649533 32180 tablet_bootstrap.cc:654] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.650732 32045 tablet_service.cc:1511] Processing CreateTablet for tablet be53aa47c89a49dd98dd5050d875c00e (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:03.660705 32045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be53aa47c89a49dd98dd5050d875c00e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.663363 32117 tablet_service.cc:1511] Processing CreateTablet for tablet be53aa47c89a49dd98dd5050d875c00e (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:03.664752 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be53aa47c89a49dd98dd5050d875c00e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.665337 31967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6829450035496cad51a237b822114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.669661 31898 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6829450035496cad51a237b822114a (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:03.671062 31898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6829450035496cad51a237b822114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.657070 32178 tablet_bootstrap.cc:654] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.672693 31975 tablet_service.cc:1511] Processing CreateTablet for tablet e98700f72c2d466b951e6776bdc74e2f (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:03.674124 31975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98700f72c2d466b951e6776bdc74e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.647706 32177 consensus_queue.cc:260] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:03.655705 31891 tablet_service.cc:1511] Processing CreateTablet for tablet bdf375d76dea417eaf6400807194cf2d (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:03.681631 32010 heartbeater.cc:499] Master 127.21.244.62:44861 was elected leader, sending a full tablet report...
I20260709 13:12:03.685727 31973 tablet_service.cc:1511] Processing CreateTablet for tablet fd01da40464a4c3e907fbd4a05e7cf08 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:03.687104 31973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd01da40464a4c3e907fbd4a05e7cf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.687871 31893 tablet_service.cc:1511] Processing CreateTablet for tablet 762054515f9846129075d921ceefcd1f (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:03.702984 31970 tablet_service.cc:1511] Processing CreateTablet for tablet decee8d0520647f5a637ec4bc4237722 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:03.703691 32048 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5b51be38f84f3683f3fbe48c4d22af (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:03.704471 31970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet decee8d0520647f5a637ec4bc4237722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.708218 32048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5b51be38f84f3683f3fbe48c4d22af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.708837 32177 ts_tablet_manager.cc:1434] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.005s
I20260709 13:12:03.709673 32084 heartbeater.cc:499] Master 127.21.244.62:44861 was elected leader, sending a full tablet report...
I20260709 13:12:03.720155 31900 tablet_service.cc:1511] Processing CreateTablet for tablet fd01da40464a4c3e907fbd4a05e7cf08 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:03.728439 32177 tablet_bootstrap.cc:492] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:03.754572 31893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762054515f9846129075d921ceefcd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.758931 31895 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcab21f469948228159fc838c35005b (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:03.762399 31895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcab21f469948228159fc838c35005b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.763012 31897 tablet_service.cc:1511] Processing CreateTablet for tablet be3e38a5bb6f4fd48b4bd695694eb7d9 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:03.759423 32181 tablet_bootstrap.cc:492] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:03.765580 31966 tablet_service.cc:1511] Processing CreateTablet for tablet cb7c99a3ac8c469995be8be36b6b8cf1 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:03.767047 31966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7c99a3ac8c469995be8be36b6b8cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.761206 31971 tablet_service.cc:1511] Processing CreateTablet for tablet 24a52eeb653346c286bc79d5ee09d7b5 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:03.793128 31968 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcab21f469948228159fc838c35005b (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:03.793996 31971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a52eeb653346c286bc79d5ee09d7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.761600 31894 tablet_service.cc:1511] Processing CreateTablet for tablet 24a52eeb653346c286bc79d5ee09d7b5 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:03.799278 31896 tablet_service.cc:1511] Processing CreateTablet for tablet 2af6353e4b694dc58ca636af51b7f1eb (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 13:12:03.802660 32085 tablet.cc:2406] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:03.804399 32183 raft_consensus.cc:493] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.805174 32183 raft_consensus.cc:515] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:03.809389 31899 tablet_service.cc:1511] Processing CreateTablet for tablet ced69c1fedef46c1a15fcea51cc970f4 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:03.812314 32180 tablet_bootstrap.cc:492] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:03.812912 32180 ts_tablet_manager.cc:1403] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.244s	user 0.017s	sys 0.013s
I20260709 13:12:03.816314 32180 raft_consensus.cc:359] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:03.817065 32180 raft_consensus.cc:385] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.817348 32180 raft_consensus.cc:740] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.759475 31892 tablet_service.cc:1511] Processing CreateTablet for tablet 95d018ee52cc46cebe51e75edec5abe5 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:03.820850 31974 tablet_service.cc:1511] Processing CreateTablet for tablet 2af6353e4b694dc58ca636af51b7f1eb (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:03.800750 31900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd01da40464a4c3e907fbd4a05e7cf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.824165 31892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d018ee52cc46cebe51e75edec5abe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.825981 31896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af6353e4b694dc58ca636af51b7f1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.826645 31972 tablet_service.cc:1511] Processing CreateTablet for tablet ced69c1fedef46c1a15fcea51cc970f4 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:03.828161 31899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced69c1fedef46c1a15fcea51cc970f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.832804 31891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf375d76dea417eaf6400807194cf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.834508 31894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a52eeb653346c286bc79d5ee09d7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.821921 32177 tablet_bootstrap.cc:654] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.821848 32180 consensus_queue.cc:260] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:03.846009 31897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be3e38a5bb6f4fd48b4bd695694eb7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.864468 32178 tablet_bootstrap.cc:492] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:03.865152 32178 ts_tablet_manager.cc:1403] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.241s	user 0.018s	sys 0.013s
I20260709 13:12:03.800519 31968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcab21f469948228159fc838c35005b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.879177 32183 leader_election.cc:290] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:03.879918 31972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced69c1fedef46c1a15fcea51cc970f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.901044 32158 heartbeater.cc:499] Master 127.21.244.62:44861 was elected leader, sending a full tablet report...
I20260709 13:12:03.910939 31974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af6353e4b694dc58ca636af51b7f1eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.929673 32177 tablet_bootstrap.cc:492] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:03.930310 32177 ts_tablet_manager.cc:1403] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.202s	user 0.011s	sys 0.013s
I20260709 13:12:03.935201 31967 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5b51be38f84f3683f3fbe48c4d22af (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:03.936709 31967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5b51be38f84f3683f3fbe48c4d22af. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:03.940917 31795 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 187242us
W20260709 13:12:03.944236 31794 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 188217us
I20260709 13:12:03.944558 31975 tablet_service.cc:1511] Processing CreateTablet for tablet be53aa47c89a49dd98dd5050d875c00e (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:03.946023 31975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be53aa47c89a49dd98dd5050d875c00e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.956990 32180 ts_tablet_manager.cc:1434] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.144s	user 0.010s	sys 0.009s
I20260709 13:12:03.958493 32180 tablet_bootstrap.cc:492] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:03.965387 31900 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5b51be38f84f3683f3fbe48c4d22af (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:03.965962 32177 raft_consensus.cc:359] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:03.966982 32177 raft_consensus.cc:385] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.967237 31900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5b51be38f84f3683f3fbe48c4d22af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.967455 32177 raft_consensus.cc:740] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.000150 32177 consensus_queue.cc:260] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:03.989542 31795 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 45791.8us
W20260709 13:12:04.007893 31793 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 222154us
I20260709 13:12:03.951285 31898 tablet_service.cc:1511] Processing CreateTablet for tablet 101f0f9b51684b15a3f577bf4685bb9c (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:04.002071 31969 tablet_service.cc:1511] Processing CreateTablet for tablet cd4d256597f64c68b23aefc1246fefcd (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:04.011137 31898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101f0f9b51684b15a3f577bf4685bb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.012174 32114 tablet_service.cc:1511] Processing CreateTablet for tablet d1a83560836343219eaeb0ba1a0bc451 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:04.013569 32114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a83560836343219eaeb0ba1a0bc451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.011170 32117 tablet_service.cc:1511] Processing CreateTablet for tablet 78e0ed9b586e440c98baa7861469e247 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:04.015909 32048 tablet_service.cc:1511] Processing CreateTablet for tablet 78e0ed9b586e440c98baa7861469e247 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:04.017089 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e0ed9b586e440c98baa7861469e247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.018188 32048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e0ed9b586e440c98baa7861469e247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.021386 32045 tablet_service.cc:1511] Processing CreateTablet for tablet d1a83560836343219eaeb0ba1a0bc451 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:04.021641 32116 tablet_service.cc:1511] Processing CreateTablet for tablet cd4d256597f64c68b23aefc1246fefcd (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:04.022765 32045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a83560836343219eaeb0ba1a0bc451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.028316 32181 tablet_bootstrap.cc:700] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: Time spent opening tablet: real 0.205s	user 0.004s	sys 0.000s
I20260709 13:12:04.029034 32181 tablet_bootstrap.cc:654] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.011337 31969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4d256597f64c68b23aefc1246fefcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.041321 31895 tablet_service.cc:1511] Processing CreateTablet for tablet cd4d256597f64c68b23aefc1246fefcd (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:04.045554 31895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4d256597f64c68b23aefc1246fefcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.051990 31892 tablet_service.cc:1511] Processing CreateTablet for tablet 78e0ed9b586e440c98baa7861469e247 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:04.053495 31892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e0ed9b586e440c98baa7861469e247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.017510 32178 raft_consensus.cc:359] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:04.064648 32178 raft_consensus.cc:385] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.065104 32178 raft_consensus.cc:740] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.066152 32178 consensus_queue.cc:260] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:04.068014 32116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4d256597f64c68b23aefc1246fefcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.072680 32177 ts_tablet_manager.cc:1434] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.142s	user 0.007s	sys 0.004s
I20260709 13:12:04.074162 32177 tablet_bootstrap.cc:492] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:04.097388 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b84cbd41b64e929eaab29437b49118" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:04.099552 32024 leader_election.cc:343] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:04.108009 31794 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.244.2:45831, user_credentials={real_user=slave}} blocked reactor thread for 78039us
I20260709 13:12:04.105439 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b84cbd41b64e929eaab29437b49118" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:04.112157 32023 leader_election.cc:343] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.112648 32023 leader_election.cc:304] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:04.113507 32183 raft_consensus.cc:2749] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.116379 32045 tablet_service.cc:1511] Processing CreateTablet for tablet 58378bb5379a40ed94b3726a99108cca (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:04.119432 32045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58378bb5379a40ed94b3726a99108cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.117997 32117 tablet_service.cc:1511] Processing CreateTablet for tablet c8212163be194b95a51643b109e411a8 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:04.120625 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8212163be194b95a51643b109e411a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.122897 32047 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae250d6acb34e1692cfe5ab3cce75ca (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:04.132318 32119 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae250d6acb34e1692cfe5ab3cce75ca (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:04.133801 32119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae250d6acb34e1692cfe5ab3cce75ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.137650 32177 tablet_bootstrap.cc:654] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.143894 32047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae250d6acb34e1692cfe5ab3cce75ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.114926 31966 tablet_service.cc:1511] Processing CreateTablet for tablet d1a83560836343219eaeb0ba1a0bc451 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:04.152030 31968 tablet_service.cc:1511] Processing CreateTablet for tablet 58378bb5379a40ed94b3726a99108cca (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:04.153057 31966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a83560836343219eaeb0ba1a0bc451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.159492 32178 ts_tablet_manager.cc:1434] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.294s	user 0.005s	sys 0.007s
I20260709 13:12:04.160707 32178 tablet_bootstrap.cc:492] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:04.142750 32180 tablet_bootstrap.cc:654] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.149377 31898 tablet_service.cc:1511] Processing CreateTablet for tablet 58378bb5379a40ed94b3726a99108cca (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:04.162002 31898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58378bb5379a40ed94b3726a99108cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.165287 31968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58378bb5379a40ed94b3726a99108cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.180223 31970 tablet_service.cc:1511] Processing CreateTablet for tablet c8212163be194b95a51643b109e411a8 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:04.180639 31893 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae250d6acb34e1692cfe5ab3cce75ca (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:04.181684 31970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8212163be194b95a51643b109e411a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.181048 32181 tablet_bootstrap.cc:492] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:04.182008 31893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae250d6acb34e1692cfe5ab3cce75ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.182361 32181 ts_tablet_manager.cc:1403] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.423s	user 0.031s	sys 0.096s
I20260709 13:12:04.185648 32181 raft_consensus.cc:359] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:04.186410 32181 raft_consensus.cc:385] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.185672 32048 tablet_service.cc:1511] Processing CreateTablet for tablet 584ae225b8df4057bf6eb29eb393c7e2 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:04.186821 31974 tablet_service.cc:1511] Processing CreateTablet for tablet 584ae225b8df4057bf6eb29eb393c7e2 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:04.188452 31974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584ae225b8df4057bf6eb29eb393c7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.199039 32048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584ae225b8df4057bf6eb29eb393c7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.186712 32181 raft_consensus.cc:740] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.204981 32181 consensus_queue.cc:260] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:04.204998 31895 tablet_service.cc:1511] Processing CreateTablet for tablet c8212163be194b95a51643b109e411a8 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:04.210762 31895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8212163be194b95a51643b109e411a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.243080 32177 tablet_bootstrap.cc:492] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:04.243681 32177 ts_tablet_manager.cc:1403] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.170s	user 0.008s	sys 0.007s
I20260709 13:12:04.244575 32121 tablet_service.cc:1511] Processing CreateTablet for tablet 584ae225b8df4057bf6eb29eb393c7e2 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:04.245954 32121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584ae225b8df4057bf6eb29eb393c7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.246860 32177 raft_consensus.cc:359] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.247627 32177 raft_consensus.cc:385] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.250185 32177 raft_consensus.cc:740] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.252168 32177 consensus_queue.cc:260] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.260393 32177 ts_tablet_manager.cc:1434] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 13:12:04.262210 32177 tablet_bootstrap.cc:492] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:04.264770 32192 raft_consensus.cc:493] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.265370 32192 raft_consensus.cc:515] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:04.276820 32181 ts_tablet_manager.cc:1434] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.094s	user 0.013s	sys 0.009s
I20260709 13:12:04.278184 32181 tablet_bootstrap.cc:492] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:04.283972 32180 tablet_bootstrap.cc:492] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:04.284216 32186 raft_consensus.cc:493] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.284627 32180 ts_tablet_manager.cc:1403] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.326s	user 0.005s	sys 0.022s
I20260709 13:12:04.284708 32186 raft_consensus.cc:515] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:04.296607 31893 tablet_service.cc:1511] Processing CreateTablet for tablet d90689ee41da48e1bdcc50534b90c4b8 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:04.297806 32192 leader_election.cc:290] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:04.316468 32178 tablet_bootstrap.cc:654] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.319103 32181 tablet_bootstrap.cc:654] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.326866 31966 tablet_service.cc:1511] Processing CreateTablet for tablet d90689ee41da48e1bdcc50534b90c4b8 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:04.333078 32045 tablet_service.cc:1511] Processing CreateTablet for tablet d90689ee41da48e1bdcc50534b90c4b8 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:04.334059 31893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90689ee41da48e1bdcc50534b90c4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.334964 32178 tablet_bootstrap.cc:492] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:04.335638 32178 ts_tablet_manager.cc:1403] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.175s	user 0.009s	sys 0.011s
I20260709 13:12:04.338872 32178 raft_consensus.cc:359] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.339643 32178 raft_consensus.cc:385] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.340018 32178 raft_consensus.cc:740] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.339922 32180 raft_consensus.cc:359] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:04.341351 32178 consensus_queue.cc:260] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.341792 31898 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa7046f9ae649068369e98a43c01171 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:04.343421 31898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa7046f9ae649068369e98a43c01171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.345602 32047 tablet_service.cc:1511] Processing CreateTablet for tablet 69fe566df0914a4799610044a0e01daa (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:04.345995 32178 ts_tablet_manager.cc:1434] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:04.342072 32180 raft_consensus.cc:385] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.346606 32180 raft_consensus.cc:740] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.347234 32045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90689ee41da48e1bdcc50534b90c4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.347311 32178 tablet_bootstrap.cc:492] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:04.354456 32178 tablet_bootstrap.cc:654] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.354516 32047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fe566df0914a4799610044a0e01daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.356371 31966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90689ee41da48e1bdcc50534b90c4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.364082 32186 leader_election.cc:290] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:04.375197 31969 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa7046f9ae649068369e98a43c01171 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:04.376827 32180 consensus_queue.cc:260] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:04.382918 31969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa7046f9ae649068369e98a43c01171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.400619 32183 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.401221 32183 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.401785 31892 tablet_service.cc:1511] Processing CreateTablet for tablet 69fe566df0914a4799610044a0e01daa (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:04.394773 32180 ts_tablet_manager.cc:1434] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.110s	user 0.015s	sys 0.000s
I20260709 13:12:04.406898 31892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fe566df0914a4799610044a0e01daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.409849 31970 tablet_service.cc:1511] Processing CreateTablet for tablet af49880db24d43b08da39dc862b4c37b (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:04.411985 32048 tablet_service.cc:1511] Processing CreateTablet for tablet af49880db24d43b08da39dc862b4c37b (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:04.413332 32048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af49880db24d43b08da39dc862b4c37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.417093 32183 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:04.417300 32041 tablet_service.cc:1511] Processing CreateTablet for tablet 60f7547964fe4ef7aab61a37abdcb466 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:04.418679 32041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60f7547964fe4ef7aab61a37abdcb466. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.421222 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:04.422286 32133 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:04.423965 32023 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:04.425002 32183 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.425451 32183 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.425861 32183 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.430923 31897 tablet_service.cc:1511] Processing CreateTablet for tablet 60f7547964fe4ef7aab61a37abdcb466 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:04.431430 31970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af49880db24d43b08da39dc862b4c37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.432435 31897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60f7547964fe4ef7aab61a37abdcb466. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:04.436847 31855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:04.411553 32177 tablet_bootstrap.cc:654] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.468623 31967 tablet_service.cc:1511] Processing CreateTablet for tablet 60f7547964fe4ef7aab61a37abdcb466 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:04.465420 32180 tablet_bootstrap.cc:492] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:04.479074 31967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60f7547964fe4ef7aab61a37abdcb466. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.479918 32114 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa7046f9ae649068369e98a43c01171 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:04.481348 32114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa7046f9ae649068369e98a43c01171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.482446 32180 tablet_bootstrap.cc:654] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.484900 32117 tablet_service.cc:1511] Processing CreateTablet for tablet 69fe566df0914a4799610044a0e01daa (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:04.485719 32121 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:04.486277 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fe566df0914a4799610044a0e01daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.486997 32121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfd4e6006ea4c7f9d4a960a1e0ffdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.488776 32116 tablet_service.cc:1511] Processing CreateTablet for tablet 540d3a54268745adb1ed6108ca819925 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:04.490353 32116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540d3a54268745adb1ed6108ca819925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.492949 32119 tablet_service.cc:1511] Processing CreateTablet for tablet af49880db24d43b08da39dc862b4c37b (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:04.494390 32119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af49880db24d43b08da39dc862b4c37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.505584 31968 tablet_service.cc:1511] Processing CreateTablet for tablet a68212da6ed34d7ca6eada16ee48977a (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:04.507048 31968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a68212da6ed34d7ca6eada16ee48977a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.509873 32120 tablet_service.cc:1511] Processing CreateTablet for tablet a68212da6ed34d7ca6eada16ee48977a (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:04.511327 32120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a68212da6ed34d7ca6eada16ee48977a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.536967 32047 tablet_service.cc:1511] Processing CreateTablet for tablet a68212da6ed34d7ca6eada16ee48977a (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:04.538329 32047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a68212da6ed34d7ca6eada16ee48977a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.551389 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:04.555235 31950 leader_election.cc:343] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.556313 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:04.558094 32098 leader_election.cc:343] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.560093 32183 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.563153 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:04.563874 32133 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.565294 32183 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:04.565964 32183 raft_consensus.cc:493] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.566430 32183 raft_consensus.cc:515] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.573071 32048 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:04.575254 32048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfd4e6006ea4c7f9d4a960a1e0ffdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.571195 31969 tablet_service.cc:1511] Processing CreateTablet for tablet 540d3a54268745adb1ed6108ca819925 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:04.582571 32045 tablet_service.cc:1511] Processing CreateTablet for tablet 0126ecb33b074d9d8af32e047a43f067 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:04.587997 31893 tablet_service.cc:1511] Processing CreateTablet for tablet 540d3a54268745adb1ed6108ca819925 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:04.589424 31893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540d3a54268745adb1ed6108ca819925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.589100 31967 tablet_service.cc:1511] Processing CreateTablet for tablet 0126ecb33b074d9d8af32e047a43f067 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:04.590144 32186 raft_consensus.cc:493] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.590660 32186 raft_consensus.cc:515] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:04.588057 32122 tablet_service.cc:1511] Processing CreateTablet for tablet 0eecdc9a6c45481b8148098fe8e47232 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:04.592276 32045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0126ecb33b074d9d8af32e047a43f067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.593073 32122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eecdc9a6c45481b8148098fe8e47232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.594396 32133 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:04.595757 32023 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:04.596571 32186 leader_election.cc:290] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:04.606839 31898 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:04.608273 31898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfd4e6006ea4c7f9d4a960a1e0ffdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.614301 31895 tablet_service.cc:1511] Processing CreateTablet for tablet 0eecdc9a6c45481b8148098fe8e47232 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:04.615276 31897 tablet_service.cc:1511] Processing CreateTablet for tablet 0126ecb33b074d9d8af32e047a43f067 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:04.615798 31895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eecdc9a6c45481b8148098fe8e47232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.616360 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:04.617812 32024 leader_election.cc:343] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.617693 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:04.614301 31974 tablet_service.cc:1511] Processing CreateTablet for tablet 0eecdc9a6c45481b8148098fe8e47232 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:12:04.619820 32024 leader_election.cc:343] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.620597 31967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0126ecb33b074d9d8af32e047a43f067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.621235 31897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0126ecb33b074d9d8af32e047a43f067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.624706 32195 raft_consensus.cc:493] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.625279 32195 raft_consensus.cc:515] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:04.628823 32195 leader_election.cc:290] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:04.638927 32181 tablet_bootstrap.cc:492] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:04.640733 32180 tablet_bootstrap.cc:492] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:04.641168 32177 tablet_bootstrap.cc:492] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:04.641302 32180 ts_tablet_manager.cc:1403] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.179s	user 0.011s	sys 0.006s
I20260709 13:12:04.641692 32177 ts_tablet_manager.cc:1403] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.380s	user 0.015s	sys 0.005s
I20260709 13:12:04.644960 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:04.645571 32177 raft_consensus.cc:359] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.646324 32177 raft_consensus.cc:385] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:04.646494 31949 leader_election.cc:343] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.646703 32177 raft_consensus.cc:740] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.648718 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:04.649057 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:04.649189 32183 leader_election.cc:290] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
W20260709 13:12:04.650534 31951 leader_election.cc:343] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.639542 32181 ts_tablet_manager.cc:1403] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.362s	user 0.006s	sys 0.012s
I20260709 13:12:04.650990 31951 leader_election.cc:304] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:04.651780 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaedd9866a6e4923a483d1268ac000ea" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:04.653359 32178 tablet_bootstrap.cc:492] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:04.653925 32178 ts_tablet_manager.cc:1403] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.307s	user 0.031s	sys 0.026s
I20260709 13:12:04.653806 32177 consensus_queue.cc:260] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.657763 32206 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.661299 32181 raft_consensus.cc:359] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:04.661326 32117 tablet_service.cc:1511] Processing CreateTablet for tablet 7ec8220975c3487fb08ddb14edb71cf5 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 13:12:04.661949 32024 leader_election.cc:343] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.662197 32181 raft_consensus.cc:385] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.662571 32181 raft_consensus.cc:740] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.662961 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ec8220975c3487fb08ddb14edb71cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.662634 32178 raft_consensus.cc:359] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:04.646687 31969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540d3a54268745adb1ed6108ca819925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.663462 32178 raft_consensus.cc:385] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.675495 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:04.689380 32178 raft_consensus.cc:740] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.676826 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaedd9866a6e4923a483d1268ac000ea" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:04.693425 32098 leader_election.cc:343] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:04.670267 31951 leader_election.cc:343] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.695580 32098 leader_election.cc:304] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:04.707211 31951 leader_election.cc:304] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:04.698984 31893 tablet_service.cc:1511] Processing CreateTablet for tablet 7ec8220975c3487fb08ddb14edb71cf5 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:04.700462 32180 raft_consensus.cc:359] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:04.701713 32024 leader_election.cc:343] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.663403 32181 consensus_queue.cc:260] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:04.668066 32186 raft_consensus.cc:2749] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.707417 32177 ts_tablet_manager.cc:1434] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.001s
I20260709 13:12:04.698179 32178 consensus_queue.cc:260] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:04.708879 32192 raft_consensus.cc:2749] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.708879 32180 raft_consensus.cc:385] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.709408 32041 tablet_service.cc:1511] Processing CreateTablet for tablet 7ec8220975c3487fb08ddb14edb71cf5 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:04.710285 32024 leader_election.cc:304] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:04.722848 32180 raft_consensus.cc:740] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.723898 32183 raft_consensus.cc:2749] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.723754 32180 consensus_queue.cc:260] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.713835 31893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ec8220975c3487fb08ddb14edb71cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.726204 32180 ts_tablet_manager.cc:1434] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.002s
I20260709 13:12:04.687503 32206 raft_consensus.cc:697] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:04.715531 31974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eecdc9a6c45481b8148098fe8e47232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.730098 32180 tablet_bootstrap.cc:492] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:04.715512 32044 tablet_service.cc:1511] Processing CreateTablet for tablet 63944c6b0e9a466dba494a0bcdefe7de (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:04.717219 32181 ts_tablet_manager.cc:1434] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:12:04.736889 32181 tablet_bootstrap.cc:492] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:04.737761 32206 consensus_queue.cc:237] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.718497 31967 tablet_service.cc:1511] Processing CreateTablet for tablet 63944c6b0e9a466dba494a0bcdefe7de (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:04.740188 32180 tablet_bootstrap.cc:654] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.740969 31967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63944c6b0e9a466dba494a0bcdefe7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.721159 32186 raft_consensus.cc:2749] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.751941 32041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ec8220975c3487fb08ddb14edb71cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.770153 32177 tablet_bootstrap.cc:492] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:04.769979 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:04.771909 31874 leader_election.cc:343] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.766398 32181 tablet_bootstrap.cc:654] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.777194 32044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63944c6b0e9a466dba494a0bcdefe7de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:04.774560 31795 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 48687.8us
I20260709 13:12:04.778925 32121 tablet_service.cc:1511] Processing CreateTablet for tablet 63944c6b0e9a466dba494a0bcdefe7de (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:12:04.776721 31951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 106498us
I20260709 13:12:04.781821 32121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63944c6b0e9a466dba494a0bcdefe7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.797446 32178 ts_tablet_manager.cc:1434] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.143s	user 0.021s	sys 0.026s
I20260709 13:12:04.805208 32178 tablet_bootstrap.cc:492] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:04.808485 32177 tablet_bootstrap.cc:654] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.811558 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:04.813428 31875 leader_election.cc:343] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.813946 31875 leader_election.cc:304] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:04.815188 32195 raft_consensus.cc:2749] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.819303 32045 tablet_service.cc:1511] Processing CreateTablet for tablet 7a7e6bd5627e4a1cb9053e79dd3e2332 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:04.820834 32045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7e6bd5627e4a1cb9053e79dd3e2332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.820959 31974 tablet_service.cc:1511] Processing CreateTablet for tablet 7a7e6bd5627e4a1cb9053e79dd3e2332 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:04.822309 31974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7e6bd5627e4a1cb9053e79dd3e2332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.830135 32117 tablet_service.cc:1511] Processing CreateTablet for tablet 78093d7ec8724a248daf1d4269de3190 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:04.831147 32178 tablet_bootstrap.cc:654] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.831568 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78093d7ec8724a248daf1d4269de3190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.836761 31897 tablet_service.cc:1511] Processing CreateTablet for tablet 78093d7ec8724a248daf1d4269de3190 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:04.838233 31897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78093d7ec8724a248daf1d4269de3190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.843657 31967 tablet_service.cc:1511] Processing CreateTablet for tablet 78093d7ec8724a248daf1d4269de3190 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:04.845322 31967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78093d7ec8724a248daf1d4269de3190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.844725 31808 catalog_manager.cc:5697] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 1 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.848090 32206 raft_consensus.cc:493] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.848680 32206 raft_consensus.cc:515] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.850845 32206 leader_election.cc:290] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:04.851706 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858cfa025ea0471a97b28dd8a9d61990" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:04.852497 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858cfa025ea0471a97b28dd8a9d61990" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:04.852658 32047 tablet_service.cc:1511] Processing CreateTablet for tablet 209aeaad860746c39ef57d290c03b5fe (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:12:04.853304 32023 leader_election.cc:343] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:04.854027 32024 leader_election.cc:343] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.854182 32047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 209aeaad860746c39ef57d290c03b5fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.854526 32024 leader_election.cc:304] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:04.855758 32206 raft_consensus.cc:2749] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.857525 31893 tablet_service.cc:1511] Processing CreateTablet for tablet 7a7e6bd5627e4a1cb9053e79dd3e2332 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:04.859103 31893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7e6bd5627e4a1cb9053e79dd3e2332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.858906 32122 tablet_service.cc:1511] Processing CreateTablet for tablet 209aeaad860746c39ef57d290c03b5fe (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:04.860333 31892 tablet_service.cc:1511] Processing CreateTablet for tablet 209aeaad860746c39ef57d290c03b5fe (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:04.860848 32122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 209aeaad860746c39ef57d290c03b5fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.861737 31892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 209aeaad860746c39ef57d290c03b5fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.868024 31970 tablet_service.cc:1511] Processing CreateTablet for tablet 8ddd1afa9aee435da29e4c2ee2885a46 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:04.869678 31970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ddd1afa9aee435da29e4c2ee2885a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.886142 32044 tablet_service.cc:1511] Processing CreateTablet for tablet 8ddd1afa9aee435da29e4c2ee2885a46 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:04.887184 32178 tablet_bootstrap.cc:492] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:04.887588 32044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ddd1afa9aee435da29e4c2ee2885a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.902967 32117 tablet_service.cc:1511] Processing CreateTablet for tablet 8ddd1afa9aee435da29e4c2ee2885a46 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:04.911536 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ddd1afa9aee435da29e4c2ee2885a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.888850 32178 ts_tablet_manager.cc:1403] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.002s
I20260709 13:12:04.922880 32178 raft_consensus.cc:359] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:04.928833 32195 raft_consensus.cc:493] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.929690 32195 raft_consensus.cc:515] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:04.934389 32177 tablet_bootstrap.cc:492] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:04.935248 32177 ts_tablet_manager.cc:1403] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.013s
I20260709 13:12:04.925722 32178 raft_consensus.cc:385] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.939230 32178 raft_consensus.cc:740] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.941345 31898 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7bb527b8174d1792395c79a82a224c (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:04.943110 31898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7bb527b8174d1792395c79a82a224c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.943956 32177 raft_consensus.cc:359] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.944666 32181 tablet_bootstrap.cc:492] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:04.944800 32177 raft_consensus.cc:385] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.945191 32177 raft_consensus.cc:740] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.947214 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d653047328d4dd8b77f83bfc9318562" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:04.948971 31875 leader_election.cc:343] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.945302 32181 ts_tablet_manager.cc:1403] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.209s	user 0.015s	sys 0.008s
I20260709 13:12:04.953251 32181 raft_consensus.cc:359] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.953848 32181 raft_consensus.cc:385] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.954164 32181 raft_consensus.cc:740] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.955106 31974 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7bb527b8174d1792395c79a82a224c (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:04.956693 31974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7bb527b8174d1792395c79a82a224c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.957706 32195 leader_election.cc:290] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:04.967859 32181 consensus_queue.cc:260] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:04.977451 32044 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7bb527b8174d1792395c79a82a224c (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:04.978672 32213 raft_consensus.cc:493] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.979360 32044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7bb527b8174d1792395c79a82a224c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.981071 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d653047328d4dd8b77f83bfc9318562" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:04.979287 32213 raft_consensus.cc:515] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:04.984082 32213 leader_election.cc:290] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:04.984954 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b84cbd41b64e929eaab29437b49118" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:04.986562 32098 leader_election.cc:343] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.988504 32117 tablet_service.cc:1511] Processing CreateTablet for tablet f4253f6805a1465ca31a5979bb0632e6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:04.989777 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4253f6805a1465ca31a5979bb0632e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:04.986619 31876 leader_election.cc:343] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.994560 31876 leader_election.cc:304] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224
I20260709 13:12:04.995577 32195 raft_consensus.cc:2749] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.969702 32178 consensus_queue.cc:260] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:04.998092 32180 tablet_bootstrap.cc:492] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:04.998703 32180 ts_tablet_manager.cc:1403] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.269s	user 0.016s	sys 0.027s
I20260709 13:12:05.001308 32178 ts_tablet_manager.cc:1434] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:12:05.002457 32178 tablet_bootstrap.cc:492] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:05.007186 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b84cbd41b64e929eaab29437b49118" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:05.008033 32058 raft_consensus.cc:2468] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:05.009713 32099 leader_election.cc:304] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:05.010614 32213 raft_consensus.cc:2804] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.011029 32213 raft_consensus.cc:493] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.011374 32213 raft_consensus.cc:3060] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.003710 32180 raft_consensus.cc:359] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.014313 32180 raft_consensus.cc:385] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.014612 32180 raft_consensus.cc:740] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.015365 32180 consensus_queue.cc:260] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.017611 32180 ts_tablet_manager.cc:1434] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:12:05.019124 32181 ts_tablet_manager.cc:1434] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:12:04.974164 32177 consensus_queue.cc:260] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.020715 32213 raft_consensus.cc:515] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.022176 32177 ts_tablet_manager.cc:1434] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.001s
I20260709 13:12:05.023344 32177 tablet_bootstrap.cc:492] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:05.003883 31893 tablet_service.cc:1511] Processing CreateTablet for tablet f4253f6805a1465ca31a5979bb0632e6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:05.025230 31893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4253f6805a1465ca31a5979bb0632e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.029932 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b84cbd41b64e929eaab29437b49118" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:05.030654 31984 raft_consensus.cc:3060] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.032336 32213 leader_election.cc:290] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:05.033682 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b84cbd41b64e929eaab29437b49118" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:05.034436 32058 raft_consensus.cc:3060] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.028527 31970 tablet_service.cc:1511] Processing CreateTablet for tablet f4253f6805a1465ca31a5979bb0632e6 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:05.036805 31970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4253f6805a1465ca31a5979bb0632e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.039198 31984 raft_consensus.cc:2468] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:05.041714 32098 leader_election.cc:304] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:05.040572 32180 tablet_bootstrap.cc:492] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:05.042601 32213 raft_consensus.cc:2804] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.042204 32058 raft_consensus.cc:2468] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:05.043871 32213 raft_consensus.cc:697] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:05.046330 32213 consensus_queue.cc:237] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.046710 32047 tablet_service.cc:1511] Processing CreateTablet for tablet f7682585da6947c291d67650d6affddd (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:05.047977 32047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7682585da6947c291d67650d6affddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.051267 32181 tablet_bootstrap.cc:492] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:05.050536 32177 tablet_bootstrap.cc:654] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.064283 32117 tablet_service.cc:1511] Processing CreateTablet for tablet f7682585da6947c291d67650d6affddd (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:05.065368 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7682585da6947c291d67650d6affddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.076505 31974 tablet_service.cc:1511] Processing CreateTablet for tablet 3c4dd4a38fc647e3a2ad4a953c649261 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:05.078066 31974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c4dd4a38fc647e3a2ad4a953c649261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.079145 32180 tablet_bootstrap.cc:654] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.083294 32178 tablet_bootstrap.cc:654] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.092872 32047 tablet_service.cc:1511] Processing CreateTablet for tablet 3c4dd4a38fc647e3a2ad4a953c649261 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:05.089129 31893 tablet_service.cc:1511] Processing CreateTablet for tablet f7682585da6947c291d67650d6affddd (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:05.098857 31893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7682585da6947c291d67650d6affddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.100109 32047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c4dd4a38fc647e3a2ad4a953c649261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.107220 32177 tablet_bootstrap.cc:492] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:05.107811 32177 ts_tablet_manager.cc:1403] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.006s
I20260709 13:12:05.110664 32121 tablet_service.cc:1511] Processing CreateTablet for tablet 3c4dd4a38fc647e3a2ad4a953c649261 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:05.112123 32121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c4dd4a38fc647e3a2ad4a953c649261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.112288 31806 catalog_manager.cc:5697] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.131284 32178 tablet_bootstrap.cc:492] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:05.132164 32178 ts_tablet_manager.cc:1403] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.003s
I20260709 13:12:05.142925 31898 tablet_service.cc:1511] Processing CreateTablet for tablet 63d9f17e553345b4b6a7c1aad8e8c058 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:05.144583 31898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d9f17e553345b4b6a7c1aad8e8c058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.174448 32180 tablet_bootstrap.cc:492] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:05.180078 32180 ts_tablet_manager.cc:1403] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.140s	user 0.019s	sys 0.017s
I20260709 13:12:05.181046 32213 raft_consensus.cc:493] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.182469 32213 raft_consensus.cc:515] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.185813 32181 tablet_bootstrap.cc:654] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.188892 32177 raft_consensus.cc:359] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.189138 32178 raft_consensus.cc:359] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.189818 32177 raft_consensus.cc:385] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.190059 32178 raft_consensus.cc:385] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.190181 32177 raft_consensus.cc:740] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.190616 32178 raft_consensus.cc:740] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.191453 32178 consensus_queue.cc:260] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.191416 32177 consensus_queue.cc:260] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.195482 32212 raft_consensus.cc:493] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.195230 31970 tablet_service.cc:1511] Processing CreateTablet for tablet 63d9f17e553345b4b6a7c1aad8e8c058 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:05.196038 32212 raft_consensus.cc:515] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.196957 31970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d9f17e553345b4b6a7c1aad8e8c058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.199137 32212 leader_election.cc:290] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:05.198907 32180 raft_consensus.cc:359] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.201333 32180 raft_consensus.cc:385] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.202982 32180 raft_consensus.cc:740] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.201357 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaedd9866a6e4923a483d1268ac000ea" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:05.205552 32058 raft_consensus.cc:2468] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:05.201987 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaedd9866a6e4923a483d1268ac000ea" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:05.206959 31951 leader_election.cc:304] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
W20260709 13:12:05.208833 31950 leader_election.cc:343] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.213917 31909 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.225144 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:05.229246 32098 leader_election.cc:343] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.235149 32212 raft_consensus.cc:2804] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.235970 32212 raft_consensus.cc:493] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.236545 32212 raft_consensus.cc:3060] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.264654 32047 tablet_service.cc:1511] Processing CreateTablet for tablet 63d9f17e553345b4b6a7c1aad8e8c058 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:05.265264 32206 raft_consensus.cc:493] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.272344 32206 raft_consensus.cc:515] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.285300 32047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d9f17e553345b4b6a7c1aad8e8c058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.293994 32178 ts_tablet_manager.cc:1434] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.161s	user 0.012s	sys 0.013s
I20260709 13:12:05.293797 32180 consensus_queue.cc:260] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.297940 32178 tablet_bootstrap.cc:492] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:05.298039 32181 tablet_bootstrap.cc:492] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:05.298595 32181 ts_tablet_manager.cc:1403] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.248s	user 0.016s	sys 0.036s
I20260709 13:12:05.298811 32213 leader_election.cc:290] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:05.300174 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:05.300706 32177 ts_tablet_manager.cc:1434] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.193s	user 0.013s	sys 0.010s
I20260709 13:12:05.301822 32177 tablet_bootstrap.cc:492] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
W20260709 13:12:05.302307 32098 leader_election.cc:343] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.302136 32181 raft_consensus.cc:359] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.302968 32181 raft_consensus.cc:385] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.302924 32098 leader_election.cc:304] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
W20260709 13:12:05.304253 31793 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 81578us
I20260709 13:12:05.303475 32181 raft_consensus.cc:740] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.313637 32212 raft_consensus.cc:515] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.314831 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a24126e79904519a77414eb98380575" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:05.315605 31984 raft_consensus.cc:2468] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:05.306191 32213 raft_consensus.cc:2749] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.317510 32024 leader_election.cc:304] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
W20260709 13:12:05.306355 31950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 97584.2us
I20260709 13:12:05.320899 31893 tablet_service.cc:1511] Processing CreateTablet for tablet 15722eb44a144050b7a810716b0fb150 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:05.321393 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a24126e79904519a77414eb98380575" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:05.322254 31893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15722eb44a144050b7a810716b0fb150. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:05.323168 32023 leader_election.cc:343] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.323033 32117 tablet_service.cc:1511] Processing CreateTablet for tablet 15722eb44a144050b7a810716b0fb150 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:05.324391 32117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15722eb44a144050b7a810716b0fb150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.337179 31974 tablet_service.cc:1511] Processing CreateTablet for tablet 15722eb44a144050b7a810716b0fb150 (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:05.337757 32044 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7b78e7c3d1417b8b4035b246334cbe (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:05.338812 31974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15722eb44a144050b7a810716b0fb150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.339372 32044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7b78e7c3d1417b8b4035b246334cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.341547 31898 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7b78e7c3d1417b8b4035b246334cbe (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:05.343036 31898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7b78e7c3d1417b8b4035b246334cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.325686 32206 leader_election.cc:290] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:05.343097 32121 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7b78e7c3d1417b8b4035b246334cbe (DEFAULT_TABLE table=test-workload [id=84fd321ef358445087d1a777936fb3bd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:05.344882 32206 raft_consensus.cc:2804] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.345309 32206 raft_consensus.cc:493] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.345347 32121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7b78e7c3d1417b8b4035b246334cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.346340 32231 raft_consensus.cc:493] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.346984 32231 raft_consensus.cc:515] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.325811 32181 consensus_queue.cc:260] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.356676 32212 leader_election.cc:290] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:05.356799 32206 raft_consensus.cc:3060] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.361907 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaedd9866a6e4923a483d1268ac000ea" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:05.368077 31910 raft_consensus.cc:3060] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.362458 32181 ts_tablet_manager.cc:1434] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:12:05.372853 32181 tablet_bootstrap.cc:492] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:05.377270 31910 raft_consensus.cc:2468] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:05.377568 32180 ts_tablet_manager.cc:1434] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.195s	user 0.010s	sys 0.035s
I20260709 13:12:05.378204 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c923d9fd0eba46a5bd77f4b0359907ad" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:05.378996 32180 tablet_bootstrap.cc:492] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:05.381757 32178 tablet_bootstrap.cc:654] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.378957 32133 raft_consensus.cc:2468] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:05.383639 32023 leader_election.cc:304] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:05.392027 32181 tablet_bootstrap.cc:654] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.403569 31950 leader_election.cc:304] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:05.404758 32212 raft_consensus.cc:2804] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.405340 32212 raft_consensus.cc:697] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:05.405473 32177 tablet_bootstrap.cc:654] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.406260 32212 consensus_queue.cc:237] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.411612 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaedd9866a6e4923a483d1268ac000ea" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:05.412501 32058 raft_consensus.cc:3060] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.422746 32058 raft_consensus.cc:2468] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:05.424114 32180 tablet_bootstrap.cc:654] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.443943 32195 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.444732 32195 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.444049 32229 raft_consensus.cc:2804] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:05.448208 32023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 64698.6us
W20260709 13:12:05.461160 31855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:05.470381 32232 consensus_queue.cc:1048] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.471045 32195 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:05.465200 32229 raft_consensus.cc:493] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.464746 32206 raft_consensus.cc:515] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.473253 32231 leader_election.cc:290] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
W20260709 13:12:05.467537 32024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 56011.6us
I20260709 13:12:05.480626 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:05.481439 32206 leader_election.cc:290] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:05.482638 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a24126e79904519a77414eb98380575" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:05.483902 32236 consensus_queue.cc:1048] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.484496 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:05.479139 32229 raft_consensus.cc:3060] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.488015 32133 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:05.491964 32181 tablet_bootstrap.cc:492] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:05.492390 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c923d9fd0eba46a5bd77f4b0359907ad" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:05.491964 31808 catalog_manager.cc:5697] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.494967 32181 ts_tablet_manager.cc:1403] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.122s	user 0.003s	sys 0.025s
I20260709 13:12:05.497557 32178 tablet_bootstrap.cc:492] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
W20260709 13:12:05.508006 32023 leader_election.cc:343] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.508117 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a24126e79904519a77414eb98380575" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:05.508841 31984 raft_consensus.cc:3060] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.508936 32181 raft_consensus.cc:359] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.509745 32181 raft_consensus.cc:385] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.510038 32181 raft_consensus.cc:740] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.510787 32181 consensus_queue.cc:260] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.499588 32178 ts_tablet_manager.cc:1403] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.202s	user 0.011s	sys 0.034s
I20260709 13:12:05.513790 31874 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a
I20260709 13:12:05.517449 32229 raft_consensus.cc:515] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.520469 32229 leader_election.cc:290] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:05.521311 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c923d9fd0eba46a5bd77f4b0359907ad" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:05.521961 32132 raft_consensus.cc:3060] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.522439 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c923d9fd0eba46a5bd77f4b0359907ad" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:05.524114 31984 raft_consensus.cc:2468] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:05.524444 32177 tablet_bootstrap.cc:492] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:05.526377 32195 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:05.529081 32180 tablet_bootstrap.cc:492] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:05.529779 32180 ts_tablet_manager.cc:1403] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.151s	user 0.016s	sys 0.005s
I20260709 13:12:05.530323 32195 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27177ca9073b4128b8844b7cb37db32a)
I20260709 13:12:05.530805 32195 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:05.531563 32132 raft_consensus.cc:2468] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
W20260709 13:12:05.527005 32024 leader_election.cc:343] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.533239 32023 leader_election.cc:304] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:05.533849 32177 ts_tablet_manager.cc:1403] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.232s	user 0.016s	sys 0.011s
I20260709 13:12:05.540138 32229 raft_consensus.cc:2804] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.540004 32195 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.540688 32229 raft_consensus.cc:697] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:05.541544 32229 consensus_queue.cc:237] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.543272 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:05.544902 32178 raft_consensus.cc:359] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.548877 32178 raft_consensus.cc:385] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:05.546438 32024 leader_election.cc:343] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.552866 32213 consensus_queue.cc:1048] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.554234 31910 raft_consensus.cc:1240] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Rejecting Update request from peer 27177ca9073b4128b8844b7cb37db32a for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:05.558151 32024 leader_election.cc:304] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:05.559120 32231 raft_consensus.cc:2804] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.559607 32231 raft_consensus.cc:697] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:05.560094 32195 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:05.560441 32231 consensus_queue.cc:237] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.561475 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:05.563212 31874 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:05.564815 32195 raft_consensus.cc:2749] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:05.566471 32232 consensus_queue.cc:1059] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.567859 32181 ts_tablet_manager.cc:1434] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.073s	user 0.014s	sys 0.008s
I20260709 13:12:05.568091 32236 raft_consensus.cc:3055] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:05.568631 32236 raft_consensus.cc:740] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:05.569631 32236 consensus_queue.cc:260] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.574249 32236 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:05.577082 32181 tablet_bootstrap.cc:492] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:05.572913 32178 raft_consensus.cc:740] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.547839 32177 raft_consensus.cc:359] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.578606 32177 raft_consensus.cc:385] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.535692 32180 raft_consensus.cc:359] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.579190 32180 raft_consensus.cc:385] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.579552 32180 raft_consensus.cc:740] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.580542 32180 consensus_queue.cc:260] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.585979 32181 tablet_bootstrap.cc:654] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.590516 32177 raft_consensus.cc:740] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.600623 31808 catalog_manager.cc:5697] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 1 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.578052 32178 consensus_queue.cc:260] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.605852 32177 consensus_queue.cc:260] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.606989 32213 raft_consensus.cc:493] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.609249 32213 raft_consensus.cc:515] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.614738 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:05.615520 31910 raft_consensus.cc:2468] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:05.615983 32213 leader_election.cc:290] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:05.617753 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:05.619381 32098 leader_election.cc:304] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:05.620528 32213 raft_consensus.cc:2804] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.620916 32213 raft_consensus.cc:493] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.621260 32213 raft_consensus.cc:3060] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:05.624724 32098 leader_election.cc:343] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.592638 32180 ts_tablet_manager.cc:1434] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 13:12:05.638880 32180 tablet_bootstrap.cc:492] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:05.639828 32178 ts_tablet_manager.cc:1434] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.115s	user 0.008s	sys 0.003s
I20260709 13:12:05.640610 32177 ts_tablet_manager.cc:1434] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.103s	user 0.005s	sys 0.004s
I20260709 13:12:05.643033 32177 tablet_bootstrap.cc:492] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:05.645838 32178 tablet_bootstrap.cc:492] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:05.646119 32213 raft_consensus.cc:515] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.654263 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:05.654908 31910 raft_consensus.cc:3060] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.647013 32250 consensus_queue.cc:1048] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.663071 31910 raft_consensus.cc:2468] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:05.647666 32180 tablet_bootstrap.cc:654] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.668879 32098 leader_election.cc:304] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:05.671564 32248 raft_consensus.cc:2804] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.666628 31806 catalog_manager.cc:5697] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 1 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.675424 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
W20260709 13:12:05.677116 32098 leader_election.cc:343] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.678251 32213 leader_election.cc:290] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:05.683538 32248 raft_consensus.cc:697] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:05.684674 32248 consensus_queue.cc:237] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.686753 32181 tablet_bootstrap.cc:492] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:05.687292 32181 ts_tablet_manager.cc:1403] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.110s	user 0.048s	sys 0.027s
I20260709 13:12:05.691102 32181 raft_consensus.cc:359] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.691975 32181 raft_consensus.cc:385] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.692282 32181 raft_consensus.cc:740] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.693048 32181 consensus_queue.cc:260] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.696791 32181 ts_tablet_manager.cc:1434] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:12:05.697127 32177 tablet_bootstrap.cc:654] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.697932 32181 tablet_bootstrap.cc:492] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:05.704967 32180 tablet_bootstrap.cc:492] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:05.705561 32180 ts_tablet_manager.cc:1403] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.000s
I20260709 13:12:05.714625 32181 tablet_bootstrap.cc:654] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.715097 32178 tablet_bootstrap.cc:654] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.723534 32180 raft_consensus.cc:359] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.726461 32180 raft_consensus.cc:385] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.726797 32180 raft_consensus.cc:740] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.730000 32177 tablet_bootstrap.cc:492] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:05.730553 32177 ts_tablet_manager.cc:1403] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.088s	user 0.003s	sys 0.008s
I20260709 13:12:05.733786 32177 raft_consensus.cc:359] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.734570 32177 raft_consensus.cc:385] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.733656 31807 catalog_manager.cc:5697] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.734863 32177 raft_consensus.cc:740] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.735627 32177 consensus_queue.cc:260] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.737089 32180 consensus_queue.cc:260] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.740772 32180 ts_tablet_manager.cc:1434] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:12:05.741940 32180 tablet_bootstrap.cc:492] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:05.738005 32177 ts_tablet_manager.cc:1434] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:12:05.749058 32177 tablet_bootstrap.cc:492] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:05.757488 32177 tablet_bootstrap.cc:654] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.758831 32181 tablet_bootstrap.cc:492] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:05.759503 32181 ts_tablet_manager.cc:1403] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.062s	user 0.006s	sys 0.028s
I20260709 13:12:05.760931 32178 tablet_bootstrap.cc:492] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:05.761480 32178 ts_tablet_manager.cc:1403] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.116s	user 0.018s	sys 0.004s
I20260709 13:12:05.764088 32181 raft_consensus.cc:359] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.764856 32178 raft_consensus.cc:359] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.765377 32181 raft_consensus.cc:385] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.765926 32178 raft_consensus.cc:385] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.765974 32181 raft_consensus.cc:740] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.766448 32178 raft_consensus.cc:740] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.767441 32178 consensus_queue.cc:260] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.767347 32181 consensus_queue.cc:260] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.771596 32180 tablet_bootstrap.cc:654] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.773252 32178 ts_tablet_manager.cc:1434] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:05.774441 32178 tablet_bootstrap.cc:492] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:05.776517 32177 tablet_bootstrap.cc:492] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:05.777089 32177 ts_tablet_manager.cc:1403] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.005s
I20260709 13:12:05.775210 32181 ts_tablet_manager.cc:1434] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:12:05.778517 32181 tablet_bootstrap.cc:492] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:05.780592 32177 raft_consensus.cc:359] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.781404 32177 raft_consensus.cc:385] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.781705 32177 raft_consensus.cc:740] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.782618 32177 consensus_queue.cc:260] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.785689 32177 ts_tablet_manager.cc:1434] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:05.786118 32178 tablet_bootstrap.cc:654] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.786976 32177 tablet_bootstrap.cc:492] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:05.795212 32180 tablet_bootstrap.cc:492] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:05.795794 32181 tablet_bootstrap.cc:654] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.795904 32180 ts_tablet_manager.cc:1403] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.000s
I20260709 13:12:05.797861 32178 tablet_bootstrap.cc:492] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:05.798422 32178 ts_tablet_manager.cc:1403] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:12:05.799768 32180 raft_consensus.cc:359] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.800637 32180 raft_consensus.cc:385] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.800539 32178 raft_consensus.cc:359] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.801083 32180 raft_consensus.cc:740] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.801244 32178 raft_consensus.cc:385] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.801620 32178 raft_consensus.cc:740] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.802073 32180 consensus_queue.cc:260] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.802421 32178 consensus_queue.cc:260] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.804859 32178 ts_tablet_manager.cc:1434] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:05.805428 32181 tablet_bootstrap.cc:492] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:05.805967 32181 ts_tablet_manager.cc:1403] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.008s
I20260709 13:12:05.806282 32178 tablet_bootstrap.cc:492] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:05.808065 32180 ts_tablet_manager.cc:1434] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:05.811040 32180 tablet_bootstrap.cc:492] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:05.808975 32177 tablet_bootstrap.cc:654] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.814209 32195 raft_consensus.cc:493] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.809016 32181 raft_consensus.cc:359] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.815323 32181 raft_consensus.cc:385] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.814965 32195 raft_consensus.cc:515] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.815660 32181 raft_consensus.cc:740] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.817510 32195 leader_election.cc:290] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:05.816821 32181 consensus_queue.cc:260] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.818320 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c923d9fd0eba46a5bd77f4b0359907ad" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:05.819250 32181 ts_tablet_manager.cc:1434] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:12:05.820416 32181 tablet_bootstrap.cc:492] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:05.823496 32178 tablet_bootstrap.cc:654] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.824890 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c923d9fd0eba46a5bd77f4b0359907ad" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:05.825908 32131 raft_consensus.cc:2393] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
I20260709 13:12:05.827225 31874 leader_election.cc:304] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:05.828122 32195 raft_consensus.cc:3060] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.831714 32180 tablet_bootstrap.cc:654] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.833403 32181 tablet_bootstrap.cc:654] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.832928 32177 tablet_bootstrap.cc:492] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:05.836640 32195 raft_consensus.cc:2749] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.837381 32177 ts_tablet_manager.cc:1403] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.001s
I20260709 13:12:05.843253 32177 raft_consensus.cc:359] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.843829 32178 tablet_bootstrap.cc:492] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:05.843904 32177 raft_consensus.cc:385] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.844795 32177 raft_consensus.cc:740] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.844900 32178 ts_tablet_manager.cc:1403] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.003s
I20260709 13:12:05.845909 32177 consensus_queue.cc:260] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.846844 32180 tablet_bootstrap.cc:492] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:05.847410 32180 ts_tablet_manager.cc:1403] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 13:12:05.849331 32178 raft_consensus.cc:359] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.850453 32178 raft_consensus.cc:385] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.850894 32178 raft_consensus.cc:740] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.850577 32180 raft_consensus.cc:359] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.851552 32180 raft_consensus.cc:385] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.852862 32178 consensus_queue.cc:260] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:05.854898 32181 tablet_bootstrap.cc:492] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:05.855319 32178 ts_tablet_manager.cc:1434] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:12:05.855453 32181 ts_tablet_manager.cc:1403] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.005s
I20260709 13:12:05.856387 32178 tablet_bootstrap.cc:492] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:05.851893 32180 raft_consensus.cc:740] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.858126 32177 ts_tablet_manager.cc:1434] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:12:05.858906 32195 raft_consensus.cc:493] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.859402 32177 tablet_bootstrap.cc:492] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:05.859519 32195 raft_consensus.cc:515] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.862253 32195 leader_election.cc:290] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:05.863055 32212 raft_consensus.cc:493] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.863669 32212 raft_consensus.cc:515] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.865985 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1c9b1a299481d9675857f807393c6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:05.867180 32181 raft_consensus.cc:359] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.867686 32177 tablet_bootstrap.cc:654] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.868026 32181 raft_consensus.cc:385] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.869338 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d653047328d4dd8b77f83bfc9318562" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:05.870113 31910 raft_consensus.cc:2468] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:05.863751 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1c9b1a299481d9675857f807393c6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
W20260709 13:12:05.867748 31875 leader_election.cc:343] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.868389 32181 raft_consensus.cc:740] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.872751 32058 raft_consensus.cc:2468] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:05.873965 32178 tablet_bootstrap.cc:654] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.873723 32181 consensus_queue.cc:260] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.871876 31950 leader_election.cc:304] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:05.874513 31876 leader_election.cc:304] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:05.858294 32180 consensus_queue.cc:260] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.885087 32181 ts_tablet_manager.cc:1434] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:12:05.886763 32181 tablet_bootstrap.cc:492] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:05.886811 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d653047328d4dd8b77f83bfc9318562" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:05.887816 32058 raft_consensus.cc:2468] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:05.887980 32230 raft_consensus.cc:2804] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.888705 32230 raft_consensus.cc:493] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.889192 32230 raft_consensus.cc:3060] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.889712 32212 leader_election.cc:290] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:05.891888 32195 raft_consensus.cc:2804] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.892354 32195 raft_consensus.cc:493] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.892728 32195 raft_consensus.cc:3060] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.904206 32270 consensus_queue.cc:1048] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.924278 32181 tablet_bootstrap.cc:654] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.932981 32236 consensus_queue.cc:1048] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.941542 32177 tablet_bootstrap.cc:492] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:05.942497 32177 ts_tablet_manager.cc:1403] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.083s	user 0.017s	sys 0.033s
I20260709 13:12:05.927398 32195 raft_consensus.cc:515] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.941746 32178 tablet_bootstrap.cc:492] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:05.947115 32178 ts_tablet_manager.cc:1403] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.091s	user 0.025s	sys 0.030s
I20260709 13:12:05.946389 32177 raft_consensus.cc:359] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.948107 32177 raft_consensus.cc:385] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.948254 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1c9b1a299481d9675857f807393c6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:05.948483 32177 raft_consensus.cc:740] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.948532 32230 raft_consensus.cc:515] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.948998 32058 raft_consensus.cc:3060] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.949425 32177 consensus_queue.cc:260] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:05.951912 32248 raft_consensus.cc:493] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.952491 32248 raft_consensus.cc:515] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:05.954972 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1c9b1a299481d9675857f807393c6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:05.956307 32230 leader_election.cc:290] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:05.958120 32058 raft_consensus.cc:2468] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:05.959276 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a24126e79904519a77414eb98380575" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:05.959522 31876 leader_election.cc:304] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:05.946358 32195 leader_election.cc:290] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:05.961611 32241 raft_consensus.cc:2804] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.961797 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a24126e79904519a77414eb98380575" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:05.962055 32272 raft_consensus.cc:493] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.963709 31984 raft_consensus.cc:2393] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 1: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
I20260709 13:12:05.960877 32248 leader_election.cc:290] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
W20260709 13:12:05.965161 31875 leader_election.cc:343] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.965562 32272 raft_consensus.cc:515] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:05.969563 32099 leader_election.cc:304] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224
I20260709 13:12:05.974651 32180 ts_tablet_manager.cc:1434] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.127s	user 0.020s	sys 0.015s
I20260709 13:12:05.971530 32248 raft_consensus.cc:3060] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.977351 32177 ts_tablet_manager.cc:1434] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.004s
I20260709 13:12:05.979967 32177 tablet_bootstrap.cc:492] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:05.982409 32180 tablet_bootstrap.cc:492] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:05.987625 32236 raft_consensus.cc:493] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.988524 32236 raft_consensus.cc:515] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.004011 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d653047328d4dd8b77f83bfc9318562" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:06.005817 31909 raft_consensus.cc:3060] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.012602 32212 consensus_queue.cc:1048] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.012938 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d653047328d4dd8b77f83bfc9318562" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:06.013868 32058 raft_consensus.cc:3060] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.014456 32212 raft_consensus.cc:493] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.015043 32212 raft_consensus.cc:515] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.015223 32213 raft_consensus.cc:493] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.015211 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.016294 32213 raft_consensus.cc:515] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.016671 32132 raft_consensus.cc:2468] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:06.017272 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98700f72c2d466b951e6776bdc74e2f" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.019917 32272 leader_election.cc:290] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
W20260709 13:12:06.023849 32023 leader_election.cc:343] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.024015 32241 raft_consensus.cc:697] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:06.024526 32276 raft_consensus.cc:493] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.025113 32276 raft_consensus.cc:515] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.027673 31949 leader_election.cc:304] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:06.028832 32276 leader_election.cc:290] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:06.029839 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98700f72c2d466b951e6776bdc74e2f" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:06.031277 32212 leader_election.cc:290] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:06.032121 32212 raft_consensus.cc:2804] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.032539 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858cfa025ea0471a97b28dd8a9d61990" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:06.033329 32059 raft_consensus.cc:2468] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:06.033648 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858cfa025ea0471a97b28dd8a9d61990" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:06.031374 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858cfa025ea0471a97b28dd8a9d61990" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.034509 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.035207 32213 leader_election.cc:290] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:06.034683 32133 raft_consensus.cc:2468] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
W20260709 13:12:06.013351 32274 log.cc:927] Time spent T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:12:06.032516 32212 raft_consensus.cc:493] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.036427 32212 raft_consensus.cc:3060] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.037001 31874 leader_election.cc:304] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:06.034425 31908 raft_consensus.cc:2468] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:06.037765 32181 tablet_bootstrap.cc:492] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:06.038333 32181 ts_tablet_manager.cc:1403] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.152s	user 0.029s	sys 0.032s
W20260709 13:12:06.038822 32024 leader_election.cc:343] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.039113 32098 leader_election.cc:304] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:06.039433 32024 leader_election.cc:304] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:06.016202 32178 raft_consensus.cc:359] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.040345 32231 raft_consensus.cc:2749] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.025408 32241 consensus_queue.cc:237] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.012632 32236 leader_election.cc:290] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:06.044672 32177 tablet_bootstrap.cc:654] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.040446 32178 raft_consensus.cc:385] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.046667 32178 raft_consensus.cc:740] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.023913 31909 raft_consensus.cc:2468] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:06.049348 32181 raft_consensus.cc:359] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.050139 32181 raft_consensus.cc:385] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.035310 32180 tablet_bootstrap.cc:654] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.052158 32248 raft_consensus.cc:2749] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.050485 32181 raft_consensus.cc:740] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.054284 31950 leader_election.cc:304] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:06.054592 32181 consensus_queue.cc:260] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.055110 32195 raft_consensus.cc:2804] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.055546 32195 raft_consensus.cc:493] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.055783 32230 raft_consensus.cc:2804] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.055974 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:06.056155 32276 raft_consensus.cc:493] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.057029 31908 raft_consensus.cc:2393] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab61be703111416d9fba543ea97b2224 in current term 1: Already voted for candidate eacc546e751240eb804795d98213a57c in this term.
I20260709 13:12:06.057469 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:06.057686 32276 raft_consensus.cc:515] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.058765 32177 tablet_bootstrap.cc:492] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:06.058701 31950 leader_election.cc:304] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:06.059484 32177 ts_tablet_manager.cc:1403] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.000s
I20260709 13:12:06.060068 32272 raft_consensus.cc:3060] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.061313 32276 leader_election.cc:290] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:06.062892 32177 raft_consensus.cc:359] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.063092 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:06.063479 32177 raft_consensus.cc:385] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.061235 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.067215 32177 raft_consensus.cc:740] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.067497 32131 raft_consensus.cc:2468] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:06.054908 32231 consensus_queue.cc:1048] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:06.068171 32181 ts_tablet_manager.cc:1434] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.003s
I20260709 13:12:06.068536 32177 consensus_queue.cc:260] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.069365 32181 tablet_bootstrap.cc:492] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:06.064098 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858cfa025ea0471a97b28dd8a9d61990" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:06.070358 32059 raft_consensus.cc:2468] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:06.071257 32177 ts_tablet_manager.cc:1434] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:06.040541 32213 raft_consensus.cc:2804] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.071975 31874 leader_election.cc:304] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:06.072329 32213 raft_consensus.cc:493] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.072824 32177 tablet_bootstrap.cc:492] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:06.072774 32213 raft_consensus.cc:3060] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.073221 32281 raft_consensus.cc:2804] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.073715 32281 raft_consensus.cc:493] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.056015 32195 raft_consensus.cc:3060] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.084007 32281 raft_consensus.cc:3060] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.088912 32181 tablet_bootstrap.cc:654] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.091643 32213 raft_consensus.cc:515] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.047585 32178 consensus_queue.cc:260] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.056501 32230 raft_consensus.cc:697] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:06.096448 32177 tablet_bootstrap.cc:654] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.099633 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858cfa025ea0471a97b28dd8a9d61990" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:06.100598 32059 raft_consensus.cc:3060] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.109563 32231 consensus_queue.cc:1048] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.119225 32230 consensus_queue.cc:237] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.119434 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858cfa025ea0471a97b28dd8a9d61990" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:06.122416 32178 ts_tablet_manager.cc:1434] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.175s	user 0.008s	sys 0.000s
I20260709 13:12:06.127856 32178 tablet_bootstrap.cc:492] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:06.114516 32213 leader_election.cc:290] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:06.145380 32181 tablet_bootstrap.cc:492] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:06.146066 32181 ts_tablet_manager.cc:1403] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.005s
I20260709 13:12:06.154764 32276 raft_consensus.cc:493] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.155427 32276 raft_consensus.cc:515] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.155719 32181 raft_consensus.cc:359] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.156520 32181 raft_consensus.cc:385] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.154860 32180 tablet_bootstrap.cc:492] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:06.156828 32270 raft_consensus.cc:493] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.156854 32181 raft_consensus.cc:740] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.157469 32270 raft_consensus.cc:515] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.158895 32181 consensus_queue.cc:260] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.157444 32180 ts_tablet_manager.cc:1403] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.181s	user 0.030s	sys 0.020s
I20260709 13:12:06.161208 32276 leader_election.cc:290] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:06.162679 31983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:06.156328 32058 raft_consensus.cc:2468] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:06.164137 31983 raft_consensus.cc:2468] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:06.164604 32270 leader_election.cc:290] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:06.166389 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.148947 32213 consensus_queue.cc:1048] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:12:06.166992 32059 raft_consensus.cc:2468] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:06.161583 32231 raft_consensus.cc:493] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.163033 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.166303 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:06.167766 32180 raft_consensus.cc:359] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.184523 32180 raft_consensus.cc:385] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.180227 32213 raft_consensus.cc:493] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.168648 32099 leader_election.cc:304] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:06.186241 32180 raft_consensus.cc:740] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.189985 32178 tablet_bootstrap.cc:654] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.188848 32181 ts_tablet_manager.cc:1434] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.042s	user 0.011s	sys 0.001s
I20260709 13:12:06.191960 32181 tablet_bootstrap.cc:492] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:06.167213 32132 raft_consensus.cc:2468] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:06.193284 32229 raft_consensus.cc:493] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.183935 31907 raft_consensus.cc:2468] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:06.196162 32229 raft_consensus.cc:515] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.184280 32231 raft_consensus.cc:515] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.199028 32231 leader_election.cc:290] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:06.167826 31875 leader_election.cc:304] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:06.200146 31950 leader_election.cc:304] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:06.200459 32287 raft_consensus.cc:2804] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.200991 32287 raft_consensus.cc:493] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.201366 32287 raft_consensus.cc:3060] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.201929 31983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:06.202728 31983 raft_consensus.cc:2468] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:06.203769 32248 raft_consensus.cc:2804] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.204393 32248 raft_consensus.cc:697] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:06.205380 32270 raft_consensus.cc:2804] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.205305 32248 consensus_queue.cc:237] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.206374 32272 raft_consensus.cc:2749] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.208072 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.205973 32270 raft_consensus.cc:493] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.209133 32270 raft_consensus.cc:3060] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.194228 32180 consensus_queue.cc:260] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.212834 32276 raft_consensus.cc:493] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.213162 32180 ts_tablet_manager.cc:1434] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:12:06.213097 32177 tablet_bootstrap.cc:492] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:06.214282 32177 ts_tablet_manager.cc:1403] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.142s	user 0.017s	sys 0.004s
I20260709 13:12:06.160000 32281 raft_consensus.cc:515] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.220960 32180 tablet_bootstrap.cc:492] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:06.226286 32229 leader_election.cc:290] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:06.227130 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:06.227052 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:06.228060 31907 raft_consensus.cc:2468] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:06.228217 31909 raft_consensus.cc:2393] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab61be703111416d9fba543ea97b2224 in current term 1: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
I20260709 13:12:06.213389 32276 raft_consensus.cc:515] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.210310 32212 raft_consensus.cc:515] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.192441 32213 raft_consensus.cc:515] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.239408 32290 raft_consensus.cc:493] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.240361 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:06.241235 32133 raft_consensus.cc:3060] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.231148 32024 leader_election.cc:304] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:06.216015 32195 raft_consensus.cc:515] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.216643 32231 consensus_queue.cc:1048] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:12:06.230868 32281 leader_election.cc:290] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:06.240098 32290 raft_consensus.cc:515] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.273453 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01da40464a4c3e907fbd4a05e7cf08" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:06.278945 32272 raft_consensus.cc:493] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.279613 32272 raft_consensus.cc:515] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.279979 32254 consensus_queue.cc:1048] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:12:06.282997 31910 raft_consensus.cc:2393] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 1: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
I20260709 13:12:06.283124 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:06.286346 32133 raft_consensus.cc:2468] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:06.274744 32177 raft_consensus.cc:359] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.292024 32177 raft_consensus.cc:385] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.292508 32177 raft_consensus.cc:740] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.259918 32229 raft_consensus.cc:2804] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.291612 31808 catalog_manager.cc:5697] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.302996 32177 consensus_queue.cc:260] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.287691 31984 raft_consensus.cc:2393] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate ab61be703111416d9fba543ea97b2224 in this term.
I20260709 13:12:06.260399 32132 raft_consensus.cc:2468] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:06.314693 32181 tablet_bootstrap.cc:654] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.291451 32272 leader_election.cc:290] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:06.297564 32229 raft_consensus.cc:493] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.294410 32254 raft_consensus.cc:493] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.267920 32276 leader_election.cc:290] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
W20260709 13:12:06.312879 31875 leader_election.cc:343] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.317409 32230 raft_consensus.cc:493] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.325771 32229 raft_consensus.cc:3060] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.316023 31874 leader_election.cc:304] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:06.350692 32177 ts_tablet_manager.cc:1434] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.136s	user 0.009s	sys 0.000s
I20260709 13:12:06.351809 32177 tablet_bootstrap.cc:492] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:06.318496 32024 leader_election.cc:304] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:06.337007 31908 raft_consensus.cc:2468] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:06.331382 32254 raft_consensus.cc:515] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.343921 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01da40464a4c3e907fbd4a05e7cf08" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.356029 32276 raft_consensus.cc:2804] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.349619 32213 leader_election.cc:290] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:06.359136 32236 raft_consensus.cc:2804] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.342165 32230 raft_consensus.cc:515] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.354120 32270 raft_consensus.cc:515] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.371069 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:06.371915 31985 raft_consensus.cc:2468] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:06.372406 32178 tablet_bootstrap.cc:492] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:06.372716 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858cfa025ea0471a97b28dd8a9d61990" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:06.371145 32195 leader_election.cc:290] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:06.373659 32058 raft_consensus.cc:2393] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate eacc546e751240eb804795d98213a57c in this term.
I20260709 13:12:06.364104 32276 raft_consensus.cc:697] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:06.372996 32178 ts_tablet_manager.cc:1403] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.245s	user 0.007s	sys 0.026s
I20260709 13:12:06.375114 32276 consensus_queue.cc:237] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.366309 32236 raft_consensus.cc:493] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.380091 32236 raft_consensus.cc:3060] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.384495 32290 leader_election.cc:290] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:06.386179 31950 leader_election.cc:304] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:06.386853 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:06.387413 32293 raft_consensus.cc:2804] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.387948 32293 raft_consensus.cc:493] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.388274 32293 raft_consensus.cc:3060] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.388458 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:06.364547 31874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 61055.3us
I20260709 13:12:06.390499 32254 leader_election.cc:290] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
W20260709 13:12:06.391070 31874 leader_election.cc:343] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.392462 31874 leader_election.cc:304] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:06.393635 32287 raft_consensus.cc:515] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.394325 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6829450035496cad51a237b822114a" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:06.394749 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "858cfa025ea0471a97b28dd8a9d61990" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
W20260709 13:12:06.396040 32098 leader_election.cc:343] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.399458 32293 raft_consensus.cc:515] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.401945 31983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:06.402724 31983 raft_consensus.cc:2468] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:06.401089 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:06.397094 32178 raft_consensus.cc:359] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.404340 32290 raft_consensus.cc:2749] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.404539 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6829450035496cad51a237b822114a" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:06.406152 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:06.406798 32131 raft_consensus.cc:3060] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.407039 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:06.407290 31984 raft_consensus.cc:2393] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate ab61be703111416d9fba543ea97b2224 in this term.
I20260709 13:12:06.407629 31909 raft_consensus.cc:3060] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:06.357543 32024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 45076.9us
I20260709 13:12:06.404583 32178 raft_consensus.cc:385] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.400295 32270 leader_election.cc:290] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:06.405776 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:06.400509 32212 leader_election.cc:290] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:06.400594 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:06.415586 32098 leader_election.cc:304] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:06.430154 32254 raft_consensus.cc:2804] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:06.430361 32098 leader_election.cc:343] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.430634 32254 raft_consensus.cc:493] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.431077 32254 raft_consensus.cc:3060] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.430950 32098 leader_election.cc:304] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:06.431999 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:06.432979 32230 leader_election.cc:290] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:06.434020 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:06.434700 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762054515f9846129075d921ceefcd1f" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:06.415962 32287 leader_election.cc:290] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
W20260709 13:12:06.436342 31950 leader_election.cc:343] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.436806 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:06.417047 32132 raft_consensus.cc:2393] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab61be703111416d9fba543ea97b2224 in current term 1: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
I20260709 13:12:06.426666 32180 tablet_bootstrap.cc:654] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.415207 32178 raft_consensus.cc:740] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.428645 31908 raft_consensus.cc:2393] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab61be703111416d9fba543ea97b2224 in current term 1: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
I20260709 13:12:06.421562 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:06.451169 31949 leader_election.cc:304] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:06.451535 31982 raft_consensus.cc:2393] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate ab61be703111416d9fba543ea97b2224 in this term.
I20260709 13:12:06.452415 31909 raft_consensus.cc:2468] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:06.415592 32293 leader_election.cc:290] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:06.432322 32213 raft_consensus.cc:2749] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.425419 32232 raft_consensus.cc:493] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.426484 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:06.421837 32131 raft_consensus.cc:2468] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:06.461355 32178 consensus_queue.cc:260] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.460558 32232 raft_consensus.cc:515] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.468909 32232 leader_election.cc:290] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:06.470918 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d018ee52cc46cebe51e75edec5abe5" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.472824 31949 leader_election.cc:304] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
W20260709 13:12:06.473814 32023 leader_election.cc:343] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.475876 32230 raft_consensus.cc:2804] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.476302 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d018ee52cc46cebe51e75edec5abe5" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:06.476022 31950 leader_election.cc:304] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a
I20260709 13:12:06.476562 32230 raft_consensus.cc:697] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:06.479216 32230 consensus_queue.cc:237] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.451241 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762054515f9846129075d921ceefcd1f" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:06.481626 32056 raft_consensus.cc:2468] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:06.482398 32293 raft_consensus.cc:2804] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.483466 32293 raft_consensus.cc:697] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:06.428979 31805 catalog_manager.cc:5697] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.484454 32293 consensus_queue.cc:237] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
W20260709 13:12:06.488399 31855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:06.488947 31951 leader_election.cc:304] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:06.490757 32272 raft_consensus.cc:2804] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.491134 32272 raft_consensus.cc:493] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.491451 32272 raft_consensus.cc:3060] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.492746 32254 raft_consensus.cc:515] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.441699 32236 raft_consensus.cc:515] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.486891 32229 raft_consensus.cc:515] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.498879 32057 raft_consensus.cc:2393] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 1: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
I20260709 13:12:06.504686 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:06.506057 32229 leader_election.cc:290] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:06.506664 32177 tablet_bootstrap.cc:654] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.455950 31874 leader_election.cc:304] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:06.482744 31807 catalog_manager.cc:5697] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.456569 32212 raft_consensus.cc:2749] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.529371 32178 ts_tablet_manager.cc:1434] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.153s	user 0.006s	sys 0.003s
W20260709 13:12:06.515985 32024 leader_election.cc:343] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.534407 32178 tablet_bootstrap.cc:492] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:06.532389 32132 raft_consensus.cc:2393] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 27177ca9073b4128b8844b7cb37db32a in current term 1: Already voted for candidate eacc546e751240eb804795d98213a57c in this term.
I20260709 13:12:06.538049 32181 tablet_bootstrap.cc:492] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:06.538834 32181 ts_tablet_manager.cc:1403] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.347s	user 0.022s	sys 0.022s
I20260709 13:12:06.532169 32287 raft_consensus.cc:2749] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.535372 32058 raft_consensus.cc:2393] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
W20260709 13:12:06.535682 31874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 89391.9us
I20260709 13:12:06.545778 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:06.546386 32236 leader_election.cc:290] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:06.550550 32181 raft_consensus.cc:359] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.551494 32181 raft_consensus.cc:385] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.551828 32181 raft_consensus.cc:740] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.554073 32181 consensus_queue.cc:260] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.555951 31874 leader_election.cc:304] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:06.548979 31985 raft_consensus.cc:3060] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.556969 32276 raft_consensus.cc:2749] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.553691 32272 raft_consensus.cc:515] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.557647 31876 leader_election.cc:304] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224
I20260709 13:12:06.558579 32276 raft_consensus.cc:2749] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:06.557113 31875 consensus_peers.cc:597] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:06.559808 32272 leader_election.cc:290] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:06.561955 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762054515f9846129075d921ceefcd1f" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:06.538844 32024 leader_election.cc:304] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
W20260709 13:12:06.563457 32024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 48843.8us
I20260709 13:12:06.563699 32236 raft_consensus.cc:2749] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.548866 32254 leader_election.cc:290] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:06.567305 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762054515f9846129075d921ceefcd1f" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:06.570250 32056 raft_consensus.cc:3060] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.571475 31983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:06.572743 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b216d7234eca9b4c4eaadc8ef7e7" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
W20260709 13:12:06.569348 31950 leader_election.cc:343] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.574211 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:06.573693 31908 raft_consensus.cc:2393] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 27177ca9073b4128b8844b7cb37db32a in current term 1: Already voted for candidate ab61be703111416d9fba543ea97b2224 in this term.
I20260709 13:12:06.578323 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:06.578755 32180 tablet_bootstrap.cc:492] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:06.579196 32058 raft_consensus.cc:2393] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 1: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
I20260709 13:12:06.579277 32180 ts_tablet_manager.cc:1403] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.360s	user 0.019s	sys 0.008s
I20260709 13:12:06.582434 32180 raft_consensus.cc:359] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.582937 32180 raft_consensus.cc:385] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.582793 31985 raft_consensus.cc:2468] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:06.583245 32180 raft_consensus.cc:740] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.579507 32287 consensus_queue.cc:1048] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.584116 32180 consensus_queue.cc:260] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.586488 32180 ts_tablet_manager.cc:1434] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:12:06.587227 32181 ts_tablet_manager.cc:1434] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:12:06.587538 32180 tablet_bootstrap.cc:492] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:06.588934 32056 raft_consensus.cc:2468] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:06.590068 32181 tablet_bootstrap.cc:492] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:06.590372 32177 tablet_bootstrap.cc:492] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:06.593936 32177 ts_tablet_manager.cc:1403] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.242s	user 0.016s	sys 0.003s
I20260709 13:12:06.597003 32178 tablet_bootstrap.cc:654] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.598991 32098 leader_election.cc:304] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a
I20260709 13:12:06.599933 32213 raft_consensus.cc:2804] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.600512 32213 raft_consensus.cc:697] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:06.601562 32024 leader_election.cc:304] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:06.601528 32213 consensus_queue.cc:237] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.603691 32177 raft_consensus.cc:359] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.604717 32177 raft_consensus.cc:385] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.605083 32177 raft_consensus.cc:740] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.606067 32177 consensus_queue.cc:260] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.608697 32236 raft_consensus.cc:2749] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.608392 32181 tablet_bootstrap.cc:654] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.610250 32024 leader_election.cc:304] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:06.612097 32180 tablet_bootstrap.cc:654] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.617527 31951 leader_election.cc:304] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:06.618284 32177 ts_tablet_manager.cc:1434] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:12:06.618852 32272 raft_consensus.cc:2804] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.619323 32177 tablet_bootstrap.cc:492] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:06.619433 32272 raft_consensus.cc:697] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:06.626524 32249 raft_consensus.cc:493] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.627357 32249 raft_consensus.cc:515] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.623229 32272 consensus_queue.cc:237] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.616200 32236 raft_consensus.cc:2749] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.646970 32249 leader_election.cc:290] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:06.652160 32230 consensus_queue.cc:1048] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.654966 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3e38a5bb6f4fd48b4bd695694eb7d9" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:06.657076 32293 raft_consensus.cc:493] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:06.657279 32098 leader_election.cc:343] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.657694 32293 raft_consensus.cc:515] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.660295 32293 leader_election.cc:290] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:06.664206 32177 tablet_bootstrap.cc:654] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.668191 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98700f72c2d466b951e6776bdc74e2f" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.680567 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98700f72c2d466b951e6776bdc74e2f" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:06.681604 32056 raft_consensus.cc:2468] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:06.681988 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3e38a5bb6f4fd48b4bd695694eb7d9" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
W20260709 13:12:06.682977 31949 leader_election.cc:343] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.686750 31951 leader_election.cc:304] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:06.687830 32177 tablet_bootstrap.cc:492] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:06.688391 32177 ts_tablet_manager.cc:1403] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.002s
I20260709 13:12:06.688573 32293 raft_consensus.cc:2804] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.689184 32293 raft_consensus.cc:493] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.689729 32293 raft_consensus.cc:3060] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.692072 32177 raft_consensus.cc:359] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.692883 32177 raft_consensus.cc:385] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.693208 32177 raft_consensus.cc:740] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.693967 32177 consensus_queue.cc:260] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.695655 32177 ts_tablet_manager.cc:1434] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:06.696636 32177 tablet_bootstrap.cc:492] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:06.703244 32177 tablet_bootstrap.cc:654] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.703951 32178 tablet_bootstrap.cc:492] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:06.704762 32178 ts_tablet_manager.cc:1403] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.173s	user 0.015s	sys 0.019s
W20260709 13:12:06.708900 32099 leader_election.cc:343] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.709904 32099 leader_election.cc:304] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:06.711064 32213 raft_consensus.cc:2749] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.725621 32293 raft_consensus.cc:515] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.735598 32181 tablet_bootstrap.cc:492] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:06.736442 32181 ts_tablet_manager.cc:1403] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.147s	user 0.028s	sys 0.009s
I20260709 13:12:06.739575 32181 raft_consensus.cc:359] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.748366 32181 raft_consensus.cc:385] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.748701 32181 raft_consensus.cc:740] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.751088 32178 raft_consensus.cc:359] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.751986 32178 raft_consensus.cc:385] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.751008 32181 consensus_queue.cc:260] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.752301 32178 raft_consensus.cc:740] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.739477 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98700f72c2d466b951e6776bdc74e2f" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:06.753736 32293 leader_election.cc:290] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:06.749812 32230 consensus_queue.cc:1048] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:06.756446 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98700f72c2d466b951e6776bdc74e2f" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:06.758680 32177 tablet_bootstrap.cc:492] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:06.759248 32177 ts_tablet_manager.cc:1403] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.015s
I20260709 13:12:06.760285 32213 consensus_queue.cc:1048] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:06.760689 31949 leader_election.cc:343] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.763206 32180 tablet_bootstrap.cc:492] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:06.763693 32180 ts_tablet_manager.cc:1403] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.176s	user 0.008s	sys 0.011s
I20260709 13:12:06.765547 32178 consensus_queue.cc:260] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.766085 32181 ts_tablet_manager.cc:1434] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:12:06.767166 32181 tablet_bootstrap.cc:492] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:06.768994 32177 raft_consensus.cc:359] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.772202 32177 raft_consensus.cc:385] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.772452 32177 raft_consensus.cc:740] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.763844 32057 raft_consensus.cc:3060] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.749967 31807 catalog_manager.cc:5697] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.777114 32181 tablet_bootstrap.cc:654] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.779356 32178 ts_tablet_manager.cc:1434] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 13:12:06.784358 32177 consensus_queue.cc:260] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.786247 32177 ts_tablet_manager.cc:1434] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:12:06.787086 32177 tablet_bootstrap.cc:492] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:06.788951 32178 tablet_bootstrap.cc:492] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:06.782492 32180 raft_consensus.cc:359] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.789901 32180 raft_consensus.cc:385] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.790185 32180 raft_consensus.cc:740] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.790894 32180 consensus_queue.cc:260] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.798972 32177 tablet_bootstrap.cc:654] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.801469 32057 raft_consensus.cc:2468] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:06.798192 32180 ts_tablet_manager.cc:1434] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:12:06.818522 32180 tablet_bootstrap.cc:492] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:06.818375 31806 catalog_manager.cc:5697] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.820514 32254 consensus_queue.cc:1048] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:06.824934 32254 raft_consensus.cc:493] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.825480 32180 tablet_bootstrap.cc:654] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.825513 32254 raft_consensus.cc:515] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.829291 31951 leader_election.cc:304] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:06.830219 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf375d76dea417eaf6400807194cf2d" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:06.830642 32230 raft_consensus.cc:2804] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.831228 32230 raft_consensus.cc:697] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
W20260709 13:12:06.831925 32098 leader_election.cc:343] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.832674 32254 leader_election.cc:290] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:06.832226 32230 consensus_queue.cc:237] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.810070 32177 tablet_bootstrap.cc:492] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:06.809780 32276 consensus_queue.cc:1048] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.817390 32178 tablet_bootstrap.cc:654] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.834851 32177 ts_tablet_manager.cc:1403] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.007s
I20260709 13:12:06.837934 32177 raft_consensus.cc:359] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.838682 32177 raft_consensus.cc:385] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.838984 32177 raft_consensus.cc:740] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.839636 32177 consensus_queue.cc:260] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.840778 31808 catalog_manager.cc:5697] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.841661 32287 consensus_queue.cc:1048] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:06.843513 31808 catalog_manager.cc:5697] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.845417 32229 raft_consensus.cc:493] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.846103 32229 raft_consensus.cc:515] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:06.845768 31808 catalog_manager.cc:5697] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.852648 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c99a3ac8c469995be8be36b6b8cf1" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.856328 32180 tablet_bootstrap.cc:492] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:06.856411 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf375d76dea417eaf6400807194cf2d" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
W20260709 13:12:06.856923 32023 leader_election.cc:343] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.857384 32057 raft_consensus.cc:2468] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:06.858408 32180 ts_tablet_manager.cc:1403] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.005s
I20260709 13:12:06.859056 32229 leader_election.cc:290] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:06.860764 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c99a3ac8c469995be8be36b6b8cf1" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:06.861109 32099 leader_election.cc:304] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
W20260709 13:12:06.862493 32024 leader_election.cc:343] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.862699 32254 raft_consensus.cc:2804] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.863199 32254 raft_consensus.cc:493] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.863143 32024 leader_election.cc:304] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:06.863718 32254 raft_consensus.cc:3060] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.842078 32177 ts_tablet_manager.cc:1434] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:06.864616 32229 raft_consensus.cc:2749] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.865201 32177 tablet_bootstrap.cc:492] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:06.866487 32181 tablet_bootstrap.cc:492] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:06.867136 32181 ts_tablet_manager.cc:1403] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.100s	user 0.020s	sys 0.007s
I20260709 13:12:06.878028 32177 tablet_bootstrap.cc:654] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.878335 32254 raft_consensus.cc:515] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.881696 32254 leader_election.cc:290] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:06.883076 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf375d76dea417eaf6400807194cf2d" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
W20260709 13:12:06.884845 32098 leader_election.cc:343] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.884917 32180 raft_consensus.cc:359] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.885746 32180 raft_consensus.cc:385] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.886052 32180 raft_consensus.cc:740] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.886778 32180 consensus_queue.cc:260] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.890748 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf375d76dea417eaf6400807194cf2d" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:06.893198 32057 raft_consensus.cc:3060] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.893471 32181 raft_consensus.cc:359] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.894222 32181 raft_consensus.cc:385] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.894501 32181 raft_consensus.cc:740] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.896258 32195 raft_consensus.cc:493] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.896781 32195 raft_consensus.cc:515] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.897900 32181 consensus_queue.cc:260] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.898933 32195 leader_election.cc:290] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:06.900089 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6829450035496cad51a237b822114a" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:06.900851 32132 raft_consensus.cc:2468] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:06.900902 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6829450035496cad51a237b822114a" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:06.901822 31982 raft_consensus.cc:2468] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:06.902011 32057 raft_consensus.cc:2468] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:06.902328 31874 leader_election.cc:304] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:06.892525 32180 ts_tablet_manager.cc:1434] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:12:06.903818 32290 raft_consensus.cc:2804] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.904188 32290 raft_consensus.cc:493] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.904665 32290 raft_consensus.cc:3060] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.905517 32180 tablet_bootstrap.cc:492] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:06.900090 32181 ts_tablet_manager.cc:1434] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:12:06.908951 32230 consensus_queue.cc:1048] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:06.918588 32272 consensus_queue.cc:1048] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:06.928975 32099 leader_election.cc:304] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:06.931111 32254 raft_consensus.cc:2804] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.931874 32254 raft_consensus.cc:697] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:06.933248 32254 consensus_queue.cc:237] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:06.918761 32290 raft_consensus.cc:515] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.913618 32178 tablet_bootstrap.cc:492] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:06.945124 32178 ts_tablet_manager.cc:1403] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.156s	user 0.021s	sys 0.012s
I20260709 13:12:06.948207 32178 raft_consensus.cc:359] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.948894 32178 raft_consensus.cc:385] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.949165 32178 raft_consensus.cc:740] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.950203 32178 consensus_queue.cc:260] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:06.952368 32178 ts_tablet_manager.cc:1434] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:06.959916 32181 tablet_bootstrap.cc:492] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:06.961720 31806 catalog_manager.cc:5697] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.963693 32177 tablet_bootstrap.cc:492] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:06.964322 32177 ts_tablet_manager.cc:1403] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.099s	user 0.028s	sys 0.038s
I20260709 13:12:06.967533 32177 raft_consensus.cc:359] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.968338 32177 raft_consensus.cc:385] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.968672 32177 raft_consensus.cc:740] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.968578 32230 consensus_queue.cc:1048] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.969657 32177 consensus_queue.cc:260] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.974900 32195 raft_consensus.cc:493] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.975451 32195 raft_consensus.cc:515] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:06.977095 32181 tablet_bootstrap.cc:654] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.977612 32195 leader_election.cc:290] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:06.979385 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcab21f469948228159fc838c35005b" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:06.980777 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6829450035496cad51a237b822114a" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:06.981137 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcab21f469948228159fc838c35005b" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:06.981426 32131 raft_consensus.cc:3060] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:06.983296 31875 leader_election.cc:343] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.981340 32177 ts_tablet_manager.cc:1434] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:12:06.985261 32177 tablet_bootstrap.cc:492] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:06.987448 31804 catalog_manager.cc:5697] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.988395 32270 consensus_queue.cc:1048] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:06.990950 31876 leader_election.cc:343] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.991410 31876 leader_election.cc:304] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224
I20260709 13:12:06.993077 32287 raft_consensus.cc:2749] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.991798 32177 tablet_bootstrap.cc:654] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.998821 32131 raft_consensus.cc:2468] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:07.000293 31874 leader_election.cc:304] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:07.001303 32195 raft_consensus.cc:2804] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.001816 32195 raft_consensus.cc:697] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:07.002707 32195 consensus_queue.cc:237] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.004822 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6829450035496cad51a237b822114a" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:07.005479 31984 raft_consensus.cc:3060] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.003605 32290 leader_election.cc:290] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:07.010846 32177 tablet_bootstrap.cc:492] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:07.011380 32177 ts_tablet_manager.cc:1403] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.002s
I20260709 13:12:06.924136 32180 tablet_bootstrap.cc:654] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.013211 32229 raft_consensus.cc:493] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.013901 32229 raft_consensus.cc:515] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.015923 32178 tablet_bootstrap.cc:492] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:07.016676 32229 leader_election.cc:290] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:07.019060 31984 raft_consensus.cc:2468] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:07.019737 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:07.021741 32024 leader_election.cc:343] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.022306 32178 tablet_bootstrap.cc:654] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.022315 32177 raft_consensus.cc:359] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.023211 32177 raft_consensus.cc:385] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.023530 32177 raft_consensus.cc:740] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.023626 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:07.024338 32177 consensus_queue.cc:260] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.026566 32177 ts_tablet_manager.cc:1434] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:07.027532 32177 tablet_bootstrap.cc:492] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
W20260709 13:12:07.029882 32024 leader_election.cc:343] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.030556 32024 leader_election.cc:304] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:07.032143 32229 raft_consensus.cc:2749] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.034713 32177 tablet_bootstrap.cc:654] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.039356 32180 tablet_bootstrap.cc:492] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:07.040151 32180 ts_tablet_manager.cc:1403] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.136s	user 0.015s	sys 0.000s
I20260709 13:12:07.043198 32180 raft_consensus.cc:359] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.043972 32180 raft_consensus.cc:385] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.044286 32180 raft_consensus.cc:740] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.045082 32180 consensus_queue.cc:260] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.047415 32180 ts_tablet_manager.cc:1434] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:07.057781 32254 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27177ca9073b4128b8844b7cb37db32a)
I20260709 13:12:07.058904 32180 tablet_bootstrap.cc:492] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:07.058565 32254 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.062459 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:07.063527 32058 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 2.
I20260709 13:12:07.065196 32099 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:07.066455 32213 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:07.067072 32213 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27177ca9073b4128b8844b7cb37db32a)
I20260709 13:12:07.067559 32213 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:07.074843 32180 tablet_bootstrap.cc:654] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.097596 32180 tablet_bootstrap.cc:492] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:07.099103 32231 raft_consensus.cc:493] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.100698 32231 raft_consensus.cc:515] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.103047 32231 leader_election.cc:290] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:07.104116 32180 ts_tablet_manager.cc:1403] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 13:12:07.104157 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3e38a5bb6f4fd48b4bd695694eb7d9" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:07.105443 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3e38a5bb6f4fd48b4bd695694eb7d9" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:07.105883 32131 raft_consensus.cc:2468] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:07.107360 32023 leader_election.cc:304] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:07.108530 32231 raft_consensus.cc:2804] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:07.108839 32024 leader_election.cc:343] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.109090 32231 raft_consensus.cc:493] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.109716 32231 raft_consensus.cc:3060] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.112428 32180 raft_consensus.cc:359] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.118505 32180 raft_consensus.cc:385] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.119903 32180 raft_consensus.cc:740] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.120287 32231 raft_consensus.cc:515] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.122376 32180 consensus_queue.cc:260] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.124320 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3e38a5bb6f4fd48b4bd695694eb7d9" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:07.125535 32131 raft_consensus.cc:3060] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.125768 32304 consensus_queue.cc:1048] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:07.136060 32272 consensus_queue.cc:1048] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:07.136490 32131 raft_consensus.cc:2468] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:07.138288 32023 leader_election.cc:304] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:07.138661 32180 ts_tablet_manager.cc:1434] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:12:07.140420 32232 raft_consensus.cc:2804] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.140529 32180 tablet_bootstrap.cc:492] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:07.141315 32236 raft_consensus.cc:493] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.141921 32236 raft_consensus.cc:515] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.145080 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:07.146282 31906 raft_consensus.cc:2393] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 2: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
I20260709 13:12:07.149276 32290 raft_consensus.cc:493] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.150051 32290 raft_consensus.cc:515] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.150795 32236 leader_election.cc:290] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:07.154100 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d018ee52cc46cebe51e75edec5abe5" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:07.154850 32057 raft_consensus.cc:2468] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:07.156091 31876 leader_election.cc:304] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:07.157029 32287 raft_consensus.cc:2804] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.157415 32287 raft_consensus.cc:493] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.157759 32287 raft_consensus.cc:3060] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.158332 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decee8d0520647f5a637ec4bc4237722" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:07.163952 32213 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.165284 32304 consensus_queue.cc:1048] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:07.167805 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:07.169327 32290 leader_election.cc:290] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:07.170068 31906 raft_consensus.cc:2393] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 2: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
I20260709 13:12:07.171109 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d018ee52cc46cebe51e75edec5abe5" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:07.169423 32024 leader_election.cc:343] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.182466 32177 tablet_bootstrap.cc:492] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:07.182924 32177 ts_tablet_manager.cc:1403] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.156s	user 0.046s	sys 0.077s
I20260709 13:12:07.171887 32232 raft_consensus.cc:697] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:07.173158 32254 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:07.174605 32213 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:07.184959 32229 raft_consensus.cc:493] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:07.186352 31874 leader_election.cc:343] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.192159 32229 raft_consensus.cc:515] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.201383 32229 leader_election.cc:290] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
W20260709 13:12:07.202696 32333 log.cc:927] Time spent T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:12:07.183959 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decee8d0520647f5a637ec4bc4237722" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:07.210060 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:07.211248 32232 consensus_queue.cc:237] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.208462 32231 leader_election.cc:290] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:07.213492 32287 raft_consensus.cc:515] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:07.215097 32023 leader_election.cc:343] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.225173 32023 leader_election.cc:304] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
W20260709 13:12:07.228482 31950 consensus_peers.cc:597] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.228823 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d018ee52cc46cebe51e75edec5abe5" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:07.221829 32178 tablet_bootstrap.cc:492] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:07.222184 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcab21f469948228159fc838c35005b" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:07.222282 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcab21f469948228159fc838c35005b" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:07.223244 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3e38a5bb6f4fd48b4bd695694eb7d9" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:07.229040 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d018ee52cc46cebe51e75edec5abe5" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:07.218058 31805 catalog_manager.cc:5697] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.230068 32178 ts_tablet_manager.cc:1403] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.277s	user 0.034s	sys 0.036s
I20260709 13:12:07.234979 32056 raft_consensus.cc:3060] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:07.236367 31874 leader_election.cc:343] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.238207 32057 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 2.
I20260709 13:12:07.237979 32178 raft_consensus.cc:359] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.239068 32178 raft_consensus.cc:385] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:07.240425 32024 leader_election.cc:343] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.240450 32099 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:07.241863 31906 raft_consensus.cc:2468] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:07.242336 32345 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:07.243044 32345 raft_consensus.cc:697] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:07.244061 32024 leader_election.cc:304] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:07.232106 32236 raft_consensus.cc:2749] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.244351 32345 consensus_queue.cc:237] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.239667 32178 raft_consensus.cc:740] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.248569 32178 consensus_queue.cc:260] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.250360 32178 ts_tablet_manager.cc:1434] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:12:07.252388 32236 raft_consensus.cc:2804] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.255259 32181 tablet_bootstrap.cc:492] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:07.255559 32236 raft_consensus.cc:493] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.255875 32181 ts_tablet_manager.cc:1403] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.313s	user 0.041s	sys 0.045s
I20260709 13:12:07.231797 32287 leader_election.cc:290] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
W20260709 13:12:07.253723 32024 leader_election.cc:343] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.257408 32178 tablet_bootstrap.cc:492] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:07.256882 32236 raft_consensus.cc:3060] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.265530 32056 raft_consensus.cc:2468] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:07.267349 32180 tablet_bootstrap.cc:654] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.270430 32236 raft_consensus.cc:515] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.272483 31876 leader_election.cc:304] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:07.277199 32177 raft_consensus.cc:359] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.277819 32177 raft_consensus.cc:385] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.278044 32177 raft_consensus.cc:740] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.274541 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcab21f469948228159fc838c35005b" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:07.278784 31906 raft_consensus.cc:3060] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.279021 32177 consensus_queue.cc:260] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.275378 32287 raft_consensus.cc:2804] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.282565 32236 leader_election.cc:290] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:07.283185 32181 raft_consensus.cc:359] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.283756 32287 raft_consensus.cc:697] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:07.284024 32181 raft_consensus.cc:385] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.284184 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcab21f469948228159fc838c35005b" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:07.284466 32181 raft_consensus.cc:740] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.284715 32287 consensus_queue.cc:237] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.285218 32181 consensus_queue.cc:260] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:07.285913 32024 leader_election.cc:343] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.287818 32181 ts_tablet_manager.cc:1434] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:12:07.288098 32177 ts_tablet_manager.cc:1434] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.003s
I20260709 13:12:07.288997 32181 tablet_bootstrap.cc:492] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:07.289094 32177 tablet_bootstrap.cc:492] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:07.299063 32181 tablet_bootstrap.cc:654] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.300098 32178 tablet_bootstrap.cc:654] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.301999 32177 tablet_bootstrap.cc:654] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.302966 32180 tablet_bootstrap.cc:492] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:07.303484 32180 ts_tablet_manager.cc:1403] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.163s	user 0.014s	sys 0.000s
I20260709 13:12:07.310048 31906 raft_consensus.cc:2468] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:07.311662 32024 leader_election.cc:304] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:07.313253 32232 raft_consensus.cc:2804] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.313817 32232 raft_consensus.cc:697] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:07.314693 32232 consensus_queue.cc:237] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.320654 32180 raft_consensus.cc:359] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.321848 32180 raft_consensus.cc:385] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.322319 32180 raft_consensus.cc:740] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.328900 32272 raft_consensus.cc:493] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.329612 32272 raft_consensus.cc:515] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.339758 32180 consensus_queue.cc:260] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.341156 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01da40464a4c3e907fbd4a05e7cf08" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:07.343597 31949 leader_election.cc:343] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.345116 32180 ts_tablet_manager.cc:1434] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:12:07.345768 32272 leader_election.cc:290] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:07.346676 32195 raft_consensus.cc:493] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.347266 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01da40464a4c3e907fbd4a05e7cf08" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:07.347442 32195 raft_consensus.cc:515] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.348287 31906 raft_consensus.cc:2468] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:07.350243 31950 leader_election.cc:304] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:07.353454 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf375d76dea417eaf6400807194cf2d" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:07.354168 32195 leader_election.cc:290] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:07.354483 32058 raft_consensus.cc:2393] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate eacc546e751240eb804795d98213a57c in this term.
I20260709 13:12:07.355450 32180 tablet_bootstrap.cc:492] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:07.355997 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf375d76dea417eaf6400807194cf2d" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:07.357079 32272 raft_consensus.cc:2804] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.358937 32272 raft_consensus.cc:493] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.359472 32272 raft_consensus.cc:3060] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.359361 31874 leader_election.cc:304] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:07.366354 31906 raft_consensus.cc:3060] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.340837 31805 catalog_manager.cc:5697] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 1 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.382709 32272 raft_consensus.cc:515] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.399966 32181 tablet_bootstrap.cc:492] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:07.400527 32181 ts_tablet_manager.cc:1403] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.013s
I20260709 13:12:07.405102 32181 raft_consensus.cc:359] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.406034 32345 consensus_queue.cc:1048] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:07.409183 31949 consensus_peers.cc:597] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 -> Peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Couldn't send request to peer eacc546e751240eb804795d98213a57c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.409528 31804 catalog_manager.cc:5697] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.409497 32177 tablet_bootstrap.cc:492] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:07.410724 32181 raft_consensus.cc:385] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.406702 32249 raft_consensus.cc:493] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.411139 32181 raft_consensus.cc:740] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.411337 32249 raft_consensus.cc:515] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.411104 32177 ts_tablet_manager.cc:1403] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.122s	user 0.024s	sys 0.049s
I20260709 13:12:07.405638 31806 catalog_manager.cc:5697] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 1 to 2, leader changed from 27177ca9073b4128b8844b7cb37db32a (127.21.244.3) to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 2 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.415310 32178 tablet_bootstrap.cc:492] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:07.414574 32195 raft_consensus.cc:2749] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.416297 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a52eeb653346c286bc79d5ee09d7b5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:07.417587 32249 leader_election.cc:290] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:07.414008 32181 consensus_queue.cc:260] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
W20260709 13:12:07.419034 32098 leader_election.cc:343] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.419176 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01da40464a4c3e907fbd4a05e7cf08" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:07.419530 32177 raft_consensus.cc:359] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.420346 32177 raft_consensus.cc:385] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.420658 32177 raft_consensus.cc:740] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.420989 32180 tablet_bootstrap.cc:654] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.420838 32195 consensus_queue.cc:1048] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.421535 32177 consensus_queue.cc:260] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.424685 32178 ts_tablet_manager.cc:1403] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.168s	user 0.009s	sys 0.013s
I20260709 13:12:07.425336 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a52eeb653346c286bc79d5ee09d7b5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:07.425549 32272 leader_election.cc:290] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:07.426038 31985 raft_consensus.cc:2468] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
W20260709 13:12:07.427523 31949 leader_election.cc:343] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.430471 32177 ts_tablet_manager.cc:1434] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:12:07.430045 32098 leader_election.cc:304] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:07.431069 32249 consensus_queue.cc:1048] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:07.436484 32249 raft_consensus.cc:2804] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.436951 32249 raft_consensus.cc:493] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.437356 32249 raft_consensus.cc:3060] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.439875 32177 tablet_bootstrap.cc:492] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:07.441696 31982 raft_consensus.cc:3060] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.447467 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01da40464a4c3e907fbd4a05e7cf08" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:07.448223 31906 raft_consensus.cc:3060] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.453341 32177 tablet_bootstrap.cc:654] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.454593 32178 raft_consensus.cc:359] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.455366 32178 raft_consensus.cc:385] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.456316 32230 raft_consensus.cc:493] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.455711 32178 raft_consensus.cc:740] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.457906 32178 consensus_queue.cc:260] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.456881 32230 raft_consensus.cc:515] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.460287 32178 ts_tablet_manager.cc:1434] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:12:07.461345 32178 tablet_bootstrap.cc:492] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:07.468034 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced69c1fedef46c1a15fcea51cc970f4" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:07.470494 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced69c1fedef46c1a15fcea51cc970f4" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:07.472229 31949 leader_election.cc:343] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.473090 31906 raft_consensus.cc:2468] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:07.462006 32230 leader_election.cc:290] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:07.473572 32272 consensus_queue.cc:1048] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.476503 32181 ts_tablet_manager.cc:1434] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.003s
W20260709 13:12:07.478204 31950 leader_election.cc:343] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.489033 32181 tablet_bootstrap.cc:492] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:07.485462 31950 leader_election.cc:304] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:07.491107 32230 raft_consensus.cc:2749] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.489070 31805 catalog_manager.cc:5697] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 1 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.509109 32181 tablet_bootstrap.cc:654] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.510109 32287 consensus_queue.cc:1048] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.491393 31950 leader_election.cc:304] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:07.512347 32230 raft_consensus.cc:2804] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.513788 32230 raft_consensus.cc:697] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:07.515491 32230 consensus_queue.cc:237] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.522636 32177 tablet_bootstrap.cc:492] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:07.524514 32177 ts_tablet_manager.cc:1403] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.015s
I20260709 13:12:07.525461 32180 tablet_bootstrap.cc:492] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:07.525970 32180 ts_tablet_manager.cc:1403] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.171s	user 0.030s	sys 0.000s
I20260709 13:12:07.531468 32178 tablet_bootstrap.cc:654] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.531626 32177 raft_consensus.cc:359] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.532730 32177 raft_consensus.cc:385] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.533106 32177 raft_consensus.cc:740] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.537971 32177 consensus_queue.cc:260] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.542405 32177 ts_tablet_manager.cc:1434] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:12:07.544473 32177 tablet_bootstrap.cc:492] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:07.548271 32180 raft_consensus.cc:359] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.549072 32180 raft_consensus.cc:385] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.549455 32180 raft_consensus.cc:740] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.552675 32287 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.553231 32287 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.550328 32180 consensus_queue.cc:260] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.562691 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:07.559655 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:07.565604 32181 tablet_bootstrap.cc:492] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:07.565537 32056 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:07.556918 32287 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:07.567476 31876 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:07.566375 32249 raft_consensus.cc:515] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.569213 32287 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:07.569766 32287 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.572145 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a52eeb653346c286bc79d5ee09d7b5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
W20260709 13:12:07.574538 32098 leader_election.cc:343] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.575265 32232 raft_consensus.cc:493] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.566222 32181 ts_tablet_manager.cc:1403] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.005s
I20260709 13:12:07.570168 32287 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:07.575875 32232 raft_consensus.cc:515] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.580905 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a52eeb653346c286bc79d5ee09d7b5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:07.585227 31985 raft_consensus.cc:3060] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.586849 32232 leader_election.cc:290] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:07.587802 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101f0f9b51684b15a3f577bf4685bb9c" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:07.588419 32177 tablet_bootstrap.cc:654] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.588881 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101f0f9b51684b15a3f577bf4685bb9c" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:07.590802 32024 leader_election.cc:343] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.590791 32180 ts_tablet_manager.cc:1434] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.001s
I20260709 13:12:07.592550 32180 tablet_bootstrap.cc:492] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:07.588601 32131 raft_consensus.cc:2468] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:07.582266 32181 raft_consensus.cc:359] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.578033 32249 leader_election.cc:290] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:07.597610 32023 leader_election.cc:304] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:07.599889 32232 raft_consensus.cc:493] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.607231 32181 raft_consensus.cc:385] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.610085 32181 raft_consensus.cc:740] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.610402 32236 raft_consensus.cc:2804] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.611128 32236 raft_consensus.cc:493] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.611619 32236 raft_consensus.cc:3060] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.608652 31807 catalog_manager.cc:5697] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.609573 32232 raft_consensus.cc:515] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
W20260709 13:12:07.637431 31855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:07.611138 32181 consensus_queue.cc:260] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.661640 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be53aa47c89a49dd98dd5050d875c00e" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:07.664077 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be53aa47c89a49dd98dd5050d875c00e" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:07.665557 32181 ts_tablet_manager.cc:1434] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.015s
W20260709 13:12:07.666004 32024 leader_election.cc:343] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.666427 32232 leader_election.cc:290] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
W20260709 13:12:07.666712 32023 leader_election.cc:343] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.667030 32181 tablet_bootstrap.cc:492] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:07.667296 32023 leader_election.cc:304] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:07.669458 32232 raft_consensus.cc:2749] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.666004 31985 raft_consensus.cc:2468] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:07.674705 32181 tablet_bootstrap.cc:654] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.684918 32098 leader_election.cc:304] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:07.686611 32345 raft_consensus.cc:2804] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.687186 32345 raft_consensus.cc:697] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:07.688156 32345 consensus_queue.cc:237] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.704739 32236 raft_consensus.cc:515] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.707409 32236 leader_election.cc:290] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:07.709491 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101f0f9b51684b15a3f577bf4685bb9c" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:07.709520 32178 tablet_bootstrap.cc:492] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:07.708596 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101f0f9b51684b15a3f577bf4685bb9c" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:07.710583 32131 raft_consensus.cc:3060] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:07.711306 32024 leader_election.cc:343] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.716483 32180 tablet_bootstrap.cc:654] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.703678 32287 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.720145 32178 ts_tablet_manager.cc:1403] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.259s	user 0.056s	sys 0.043s
I20260709 13:12:07.720849 32345 raft_consensus.cc:493] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.729580 32181 tablet_bootstrap.cc:492] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:07.730154 32181 ts_tablet_manager.cc:1403] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.002s
I20260709 13:12:07.730965 32345 raft_consensus.cc:515] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.735601 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c99a3ac8c469995be8be36b6b8cf1" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:07.736389 32345 leader_election.cc:290] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
W20260709 13:12:07.738314 32098 leader_election.cc:343] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.738511 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c99a3ac8c469995be8be36b6b8cf1" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:07.739380 32058 raft_consensus.cc:2468] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:07.739872 32287 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:07.742789 32131 raft_consensus.cc:2468] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:07.743067 32181 raft_consensus.cc:359] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.744110 32181 raft_consensus.cc:385] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.744448 32181 raft_consensus.cc:740] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.745097 32181 consensus_queue.cc:260] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.748035 32023 leader_election.cc:304] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:07.748324 32178 raft_consensus.cc:359] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.749150 32178 raft_consensus.cc:385] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.749238 32236 raft_consensus.cc:2804] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.750415 32236 raft_consensus.cc:697] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:07.750974 32181 ts_tablet_manager.cc:1434] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:12:07.751053 32099 leader_election.cc:304] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
W20260709 13:12:07.751304 32024 consensus_peers.cc:597] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.752348 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:07.752467 32236 consensus_queue.cc:237] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.753037 32058 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:07.749507 32178 raft_consensus.cc:740] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.752965 32345 raft_consensus.cc:2804] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.754271 32181 tablet_bootstrap.cc:492] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:07.755460 32177 tablet_bootstrap.cc:492] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:07.756016 32177 ts_tablet_manager.cc:1403] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.212s	user 0.016s	sys 0.003s
I20260709 13:12:07.755784 32345 raft_consensus.cc:493] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.758744 32345 raft_consensus.cc:3060] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.762619 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:07.762055 32178 consensus_queue.cc:260] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.765965 32180 tablet_bootstrap.cc:492] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:07.766517 32180 ts_tablet_manager.cc:1403] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.174s	user 0.010s	sys 0.017s
I20260709 13:12:07.766875 32178 ts_tablet_manager.cc:1434] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:12:07.768033 32178 tablet_bootstrap.cc:492] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:07.773000 32180 raft_consensus.cc:359] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.773835 32180 raft_consensus.cc:385] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.774161 32180 raft_consensus.cc:740] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.774312 32177 raft_consensus.cc:359] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.775180 32177 raft_consensus.cc:385] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.775561 32177 raft_consensus.cc:740] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.776798 32058 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 3.
I20260709 13:12:07.776578 32177 consensus_queue.cc:260] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.778182 31876 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:07.779529 32290 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:07.780138 32290 raft_consensus.cc:697] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
W20260709 13:12:07.780714 31874 consensus_peers.cc:597] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 -> Peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Couldn't send request to peer eacc546e751240eb804795d98213a57c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.781507 32290 consensus_queue.cc:237] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.775238 32180 consensus_queue.cc:260] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.791846 32180 ts_tablet_manager.cc:1434] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 13:12:07.793424 32180 tablet_bootstrap.cc:492] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:07.788335 31807 catalog_manager.cc:5697] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.815275 32178 tablet_bootstrap.cc:654] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.818922 32181 tablet_bootstrap.cc:654] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.817649 32270 raft_consensus.cc:493] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.825876 32177 ts_tablet_manager.cc:1434] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.070s	user 0.018s	sys 0.009s
I20260709 13:12:07.826769 32270 raft_consensus.cc:515] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.830768 32270 leader_election.cc:290] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:07.831981 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decee8d0520647f5a637ec4bc4237722" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:07.833554 32249 raft_consensus.cc:493] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:07.834244 31949 leader_election.cc:343] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.834110 32249 raft_consensus.cc:515] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.834668 32345 raft_consensus.cc:515] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.835317 32177 tablet_bootstrap.cc:492] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:07.835109 32236 consensus_queue.cc:1048] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:07.844899 32370 raft_consensus.cc:493] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.845422 32370 raft_consensus.cc:515] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.847606 32370 leader_election.cc:290] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
W20260709 13:12:07.847935 32024 consensus_peers.cc:597] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.848311 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98700f72c2d466b951e6776bdc74e2f" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:07.850332 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decee8d0520647f5a637ec4bc4237722" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:07.850907 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5b51be38f84f3683f3fbe48c4d22af" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:07.851035 32058 raft_consensus.cc:2468] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:07.851193 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5b51be38f84f3683f3fbe48c4d22af" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:07.852128 31908 raft_consensus.cc:2468] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:07.852964 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c99a3ac8c469995be8be36b6b8cf1" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:07.855154 32177 tablet_bootstrap.cc:654] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.858107 32056 raft_consensus.cc:1240] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Rejecting Update request from peer eacc546e751240eb804795d98213a57c for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:07.852162 32345 leader_election.cc:290] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:07.857707 31804 catalog_manager.cc:5697] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 1 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.859504 32249 leader_election.cc:290] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:07.860715 31908 raft_consensus.cc:1240] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Rejecting Update request from peer eacc546e751240eb804795d98213a57c for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:07.862321 32098 leader_election.cc:343] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.865477 32249 consensus_queue.cc:1059] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:07.870780 32249 consensus_queue.cc:1243] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [LEADER]: Peer 936b035f23a5449fb43db3fd5f757325 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:12:07.871368 32345 raft_consensus.cc:3055] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:07.871780 32345 raft_consensus.cc:740] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:07.871863 32287 consensus_queue.cc:1048] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:07.872749 32345 consensus_queue.cc:260] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.873914 32345 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:07.874058 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c99a3ac8c469995be8be36b6b8cf1" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:07.874944 32056 raft_consensus.cc:3060] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.878976 32287 raft_consensus.cc:493] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.879822 32287 raft_consensus.cc:515] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.880846 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98700f72c2d466b951e6776bdc74e2f" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:07.882473 31951 leader_election.cc:304] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:07.886736 32099 leader_election.cc:304] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224
I20260709 13:12:07.889310 32213 raft_consensus.cc:2749] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.887918 32230 raft_consensus.cc:2804] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.890659 32230 raft_consensus.cc:493] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.891631 32230 raft_consensus.cc:3060] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.900398 32056 raft_consensus.cc:2468] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:07.901314 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:07.902794 31985 raft_consensus.cc:2468] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:07.904057 31875 leader_election.cc:304] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:07.905030 32290 raft_consensus.cc:2804] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.905570 32290 raft_consensus.cc:493] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.905927 32290 raft_consensus.cc:3060] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.909287 32287 leader_election.cc:290] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:07.909498 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:07.911096 32059 raft_consensus.cc:2468] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:07.911290 32180 tablet_bootstrap.cc:654] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.911594 31804 catalog_manager.cc:5697] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 2 to 3, leader changed from eacc546e751240eb804795d98213a57c (127.21.244.4) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.917579 32181 tablet_bootstrap.cc:492] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:07.918329 32181 ts_tablet_manager.cc:1403] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.164s	user 0.001s	sys 0.013s
W20260709 13:12:07.920396 32374 log.cc:927] Time spent T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:12:07.921108 32290 raft_consensus.cc:515] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:07.922566 32370 consensus_queue.cc:1048] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:07.924727 32024 leader_election.cc:304] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:07.925942 32236 raft_consensus.cc:2804] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:07.926039 32024 leader_election.cc:343] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.926470 32236 raft_consensus.cc:493] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.926968 32236 raft_consensus.cc:3060] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.926909 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:07.927982 32290 leader_election.cc:290] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:07.929312 32099 leader_election.cc:304] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:07.933624 32177 tablet_bootstrap.cc:492] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:07.933867 32249 raft_consensus.cc:2804] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.934224 32177 ts_tablet_manager.cc:1403] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.107s	user 0.007s	sys 0.007s
I20260709 13:12:07.933982 32230 raft_consensus.cc:515] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.934634 32249 raft_consensus.cc:697] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:07.931696 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:07.929059 32056 raft_consensus.cc:3060] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.938592 31985 raft_consensus.cc:3060] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.935635 32249 consensus_queue.cc:237] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:07.951464 32132 raft_consensus.cc:3060] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.941924 32177 raft_consensus.cc:359] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.954679 32177 raft_consensus.cc:385] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.955183 32177 raft_consensus.cc:740] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.956357 32178 tablet_bootstrap.cc:492] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:07.956954 32178 ts_tablet_manager.cc:1403] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.189s	user 0.014s	sys 0.024s
I20260709 13:12:07.960005 32178 raft_consensus.cc:359] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.962054 32178 raft_consensus.cc:385] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.962384 32178 raft_consensus.cc:740] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.963259 32178 consensus_queue.cc:260] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:07.968169 32177 consensus_queue.cc:260] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.973114 32181 raft_consensus.cc:359] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.973805 32181 raft_consensus.cc:385] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.974068 32181 raft_consensus.cc:740] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.975114 32181 consensus_queue.cc:260] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:07.979302 32180 tablet_bootstrap.cc:492] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:07.980129 32180 ts_tablet_manager.cc:1403] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.004s
I20260709 13:12:07.981878 32177 ts_tablet_manager.cc:1434] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.001s
I20260709 13:12:07.983438 32177 tablet_bootstrap.cc:492] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:07.996723 32178 ts_tablet_manager.cc:1434] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:12:07.998580 32178 tablet_bootstrap.cc:492] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:08.006438 32181 ts_tablet_manager.cc:1434] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.002s
I20260709 13:12:08.007764 32181 tablet_bootstrap.cc:492] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:08.012102 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decee8d0520647f5a637ec4bc4237722" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:08.030126 31985 raft_consensus.cc:2468] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:08.010027 32230 leader_election.cc:290] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
W20260709 13:12:08.067025 31949 leader_election.cc:343] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.038035 32236 raft_consensus.cc:515] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.069402 32178 tablet_bootstrap.cc:654] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.069826 32056 raft_consensus.cc:2468] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:08.071061 32236 leader_election.cc:290] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:08.072156 31876 leader_election.cc:304] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:08.073136 32195 raft_consensus.cc:2804] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.063485 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decee8d0520647f5a637ec4bc4237722" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:08.074084 32195 raft_consensus.cc:697] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:08.074589 32058 raft_consensus.cc:3060] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.075354 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5b51be38f84f3683f3fbe48c4d22af" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:08.075505 32195 consensus_queue.cc:237] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.077543 32131 raft_consensus.cc:3060] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.044143 32379 raft_consensus.cc:493] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.091465 32180 raft_consensus.cc:359] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.092672 32180 raft_consensus.cc:385] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.093068 32180 raft_consensus.cc:740] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.094036 32180 consensus_queue.cc:260] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.100528 32180 ts_tablet_manager.cc:1434] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.120s	user 0.010s	sys 0.000s
I20260709 13:12:08.110658 32345 consensus_queue.cc:1048] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:08.088423 32024 leader_election.cc:343] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.083050 32379 raft_consensus.cc:515] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.082861 32230 consensus_queue.cc:1048] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:12:08.121754 32379 leader_election.cc:290] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:08.124805 32177 tablet_bootstrap.cc:654] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.126989 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a83560836343219eaeb0ba1a0bc451" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:08.129812 32023 leader_election.cc:343] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.157596 32181 tablet_bootstrap.cc:654] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.162295 32180 tablet_bootstrap.cc:492] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:08.177117 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a83560836343219eaeb0ba1a0bc451" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:08.182435 32058 raft_consensus.cc:2468] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:08.184110 31951 leader_election.cc:304] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:08.185338 32270 raft_consensus.cc:2804] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.185899 32270 raft_consensus.cc:697] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:08.189904 32270 consensus_queue.cc:237] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.188917 32287 raft_consensus.cc:493] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.196180 32287 raft_consensus.cc:515] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.203802 32180 tablet_bootstrap.cc:654] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:08.199493 32024 leader_election.cc:343] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.206194 32195 raft_consensus.cc:493] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.209431 32345 raft_consensus.cc:493] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.219005 32345 raft_consensus.cc:515] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.220474 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5b51be38f84f3683f3fbe48c4d22af" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:08.221274 31910 raft_consensus.cc:3060] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.212677 32024 leader_election.cc:304] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:08.228965 32379 raft_consensus.cc:2749] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.230198 32177 tablet_bootstrap.cc:492] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:08.231652 32177 ts_tablet_manager.cc:1403] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.249s	user 0.017s	sys 0.002s
I20260709 13:12:08.211351 32230 consensus_queue.cc:1048] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:12:08.234290 32345 leader_election.cc:290] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:08.245505 32178 tablet_bootstrap.cc:492] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:08.246081 32178 ts_tablet_manager.cc:1403] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.248s	user 0.022s	sys 0.018s
I20260709 13:12:08.225991 32195 raft_consensus.cc:515] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.254770 32287 leader_election.cc:290] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:08.255602 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced69c1fedef46c1a15fcea51cc970f4" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:08.257341 31874 leader_election.cc:343] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.259778 31910 raft_consensus.cc:2468] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:08.252435 32379 raft_consensus.cc:493] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.260671 32379 raft_consensus.cc:515] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.263622 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:08.268666 32379 leader_election.cc:290] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:08.271700 32024 leader_election.cc:304] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:08.272399 32133 raft_consensus.cc:1275] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:12:08.272992 32133 pending_rounds.cc:85] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c: Aborting all ops after (but not including) 1
I20260709 13:12:08.273228 32133 pending_rounds.cc:107] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:12:08.273495 32133 raft_consensus.cc:2889] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:08.273620 32370 raft_consensus.cc:2804] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.273630 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01da40464a4c3e907fbd4a05e7cf08" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:08.274261 32370 raft_consensus.cc:697] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:08.275465 32370 consensus_queue.cc:237] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.277230 32386 consensus_queue.cc:1048] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:08.278118 32177 raft_consensus.cc:359] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.278891 32177 raft_consensus.cc:385] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.279191 32177 raft_consensus.cc:740] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.272377 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:08.280467 32178 raft_consensus.cc:359] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.285101 32178 raft_consensus.cc:385] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.285596 32178 raft_consensus.cc:740] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.286777 32178 consensus_queue.cc:260] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.290923 32178 ts_tablet_manager.cc:1434] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.003s
I20260709 13:12:08.292393 32178 tablet_bootstrap.cc:492] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:08.282903 32177 consensus_queue.cc:260] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.293176 32181 tablet_bootstrap.cc:492] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:08.294095 32181 ts_tablet_manager.cc:1403] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.287s	user 0.020s	sys 0.008s
W20260709 13:12:08.296837 32023 leader_election.cc:343] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.304591 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101f0f9b51684b15a3f577bf4685bb9c" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:08.305867 32129 raft_consensus.cc:2393] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
W20260709 13:12:08.309123 32024 leader_election.cc:343] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.309639 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced69c1fedef46c1a15fcea51cc970f4" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:08.310371 31982 raft_consensus.cc:2468] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:08.310374 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101f0f9b51684b15a3f577bf4685bb9c" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:08.311393 32056 raft_consensus.cc:1275] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:08.315451 32177 ts_tablet_manager.cc:1434] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.000s
I20260709 13:12:08.296965 32195 leader_election.cc:290] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:08.317234 32177 tablet_bootstrap.cc:492] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:08.309675 32024 leader_election.cc:304] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:08.320645 31876 leader_election.cc:304] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:08.321652 31908 raft_consensus.cc:3060] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.323117 32370 raft_consensus.cc:2749] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.323619 32232 consensus_queue.cc:1048] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:08.324268 31807 catalog_manager.cc:5697] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.343884 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01da40464a4c3e907fbd4a05e7cf08" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:08.348878 31875 leader_election.cc:304] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:08.350519 32287 raft_consensus.cc:2804] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.350934 32287 raft_consensus.cc:493] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.352458 32178 tablet_bootstrap.cc:654] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.333782 32383 consensus_queue.cc:1048] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:12:08.356796 32177 tablet_bootstrap.cc:654] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.352097 32287 raft_consensus.cc:3060] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.354090 31806 catalog_manager.cc:5697] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.351457 32195 raft_consensus.cc:2749] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.366066 32098 leader_election.cc:304] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:08.368019 32345 raft_consensus.cc:2749] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:08.393656 32098 consensus_peers.cc:597] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.395288 32287 raft_consensus.cc:515] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.395507 32181 raft_consensus.cc:359] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.406580 32181 raft_consensus.cc:385] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.402558 32180 tablet_bootstrap.cc:492] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:08.406927 32181 raft_consensus.cc:740] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.407280 32180 ts_tablet_manager.cc:1403] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.245s	user 0.032s	sys 0.002s
I20260709 13:12:08.407670 32181 consensus_queue.cc:260] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.412592 32287 leader_election.cc:290] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:08.414206 32181 ts_tablet_manager.cc:1434] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 13:12:08.416527 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced69c1fedef46c1a15fcea51cc970f4" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:08.416720 31908 raft_consensus.cc:3060] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:08.420295 31874 leader_election.cc:343] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.424269 32232 consensus_queue.cc:1048] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:08.426673 32403 consensus_queue.cc:1048] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:08.428731 32178 tablet_bootstrap.cc:492] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:08.429291 32178 ts_tablet_manager.cc:1403] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.018s
I20260709 13:12:08.431476 32181 tablet_bootstrap.cc:492] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:08.438752 31804 catalog_manager.cc:5697] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 1 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.442633 31805 catalog_manager.cc:5697] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.460938 32178 raft_consensus.cc:359] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.462198 32178 raft_consensus.cc:385] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.462532 32178 raft_consensus.cc:740] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.463348 32178 consensus_queue.cc:260] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.466547 32178 ts_tablet_manager.cc:1434] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 13:12:08.467559 32178 tablet_bootstrap.cc:492] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:08.473711 32178 tablet_bootstrap.cc:654] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.480381 32177 tablet_bootstrap.cc:492] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:08.484619 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced69c1fedef46c1a15fcea51cc970f4" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:08.487818 32181 tablet_bootstrap.cc:654] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.492154 32177 ts_tablet_manager.cc:1403] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.175s	user 0.041s	sys 0.002s
I20260709 13:12:08.493036 31982 raft_consensus.cc:3060] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.499717 32177 raft_consensus.cc:359] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.500533 32177 raft_consensus.cc:385] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.500890 32177 raft_consensus.cc:740] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.501750 32177 consensus_queue.cc:260] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.505700 32177 ts_tablet_manager.cc:1434] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:08.506680 32177 tablet_bootstrap.cc:492] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:08.507551 32180 raft_consensus.cc:359] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.508581 32180 raft_consensus.cc:385] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.508986 32180 raft_consensus.cc:740] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.509781 32180 consensus_queue.cc:260] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.519863 31982 raft_consensus.cc:2468] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:08.520524 32270 raft_consensus.cc:493] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.521168 32270 raft_consensus.cc:515] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.523468 32270 leader_election.cc:290] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:08.527948 32180 ts_tablet_manager.cc:1434] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.120s	user 0.005s	sys 0.004s
I20260709 13:12:08.529192 32180 tablet_bootstrap.cc:492] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:08.545851 31982 raft_consensus.cc:3060] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.550526 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c99a3ac8c469995be8be36b6b8cf1" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:08.550526 31875 leader_election.cc:304] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:08.558677 32383 raft_consensus.cc:2804] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.559279 32383 raft_consensus.cc:697] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:08.566761 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7c99a3ac8c469995be8be36b6b8cf1" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:08.571928 32345 raft_consensus.cc:493] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.575322 32345 raft_consensus.cc:515] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.577899 32345 leader_election.cc:290] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:08.578665 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d018ee52cc46cebe51e75edec5abe5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:08.580571 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d018ee52cc46cebe51e75edec5abe5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:08.580502 32383 consensus_queue.cc:237] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.582521 32098 leader_election.cc:304] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:08.582636 32213 consensus_queue.cc:1048] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:08.583451 32396 raft_consensus.cc:2749] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.586463 31951 leader_election.cc:304] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:08.588029 32270 raft_consensus.cc:2749] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.590732 32181 tablet_bootstrap.cc:492] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:08.591285 32181 ts_tablet_manager.cc:1403] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.161s	user 0.023s	sys 0.006s
I20260709 13:12:08.593716 32178 tablet_bootstrap.cc:492] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:08.594277 32178 ts_tablet_manager.cc:1403] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.127s	user 0.028s	sys 0.024s
I20260709 13:12:08.594669 32177 tablet_bootstrap.cc:654] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.597035 32178 raft_consensus.cc:359] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.597939 32178 raft_consensus.cc:385] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.600184 32178 raft_consensus.cc:740] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.601171 32178 consensus_queue.cc:260] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.599880 32181 raft_consensus.cc:359] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.610733 32181 raft_consensus.cc:385] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.611027 32181 raft_consensus.cc:740] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.611702 32181 consensus_queue.cc:260] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.613766 32181 ts_tablet_manager.cc:1434] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:12:08.614692 32181 tablet_bootstrap.cc:492] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:08.599525 32180 tablet_bootstrap.cc:654] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.607021 32178 ts_tablet_manager.cc:1434] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:12:08.616510 32178 tablet_bootstrap.cc:492] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:08.619077 32379 raft_consensus.cc:493] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.619577 32379 raft_consensus.cc:515] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.620554 32181 tablet_bootstrap.cc:654] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.603665 31806 catalog_manager.cc:5697] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.622105 32379 leader_election.cc:290] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:08.622725 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae250d6acb34e1692cfe5ab3cce75ca" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:08.609724 32177 tablet_bootstrap.cc:492] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:08.624364 32177 ts_tablet_manager.cc:1403] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.002s
I20260709 13:12:08.627753 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae250d6acb34e1692cfe5ab3cce75ca" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:08.628958 32023 leader_election.cc:343] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.630213 32287 consensus_queue.cc:1048] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:08.632066 32024 leader_election.cc:343] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.632544 32024 leader_election.cc:304] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:08.633947 32379 raft_consensus.cc:2749] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.643141 32180 tablet_bootstrap.cc:492] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:08.643458 32178 tablet_bootstrap.cc:654] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.643893 32180 ts_tablet_manager.cc:1403] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.009s
I20260709 13:12:08.648137 32177 raft_consensus.cc:359] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.648865 32177 raft_consensus.cc:385] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.649155 32177 raft_consensus.cc:740] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.650051 32177 consensus_queue.cc:260] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.648140 32396 raft_consensus.cc:493] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.652657 32177 ts_tablet_manager.cc:1434] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 13:12:08.652391 32396 raft_consensus.cc:515] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.653680 32177 tablet_bootstrap.cc:492] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:08.654511 32396 leader_election.cc:290] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:08.655679 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decee8d0520647f5a637ec4bc4237722" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:08.656576 32058 raft_consensus.cc:2393] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 1: Already voted for candidate ab61be703111416d9fba543ea97b2224 in this term.
I20260709 13:12:08.656669 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decee8d0520647f5a637ec4bc4237722" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:08.658031 32129 raft_consensus.cc:3060] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.658900 32098 leader_election.cc:304] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224
I20260709 13:12:08.660501 32370 raft_consensus.cc:493] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.660998 32370 raft_consensus.cc:515] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.662612 32177 tablet_bootstrap.cc:654] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.663127 32370 leader_election.cc:290] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:08.664795 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:08.667403 32024 leader_election.cc:343] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.671473 32345 raft_consensus.cc:2749] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.671957 32180 raft_consensus.cc:359] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.673316 32180 raft_consensus.cc:385] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.673586 32180 raft_consensus.cc:740] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.673836 32270 consensus_queue.cc:1048] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:08.674253 32180 consensus_queue.cc:260] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.675902 32178 tablet_bootstrap.cc:492] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:08.676445 32178 ts_tablet_manager.cc:1403] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.012s
I20260709 13:12:08.678418 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:08.690099 32024 leader_election.cc:343] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.690609 32024 leader_election.cc:304] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:08.691944 32370 raft_consensus.cc:2749] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.695098 32383 consensus_queue.cc:1048] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:08.679669 32180 ts_tablet_manager.cc:1434] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:12:08.679606 32178 raft_consensus.cc:359] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.702767 32178 raft_consensus.cc:385] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.703087 32178 raft_consensus.cc:740] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.703315 32180 tablet_bootstrap.cc:492] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:08.704316 32181 tablet_bootstrap.cc:492] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:08.703717 32178 consensus_queue.cc:260] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.704808 32181 ts_tablet_manager.cc:1403] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.006s
I20260709 13:12:08.706719 32178 ts_tablet_manager.cc:1434] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:12:08.708878 32181 raft_consensus.cc:359] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.709784 32181 raft_consensus.cc:385] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.710070 32181 raft_consensus.cc:740] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.710804 32181 consensus_queue.cc:260] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.712852 32178 tablet_bootstrap.cc:492] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:08.723313 32178 tablet_bootstrap.cc:654] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.725039 32397 consensus_queue.cc:1048] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:08.738272 32180 tablet_bootstrap.cc:654] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.742339 32293 raft_consensus.cc:493] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.742908 32293 raft_consensus.cc:515] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.745065 32293 leader_election.cc:290] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:08.746500 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcab21f469948228159fc838c35005b" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:08.747534 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcab21f469948228159fc838c35005b" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:08.749071 31950 leader_election.cc:304] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:08.750269 32293 raft_consensus.cc:2749] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.750728 32177 tablet_bootstrap.cc:492] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:08.751277 32177 ts_tablet_manager.cc:1403] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.098s	user 0.019s	sys 0.022s
I20260709 13:12:08.753595 32181 ts_tablet_manager.cc:1434] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.002s
I20260709 13:12:08.754040 32177 raft_consensus.cc:359] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.755007 32177 raft_consensus.cc:385] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.755345 32177 raft_consensus.cc:740] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.757961 32178 tablet_bootstrap.cc:492] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:08.758421 32178 ts_tablet_manager.cc:1403] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.001s
I20260709 13:12:08.760739 32177 consensus_queue.cc:260] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.761061 32178 raft_consensus.cc:359] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.761807 32178 raft_consensus.cc:385] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.762087 32178 raft_consensus.cc:740] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.762863 32178 consensus_queue.cc:260] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.764505 32177 ts_tablet_manager.cc:1434] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:12:08.765628 32178 ts_tablet_manager.cc:1434] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:08.766827 32178 tablet_bootstrap.cc:492] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:08.767024 32181 tablet_bootstrap.cc:492] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:08.767503 32180 tablet_bootstrap.cc:492] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:08.768007 32180 ts_tablet_manager.cc:1403] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.003s
I20260709 13:12:08.770999 32180 raft_consensus.cc:359] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.771689 32180 raft_consensus.cc:385] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.771986 32180 raft_consensus.cc:740] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.772825 32178 tablet_bootstrap.cc:654] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.772647 32180 consensus_queue.cc:260] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.773399 32181 tablet_bootstrap.cc:654] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.783514 32180 ts_tablet_manager.cc:1434] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:12:08.784541 32180 tablet_bootstrap.cc:492] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:08.765697 32177 tablet_bootstrap.cc:492] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
W20260709 13:12:08.791779 31855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:08.796056 32370 raft_consensus.cc:493] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.796640 32370 raft_consensus.cc:515] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.798921 32370 leader_election.cc:290] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:08.800693 32177 tablet_bootstrap.cc:654] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.801182 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae225b8df4057bf6eb29eb393c7e2" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:08.803808 31910 raft_consensus.cc:3060] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.805215 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae225b8df4057bf6eb29eb393c7e2" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:08.803833 31985 raft_consensus.cc:2468] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
W20260709 13:12:08.807112 32023 leader_election.cc:343] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.803172 32180 tablet_bootstrap.cc:654] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.809988 32024 leader_election.cc:304] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:08.811275 32379 consensus_queue.cc:1048] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:08.812711 32379 raft_consensus.cc:2804] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.813086 32379 raft_consensus.cc:493] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.813431 32379 raft_consensus.cc:3060] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.810101 32129 raft_consensus.cc:3060] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.817193 32177 tablet_bootstrap.cc:492] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:08.817751 32177 ts_tablet_manager.cc:1403] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.000s
I20260709 13:12:08.820874 32177 raft_consensus.cc:359] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.821368 32181 tablet_bootstrap.cc:492] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:08.821528 32177 raft_consensus.cc:385] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.821969 32177 raft_consensus.cc:740] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.822153 32181 ts_tablet_manager.cc:1403] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.055s	user 0.025s	sys 0.017s
I20260709 13:12:08.823982 32177 consensus_queue.cc:260] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.827600 32177 ts_tablet_manager.cc:1434] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:08.827488 32181 raft_consensus.cc:359] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.828433 32181 raft_consensus.cc:385] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.828663 32177 tablet_bootstrap.cc:492] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:08.828787 32181 raft_consensus.cc:740] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.829736 32181 consensus_queue.cc:260] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.831791 32397 raft_consensus.cc:493] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.833073 32397 raft_consensus.cc:515] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.835137 32397 leader_election.cc:290] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:08.836828 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be53aa47c89a49dd98dd5050d875c00e" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:08.837647 32132 raft_consensus.cc:2468] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:08.840152 31949 leader_election.cc:304] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:08.842609 32293 raft_consensus.cc:2804] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.843011 32293 raft_consensus.cc:493] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.843325 32379 raft_consensus.cc:515] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.843343 32293 raft_consensus.cc:3060] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.845633 32379 leader_election.cc:290] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:08.846742 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae225b8df4057bf6eb29eb393c7e2" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
W20260709 13:12:08.847421 32024 consensus_peers.cc:597] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.848278 32023 leader_election.cc:343] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.849668 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584ae225b8df4057bf6eb29eb393c7e2" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:08.850327 32180 tablet_bootstrap.cc:492] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:08.850852 32180 ts_tablet_manager.cc:1403] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.001s
I20260709 13:12:08.850792 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be53aa47c89a49dd98dd5050d875c00e" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:08.851603 32056 raft_consensus.cc:2468] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:08.850297 31985 raft_consensus.cc:3060] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.861526 32181 ts_tablet_manager.cc:1434] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:12:08.861908 32180 raft_consensus.cc:359] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.862514 32181 tablet_bootstrap.cc:492] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:08.862690 32180 raft_consensus.cc:385] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.862980 32180 raft_consensus.cc:740] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.853257 32293 raft_consensus.cc:515] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.866668 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be53aa47c89a49dd98dd5050d875c00e" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:08.867347 32056 raft_consensus.cc:3060] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.870620 32177 tablet_bootstrap.cc:654] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.873328 32178 tablet_bootstrap.cc:492] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:08.873917 32178 ts_tablet_manager.cc:1403] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.001s
I20260709 13:12:08.875581 32056 raft_consensus.cc:2468] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:08.877446 32178 raft_consensus.cc:359] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.878237 32178 raft_consensus.cc:385] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.878531 32178 raft_consensus.cc:740] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.878383 31951 leader_election.cc:304] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:08.863639 32180 consensus_queue.cc:260] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.879408 32178 consensus_queue.cc:260] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.880322 32230 raft_consensus.cc:2804] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.880810 32230 raft_consensus.cc:697] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:08.881649 32230 consensus_queue.cc:237] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.882270 32178 ts_tablet_manager.cc:1434] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:12:08.883319 32178 tablet_bootstrap.cc:492] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:08.859530 31985 raft_consensus.cc:2468] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:08.889405 32180 ts_tablet_manager.cc:1434] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:12:08.887593 32379 raft_consensus.cc:493] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.887691 32024 leader_election.cc:304] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:08.892149 32180 tablet_bootstrap.cc:492] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:08.891396 32379 raft_consensus.cc:515] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:08.892974 32370 raft_consensus.cc:2804] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.893512 32370 raft_consensus.cc:697] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:08.895546 32370 consensus_queue.cc:237] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:08.896297 32379 leader_election.cc:290] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:08.898365 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:08.900097 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be53aa47c89a49dd98dd5050d875c00e" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:08.900466 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:08.900777 32131 raft_consensus.cc:3060] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.901037 31985 raft_consensus.cc:3060] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.902346 32181 tablet_bootstrap.cc:654] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.894800 32293 leader_election.cc:290] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
W20260709 13:12:08.912108 32024 leader_election.cc:343] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:08.913709 32024 leader_election.cc:343] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.914250 32024 leader_election.cc:304] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:08.915256 32232 raft_consensus.cc:2749] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.925999 31910 raft_consensus.cc:3060] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.927212 32178 tablet_bootstrap.cc:654] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.929051 31807 catalog_manager.cc:5697] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.941924 32232 raft_consensus.cc:493] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.942653 32232 raft_consensus.cc:515] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:08.952421 32131 raft_consensus.cc:2468] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:08.959043 31805 catalog_manager.cc:5697] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 1 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.984285 32345 raft_consensus.cc:493] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.987483 32385 raft_consensus.cc:493] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.990515 32345 raft_consensus.cc:515] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.991124 32385 raft_consensus.cc:515] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:08.996472 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:09.003144 32132 raft_consensus.cc:2468] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:08.994971 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:09.004619 32232 leader_election.cc:290] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:09.005191 31874 leader_election.cc:304] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:08.996277 32385 leader_election.cc:290] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
W20260709 13:12:09.006526 31875 leader_election.cc:343] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.008720 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe566df0914a4799610044a0e01daa" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:09.006541 32383 raft_consensus.cc:2804] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.010179 32383 raft_consensus.cc:493] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.010357 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe566df0914a4799610044a0e01daa" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:09.011718 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced69c1fedef46c1a15fcea51cc970f4" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:09.010648 32383 raft_consensus.cc:3060] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:09.011886 32024 leader_election.cc:343] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.014809 32181 tablet_bootstrap.cc:492] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:09.015375 32181 ts_tablet_manager.cc:1403] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.153s	user 0.016s	sys 0.010s
I20260709 13:12:09.015712 32180 tablet_bootstrap.cc:654] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.013620 32195 raft_consensus.cc:493] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27177ca9073b4128b8844b7cb37db32a)
I20260709 13:12:09.016687 32177 tablet_bootstrap.cc:492] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:09.016470 32195 raft_consensus.cc:515] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.017228 32177 ts_tablet_manager.cc:1403] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.189s	user 0.028s	sys 0.009s
W20260709 13:12:09.022094 32023 leader_election.cc:343] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.022799 32023 leader_election.cc:304] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:09.022951 32181 raft_consensus.cc:359] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.023748 32181 raft_consensus.cc:385] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.024113 32181 raft_consensus.cc:740] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.028492 32230 raft_consensus.cc:493] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.028682 32232 raft_consensus.cc:2749] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.029129 32230 raft_consensus.cc:515] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.022229 32177 raft_consensus.cc:359] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.030260 32177 raft_consensus.cc:385] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.030576 32177 raft_consensus.cc:740] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.031458 32177 consensus_queue.cc:260] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.032998 32181 consensus_queue.cc:260] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.037307 32177 ts_tablet_manager.cc:1434] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:12:09.041388 32383 raft_consensus.cc:515] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:09.042076 32345 leader_election.cc:290] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:09.045507 32177 tablet_bootstrap.cc:492] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:09.046056 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:09.046840 32056 raft_consensus.cc:2468] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:09.048002 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced69c1fedef46c1a15fcea51cc970f4" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:09.048897 31985 raft_consensus.cc:2393] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 1: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
I20260709 13:12:09.036558 32230 leader_election.cc:290] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:09.051334 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:09.051146 32098 leader_election.cc:304] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:09.052189 32383 leader_election.cc:290] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:09.054065 32213 raft_consensus.cc:3060] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.054747 32177 tablet_bootstrap.cc:654] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.055059 32178 tablet_bootstrap.cc:492] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:09.058033 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:09.058717 32132 raft_consensus.cc:3060] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:09.059314 31950 leader_election.cc:343] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.066777 32178 ts_tablet_manager.cc:1403] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.184s	user 0.007s	sys 0.034s
I20260709 13:12:09.072440 31951 leader_election.cc:304] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:09.074338 32230 raft_consensus.cc:2804] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.074928 32230 raft_consensus.cc:493] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.079778 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3e38a5bb6f4fd48b4bd695694eb7d9" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:09.081038 32195 leader_election.cc:290] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:09.081204 32287 raft_consensus.cc:493] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.082271 32287 raft_consensus.cc:515] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.084942 32287 leader_election.cc:290] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:09.088089 32132 raft_consensus.cc:2468] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:09.087906 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:09.100978 32181 ts_tablet_manager.cc:1434] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:12:09.109134 32178 raft_consensus.cc:359] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.075428 32230 raft_consensus.cc:3060] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:09.116886 31875 leader_election.cc:343] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.117671 32180 tablet_bootstrap.cc:492] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:09.118044 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:09.127782 32180 ts_tablet_manager.cc:1403] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.237s	user 0.041s	sys 0.027s
I20260709 13:12:09.127935 32056 raft_consensus.cc:2468] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:09.119102 32181 tablet_bootstrap.cc:492] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:09.130844 32441 consensus_queue.cc:1048] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.131080 32180 raft_consensus.cc:359] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.131855 32180 raft_consensus.cc:385] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.132205 32180 raft_consensus.cc:740] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.132946 32180 consensus_queue.cc:260] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.088176 32213 raft_consensus.cc:2749] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.119447 32178 raft_consensus.cc:385] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.134804 32178 raft_consensus.cc:740] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.135399 32345 raft_consensus.cc:493] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.135784 32178 consensus_queue.cc:260] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.135985 32345 raft_consensus.cc:515] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.137593 32178 ts_tablet_manager.cc:1434] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:12:09.139812 32178 tablet_bootstrap.cc:492] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:09.145656 32181 tablet_bootstrap.cc:654] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.146706 31876 leader_election.cc:304] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:09.148581 32441 raft_consensus.cc:2804] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.149021 32441 raft_consensus.cc:493] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.149437 32441 raft_consensus.cc:3060] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.149785 32345 leader_election.cc:290] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:09.149941 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:09.150774 32056 raft_consensus.cc:2468] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:09.155411 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:09.157390 32230 raft_consensus.cc:515] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.158165 32099 leader_election.cc:304] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:09.160815 32345 raft_consensus.cc:2804] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.161290 32345 raft_consensus.cc:493] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.155481 32180 ts_tablet_manager.cc:1434] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:12:09.164965 31874 leader_election.cc:304] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:09.165877 32180 tablet_bootstrap.cc:492] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:09.168084 32287 raft_consensus.cc:2804] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.168448 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:09.168753 32287 raft_consensus.cc:697] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:09.168121 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3e38a5bb6f4fd48b4bd695694eb7d9" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:09.169793 32287 consensus_queue.cc:237] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:09.170912 32177 tablet_bootstrap.cc:492] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:09.171641 32177 ts_tablet_manager.cc:1403] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.126s	user 0.008s	sys 0.007s
I20260709 13:12:09.174682 32230 leader_election.cc:290] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:09.177083 32177 raft_consensus.cc:359] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.180387 32177 raft_consensus.cc:385] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.180688 32177 raft_consensus.cc:740] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.181454 32177 consensus_queue.cc:260] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.161707 32345 raft_consensus.cc:3060] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.191107 32178 tablet_bootstrap.cc:654] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.208235 32181 tablet_bootstrap.cc:492] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:09.208846 32181 ts_tablet_manager.cc:1403] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.017s
I20260709 13:12:09.197628 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:09.185285 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:09.210527 32056 raft_consensus.cc:3060] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.211637 32441 raft_consensus.cc:515] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.213140 31910 raft_consensus.cc:2393] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 1: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
W20260709 13:12:09.215957 31950 leader_election.cc:343] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.189680 32195 consensus_queue.cc:1048] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:12:09.219465 32177 ts_tablet_manager.cc:1434] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.002s
I20260709 13:12:09.220698 32177 tablet_bootstrap.cc:492] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:09.227207 32177 tablet_bootstrap.cc:654] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.229425 32441 leader_election.cc:290] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:09.189252 31874 leader_election.cc:304] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
W20260709 13:12:09.233184 31874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 44033.5us
I20260709 13:12:09.236428 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:09.237438 32058 raft_consensus.cc:3060] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.234017 32441 raft_consensus.cc:2749] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:09.247495 32181 raft_consensus.cc:359] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.255915 32181 raft_consensus.cc:385] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.261229 32056 raft_consensus.cc:2468] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:09.268375 32180 tablet_bootstrap.cc:654] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.256245 32181 raft_consensus.cc:740] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.270826 31951 leader_election.cc:304] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:09.271145 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:09.273285 32230 raft_consensus.cc:2804] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.273576 32177 tablet_bootstrap.cc:492] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:09.273823 32230 raft_consensus.cc:697] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:09.274626 32177 ts_tablet_manager.cc:1403] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.054s	user 0.005s	sys 0.011s
I20260709 13:12:09.275226 32230 consensus_queue.cc:237] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.281266 31807 catalog_manager.cc:5697] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.278386 32177 raft_consensus.cc:359] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.288615 32177 raft_consensus.cc:385] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.288990 32177 raft_consensus.cc:740] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.291661 32058 raft_consensus.cc:2468] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:09.290629 32177 consensus_queue.cc:260] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.297607 31876 leader_election.cc:304] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:09.298786 32177 ts_tablet_manager.cc:1434] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 13:12:09.299906 32441 raft_consensus.cc:2804] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.301477 32232 raft_consensus.cc:493] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.302465 32441 raft_consensus.cc:697] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:09.304131 32177 tablet_bootstrap.cc:492] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:09.303012 32232 raft_consensus.cc:515] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.308320 32178 tablet_bootstrap.cc:492] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:09.309151 32178 ts_tablet_manager.cc:1403] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.170s	user 0.021s	sys 0.028s
I20260709 13:12:09.310218 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:09.311183 32181 consensus_queue.cc:260] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:09.312572 32024 leader_election.cc:343] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.312741 32178 raft_consensus.cc:359] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:09.313562 32178 raft_consensus.cc:385] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.314153 32178 raft_consensus.cc:740] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.313510 32441 consensus_queue.cc:237] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.315042 32178 consensus_queue.cc:260] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:09.316063 32232 leader_election.cc:290] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:09.320806 32181 ts_tablet_manager.cc:1434] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.002s
I20260709 13:12:09.321184 32178 ts_tablet_manager.cc:1434] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:09.321977 32181 tablet_bootstrap.cc:492] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:09.322160 32178 tablet_bootstrap.cc:492] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:09.324074 32230 raft_consensus.cc:493] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.324990 32230 raft_consensus.cc:515] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.325935 32177 tablet_bootstrap.cc:654] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:09.327266 32023 consensus_peers.cc:597] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a -> Peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Couldn't send request to peer eacc546e751240eb804795d98213a57c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.328186 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a83560836343219eaeb0ba1a0bc451" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:09.328852 32058 raft_consensus.cc:2468] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:09.329368 32178 tablet_bootstrap.cc:654] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.330642 31951 leader_election.cc:304] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:09.331497 32397 raft_consensus.cc:2804] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.331879 32397 raft_consensus.cc:493] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.332355 32397 raft_consensus.cc:3060] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.336658 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:09.339368 31806 catalog_manager.cc:5697] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:09.340972 32023 leader_election.cc:343] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.341733 32023 leader_election.cc:304] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:09.343300 32370 raft_consensus.cc:2749] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.354924 32396 raft_consensus.cc:493] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.355773 32396 raft_consensus.cc:515] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.380412 32396 leader_election.cc:290] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:09.389596 32230 leader_election.cc:290] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:09.362722 32345 raft_consensus.cc:515] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.396420 32129 raft_consensus.cc:2393] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate eacc546e751240eb804795d98213a57c in this term.
I20260709 13:12:09.397483 32345 leader_election.cc:290] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:09.369138 32397 raft_consensus.cc:515] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.414494 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae250d6acb34e1692cfe5ab3cce75ca" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:09.410037 32232 raft_consensus.cc:493] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.418918 32180 tablet_bootstrap.cc:492] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:09.419510 32180 ts_tablet_manager.cc:1403] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.254s	user 0.010s	sys 0.007s
I20260709 13:12:09.422049 31808 catalog_manager.cc:5697] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.423599 32178 tablet_bootstrap.cc:492] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:09.424340 32178 ts_tablet_manager.cc:1403] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.102s	user 0.019s	sys 0.021s
I20260709 13:12:09.423336 32056 raft_consensus.cc:2468] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:09.420552 32232 raft_consensus.cc:515] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.428207 32232 leader_election.cc:290] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:09.428886 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f7547964fe4ef7aab61a37abdcb466" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:09.428587 32180 raft_consensus.cc:359] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:09.429548 32180 raft_consensus.cc:385] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.429857 32180 raft_consensus.cc:740] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.430835 32180 consensus_queue.cc:260] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:09.431296 32024 leader_election.cc:343] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.432201 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f7547964fe4ef7aab61a37abdcb466" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:09.433029 32370 raft_consensus.cc:493] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.433616 32370 raft_consensus.cc:515] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.436193 32370 leader_election.cc:290] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:09.438059 32099 leader_election.cc:304] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:09.438933 32455 raft_consensus.cc:2804] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.439399 32455 raft_consensus.cc:493] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.439821 32455 raft_consensus.cc:3060] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.439692 32178 raft_consensus.cc:359] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.441784 32397 leader_election.cc:290] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:09.442826 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:09.443466 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae250d6acb34e1692cfe5ab3cce75ca" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:09.443683 32024 leader_election.cc:343] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.444065 32178 raft_consensus.cc:385] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.446614 32177 tablet_bootstrap.cc:492] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:09.451349 32180 ts_tablet_manager.cc:1434] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:12:09.458654 32178 raft_consensus.cc:740] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.458549 32056 raft_consensus.cc:2393] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 1: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
I20260709 13:12:09.458910 32177 ts_tablet_manager.cc:1403] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.002s
I20260709 13:12:09.451100 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af49880db24d43b08da39dc862b4c37b" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:09.459808 32180 tablet_bootstrap.cc:492] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:09.450394 32455 raft_consensus.cc:515] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.459875 32178 consensus_queue.cc:260] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.462369 32177 raft_consensus.cc:359] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.463286 32177 raft_consensus.cc:385] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.463601 32177 raft_consensus.cc:740] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.455687 32181 tablet_bootstrap.cc:654] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.458925 32024 leader_election.cc:304] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:09.464376 32177 consensus_queue.cc:260] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.465150 32232 raft_consensus.cc:2749] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.457237 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:09.465988 32232 consensus_queue.cc:1048] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.466658 32177 ts_tablet_manager.cc:1434] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:12:09.467936 32177 tablet_bootstrap.cc:492] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:09.468784 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a83560836343219eaeb0ba1a0bc451" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:09.469177 32455 leader_election.cc:290] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:09.469480 32132 raft_consensus.cc:2468] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:09.472605 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae250d6acb34e1692cfe5ab3cce75ca" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:09.473011 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a83560836343219eaeb0ba1a0bc451" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:09.473639 32056 raft_consensus.cc:3060] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.458542 31910 raft_consensus.cc:2468] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:09.474578 32177 tablet_bootstrap.cc:654] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.475157 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a83560836343219eaeb0ba1a0bc451" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:09.475711 32132 raft_consensus.cc:3060] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.478044 32098 leader_election.cc:304] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:09.478678 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae250d6acb34e1692cfe5ab3cce75ca" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:09.479296 32058 raft_consensus.cc:3060] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.480463 32345 raft_consensus.cc:2749] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.482788 32178 ts_tablet_manager.cc:1434] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:12:09.483872 32178 tablet_bootstrap.cc:492] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
W20260709 13:12:09.473835 32024 leader_election.cc:343] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.500052 32293 consensus_queue.cc:1048] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.504428 32293 consensus_queue.cc:1048] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:12:09.502086 32056 raft_consensus.cc:2468] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:09.510562 32058 raft_consensus.cc:2468] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:09.524539 32099 leader_election.cc:304] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:09.524587 31951 leader_election.cc:304] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:09.525492 32345 raft_consensus.cc:2804] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.525791 32293 raft_consensus.cc:2804] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.526149 32345 raft_consensus.cc:697] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:09.526466 32293 raft_consensus.cc:697] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:09.527225 32345 consensus_queue.cc:237] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.528493 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af49880db24d43b08da39dc862b4c37b" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:09.530598 32023 leader_election.cc:343] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.531155 32132 raft_consensus.cc:2468] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:09.531106 32023 leader_election.cc:304] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:09.527488 32293 consensus_queue.cc:237] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.536044 32232 raft_consensus.cc:2749] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.538993 32180 tablet_bootstrap.cc:654] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.559767 32181 tablet_bootstrap.cc:492] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:09.560335 32181 ts_tablet_manager.cc:1403] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.239s	user 0.019s	sys 0.004s
I20260709 13:12:09.563621 32181 raft_consensus.cc:359] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.564494 32181 raft_consensus.cc:385] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.564776 32181 raft_consensus.cc:740] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.573761 32181 consensus_queue.cc:260] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.574808 32178 tablet_bootstrap.cc:654] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.578577 32181 ts_tablet_manager.cc:1434] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:12:09.580117 32181 tablet_bootstrap.cc:492] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:09.594426 31808 catalog_manager.cc:5697] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.600258 32177 tablet_bootstrap.cc:492] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:09.600808 32177 ts_tablet_manager.cc:1403] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.026s
I20260709 13:12:09.605005 31807 catalog_manager.cc:5697] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.621438 32177 raft_consensus.cc:359] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.622337 32177 raft_consensus.cc:385] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.622639 32177 raft_consensus.cc:740] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.623518 32177 consensus_queue.cc:260] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.626006 32177 ts_tablet_manager.cc:1434] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:12:09.627074 32177 tablet_bootstrap.cc:492] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:09.634389 32177 tablet_bootstrap.cc:654] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.648779 31982 raft_consensus.cc:3060] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.652402 32195 raft_consensus.cc:493] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.653151 32195 raft_consensus.cc:515] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.656772 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:09.657109 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:09.657944 32057 raft_consensus.cc:2393] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate ab61be703111416d9fba543ea97b2224 in this term.
I20260709 13:12:09.655479 32195 leader_election.cc:290] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:09.659255 31876 leader_election.cc:304] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224
I20260709 13:12:09.661427 32287 raft_consensus.cc:3060] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.661727 32195 consensus_queue.cc:1048] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.668092 32181 tablet_bootstrap.cc:654] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.674041 32177 tablet_bootstrap.cc:492] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:09.674562 32177 ts_tablet_manager.cc:1403] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 13:12:09.677402 32177 raft_consensus.cc:359] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.678200 32177 raft_consensus.cc:385] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.678481 32177 raft_consensus.cc:740] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.679693 32178 tablet_bootstrap.cc:492] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:09.680356 32178 ts_tablet_manager.cc:1403] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.197s	user 0.010s	sys 0.005s
I20260709 13:12:09.682250 32287 raft_consensus.cc:2749] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.679421 32177 consensus_queue.cc:260] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.686797 32177 ts_tablet_manager.cc:1434] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:09.688041 32177 tablet_bootstrap.cc:492] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:09.687667 32178 raft_consensus.cc:359] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.691613 32178 raft_consensus.cc:385] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.694310 32178 raft_consensus.cc:740] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.696751 32178 consensus_queue.cc:260] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.724170 32178 ts_tablet_manager.cc:1434] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 13:12:09.717304 32345 raft_consensus.cc:493] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.730587 32345 raft_consensus.cc:515] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:09.736637 32177 tablet_bootstrap.cc:654] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.740921 32345 leader_election.cc:290] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:09.742837 32178 tablet_bootstrap.cc:492] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:09.766986 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8212163be194b95a51643b109e411a8" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:09.773224 32180 tablet_bootstrap.cc:492] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:09.774468 32180 ts_tablet_manager.cc:1403] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.315s	user 0.015s	sys 0.012s
I20260709 13:12:09.775861 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8212163be194b95a51643b109e411a8" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:09.777444 32180 raft_consensus.cc:359] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.778223 32180 raft_consensus.cc:385] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.778512 32180 raft_consensus.cc:740] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.773661 32471 raft_consensus.cc:493] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.779534 32471 raft_consensus.cc:515] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:09.782042 32471 leader_election.cc:290] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:09.782562 32471 raft_consensus.cc:493] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.783041 32471 raft_consensus.cc:515] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:09.785606 32098 leader_election.cc:343] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.789023 32181 tablet_bootstrap.cc:492] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:09.789654 32181 ts_tablet_manager.cc:1403] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.210s	user 0.039s	sys 0.023s
I20260709 13:12:09.791181 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63944c6b0e9a466dba494a0bcdefe7de" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:09.791785 32195 consensus_queue.cc:1048] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.795866 32181 raft_consensus.cc:359] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:09.796627 32181 raft_consensus.cc:385] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.796923 32181 raft_consensus.cc:740] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.797703 32181 consensus_queue.cc:260] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:09.800364 32181 ts_tablet_manager.cc:1434] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:09.808301 32181 tablet_bootstrap.cc:492] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:09.808638 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:09.807245 32098 leader_election.cc:343] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:09.807982 32024 leader_election.cc:343] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.810282 32098 leader_election.cc:304] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:09.811111 32345 raft_consensus.cc:2749] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.802582 32180 consensus_queue.cc:260] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.806103 32471 leader_election.cc:290] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
W20260709 13:12:09.816434 32024 leader_election.cc:343] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.818655 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:09.821667 32178 tablet_bootstrap.cc:654] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.823472 32180 ts_tablet_manager.cc:1434] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.002s
I20260709 13:12:09.824504 32180 tablet_bootstrap.cc:492] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:09.832957 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63944c6b0e9a466dba494a0bcdefe7de" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:09.833382 32181 tablet_bootstrap.cc:654] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:09.837877 32023 leader_election.cc:343] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.842352 32023 leader_election.cc:304] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:09.843920 32471 raft_consensus.cc:2749] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.841717 32293 consensus_queue.cc:1048] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:12:09.864158 32180 tablet_bootstrap.cc:654] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.857406 32230 consensus_queue.cc:1048] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:12:09.868278 32177 tablet_bootstrap.cc:492] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:09.869706 32177 ts_tablet_manager.cc:1403] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.182s	user 0.022s	sys 0.010s
I20260709 13:12:09.880360 32177 raft_consensus.cc:359] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.881253 32177 raft_consensus.cc:385] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.882177 32177 raft_consensus.cc:740] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
W20260709 13:12:09.869185 32023 leader_election.cc:343] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.886967 32023 leader_election.cc:304] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:09.888567 32471 raft_consensus.cc:2749] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.889933 32177 consensus_queue.cc:260] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:09.889585 32471 raft_consensus.cc:493] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.892527 32471 raft_consensus.cc:515] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:09.898434 32471 leader_election.cc:290] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:09.900132 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0126ecb33b074d9d8af32e047a43f067" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:09.900420 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0126ecb33b074d9d8af32e047a43f067" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:09.902143 32024 leader_election.cc:343] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.902660 32181 tablet_bootstrap.cc:492] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:09.903194 32181 ts_tablet_manager.cc:1403] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.095s	user 0.025s	sys 0.008s
W20260709 13:12:09.904776 32024 leader_election.cc:343] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.905007 32177 ts_tablet_manager.cc:1434] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.035s	user 0.001s	sys 0.005s
I20260709 13:12:09.905376 32024 leader_election.cc:304] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:09.906036 32177 tablet_bootstrap.cc:492] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:09.906116 32471 raft_consensus.cc:2749] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.907881 32476 consensus_queue.cc:1048] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:09.907416 32181 raft_consensus.cc:359] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:09.911577 32181 raft_consensus.cc:385] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.912359 32181 raft_consensus.cc:740] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.930960 32230 consensus_queue.cc:1048] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.947441 32477 consensus_queue.cc:1048] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.950618 32293 consensus_queue.cc:1048] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.947203 32180 tablet_bootstrap.cc:492] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:09.952122 32180 ts_tablet_manager.cc:1403] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.005s
I20260709 13:12:09.913847 32181 consensus_queue.cc:260] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:09.959499 32181 ts_tablet_manager.cc:1434] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.002s
I20260709 13:12:09.964566 32178 tablet_bootstrap.cc:492] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:09.964635 32132 raft_consensus.cc:3060] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.966648 32178 ts_tablet_manager.cc:1403] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.241s	user 0.011s	sys 0.014s
W20260709 13:12:09.973986 31855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:09.973001 32180 raft_consensus.cc:359] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:09.980741 32180 raft_consensus.cc:385] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.985739 32181 tablet_bootstrap.cc:492] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:09.981181 32180 raft_consensus.cc:740] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.994581 32441 raft_consensus.cc:493] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.000840 32441 raft_consensus.cc:515] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.003971 32441 leader_election.cc:290] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:10.006803 32178 raft_consensus.cc:359] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:10.009706 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8212163be194b95a51643b109e411a8" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:10.010496 32129 raft_consensus.cc:2468] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:10.010522 32180 consensus_queue.cc:260] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.014825 32180 ts_tablet_manager.cc:1434] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 13:12:10.015782 32180 tablet_bootstrap.cc:492] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:10.007676 32178 raft_consensus.cc:385] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.020164 32178 raft_consensus.cc:740] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.020861 32178 consensus_queue.cc:260] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:10.022290 32177 tablet_bootstrap.cc:654] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.021194 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8212163be194b95a51643b109e411a8" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:10.032114 31874 leader_election.cc:304] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:10.033293 32441 raft_consensus.cc:2804] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.033690 32441 raft_consensus.cc:493] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.034055 32441 raft_consensus.cc:3060] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.034806 32345 raft_consensus.cc:493] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.035426 32345 raft_consensus.cc:515] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:10.026830 31982 raft_consensus.cc:2468] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:10.037796 31909 raft_consensus.cc:3060] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.038256 32178 ts_tablet_manager.cc:1434] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260709 13:12:10.039300 32178 tablet_bootstrap.cc:492] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:10.044062 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe566df0914a4799610044a0e01daa" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:10.044555 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe566df0914a4799610044a0e01daa" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:10.045025 32056 raft_consensus.cc:2468] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
W20260709 13:12:10.046442 32098 leader_election.cc:343] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.055168 32454 consensus_queue.cc:1048] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:10.057000 32181 tablet_bootstrap.cc:654] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.063036 32099 leader_election.cc:304] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:10.064076 32454 raft_consensus.cc:2804] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.064489 32454 raft_consensus.cc:493] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.064857 32454 raft_consensus.cc:3060] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.067821 32345 leader_election.cc:290] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:10.077118 32293 raft_consensus.cc:493] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.077739 32293 raft_consensus.cc:515] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.055107 32441 raft_consensus.cc:515] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.086565 32293 leader_election.cc:290] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:10.097553 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5b51be38f84f3683f3fbe48c4d22af" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:10.101457 32441 leader_election.cc:290] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:10.104902 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8212163be194b95a51643b109e411a8" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:10.105561 32131 raft_consensus.cc:3060] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.109210 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5b51be38f84f3683f3fbe48c4d22af" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:10.113946 31951 leader_election.cc:304] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:10.115705 32484 raft_consensus.cc:2749] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.115585 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8212163be194b95a51643b109e411a8" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:10.116413 31982 raft_consensus.cc:3060] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.116833 32476 raft_consensus.cc:493] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.117322 32476 raft_consensus.cc:515] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.132179 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa7046f9ae649068369e98a43c01171" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:10.132730 32181 tablet_bootstrap.cc:492] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:10.133335 32181 ts_tablet_manager.cc:1403] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.017s
I20260709 13:12:10.133315 32476 leader_election.cc:290] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:10.136323 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa7046f9ae649068369e98a43c01171" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:10.138165 31875 leader_election.cc:343] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.136322 32181 raft_consensus.cc:359] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.140275 32181 raft_consensus.cc:385] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.140620 32181 raft_consensus.cc:740] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
W20260709 13:12:10.142493 31874 leader_election.cc:343] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.143162 31982 raft_consensus.cc:2468] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:10.143298 31874 leader_election.cc:304] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:10.146334 32180 tablet_bootstrap.cc:654] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.147840 32178 tablet_bootstrap.cc:654] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.148393 32345 consensus_queue.cc:1048] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.149039 31875 leader_election.cc:304] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:10.150372 32476 raft_consensus.cc:2749] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.150691 32477 raft_consensus.cc:2804] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.151268 32477 raft_consensus.cc:697] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:10.152344 32477 consensus_queue.cc:237] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.162012 32454 raft_consensus.cc:515] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:10.141692 32181 consensus_queue.cc:260] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.170725 32177 tablet_bootstrap.cc:492] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:10.171581 32177 ts_tablet_manager.cc:1403] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.266s	user 0.013s	sys 0.008s
I20260709 13:12:10.175179 32181 ts_tablet_manager.cc:1434] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:12:10.176266 32181 tablet_bootstrap.cc:492] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:10.169760 32131 raft_consensus.cc:2468] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:10.195336 32180 tablet_bootstrap.cc:492] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:10.196030 32180 ts_tablet_manager.cc:1403] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.180s	user 0.013s	sys 0.000s
I20260709 13:12:10.203003 32454 leader_election.cc:290] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:10.203589 32177 raft_consensus.cc:359] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.204779 32379 raft_consensus.cc:493] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.205318 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe566df0914a4799610044a0e01daa" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:10.205381 32379 raft_consensus.cc:515] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:10.206207 32056 raft_consensus.cc:3060] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.206457 31982 raft_consensus.cc:3060] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.209455 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe566df0914a4799610044a0e01daa" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:10.212886 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec8220975c3487fb08ddb14edb71cf5" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:10.214587 32023 leader_election.cc:343] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.216089 32181 tablet_bootstrap.cc:654] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:10.216730 32098 leader_election.cc:343] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.219141 32177 raft_consensus.cc:385] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.220304 32379 leader_election.cc:290] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:10.219514 32177 raft_consensus.cc:740] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.228293 32177 consensus_queue.cc:260] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.238943 32177 ts_tablet_manager.cc:1434] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:12:10.243978 32177 tablet_bootstrap.cc:492] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:10.237962 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec8220975c3487fb08ddb14edb71cf5" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:10.245767 32024 leader_election.cc:343] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.246264 32024 leader_election.cc:304] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:10.252823 32177 tablet_bootstrap.cc:654] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.245796 32178 tablet_bootstrap.cc:492] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:10.255743 32178 ts_tablet_manager.cc:1403] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.217s	user 0.020s	sys 0.007s
I20260709 13:12:10.254097 32056 raft_consensus.cc:2468] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:10.238620 32180 raft_consensus.cc:359] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.258170 32180 raft_consensus.cc:385] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.258523 32180 raft_consensus.cc:740] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.259665 32178 raft_consensus.cc:359] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:10.261140 32099 leader_election.cc:304] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:10.264104 32178 raft_consensus.cc:385] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.265666 32454 raft_consensus.cc:2804] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.270052 32454 raft_consensus.cc:697] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:10.271935 32471 raft_consensus.cc:493] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.272534 32471 raft_consensus.cc:515] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.276893 32471 leader_election.cc:290] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:10.276489 32454 consensus_queue.cc:237] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:10.282280 32178 raft_consensus.cc:740] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.285732 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7e6bd5627e4a1cb9053e79dd3e2332" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:10.260741 32180 consensus_queue.cc:260] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:10.288775 32024 leader_election.cc:343] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.290920 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7e6bd5627e4a1cb9053e79dd3e2332" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:10.294015 32024 leader_election.cc:343] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.294548 32024 leader_election.cc:304] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:10.262851 32379 raft_consensus.cc:2749] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.300168 32462 raft_consensus.cc:2749] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.294785 32178 consensus_queue.cc:260] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:10.310114 32180 ts_tablet_manager.cc:1434] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.000s
I20260709 13:12:10.311507 32180 tablet_bootstrap.cc:492] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:10.311569 32181 tablet_bootstrap.cc:492] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:10.312183 32181 ts_tablet_manager.cc:1403] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.136s	user 0.030s	sys 0.027s
I20260709 13:12:10.315022 32181 raft_consensus.cc:359] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.315886 32181 raft_consensus.cc:385] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.316167 32181 raft_consensus.cc:740] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.316866 32181 consensus_queue.cc:260] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.319044 32181 ts_tablet_manager.cc:1434] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:10.324048 32181 tablet_bootstrap.cc:492] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:10.325466 32178 ts_tablet_manager.cc:1434] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.000s
I20260709 13:12:10.326535 32178 tablet_bootstrap.cc:492] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:10.330088 32177 tablet_bootstrap.cc:492] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:10.330619 32177 ts_tablet_manager.cc:1403] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.022s
I20260709 13:12:10.333117 32180 tablet_bootstrap.cc:654] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.333421 32177 raft_consensus.cc:359] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:10.334129 32177 raft_consensus.cc:385] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.334399 32177 raft_consensus.cc:740] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.335204 32177 consensus_queue.cc:260] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:10.338141 32177 ts_tablet_manager.cc:1434] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:10.338783 32181 tablet_bootstrap.cc:654] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.339227 32177 tablet_bootstrap.cc:492] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:10.339524 32178 tablet_bootstrap.cc:654] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.345582 32178 tablet_bootstrap.cc:492] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:10.346099 32178 ts_tablet_manager.cc:1403] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 13:12:10.346582 32177 tablet_bootstrap.cc:654] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.350056 32178 raft_consensus.cc:359] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.350843 32178 raft_consensus.cc:385] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.351146 32178 raft_consensus.cc:740] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.351992 32178 consensus_queue.cc:260] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.354888 32178 ts_tablet_manager.cc:1434] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:10.409559 32471 raft_consensus.cc:493] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.423211 32471 raft_consensus.cc:515] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:10.419843 32441 raft_consensus.cc:493] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.425743 32178 tablet_bootstrap.cc:492] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:10.425371 32441 raft_consensus.cc:515] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.428596 32471 leader_election.cc:290] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:10.421707 32180 tablet_bootstrap.cc:492] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:10.441876 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209aeaad860746c39ef57d290c03b5fe" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:10.444391 32024 leader_election.cc:343] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.451673 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209aeaad860746c39ef57d290c03b5fe" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:10.457195 32180 ts_tablet_manager.cc:1403] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.004s
I20260709 13:12:10.462119 32441 leader_election.cc:290] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
W20260709 13:12:10.463027 32023 leader_election.cc:343] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.469322 32023 leader_election.cc:304] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:10.472950 32177 tablet_bootstrap.cc:492] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:10.474150 32177 ts_tablet_manager.cc:1403] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.004s
I20260709 13:12:10.473840 31808 catalog_manager.cc:5697] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.475695 32379 raft_consensus.cc:2749] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.478758 32178 tablet_bootstrap.cc:654] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.481480 32181 tablet_bootstrap.cc:492] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:10.482620 32181 ts_tablet_manager.cc:1403] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.159s	user 0.015s	sys 0.006s
I20260709 13:12:10.485968 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:10.487154 32059 raft_consensus.cc:2468] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:10.489657 31876 leader_election.cc:304] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:10.487416 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:10.490924 32441 raft_consensus.cc:2804] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.491371 32441 raft_consensus.cc:493] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.491825 32441 raft_consensus.cc:3060] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.495790 32180 raft_consensus.cc:359] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.495868 32181 raft_consensus.cc:359] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.497031 32180 raft_consensus.cc:385] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.497095 32181 raft_consensus.cc:385] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.497892 32180 raft_consensus.cc:740] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.498039 32181 raft_consensus.cc:740] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
W20260709 13:12:10.500404 31875 leader_election.cc:343] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.499248 32180 consensus_queue.cc:260] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.501212 32397 raft_consensus.cc:493] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.503285 32397 raft_consensus.cc:515] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.499241 32181 consensus_queue.cc:260] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.512022 31807 catalog_manager.cc:5697] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.532064 32230 raft_consensus.cc:493] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.532884 32230 raft_consensus.cc:515] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.535521 32397 leader_election.cc:290] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:10.538818 32181 ts_tablet_manager.cc:1434] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 13:12:10.551753 32230 leader_election.cc:290] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:10.553395 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa7046f9ae649068369e98a43c01171" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:10.556748 32441 raft_consensus.cc:515] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.556155 32180 ts_tablet_manager.cc:1434] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.098s	user 0.018s	sys 0.009s
I20260709 13:12:10.505882 32177 raft_consensus.cc:359] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:10.562969 32177 raft_consensus.cc:385] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.563383 32177 raft_consensus.cc:740] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.564359 32177 consensus_queue.cc:260] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
W20260709 13:12:10.572876 31949 leader_election.cc:343] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.576642 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa7046f9ae649068369e98a43c01171" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:10.578166 31909 raft_consensus.cc:2468] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:10.580060 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f7547964fe4ef7aab61a37abdcb466" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:10.581135 31910 raft_consensus.cc:2468] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:10.595158 32180 tablet_bootstrap.cc:492] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:10.597218 32441 leader_election.cc:290] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:10.600968 32178 tablet_bootstrap.cc:492] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:10.601706 32178 ts_tablet_manager.cc:1403] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.177s	user 0.019s	sys 0.002s
I20260709 13:12:10.603199 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:10.606005 32177 ts_tablet_manager.cc:1434] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.131s	user 0.007s	sys 0.002s
I20260709 13:12:10.608387 32178 raft_consensus.cc:359] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.610275 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:10.611209 32057 raft_consensus.cc:3060] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:10.606133 31875 leader_election.cc:343] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.610395 32178 raft_consensus.cc:385] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.619751 32178 raft_consensus.cc:740] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.620024 32498 raft_consensus.cc:493] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.621315 32498 raft_consensus.cc:515] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:10.621141 32178 consensus_queue.cc:260] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.623507 32178 ts_tablet_manager.cc:1434] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:12:10.625151 32178 tablet_bootstrap.cc:492] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:10.627919 32181 tablet_bootstrap.cc:492] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:10.628713 32177 tablet_bootstrap.cc:492] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:10.632405 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f7547964fe4ef7aab61a37abdcb466" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:10.640480 32056 raft_consensus.cc:2468] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:10.647976 31950 leader_election.cc:304] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: eacc546e751240eb804795d98213a57c
I20260709 13:12:10.656167 32293 raft_consensus.cc:2804] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.656715 32293 raft_consensus.cc:493] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.657151 32293 raft_consensus.cc:3060] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.659368 32178 tablet_bootstrap.cc:654] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.663183 32462 raft_consensus.cc:493] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.663890 32462 raft_consensus.cc:515] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:10.668242 32177 tablet_bootstrap.cc:654] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.668159 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:10.672418 31950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 82793.2us
W20260709 13:12:10.673454 32023 leader_election.cc:343] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.673857 31950 leader_election.cc:304] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:10.677461 32484 raft_consensus.cc:2804] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.672653 32462 leader_election.cc:290] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:10.682476 32484 raft_consensus.cc:493] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.688433 32057 raft_consensus.cc:2468] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:10.690362 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:10.688802 32195 consensus_queue.cc:1048] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:10.700383 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:10.705416 32177 tablet_bootstrap.cc:492] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:10.706306 32177 ts_tablet_manager.cc:1403] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.007s
I20260709 13:12:10.698305 32484 raft_consensus.cc:3060] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:10.714730 32024 leader_election.cc:343] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.715662 32024 leader_election.cc:304] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:10.724772 32471 raft_consensus.cc:2749] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.718079 31876 leader_election.cc:304] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224
W20260709 13:12:10.732761 32098 consensus_peers.cc:597] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:10.733069 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:10.732760 32477 raft_consensus.cc:2804] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.733985 32058 raft_consensus.cc:2468] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:10.734771 32477 raft_consensus.cc:697] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:10.736186 32477 consensus_queue.cc:237] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.737161 32345 raft_consensus.cc:493] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.737794 32099 leader_election.cc:304] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:10.738291 32455 consensus_queue.cc:1048] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:10.740046 32455 raft_consensus.cc:2804] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.744079 32441 raft_consensus.cc:493] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.747906 32441 raft_consensus.cc:515] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.750105 32177 raft_consensus.cc:359] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.750615 32441 leader_election.cc:290] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:10.751053 32177 raft_consensus.cc:385] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.740486 32455 raft_consensus.cc:493] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.752588 32455 raft_consensus.cc:3060] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.737733 32345 raft_consensus.cc:515] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.754951 32293 raft_consensus.cc:515] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.756053 32181 tablet_bootstrap.cc:654] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.755416 32345 leader_election.cc:290] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:10.746368 32498 leader_election.cc:290] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:10.757272 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540d3a54268745adb1ed6108ca819925" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:10.751461 32177 raft_consensus.cc:740] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.762884 32498 raft_consensus.cc:493] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.763551 32177 consensus_queue.cc:260] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.763458 32498 raft_consensus.cc:515] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.769021 32129 raft_consensus.cc:2468] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:10.770229 32293 leader_election.cc:290] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:10.780301 32177 ts_tablet_manager.cc:1434] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 13:12:10.781297 32498 leader_election.cc:290] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:10.781791 32177 tablet_bootstrap.cc:492] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:10.770501 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa7046f9ae649068369e98a43c01171" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:10.782343 32132 raft_consensus.cc:3060] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:10.783994 32098 leader_election.cc:343] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.784132 32476 consensus_queue.cc:1048] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:10.769222 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540d3a54268745adb1ed6108ca819925" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:10.804687 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa7046f9ae649068369e98a43c01171" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:10.805509 31908 raft_consensus.cc:2468] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
W20260709 13:12:10.822785 31875 leader_election.cc:343] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.826409 31874 leader_election.cc:304] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:10.829001 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa7046f9ae649068369e98a43c01171" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:10.829814 31908 raft_consensus.cc:3060] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.833101 32177 tablet_bootstrap.cc:654] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.840444 32180 tablet_bootstrap.cc:654] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.840430 32476 raft_consensus.cc:2804] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.850575 32476 raft_consensus.cc:493] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.850732 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540d3a54268745adb1ed6108ca819925" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:10.851079 32476 raft_consensus.cc:3060] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.851476 32178 tablet_bootstrap.cc:492] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:10.851629 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540d3a54268745adb1ed6108ca819925" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:10.852104 32178 ts_tablet_manager.cc:1403] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.228s	user 0.011s	sys 0.012s
I20260709 13:12:10.849789 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa7046f9ae649068369e98a43c01171" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:10.844213 32484 raft_consensus.cc:515] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:10.858213 31982 raft_consensus.cc:2393] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 1: Already voted for candidate ab61be703111416d9fba543ea97b2224 in this term.
I20260709 13:12:10.860105 32484 leader_election.cc:290] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:10.873677 32455 raft_consensus.cc:515] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:10.880187 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f7547964fe4ef7aab61a37abdcb466" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:10.881150 31909 raft_consensus.cc:3060] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.880309 32181 tablet_bootstrap.cc:492] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:10.882937 32181 ts_tablet_manager.cc:1403] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.259s	user 0.016s	sys 0.004s
I20260709 13:12:10.890272 32178 raft_consensus.cc:359] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:10.891526 32178 raft_consensus.cc:385] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.891996 32178 raft_consensus.cc:740] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.893841 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60f7547964fe4ef7aab61a37abdcb466" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:10.894933 32057 raft_consensus.cc:3060] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.895087 32476 raft_consensus.cc:515] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.897245 31910 raft_consensus.cc:2393] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 1: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
I20260709 13:12:10.886180 32098 leader_election.cc:304] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
W20260709 13:12:10.901928 32098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 44133.9us
I20260709 13:12:10.890516 32455 leader_election.cc:290] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:10.910075 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:10.910722 32058 raft_consensus.cc:3060] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.918157 32181 raft_consensus.cc:359] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:10.919023 32181 raft_consensus.cc:385] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.919327 32181 raft_consensus.cc:740] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.920881 32058 raft_consensus.cc:2468] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:10.920171 32181 consensus_queue.cc:260] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:10.922350 32099 leader_election.cc:304] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:10.903268 31908 raft_consensus.cc:2468] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
W20260709 13:12:10.909227 32098 leader_election.cc:343] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.923267 32345 raft_consensus.cc:2804] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.909822 32178 consensus_queue.cc:260] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:10.925710 32345 raft_consensus.cc:697] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:10.925664 31950 leader_election.cc:304] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:10.929491 32345 consensus_queue.cc:237] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:10.931833 32484 raft_consensus.cc:2804] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.932018 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:10.932412 32484 raft_consensus.cc:697] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:10.936368 32484 consensus_queue.cc:237] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:10.943928 32132 raft_consensus.cc:2468] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:10.944715 32498 raft_consensus.cc:2764] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:12:10.951385 32181 ts_tablet_manager.cc:1434] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 13:12:10.954409 32180 tablet_bootstrap.cc:492] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:10.955123 32180 ts_tablet_manager.cc:1403] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.361s	user 0.004s	sys 0.016s
I20260709 13:12:10.956944 32098 leader_election.cc:304] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:10.967478 32455 raft_consensus.cc:3060] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.989056 32512 raft_consensus.cc:493] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.990005 32512 raft_consensus.cc:515] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.007458 32181 tablet_bootstrap.cc:492] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:11.004688 32379 raft_consensus.cc:493] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.009995 32177 tablet_bootstrap.cc:492] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:11.010640 32177 ts_tablet_manager.cc:1403] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.229s	user 0.011s	sys 0.004s
I20260709 13:12:11.014120 32512 leader_election.cc:290] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:11.018096 32177 raft_consensus.cc:359] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.018980 32177 raft_consensus.cc:385] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:11.022318 32098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 90859.1us
I20260709 13:12:11.019270 32177 raft_consensus.cc:740] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
W20260709 13:12:11.034524 32098 leader_election.cc:343] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.036106 32180 raft_consensus.cc:359] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.038125 32180 raft_consensus.cc:385] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.038556 32180 raft_consensus.cc:740] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.039641 32177 consensus_queue.cc:260] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.042487 32178 ts_tablet_manager.cc:1434] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.190s	user 0.010s	sys 0.000s
W20260709 13:12:11.034242 32099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 69684.4us
I20260709 13:12:11.010092 32379 raft_consensus.cc:515] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.044015 31909 raft_consensus.cc:2468] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:11.044538 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af49880db24d43b08da39dc862b4c37b" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:11.060096 32379 leader_election.cc:290] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
W20260709 13:12:11.061882 32098 leader_election.cc:343] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.065239 32455 raft_consensus.cc:2749] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.067342 32181 tablet_bootstrap.cc:654] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.066610 31805 catalog_manager.cc:5697] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.068956 32178 tablet_bootstrap.cc:492] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:11.069573 31950 leader_election.cc:304] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:11.072439 32293 raft_consensus.cc:2804] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.072983 32293 raft_consensus.cc:697] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:11.073835 32293 consensus_queue.cc:237] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.077479 32379 raft_consensus.cc:493] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.086079 32379 raft_consensus.cc:515] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.042549 32057 raft_consensus.cc:2468] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:11.092984 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:11.049015 32180 consensus_queue.cc:260] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
W20260709 13:12:11.098357 32023 leader_election.cc:343] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.096958 31808 catalog_manager.cc:5697] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.099956 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540d3a54268745adb1ed6108ca819925" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:11.112179 32177 ts_tablet_manager.cc:1434] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.003s
I20260709 13:12:11.101271 32379 leader_election.cc:290] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:11.109651 32441 raft_consensus.cc:493] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.129158 32180 ts_tablet_manager.cc:1434] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.174s	user 0.006s	sys 0.003s
I20260709 13:12:11.133630 32441 raft_consensus.cc:515] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.137568 32441 leader_election.cc:290] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:11.132769 32476 leader_election.cc:290] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:11.159322 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7bb527b8174d1792395c79a82a224c" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:11.160087 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:11.160929 32059 raft_consensus.cc:2468] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:11.161803 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af49880db24d43b08da39dc862b4c37b" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:11.162295 31876 leader_election.cc:304] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:11.162645 32057 raft_consensus.cc:2468] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:11.163244 32477 raft_consensus.cc:2804] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.163620 32477 raft_consensus.cc:493] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.163947 32477 raft_consensus.cc:3060] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.168131 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540d3a54268745adb1ed6108ca819925" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
W20260709 13:12:11.171206 31875 leader_election.cc:343] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.174734 32180 tablet_bootstrap.cc:492] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:11.175352 32177 tablet_bootstrap.cc:492] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:11.159433 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:11.193470 32181 tablet_bootstrap.cc:492] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:11.200812 32181 ts_tablet_manager.cc:1403] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.196s	user 0.024s	sys 0.025s
W20260709 13:12:11.202487 32024 leader_election.cc:343] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:11.208961 32024 leader_election.cc:343] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.209790 32024 leader_election.cc:304] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:11.217612 32181 raft_consensus.cc:359] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.218510 32181 raft_consensus.cc:385] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.219626 32181 raft_consensus.cc:740] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.220521 32181 consensus_queue.cc:260] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.219317 32177 tablet_bootstrap.cc:654] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.225719 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7bb527b8174d1792395c79a82a224c" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:11.227020 32024 leader_election.cc:343] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.227890 32024 leader_election.cc:304] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:11.229995 32462 raft_consensus.cc:2749] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.229993 31806 catalog_manager.cc:5697] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.232111 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:11.235101 31807 catalog_manager.cc:5697] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:11.236671 31874 leader_election.cc:343] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.238412 32099 leader_election.cc:304] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:11.240518 32454 raft_consensus.cc:2804] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.240963 32454 raft_consensus.cc:493] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.241338 32454 raft_consensus.cc:3060] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.249923 32132 raft_consensus.cc:2468] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:11.226998 32529 raft_consensus.cc:2749] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.255996 32454 raft_consensus.cc:515] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.258463 32454 leader_election.cc:290] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:11.260344 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af49880db24d43b08da39dc862b4c37b" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
W20260709 13:12:11.262277 32098 leader_election.cc:343] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.265133 32180 tablet_bootstrap.cc:654] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.269192 32178 tablet_bootstrap.cc:654] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.246140 32477 raft_consensus.cc:515] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.276199 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af49880db24d43b08da39dc862b4c37b" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:11.281090 32057 raft_consensus.cc:3060] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.284392 32181 ts_tablet_manager.cc:1434] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:12:11.285593 32181 tablet_bootstrap.cc:492] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:11.290381 32057 raft_consensus.cc:2468] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:11.290992 32181 tablet_bootstrap.cc:654] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:11.273959 31875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:45831, user_credentials={real_user=slave}} blocked reactor thread for 101882us
I20260709 13:12:11.302500 32099 leader_election.cc:304] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
W20260709 13:12:11.304951 31875 consensus_peers.cc:597] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.305589 32181 tablet_bootstrap.cc:492] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
W20260709 13:12:11.307124 31874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 47638us
W20260709 13:12:11.322373 31855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:11.310971 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:11.323119 32058 raft_consensus.cc:3060] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.329814 32441 consensus_queue.cc:1048] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.330242 32058 raft_consensus.cc:2468] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:11.311769 32477 leader_election.cc:290] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:11.311955 32180 tablet_bootstrap.cc:492] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:11.315070 32178 tablet_bootstrap.cc:492] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:11.319849 32181 ts_tablet_manager.cc:1403] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.012s
I20260709 13:12:11.322263 31874 leader_election.cc:304] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:11.308045 32177 tablet_bootstrap.cc:492] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:11.331701 32180 ts_tablet_manager.cc:1403] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.173s	user 0.007s	sys 0.006s
I20260709 13:12:11.332561 32177 ts_tablet_manager.cc:1403] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.178s	user 0.013s	sys 0.001s
I20260709 13:12:11.338680 32180 raft_consensus.cc:359] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.339700 32180 raft_consensus.cc:385] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.339795 32177 raft_consensus.cc:359] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.340365 32180 raft_consensus.cc:740] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.340713 32177 raft_consensus.cc:385] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.333623 32454 raft_consensus.cc:2804] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.341912 32454 raft_consensus.cc:697] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:11.341400 32180 consensus_queue.cc:260] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.342913 32454 consensus_queue.cc:237] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.343922 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:11.344270 32180 ts_tablet_manager.cc:1434] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:12:11.335098 32178 ts_tablet_manager.cc:1403] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.267s	user 0.012s	sys 0.003s
I20260709 13:12:11.332748 32441 raft_consensus.cc:2804] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.348250 32441 raft_consensus.cc:697] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:11.349252 32441 consensus_queue.cc:237] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.334482 32181 raft_consensus.cc:359] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.350206 32178 raft_consensus.cc:359] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.351094 32178 raft_consensus.cc:385] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.332077 31876 leader_election.cc:304] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:11.351416 32178 raft_consensus.cc:740] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.350904 32181 raft_consensus.cc:385] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.352197 32181 raft_consensus.cc:740] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.352224 32178 consensus_queue.cc:260] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.353129 32181 consensus_queue.cc:260] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.355077 32178 ts_tablet_manager.cc:1434] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:11.355280 32177 raft_consensus.cc:740] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.356215 32177 consensus_queue.cc:260] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.357573 32178 tablet_bootstrap.cc:492] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:11.358726 32177 ts_tablet_manager.cc:1434] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:12:11.369138 32177 tablet_bootstrap.cc:492] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:11.359354 32477 raft_consensus.cc:2804] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:11.362836 31874 leader_election.cc:343] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.375514 32477 raft_consensus.cc:697] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:11.376945 32177 tablet_bootstrap.cc:654] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.356758 32180 tablet_bootstrap.cc:492] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:11.363540 32181 ts_tablet_manager.cc:1434] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:12:11.376483 32477 consensus_queue.cc:237] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.389729 31806 catalog_manager.cc:5697] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.393177 32180 tablet_bootstrap.cc:654] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.392380 31808 catalog_manager.cc:5697] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.366578 32178 tablet_bootstrap.cc:654] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.392259 32293 consensus_queue.cc:1048] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:11.406665 32293 raft_consensus.cc:493] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.407428 32293 raft_consensus.cc:515] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.412142 32293 leader_election.cc:290] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:11.412329 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:11.413306 32057 raft_consensus.cc:2393] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab61be703111416d9fba543ea97b2224 in current term 1: Already voted for candidate eacc546e751240eb804795d98213a57c in this term.
I20260709 13:12:11.414017 32181 tablet_bootstrap.cc:492] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:11.418269 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:11.418643 31984 raft_consensus.cc:3060] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.420064 32532 raft_consensus.cc:493] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.420666 32532 raft_consensus.cc:515] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.423272 32532 leader_election.cc:290] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:11.430028 32534 raft_consensus.cc:493] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.430982 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0126ecb33b074d9d8af32e047a43f067" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:11.433704 32056 raft_consensus.cc:2468] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:11.430279 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0126ecb33b074d9d8af32e047a43f067" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:11.433533 32534 raft_consensus.cc:515] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.436713 32454 consensus_queue.cc:1048] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.438519 32534 leader_election.cc:290] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
W20260709 13:12:11.440099 31875 leader_election.cc:343] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.429759 31949 leader_election.cc:304] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:11.444486 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eecdc9a6c45481b8148098fe8e47232" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:11.444272 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eecdc9a6c45481b8148098fe8e47232" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:11.449860 32178 tablet_bootstrap.cc:492] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:11.449822 32130 raft_consensus.cc:2468] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:11.450754 32178 ts_tablet_manager.cc:1403] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.007s
W20260709 13:12:11.449746 31875 leader_election.cc:343] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.454142 32178 raft_consensus.cc:359] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.454922 32178 raft_consensus.cc:385] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.455243 32178 raft_consensus.cc:740] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.456110 31874 leader_election.cc:304] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:11.456144 32178 consensus_queue.cc:260] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.461565 32534 raft_consensus.cc:2804] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.462127 32534 raft_consensus.cc:493] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.462543 32534 raft_consensus.cc:3060] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.491899 31876 leader_election.cc:304] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:11.493553 32178 ts_tablet_manager.cc:1434] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:12:11.494922 32178 tablet_bootstrap.cc:492] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:11.500046 32441 raft_consensus.cc:2804] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.500730 32441 raft_consensus.cc:493] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.501261 32441 raft_consensus.cc:3060] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.495574 32181 tablet_bootstrap.cc:654] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.520165 32180 tablet_bootstrap.cc:492] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:11.520830 32180 ts_tablet_manager.cc:1403] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.004s
I20260709 13:12:11.526264 32534 raft_consensus.cc:515] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.541260 32178 tablet_bootstrap.cc:654] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.543524 32177 tablet_bootstrap.cc:492] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:11.546139 32177 ts_tablet_manager.cc:1403] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.033s
I20260709 13:12:11.550864 32441 raft_consensus.cc:515] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.563329 32534 leader_election.cc:290] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:11.563902 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eecdc9a6c45481b8148098fe8e47232" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:11.565610 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eecdc9a6c45481b8148098fe8e47232" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:11.566463 32132 raft_consensus.cc:3060] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.567068 32180 raft_consensus.cc:359] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.568248 32230 raft_consensus.cc:2749] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.570915 32180 raft_consensus.cc:385] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.571393 32180 raft_consensus.cc:740] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
W20260709 13:12:11.568846 31875 leader_election.cc:343] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.569406 32454 consensus_queue.cc:1048] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.569585 31806 catalog_manager.cc:5697] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.570111 32177 raft_consensus.cc:359] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.574750 32177 raft_consensus.cc:385] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.572433 32180 consensus_queue.cc:260] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.575065 32441 leader_election.cc:290] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:11.576383 32180 ts_tablet_manager.cc:1434] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.003s
I20260709 13:12:11.575114 32177 raft_consensus.cc:740] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.578441 32177 consensus_queue.cc:260] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.583060 32177 ts_tablet_manager.cc:1434] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:12:11.584033 32180 tablet_bootstrap.cc:492] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:11.590196 32510 consensus_queue.cc:1048] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.591380 32180 tablet_bootstrap.cc:654] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.592259 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0126ecb33b074d9d8af32e047a43f067" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:11.599499 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0126ecb33b074d9d8af32e047a43f067" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:11.600167 32056 raft_consensus.cc:3060] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.600733 32132 raft_consensus.cc:2468] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
W20260709 13:12:11.607769 31875 leader_election.cc:343] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.609680 32293 consensus_queue.cc:1048] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.610713 32178 tablet_bootstrap.cc:492] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:11.611325 32178 ts_tablet_manager.cc:1403] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.004s
I20260709 13:12:11.610597 31874 leader_election.cc:304] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:11.613668 32441 raft_consensus.cc:2804] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.614295 32441 raft_consensus.cc:697] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:11.614459 32178 raft_consensus.cc:359] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.615262 32178 raft_consensus.cc:385] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.615567 32178 raft_consensus.cc:740] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.617481 32178 consensus_queue.cc:260] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.615391 32441 consensus_queue.cc:237] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.619935 32178 ts_tablet_manager.cc:1434] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:11.623649 32178 tablet_bootstrap.cc:492] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:11.638833 32056 raft_consensus.cc:2468] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:11.647701 32177 tablet_bootstrap.cc:492] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a: Bootstrap starting.
I20260709 13:12:11.651525 32178 tablet_bootstrap.cc:654] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.645105 32528 raft_consensus.cc:493] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.655838 32528 raft_consensus.cc:515] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.658003 32528 leader_election.cc:290] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:11.658396 32177 tablet_bootstrap.cc:654] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.659184 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:11.669183 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:11.670339 32056 raft_consensus.cc:2393] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 1: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
I20260709 13:12:11.664170 31876 leader_election.cc:304] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:11.680277 32477 raft_consensus.cc:2804] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.680877 32477 raft_consensus.cc:697] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:11.689908 32477 consensus_queue.cc:237] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.690900 32181 tablet_bootstrap.cc:492] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:11.691512 32181 ts_tablet_manager.cc:1403] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.301s	user 0.014s	sys 0.015s
I20260709 13:12:11.706496 32099 leader_election.cc:304] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:11.709061 32528 raft_consensus.cc:3060] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.719993 32180 tablet_bootstrap.cc:492] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:11.720772 32180 ts_tablet_manager.cc:1403] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.137s	user 0.020s	sys 0.009s
I20260709 13:12:11.729564 32181 raft_consensus.cc:359] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.729693 32180 raft_consensus.cc:359] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.730468 32181 raft_consensus.cc:385] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.730860 32181 raft_consensus.cc:740] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.734158 32484 consensus_queue.cc:1048] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.736696 32181 consensus_queue.cc:260] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.736846 31808 catalog_manager.cc:5697] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.739322 32181 ts_tablet_manager.cc:1434] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 13:12:11.730595 32180 raft_consensus.cc:385] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.752017 32180 raft_consensus.cc:740] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.781464 31985 raft_consensus.cc:3060] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.786605 32180 consensus_queue.cc:260] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.787966 31982 raft_consensus.cc:3060] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.789525 32180 ts_tablet_manager.cc:1434] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.068s	user 0.004s	sys 0.003s
I20260709 13:12:11.790848 32180 tablet_bootstrap.cc:492] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:11.797243 32528 raft_consensus.cc:2749] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.820385 32455 consensus_queue.cc:1048] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:11.825191 31875 consensus_peers.cc:597] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.825484 32177 tablet_bootstrap.cc:492] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a: No bootstrap required, opened a new log
I20260709 13:12:11.826062 32177 ts_tablet_manager.cc:1403] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.010s
I20260709 13:12:11.833102 32528 consensus_queue.cc:1048] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.838501 32177 raft_consensus.cc:359] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.839339 32177 raft_consensus.cc:385] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.839717 32177 raft_consensus.cc:740] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.839442 32462 raft_consensus.cc:493] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.840622 32177 consensus_queue.cc:260] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.842737 32181 tablet_bootstrap.cc:492] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:11.842445 32462 raft_consensus.cc:515] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.855464 32177 ts_tablet_manager.cc:1434] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:12:11.855674 32462 leader_election.cc:290] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:11.857285 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c4dd4a38fc647e3a2ad4a953c649261" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:11.859102 32023 leader_election.cc:343] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.861176 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c4dd4a38fc647e3a2ad4a953c649261" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:11.869534 32178 tablet_bootstrap.cc:492] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:11.870170 32178 ts_tablet_manager.cc:1403] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.247s	user 0.034s	sys 0.048s
I20260709 13:12:11.872941 31807 catalog_manager.cc:5697] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.884940 32180 tablet_bootstrap.cc:654] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.885483 32178 raft_consensus.cc:359] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.886363 32178 raft_consensus.cc:385] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.886664 32178 raft_consensus.cc:740] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.887761 32178 consensus_queue.cc:260] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.889489 32181 tablet_bootstrap.cc:654] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.894790 32534 consensus_queue.cc:1048] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:11.902426 32180 tablet_bootstrap.cc:492] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:11.902633 32462 raft_consensus.cc:493] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.903036 32180 ts_tablet_manager.cc:1403] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.000s
I20260709 13:12:11.903173 32462 raft_consensus.cc:515] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:11.897152 32178 ts_tablet_manager.cc:1434] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.002s
W20260709 13:12:11.899308 32024 leader_election.cc:343] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.905611 32462 leader_election.cc:290] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:11.906054 32024 leader_election.cc:304] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:11.906116 32180 raft_consensus.cc:359] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.907028 32180 raft_consensus.cc:385] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.907022 32462 raft_consensus.cc:2749] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.907583 32180 raft_consensus.cc:740] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.908140 32534 raft_consensus.cc:493] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.908449 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d9f17e553345b4b6a7c1aad8e8c058" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:11.910455 32534 raft_consensus.cc:515] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:11.913254 32024 leader_election.cc:343] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.913757 32534 leader_election.cc:290] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:11.914675 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe566df0914a4799610044a0e01daa" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:11.915437 32178 tablet_bootstrap.cc:492] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:11.908599 32180 consensus_queue.cc:260] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:11.915881 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe566df0914a4799610044a0e01daa" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:11.917642 32180 ts_tablet_manager.cc:1434] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:12:11.918864 32180 tablet_bootstrap.cc:492] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:11.925935 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d9f17e553345b4b6a7c1aad8e8c058" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:11.927510 32024 leader_election.cc:343] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.928017 32024 leader_election.cc:304] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:11.929339 32462 raft_consensus.cc:2749] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.930285 31874 leader_election.cc:304] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:11.932654 32180 tablet_bootstrap.cc:654] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.932953 32477 raft_consensus.cc:2749] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.937757 32528 raft_consensus.cc:493] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.938648 32528 raft_consensus.cc:515] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:11.940547 32532 consensus_queue.cc:1048] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.947207 32180 tablet_bootstrap.cc:492] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:11.947853 32180 ts_tablet_manager.cc:1403] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.006s
I20260709 13:12:11.956060 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec8220975c3487fb08ddb14edb71cf5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:11.956414 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec8220975c3487fb08ddb14edb71cf5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:11.956940 32059 raft_consensus.cc:2468] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
W20260709 13:12:11.957944 32098 leader_election.cc:343] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.959882 32528 leader_election.cc:290] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:11.966104 32477 consensus_queue.cc:1048] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.970062 32099 leader_election.cc:304] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:11.954509 32180 raft_consensus.cc:359] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.972339 32180 raft_consensus.cc:385] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.972709 32180 raft_consensus.cc:740] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.973278 32180 consensus_queue.cc:260] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:11.975615 32180 ts_tablet_manager.cc:1434] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:12:11.977485 32180 tablet_bootstrap.cc:492] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:11.984401 32528 raft_consensus.cc:2804] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.985107 32528 raft_consensus.cc:493] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.985594 32528 raft_consensus.cc:3060] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.987417 32178 tablet_bootstrap.cc:654] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.987111 32180 tablet_bootstrap.cc:654] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.991788 32181 tablet_bootstrap.cc:492] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:12.010612 32181 ts_tablet_manager.cc:1403] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.203s	user 0.019s	sys 0.010s
I20260709 13:12:12.012377 32528 raft_consensus.cc:515] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.015295 32178 tablet_bootstrap.cc:492] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:12.016110 32180 tablet_bootstrap.cc:492] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:12.017539 32180 ts_tablet_manager.cc:1403] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.000s
I20260709 13:12:12.017267 32178 ts_tablet_manager.cc:1403] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.004s
I20260709 13:12:12.020957 32181 raft_consensus.cc:359] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.021745 32181 raft_consensus.cc:385] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.021404 32180 raft_consensus.cc:359] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.022109 32181 raft_consensus.cc:740] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.028350 32181 consensus_queue.cc:260] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.022826 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec8220975c3487fb08ddb14edb71cf5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:12.029667 32056 raft_consensus.cc:3060] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.031070 32181 ts_tablet_manager.cc:1434] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:12:12.024223 32178 raft_consensus.cc:359] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:12.035518 32178 raft_consensus.cc:385] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.026746 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ec8220975c3487fb08ddb14edb71cf5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:12.035986 32178 raft_consensus.cc:740] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.036211 31910 raft_consensus.cc:3060] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.036705 32178 consensus_queue.cc:260] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:12.038941 32178 ts_tablet_manager.cc:1434] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.000s
I20260709 13:12:12.043888 32056 raft_consensus.cc:2468] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:12.045217 32099 leader_election.cc:304] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:12.025295 32528 leader_election.cc:290] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:12.035526 32181 tablet_bootstrap.cc:492] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:12.022449 32180 raft_consensus.cc:385] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.046380 32345 raft_consensus.cc:2804] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.049408 32178 tablet_bootstrap.cc:492] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:12.054220 32180 raft_consensus.cc:740] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.056919 32180 consensus_queue.cc:260] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.060407 32471 raft_consensus.cc:493] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.061003 32471 raft_consensus.cc:515] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:12.063288 32471 leader_election.cc:290] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:12.055826 32345 raft_consensus.cc:697] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:12.064968 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63944c6b0e9a466dba494a0bcdefe7de" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:12.065732 32130 raft_consensus.cc:2468] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:12.065948 32345 consensus_queue.cc:237] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.067050 32023 leader_election.cc:304] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:12.072818 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63944c6b0e9a466dba494a0bcdefe7de" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:12.073635 31982 raft_consensus.cc:2468] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:12.075505 32181 tablet_bootstrap.cc:654] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.077348 32471 raft_consensus.cc:2804] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.077981 32471 raft_consensus.cc:493] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.078377 32471 raft_consensus.cc:3060] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.078778 32178 tablet_bootstrap.cc:654] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.080722 32509 raft_consensus.cc:493] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.081306 32509 raft_consensus.cc:515] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:12.086256 32180 ts_tablet_manager.cc:1434] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:12:12.086364 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0126ecb33b074d9d8af32e047a43f067" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:12.089751 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0126ecb33b074d9d8af32e047a43f067" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:12.090008 32509 leader_election.cc:290] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:12.090180 31908 raft_consensus.cc:3060] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.090752 32059 raft_consensus.cc:2393] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab61be703111416d9fba543ea97b2224 in current term 1: Already voted for candidate 936b035f23a5449fb43db3fd5f757325 in this term.
I20260709 13:12:12.053910 31910 raft_consensus.cc:2468] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:12.093649 31951 leader_election.cc:304] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:12.096887 32509 raft_consensus.cc:3060] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.087599 32180 tablet_bootstrap.cc:492] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:12.130363 32484 raft_consensus.cc:493] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.152328 32178 tablet_bootstrap.cc:492] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:12.153059 32178 ts_tablet_manager.cc:1403] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.104s	user 0.009s	sys 0.034s
I20260709 13:12:12.154767 32455 raft_consensus.cc:493] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.163000 32455 raft_consensus.cc:515] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.132563 32484 raft_consensus.cc:515] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.165632 32455 leader_election.cc:290] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:12.166662 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78093d7ec8724a248daf1d4269de3190" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:12.167503 32484 leader_election.cc:290] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:12.168109 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78093d7ec8724a248daf1d4269de3190" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:12.170404 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540d3a54268745adb1ed6108ca819925" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:12.172143 32098 leader_election.cc:343] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:12.172855 32098 leader_election.cc:343] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.178330 32098 leader_election.cc:304] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:12.185921 32181 tablet_bootstrap.cc:492] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:12.186486 32181 ts_tablet_manager.cc:1403] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.151s	user 0.019s	sys 0.026s
I20260709 13:12:12.190070 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540d3a54268745adb1ed6108ca819925" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:12.160166 32471 raft_consensus.cc:515] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:12.190673 32345 raft_consensus.cc:2749] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.218780 32178 raft_consensus.cc:359] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.223546 32178 raft_consensus.cc:385] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.224876 32178 raft_consensus.cc:740] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.226509 32178 consensus_queue.cc:260] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.236258 32509 raft_consensus.cc:2749] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.221478 32471 leader_election.cc:290] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:12.239271 31982 raft_consensus.cc:3060] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.239413 32181 raft_consensus.cc:359] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.233754 31808 catalog_manager.cc:5697] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:12.240352 32181 raft_consensus.cc:385] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.240774 32181 raft_consensus.cc:740] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.243690 32181 consensus_queue.cc:260] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.245190 32178 ts_tablet_manager.cc:1434] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.001s
I20260709 13:12:12.245757 32180 tablet_bootstrap.cc:654] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.239774 31984 raft_consensus.cc:3060] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.251910 32471 raft_consensus.cc:493] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.266176 32471 raft_consensus.cc:515] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.267815 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63944c6b0e9a466dba494a0bcdefe7de" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:12.268411 32471 leader_election.cc:290] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:12.268548 32130 raft_consensus.cc:3060] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.273000 32534 consensus_queue.cc:1048] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:12.259964 32181 ts_tablet_manager.cc:1434] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.003s
I20260709 13:12:12.280993 32510 raft_consensus.cc:493] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.283068 31983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63944c6b0e9a466dba494a0bcdefe7de" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:12.282550 31950 leader_election.cc:304] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:12.306650 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:12.285983 32534 consensus_queue.cc:1048] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:12.313760 31983 raft_consensus.cc:3060] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:12.319523 32023 leader_election.cc:343] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.331983 32181 tablet_bootstrap.cc:492] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:12.341706 32178 tablet_bootstrap.cc:492] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:12.341638 32462 raft_consensus.cc:493] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.354941 32583 consensus_queue.cc:1048] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:12.357815 32130 raft_consensus.cc:2468] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:12.361266 32462 raft_consensus.cc:515] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:12.333745 32510 raft_consensus.cc:515] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.364641 32534 raft_consensus.cc:493] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.367606 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:12.386616 32024 leader_election.cc:343] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.387204 32024 leader_election.cc:304] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:12.380602 32534 raft_consensus.cc:515] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:12.451047 32024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 64475.7us
W20260709 13:12:12.463999 31855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:12.465598 32180 tablet_bootstrap.cc:492] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:12.466288 32180 ts_tablet_manager.cc:1403] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.379s	user 0.026s	sys 0.021s
I20260709 13:12:12.445673 32579 raft_consensus.cc:2749] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.443183 31983 raft_consensus.cc:2468] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:12.473443 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78093d7ec8724a248daf1d4269de3190" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:12.474521 32131 raft_consensus.cc:2468] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 0.
I20260709 13:12:12.477730 32181 tablet_bootstrap.cc:654] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:12.480564 32023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 75527.5us
I20260709 13:12:12.478164 32024 leader_election.cc:304] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:12.483568 31910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7e6bd5627e4a1cb9053e79dd3e2332" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:12.485252 32024 leader_election.cc:343] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.486188 32471 raft_consensus.cc:2804] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.486799 32471 raft_consensus.cc:697] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:12.495013 32178 tablet_bootstrap.cc:654] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.500156 32455 raft_consensus.cc:493] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.500828 32455 raft_consensus.cc:515] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.504487 31874 leader_election.cc:304] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:12.506597 32441 raft_consensus.cc:2804] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.507071 32441 raft_consensus.cc:493] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.507496 32441 raft_consensus.cc:3060] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.519423 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209aeaad860746c39ef57d290c03b5fe" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
W20260709 13:12:12.539949 31951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 82941us
I20260709 13:12:12.520468 32056 raft_consensus.cc:2468] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:12.548168 32099 leader_election.cc:304] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:12.478302 32534 leader_election.cc:290] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:12.503575 32455 leader_election.cc:290] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
W20260709 13:12:12.570449 31876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 70260.9us
I20260709 13:12:12.553998 32528 raft_consensus.cc:2804] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:12.581207 31950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 110661us
I20260709 13:12:12.562119 32462 leader_election.cc:290] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:12.545136 32471 consensus_queue.cc:237] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:12.597018 31983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7e6bd5627e4a1cb9053e79dd3e2332" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:12.597919 32510 leader_election.cc:290] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:12.577411 32528 raft_consensus.cc:493] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:12.604066 32024 leader_election.cc:343] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.604748 32024 leader_election.cc:304] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:12.580403 31985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78093d7ec8724a248daf1d4269de3190" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:12.614017 32293 raft_consensus.cc:2749] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.635751 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209aeaad860746c39ef57d290c03b5fe" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:12.638288 32181 tablet_bootstrap.cc:492] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:12.639645 32181 ts_tablet_manager.cc:1403] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.357s	user 0.017s	sys 0.013s
I20260709 13:12:12.624729 32591 raft_consensus.cc:2749] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.648250 32178 tablet_bootstrap.cc:492] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:12.649178 32178 ts_tablet_manager.cc:1403] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.309s	user 0.010s	sys 0.014s
I20260709 13:12:12.650065 32180 raft_consensus.cc:359] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.653556 32180 raft_consensus.cc:385] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.653991 32180 raft_consensus.cc:740] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.655336 32180 consensus_queue.cc:260] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.606832 32528 raft_consensus.cc:3060] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:12.658172 32098 leader_election.cc:343] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.687837 32180 ts_tablet_manager.cc:1434] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.221s	user 0.010s	sys 0.000s
I20260709 13:12:12.702766 32178 raft_consensus.cc:359] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:12.703567 32178 raft_consensus.cc:385] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.703892 32178 raft_consensus.cc:740] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.704599 32178 consensus_queue.cc:260] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
W20260709 13:12:12.696821 31950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 112660us
I20260709 13:12:12.719508 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eecdc9a6c45481b8148098fe8e47232" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:12.724583 32180 tablet_bootstrap.cc:492] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:12.724869 32181 raft_consensus.cc:359] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.727639 32181 raft_consensus.cc:385] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.728017 32181 raft_consensus.cc:740] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.728889 32178 ts_tablet_manager.cc:1434] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 13:12:12.731060 32178 tablet_bootstrap.cc:492] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
W20260709 13:12:12.732669 32590 log.cc:927] Time spent T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:12:12.699774 32441 raft_consensus.cc:515] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.748137 32441 leader_election.cc:290] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:12.759411 32178 tablet_bootstrap.cc:654] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.761483 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78093d7ec8724a248daf1d4269de3190" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:12.762439 31984 raft_consensus.cc:3060] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.803629 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eecdc9a6c45481b8148098fe8e47232" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:12.806980 32181 consensus_queue.cc:260] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.815613 32180 tablet_bootstrap.cc:654] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.817471 32528 raft_consensus.cc:515] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.829558 32181 ts_tablet_manager.cc:1434] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.189s	user 0.010s	sys 0.000s
I20260709 13:12:12.838200 32178 tablet_bootstrap.cc:492] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:12.838755 32178 ts_tablet_manager.cc:1403] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.007s
I20260709 13:12:12.843452 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78093d7ec8724a248daf1d4269de3190" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:12.844197 32132 raft_consensus.cc:3060] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.848516 32181 tablet_bootstrap.cc:492] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:12.863212 32132 raft_consensus.cc:2468] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
W20260709 13:12:12.867233 32098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:45831, user_credentials={real_user=slave}} blocked reactor thread for 78818.4us
I20260709 13:12:12.869167 32586 consensus_queue.cc:1048] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:12.892210 31874 leader_election.cc:304] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:12.878826 32454 consensus_queue.cc:1048] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:12:12.896129 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209aeaad860746c39ef57d290c03b5fe" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:12.896833 32057 raft_consensus.cc:3060] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.899261 32586 raft_consensus.cc:2804] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.900367 32586 raft_consensus.cc:697] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:12.901250 32586 consensus_queue.cc:237] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.900367 32610 consensus_queue.cc:1048] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:12.875154 31950 leader_election.cc:304] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:12.907086 32181 tablet_bootstrap.cc:654] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.907542 32509 raft_consensus.cc:2749] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:12.907606 32057 raft_consensus.cc:2468] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:12.912412 32099 leader_election.cc:304] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:12.920739 31806 catalog_manager.cc:5697] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 1 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:12.926162 32528 leader_election.cc:290] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:12.933703 31984 raft_consensus.cc:2468] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 1.
I20260709 13:12:12.947475 32178 raft_consensus.cc:359] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.952158 32178 raft_consensus.cc:385] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.953249 32178 raft_consensus.cc:740] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.957680 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209aeaad860746c39ef57d290c03b5fe" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:12.958735 31907 raft_consensus.cc:3060] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.955928 32178 consensus_queue.cc:260] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:12.968192 32471 raft_consensus.cc:493] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.969015 32471 raft_consensus.cc:515] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:12.971251 32606 raft_consensus.cc:2804] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.971920 32606 raft_consensus.cc:697] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:12.973160 32471 leader_election.cc:290] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:12.975435 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:12.976436 32129 raft_consensus.cc:2468] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:12.978359 32023 leader_election.cc:304] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:12.979853 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:12.973162 32606 consensus_queue.cc:237] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:12.981976 32462 raft_consensus.cc:2804] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:12.983996 32024 leader_election.cc:343] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.984328 32462 raft_consensus.cc:493] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.984750 32462 raft_consensus.cc:3060] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.004626 32181 tablet_bootstrap.cc:492] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:13.005189 32181 ts_tablet_manager.cc:1403] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.016s
I20260709 13:12:13.013092 32180 tablet_bootstrap.cc:492] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:13.013635 32180 ts_tablet_manager.cc:1403] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.296s	user 0.017s	sys 0.004s
I20260709 13:12:13.002468 32580 raft_consensus.cc:493] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.017163 32178 ts_tablet_manager.cc:1434] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.178s	user 0.007s	sys 0.003s
I20260709 13:12:13.021368 31907 raft_consensus.cc:2468] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:13.021626 32180 raft_consensus.cc:359] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.022560 32180 raft_consensus.cc:385] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.022879 32180 raft_consensus.cc:740] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.023505 32180 consensus_queue.cc:260] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.021607 32580 raft_consensus.cc:515] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.025303 32180 ts_tablet_manager.cc:1434] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:13.026490 32180 tablet_bootstrap.cc:492] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:13.026600 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7bb527b8174d1792395c79a82a224c" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:13.027297 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7bb527b8174d1792395c79a82a224c" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:13.026397 32580 leader_election.cc:290] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:13.029716 32528 raft_consensus.cc:493] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:13.030460 32024 leader_election.cc:343] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.030361 32528 raft_consensus.cc:515] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:13.031123 32024 leader_election.cc:343] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.031553 32024 leader_election.cc:304] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:13.032852 32580 raft_consensus.cc:2749] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:13.032958 32528 leader_election.cc:290] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:13.034029 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4253f6805a1465ca31a5979bb0632e6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:13.035522 32098 leader_election.cc:343] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.037838 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4253f6805a1465ca31a5979bb0632e6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:13.040241 32098 leader_election.cc:343] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.043365 32098 leader_election.cc:304] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:13.044068 32528 raft_consensus.cc:2749] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:13.041747 32178 tablet_bootstrap.cc:492] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:13.052363 32180 tablet_bootstrap.cc:654] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.056612 32580 consensus_queue.cc:1048] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:13.062880 32580 consensus_queue.cc:1048] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:13.034538 32462 raft_consensus.cc:515] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.095124 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:13.096143 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:13.099584 32181 raft_consensus.cc:359] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.100575 32181 raft_consensus.cc:385] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.100872 32181 raft_consensus.cc:740] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.098933 31807 catalog_manager.cc:5697] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.107863 32129 raft_consensus.cc:3060] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.089177 32462 leader_election.cc:290] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:13.105577 32181 consensus_queue.cc:260] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.121141 32178 tablet_bootstrap.cc:654] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:13.129443 32024 leader_election.cc:343] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.157220 32181 ts_tablet_manager.cc:1434] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.152s	user 0.008s	sys 0.000s
I20260709 13:12:13.161147 32509 raft_consensus.cc:493] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.166316 32509 raft_consensus.cc:515] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.168612 32509 leader_election.cc:290] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:13.175585 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7e6bd5627e4a1cb9053e79dd3e2332" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:13.169517 32129 raft_consensus.cc:2468] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:13.176276 32058 raft_consensus.cc:2468] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:13.174695 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7e6bd5627e4a1cb9053e79dd3e2332" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:13.177310 31906 raft_consensus.cc:2468] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:13.178699 31950 leader_election.cc:304] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:13.179836 32509 raft_consensus.cc:2804] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:13.180102 32023 leader_election.cc:304] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: ab61be703111416d9fba543ea97b2224
I20260709 13:12:13.181604 32580 raft_consensus.cc:2804] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:13.182093 32580 raft_consensus.cc:697] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:13.182976 32580 consensus_queue.cc:237] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.188670 32471 raft_consensus.cc:493] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.189273 32471 raft_consensus.cc:515] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:13.191562 32471 leader_election.cc:290] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:13.195638 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:13.197271 32024 leader_election.cc:343] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.180410 32509 raft_consensus.cc:493] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.205974 32509 raft_consensus.cc:3060] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.212383 32181 tablet_bootstrap.cc:492] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:13.222118 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:13.229624 32180 tablet_bootstrap.cc:492] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:13.230190 32180 ts_tablet_manager.cc:1403] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.204s	user 0.038s	sys 0.023s
W20260709 13:12:13.232241 32023 leader_election.cc:343] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eacc546e751240eb804795d98213a57c (127.21.244.4:43793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.232790 32023 leader_election.cc:304] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:13.234310 32509 raft_consensus.cc:515] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.234944 32181 tablet_bootstrap.cc:654] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.234498 32180 raft_consensus.cc:359] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.235401 32180 raft_consensus.cc:385] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.235765 32180 raft_consensus.cc:740] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.236517 32180 consensus_queue.cc:260] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.237370 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7e6bd5627e4a1cb9053e79dd3e2332" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:13.238083 31907 raft_consensus.cc:3060] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.239509 32180 ts_tablet_manager.cc:1434] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:13.239902 32580 raft_consensus.cc:2749] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:13.240756 32180 tablet_bootstrap.cc:492] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:13.251573 31907 raft_consensus.cc:2468] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:13.256177 32180 tablet_bootstrap.cc:654] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.252992 31805 catalog_manager.cc:5697] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.258149 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7e6bd5627e4a1cb9053e79dd3e2332" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:13.258793 32057 raft_consensus.cc:3060] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.260627 31950 leader_election.cc:304] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:13.261468 32576 raft_consensus.cc:2804] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:13.261941 32576 raft_consensus.cc:697] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:13.262696 32576 consensus_queue.cc:237] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.269289 32057 raft_consensus.cc:2468] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:13.270558 32178 tablet_bootstrap.cc:492] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:13.271085 32178 ts_tablet_manager.cc:1403] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.230s	user 0.019s	sys 0.004s
I20260709 13:12:13.274653 32178 raft_consensus.cc:359] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.275353 32178 raft_consensus.cc:385] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.276371 32509 leader_election.cc:290] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:13.275663 32178 raft_consensus.cc:740] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.278220 32178 consensus_queue.cc:260] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.282733 31807 catalog_manager.cc:5697] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 1 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.286773 32178 ts_tablet_manager.cc:1434] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:12:13.287977 32178 tablet_bootstrap.cc:492] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:13.297150 32180 tablet_bootstrap.cc:492] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:13.300804 32180 ts_tablet_manager.cc:1403] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.060s	user 0.023s	sys 0.002s
I20260709 13:12:13.305090 32180 raft_consensus.cc:359] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.305837 32180 raft_consensus.cc:385] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.306130 32180 raft_consensus.cc:740] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.299511 32181 tablet_bootstrap.cc:492] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:13.300249 32178 tablet_bootstrap.cc:654] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.307288 32181 ts_tablet_manager.cc:1403] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.003s
I20260709 13:12:13.309921 32181 raft_consensus.cc:359] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.310485 32181 raft_consensus.cc:385] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.310667 32181 raft_consensus.cc:740] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.311167 32181 consensus_queue.cc:260] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.313114 32181 ts_tablet_manager.cc:1434] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:13.306852 32180 consensus_queue.cc:260] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.319015 32180 ts_tablet_manager.cc:1434] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:12:13.318490 31808 catalog_manager.cc:5697] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.320920 32180 tablet_bootstrap.cc:492] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:13.328292 32484 raft_consensus.cc:493] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.328697 32178 tablet_bootstrap.cc:492] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:13.329241 32178 ts_tablet_manager.cc:1403] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.001s
I20260709 13:12:13.328832 32484 raft_consensus.cc:515] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.331076 32484 leader_election.cc:290] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:13.334422 32180 tablet_bootstrap.cc:654] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.337368 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7bb527b8174d1792395c79a82a224c" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:13.338099 31906 raft_consensus.cc:2468] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:13.338263 32181 tablet_bootstrap.cc:492] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:13.339352 31950 leader_election.cc:304] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:13.340144 32484 raft_consensus.cc:2804] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:13.340654 32484 raft_consensus.cc:493] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.341058 32484 raft_consensus.cc:3060] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.342831 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7bb527b8174d1792395c79a82a224c" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:13.343770 32058 raft_consensus.cc:2468] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:13.349185 32484 raft_consensus.cc:515] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.352208 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7bb527b8174d1792395c79a82a224c" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:13.352818 31906 raft_consensus.cc:3060] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.353216 32178 raft_consensus.cc:359] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:13.353946 32178 raft_consensus.cc:385] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.354316 32178 raft_consensus.cc:740] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.354985 32178 consensus_queue.cc:260] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:13.357775 32178 ts_tablet_manager.cc:1434] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:12:13.365970 31906 raft_consensus.cc:2468] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:13.370385 32178 tablet_bootstrap.cc:492] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:13.370599 31950 leader_election.cc:304] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:13.369362 32484 leader_election.cc:290] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:13.371342 32576 raft_consensus.cc:2804] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:13.372141 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7bb527b8174d1792395c79a82a224c" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:13.373000 32058 raft_consensus.cc:3060] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:13.425134 32098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:45831, user_credentials={real_user=slave}} blocked reactor thread for 48454.6us
I20260709 13:12:13.442591 32597 consensus_queue.cc:1048] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:13.452908 32180 tablet_bootstrap.cc:492] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:13.453474 32180 ts_tablet_manager.cc:1403] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.133s	user 0.022s	sys 0.027s
I20260709 13:12:13.454294 32586 consensus_queue.cc:1048] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:13.458297 32576 raft_consensus.cc:697] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:13.459367 32180 raft_consensus.cc:359] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:13.460294 32180 raft_consensus.cc:385] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.461946 32180 raft_consensus.cc:740] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.462790 32180 consensus_queue.cc:260] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:13.464985 32180 ts_tablet_manager.cc:1434] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:13.466035 32180 tablet_bootstrap.cc:492] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:13.459453 32576 consensus_queue.cc:237] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:13.461889 32178 tablet_bootstrap.cc:654] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.475252 32612 raft_consensus.cc:493] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.475916 32612 raft_consensus.cc:515] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:13.478737 32612 leader_election.cc:290] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:13.479673 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:13.480434 32180 tablet_bootstrap.cc:654] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.480472 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
W20260709 13:12:13.481038 32098 leader_election.cc:343] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.481434 32057 raft_consensus.cc:2468] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:13.486835 32099 leader_election.cc:304] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:13.491463 32612 raft_consensus.cc:2804] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:13.491995 32612 raft_consensus.cc:493] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.492419 32612 raft_consensus.cc:3060] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.493014 32180 tablet_bootstrap.cc:492] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:13.496194 32178 tablet_bootstrap.cc:492] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:13.496825 32178 ts_tablet_manager.cc:1403] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.138s	user 0.010s	sys 0.004s
I20260709 13:12:13.497359 32607 raft_consensus.cc:493] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.498004 32607 raft_consensus.cc:515] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.500612 32607 leader_election.cc:290] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:13.501391 32180 ts_tablet_manager.cc:1403] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.000s
I20260709 13:12:13.500321 32178 raft_consensus.cc:359] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:13.503196 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c4dd4a38fc647e3a2ad4a953c649261" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:13.504300 32178 raft_consensus.cc:385] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.504793 32178 raft_consensus.cc:740] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.505530 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c4dd4a38fc647e3a2ad4a953c649261" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:13.506402 32057 raft_consensus.cc:2468] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:13.505848 32178 consensus_queue.cc:260] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:13.508229 32099 leader_election.cc:304] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
W20260709 13:12:13.509085 32098 leader_election.cc:343] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.456440 32058 raft_consensus.cc:2468] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:13.509585 32454 raft_consensus.cc:2804] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:13.514386 32454 raft_consensus.cc:493] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.514950 32454 raft_consensus.cc:3060] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.530292 32454 raft_consensus.cc:515] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.512897 32180 raft_consensus.cc:359] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.540138 32180 raft_consensus.cc:385] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.540774 32180 raft_consensus.cc:740] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.541970 32180 consensus_queue.cc:260] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.545367 32180 ts_tablet_manager.cc:1434] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:12:13.511209 32178 ts_tablet_manager.cc:1434] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:12:13.551597 32178 tablet_bootstrap.cc:492] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c: Bootstrap starting.
I20260709 13:12:13.530947 32606 consensus_queue.cc:1048] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:13.564715 32180 tablet_bootstrap.cc:492] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:13.548300 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c4dd4a38fc647e3a2ad4a953c649261" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:13.566135 31979 raft_consensus.cc:3060] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.549705 32454 leader_election.cc:290] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:13.536619 32181 tablet_bootstrap.cc:654] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.584298 32178 tablet_bootstrap.cc:654] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.584677 31979 raft_consensus.cc:2468] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:13.588204 32180 tablet_bootstrap.cc:654] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.589706 32098 leader_election.cc:304] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:13.593958 32230 raft_consensus.cc:493] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:13.598671 31855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:13.594686 32230 raft_consensus.cc:515] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.600191 32607 raft_consensus.cc:2804] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:13.652334 32230 leader_election.cc:290] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
W20260709 13:12:13.651906 31951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 46629.8us
I20260709 13:12:13.639504 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c4dd4a38fc647e3a2ad4a953c649261" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:13.659231 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:13.661660 32059 raft_consensus.cc:3060] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.685093 32612 raft_consensus.cc:515] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:13.675524 32455 consensus_queue.cc:1048] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:12:13.694778 32178 tablet_bootstrap.cc:492] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c: No bootstrap required, opened a new log
I20260709 13:12:13.695479 32178 ts_tablet_manager.cc:1403] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.027s
I20260709 13:12:13.667661 32607 raft_consensus.cc:697] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:13.691191 32610 raft_consensus.cc:493] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.707993 32610 raft_consensus.cc:515] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:13.680634 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:13.719910 31983 raft_consensus.cc:3060] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.721515 32130 raft_consensus.cc:2393] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab61be703111416d9fba543ea97b2224 in current term 1: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
I20260709 13:12:13.724298 31949 leader_election.cc:304] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:13.726047 32612 leader_election.cc:290] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:13.730002 32178 raft_consensus.cc:359] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:13.731096 32178 raft_consensus.cc:385] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.731454 32178 raft_consensus.cc:740] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.727949 32610 leader_election.cc:290] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:13.738785 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15722eb44a144050b7a810716b0fb150" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:13.739711 32484 raft_consensus.cc:2749] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:13.758882 32607 consensus_queue.cc:237] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:13.763593 32462 consensus_queue.cc:1048] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:13.745791 32178 consensus_queue.cc:260] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:13.753933 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:13.756868 32059 raft_consensus.cc:2468] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:13.770241 32058 raft_consensus.cc:3060] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.772584 32589 consensus_queue.cc:1048] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:13.742432 32181 tablet_bootstrap.cc:492] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:13.774426 32181 ts_tablet_manager.cc:1403] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.436s	user 0.011s	sys 0.021s
I20260709 13:12:13.776824 32178 ts_tablet_manager.cc:1434] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:12:13.777235 32181 raft_consensus.cc:359] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:13.777940 32181 raft_consensus.cc:385] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.778218 32181 raft_consensus.cc:740] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.763674 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:13.783128 32058 raft_consensus.cc:2468] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:13.784655 32180 tablet_bootstrap.cc:492] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:13.785219 32180 ts_tablet_manager.cc:1403] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.221s	user 0.021s	sys 0.002s
I20260709 13:12:13.785948 32181 consensus_queue.cc:260] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:13.791561 32099 leader_election.cc:304] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:13.801781 31805 catalog_manager.cc:5697] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.751996 32576 raft_consensus.cc:493] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:13.787308 32098 leader_election.cc:343] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.814592 32647 consensus_queue.cc:1048] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:13.810094 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15722eb44a144050b7a810716b0fb150" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:13.797201 32455 raft_consensus.cc:2804] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:13.845561 32181 ts_tablet_manager.cc:1434] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.002s
I20260709 13:12:13.847000 32181 tablet_bootstrap.cc:492] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:13.831568 32455 raft_consensus.cc:697] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:13.852696 32455 consensus_queue.cc:237] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:13.854256 32180 raft_consensus.cc:359] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:13.855063 32180 raft_consensus.cc:385] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.816906 32576 raft_consensus.cc:515] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:13.855334 32180 raft_consensus.cc:740] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.865965 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4253f6805a1465ca31a5979bb0632e6" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:13.869549 32180 consensus_queue.cc:260] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:13.871546 32129 raft_consensus.cc:2468] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:13.859110 32576 leader_election.cc:290] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:13.887159 32647 consensus_queue.cc:1048] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:13.882464 31949 leader_election.cc:304] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:13.892639 32181 tablet_bootstrap.cc:654] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:13.896112 32098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 82933.1us
I20260709 13:12:13.914170 32180 ts_tablet_manager.cc:1434] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.129s	user 0.007s	sys 0.002s
I20260709 13:12:13.915613 32180 tablet_bootstrap.cc:492] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224: Bootstrap starting.
I20260709 13:12:13.922217 32180 tablet_bootstrap.cc:654] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.899222 32644 raft_consensus.cc:2804] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:13.926240 32098 leader_election.cc:343] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:13.934865 32098 leader_election.cc:343] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:13.935346 32098 leader_election.cc:304] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:13.932803 32644 raft_consensus.cc:493] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.940110 32610 raft_consensus.cc:2749] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:13.951545 32644 raft_consensus.cc:3060] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:13.965499 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4253f6805a1465ca31a5979bb0632e6" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:13.975869 31907 raft_consensus.cc:2468] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:13.984781 32610 raft_consensus.cc:493] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.985386 32610 raft_consensus.cc:515] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:13.992319 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:13.981297 31806 catalog_manager.cc:5697] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.992924 32057 raft_consensus.cc:2468] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 0.
I20260709 13:12:13.998679 32099 leader_election.cc:304] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:14.008709 32180 tablet_bootstrap.cc:492] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224: No bootstrap required, opened a new log
I20260709 13:12:14.009503 32180 ts_tablet_manager.cc:1403] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.008s
I20260709 13:12:14.004926 32606 raft_consensus.cc:2804] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.040933 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:14.045310 32098 leader_election.cc:343] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.015586 32606 raft_consensus.cc:493] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.050979 32606 raft_consensus.cc:3060] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.060153 32180 raft_consensus.cc:359] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:14.062958 32180 raft_consensus.cc:385] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.063323 32180 raft_consensus.cc:740] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.064684 32610 leader_election.cc:290] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:14.083160 32644 raft_consensus.cc:515] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:14.086071 32644 leader_election.cc:290] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:14.064240 32180 consensus_queue.cc:260] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:14.088645 32180 ts_tablet_manager.cc:1434] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224: Time spent starting tablet: real 0.078s	user 0.002s	sys 0.006s
I20260709 13:12:14.097496 32664 raft_consensus.cc:493] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.098366 32664 raft_consensus.cc:515] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:14.101038 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4253f6805a1465ca31a5979bb0632e6" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:14.102123 32133 raft_consensus.cc:3060] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.109767 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d9f17e553345b4b6a7c1aad8e8c058" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:14.111536 32024 leader_election.cc:343] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.113112 32664 leader_election.cc:290] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:14.124073 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d9f17e553345b4b6a7c1aad8e8c058" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:14.125044 31980 raft_consensus.cc:2468] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 0.
I20260709 13:12:14.133272 32230 consensus_queue.cc:1048] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.140882 32024 leader_election.cc:304] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:14.142946 32664 raft_consensus.cc:2804] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.143571 32664 raft_consensus.cc:493] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.144356 32664 raft_consensus.cc:3060] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.154145 32133 raft_consensus.cc:2468] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:14.158910 31949 leader_election.cc:304] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:14.160140 32647 raft_consensus.cc:2804] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.161119 32647 raft_consensus.cc:697] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:14.162220 32647 consensus_queue.cc:237] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:14.226598 31950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 292708us
I20260709 13:12:14.249707 32181 tablet_bootstrap.cc:492] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:14.250313 32181 ts_tablet_manager.cc:1403] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.404s	user 0.014s	sys 0.016s
I20260709 13:12:14.253566 32181 raft_consensus.cc:359] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:14.254545 32181 raft_consensus.cc:385] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.254958 32181 raft_consensus.cc:740] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
W20260709 13:12:14.255481 31949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 96656.7us
I20260709 13:12:14.255892 32181 consensus_queue.cc:260] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:14.154224 32606 raft_consensus.cc:515] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:14.260018 32181 ts_tablet_manager.cc:1434] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:14.261217 32181 tablet_bootstrap.cc:492] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:14.268692 32606 leader_election.cc:290] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:14.269129 31906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
W20260709 13:12:14.270581 32098 leader_election.cc:343] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.276062 32664 raft_consensus.cc:515] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:14.283236 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:14.283926 32057 raft_consensus.cc:3060] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.288390 32657 raft_consensus.cc:493] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.288980 32657 raft_consensus.cc:515] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:14.291023 32657 leader_election.cc:290] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:14.292150 31807 catalog_manager.cc:5697] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.298658 32664 leader_election.cc:290] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:14.307823 32181 tablet_bootstrap.cc:654] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.310215 31908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4253f6805a1465ca31a5979bb0632e6" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:14.310936 31908 raft_consensus.cc:3060] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.317186 32057 raft_consensus.cc:2468] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:14.326207 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d9f17e553345b4b6a7c1aad8e8c058" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:14.329250 32657 consensus_queue.cc:1048] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.330968 31907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15722eb44a144050b7a810716b0fb150" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
W20260709 13:12:14.332631 31949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 49724.2us
W20260709 13:12:14.335041 31950 leader_election.cc:343] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.332718 31908 raft_consensus.cc:2468] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:14.344074 32133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15722eb44a144050b7a810716b0fb150" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:14.344846 32133 raft_consensus.cc:2468] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 0.
I20260709 13:12:14.349591 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d9f17e553345b4b6a7c1aad8e8c058" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:14.350332 31981 raft_consensus.cc:3060] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.352722 32099 leader_election.cc:304] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:14.356632 32606 raft_consensus.cc:2804] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.357379 32606 raft_consensus.cc:697] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:14.367015 32606 consensus_queue.cc:237] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:14.373044 32181 tablet_bootstrap.cc:492] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:14.373639 31981 raft_consensus.cc:2468] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:14.375911 32181 ts_tablet_manager.cc:1403] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.015s
W20260709 13:12:14.377852 32024 leader_election.cc:343] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.379530 32645 consensus_queue.cc:1048] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.380086 32454 consensus_queue.cc:1048] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.376313 31949 leader_election.cc:304] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:14.381615 32644 raft_consensus.cc:2804] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.382045 32644 raft_consensus.cc:493] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.381834 32181 raft_consensus.cc:359] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:14.382452 32644 raft_consensus.cc:3060] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.382623 32181 raft_consensus.cc:385] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.383018 32181 raft_consensus.cc:740] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.385424 32181 consensus_queue.cc:260] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:14.386862 32024 leader_election.cc:304] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:14.393829 32181 ts_tablet_manager.cc:1434] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:12:14.395358 32181 tablet_bootstrap.cc:492] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:14.391235 32664 raft_consensus.cc:2804] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.398164 32664 raft_consensus.cc:697] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:14.399123 32664 consensus_queue.cc:237] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:14.400705 32610 consensus_queue.cc:1048] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.419247 32181 tablet_bootstrap.cc:654] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.435098 31908 raft_consensus.cc:3060] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.443655 32644 raft_consensus.cc:515] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:14.465718 32132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15722eb44a144050b7a810716b0fb150" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:14.466358 32132 raft_consensus.cc:3060] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.467340 31807 catalog_manager.cc:5697] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.473207 32606 consensus_queue.cc:1048] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:14.471490 32644 leader_election.cc:290] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:14.518306 31909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15722eb44a144050b7a810716b0fb150" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
W20260709 13:12:14.526463 31950 leader_election.cc:343] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.543491 32181 tablet_bootstrap.cc:492] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:14.544139 32181 ts_tablet_manager.cc:1403] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.149s	user 0.010s	sys 0.003s
I20260709 13:12:14.547345 32181 raft_consensus.cc:359] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:14.548117 32181 raft_consensus.cc:385] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.548400 32181 raft_consensus.cc:740] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.549082 32181 consensus_queue.cc:260] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:14.615787 31950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 56980us
I20260709 13:12:14.623267 31806 catalog_manager.cc:5697] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 0 to 1, leader changed from <none> to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 1 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.629887 32132 raft_consensus.cc:2468] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
W20260709 13:12:14.635972 31875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:45831, user_credentials={real_user=slave}} blocked reactor thread for 85976.8us
I20260709 13:12:14.641103 31949 leader_election.cc:304] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:14.642786 32181 ts_tablet_manager.cc:1434] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.011s
I20260709 13:12:14.644892 32230 raft_consensus.cc:2804] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.647173 32230 raft_consensus.cc:697] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:14.648207 32230 consensus_queue.cc:237] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:14.669363 32181 tablet_bootstrap.cc:492] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
W20260709 13:12:14.675925 31876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 88760.2us
W20260709 13:12:14.700330 31874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 55455.2us
I20260709 13:12:14.704336 32609 raft_consensus.cc:493] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.704859 32609 raft_consensus.cc:515] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:14.706897 32609 leader_election.cc:290] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:14.707387 32609 raft_consensus.cc:493] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.714210 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d9f17e553345b4b6a7c1aad8e8c058" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:14.717422 32609 raft_consensus.cc:515] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:14.719010 32644 consensus_queue.cc:1048] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.719717 32609 leader_election.cc:290] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
W20260709 13:12:14.726603 31855 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:14.733356 32657 consensus_queue.cc:1048] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.738125 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:14.741364 32055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:14.749078 32687 raft_consensus.cc:493] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.756131 32687 raft_consensus.cc:515] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:14.773921 31876 leader_election.cc:304] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:14.821391 32597 raft_consensus.cc:2749] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:14.823110 32687 leader_election.cc:290] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:14.828826 32055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:14.829855 32055 raft_consensus.cc:2393] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate eacc546e751240eb804795d98213a57c in this term.
I20260709 13:12:14.828866 32181 tablet_bootstrap.cc:654] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.833458 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:14.844020 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d9f17e553345b4b6a7c1aad8e8c058" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:14.845055 31980 raft_consensus.cc:2393] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 1: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
I20260709 13:12:14.850554 31874 leader_election.cc:304] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:14.858589 32649 raft_consensus.cc:3060] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.894344 31909 raft_consensus.cc:3060] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:14.902869 32691 log.cc:927] Time spent T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:12:14.923892 32454 consensus_queue.cc:1048] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.929822 32649 raft_consensus.cc:2749] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.918422 31804 catalog_manager.cc:5697] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 1 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.954216 31807 catalog_manager.cc:5697] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:14.988158 31875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:45831, user_credentials={real_user=slave}} blocked reactor thread for 58426.7us
I20260709 13:12:14.993083 32684 consensus_queue.cc:1048] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:15.003454 32181 tablet_bootstrap.cc:492] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325: No bootstrap required, opened a new log
I20260709 13:12:15.022434 32181 ts_tablet_manager.cc:1403] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.358s	user 0.013s	sys 0.006s
I20260709 13:12:15.029296 32181 raft_consensus.cc:359] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:15.048038 32580 consensus_queue.cc:1048] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:15.052462 32181 raft_consensus.cc:385] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:15.052994 32181 raft_consensus.cc:740] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.053882 32181 consensus_queue.cc:260] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:15.070048 32181 ts_tablet_manager.cc:1434] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
W20260709 13:12:15.223721 32024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 108883us
I20260709 13:12:15.496958 31875 leader_election.cc:304] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224
I20260709 13:12:15.497762 32699 raft_consensus.cc:2749] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:15.525691 31905 raft_consensus.cc:3060] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:15.573983 32657 consensus_queue.cc:1048] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.659603 32454 consensus_queue.cc:1048] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:15.718742 22480 tablet_server.cc:179] TabletServer@127.21.244.1:0 shutting down...
W20260709 13:12:15.755271 31950 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:15.772029 32672 consensus_queue.cc:1048] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:15.807572 31950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 52342.1us
W20260709 13:12:15.813153 31950 consensus_peers.cc:597] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:15.818578 31950 consensus_peers.cc:597] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:15.831013 32098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 49904.4us
W20260709 13:12:15.834489 32098 consensus_peers.cc:597] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:15.838054 32098 consensus_peers.cc:597] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:15.838711 32098 consensus_peers.cc:597] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:15.872618 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:15.874220 22480 tablet_replica.cc:333] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.875365 22480 raft_consensus.cc:2243] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.876078 22480 raft_consensus.cc:2272] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:15.878968 32024 consensus_peers.cc:597] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:15.880843 22480 tablet_replica.cc:333] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.881910 22480 raft_consensus.cc:2243] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.883021 22480 raft_consensus.cc:2272] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:15.884402 32098 consensus_peers.cc:597] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:15.885648 22480 tablet_replica.cc:333] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.886744 22480 raft_consensus.cc:2243] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.887328 22480 raft_consensus.cc:2272] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.890136 22480 tablet_replica.cc:333] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.890908 22480 raft_consensus.cc:2243] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.891813 22480 raft_consensus.cc:2272] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.894495 22480 tablet_replica.cc:333] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.895421 22480 raft_consensus.cc:2243] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.895958 22480 raft_consensus.cc:2272] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.897954 22480 tablet_replica.cc:333] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.898698 22480 raft_consensus.cc:2243] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.899573 22480 raft_consensus.cc:2272] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.901432 22480 tablet_replica.cc:333] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.902139 22480 raft_consensus.cc:2243] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.902576 22480 raft_consensus.cc:2272] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.904574 22480 tablet_replica.cc:333] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.905197 22480 raft_consensus.cc:2243] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.905627 22480 raft_consensus.cc:2272] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.907529 22480 tablet_replica.cc:333] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.908223 22480 raft_consensus.cc:2243] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.908658 22480 raft_consensus.cc:2272] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.911185 22480 tablet_replica.cc:333] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.911943 22480 raft_consensus.cc:2243] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.912489 22480 raft_consensus.cc:2272] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.914855 22480 tablet_replica.cc:333] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.915512 22480 raft_consensus.cc:2243] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.916020 22480 raft_consensus.cc:2272] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:15.918287 31950 consensus_peers.cc:597] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:15.918985 22480 tablet_replica.cc:333] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.919942 22480 raft_consensus.cc:2243] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.920460 22480 raft_consensus.cc:2272] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.923235 22480 tablet_replica.cc:333] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.924278 22480 raft_consensus.cc:2243] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.925148 22480 raft_consensus.cc:2272] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.927237 22480 tablet_replica.cc:333] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.927904 22480 raft_consensus.cc:2243] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.928356 22480 raft_consensus.cc:2272] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.930919 22480 tablet_replica.cc:333] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.931538 22480 raft_consensus.cc:2243] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.932034 22480 raft_consensus.cc:2272] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.934299 22480 tablet_replica.cc:333] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.934955 22480 raft_consensus.cc:2243] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.936153 22480 raft_consensus.cc:2272] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:15.936679 31950 consensus_peers.cc:597] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:15.938491 22480 tablet_replica.cc:333] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.939175 22480 raft_consensus.cc:2243] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.939810 22480 raft_consensus.cc:2272] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.942308 22480 tablet_replica.cc:333] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.942974 22480 raft_consensus.cc:2243] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.943948 22480 raft_consensus.cc:2272] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.946105 22480 tablet_replica.cc:333] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.946775 22480 raft_consensus.cc:2243] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.947583 22480 raft_consensus.cc:2272] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.949618 22480 tablet_replica.cc:333] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.950255 22480 raft_consensus.cc:2243] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.950685 22480 raft_consensus.cc:2272] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.953487 22480 tablet_replica.cc:333] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.954226 22480 raft_consensus.cc:2243] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.954713 22480 raft_consensus.cc:2272] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.957023 22480 tablet_replica.cc:333] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.957703 22480 raft_consensus.cc:2243] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.958307 22480 raft_consensus.cc:2272] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:15.960086 31950 consensus_peers.cc:597] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:15.961170 22480 tablet_replica.cc:333] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.961884 22480 raft_consensus.cc:2243] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.962949 22480 raft_consensus.cc:2272] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.965890 22480 tablet_replica.cc:333] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.966766 22480 raft_consensus.cc:2243] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.967434 22480 raft_consensus.cc:2272] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:15.968621 31950 consensus_peers.cc:597] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:15.971958 22480 tablet_replica.cc:333] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.973090 22480 raft_consensus.cc:2243] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.974386 22480 raft_consensus.cc:2272] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.977440 22480 tablet_replica.cc:333] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.978147 22480 raft_consensus.cc:2243] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.979084 22480 raft_consensus.cc:2272] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.981230 22480 tablet_replica.cc:333] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.981910 22480 raft_consensus.cc:2243] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.982826 22480 raft_consensus.cc:2272] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.985244 22480 tablet_replica.cc:333] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.985818 22480 raft_consensus.cc:2243] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:15.986694 22480 raft_consensus.cc:2272] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.988878 22480 tablet_replica.cc:333] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.989635 22480 raft_consensus.cc:2243] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.990139 22480 raft_consensus.cc:2272] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.992873 22480 tablet_replica.cc:333] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.993605 22480 raft_consensus.cc:2243] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.994163 22480 raft_consensus.cc:2272] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:15.996881 22480 tablet_replica.cc:333] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:15.997694 22480 raft_consensus.cc:2243] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.998267 22480 raft_consensus.cc:2272] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.001139 22480 tablet_replica.cc:333] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.001865 22480 raft_consensus.cc:2243] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.002897 22480 raft_consensus.cc:2272] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.005695 22480 tablet_replica.cc:333] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.006584 22480 raft_consensus.cc:2243] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.007709 22480 raft_consensus.cc:2272] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.010728 22480 tablet_replica.cc:333] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.011302 22480 raft_consensus.cc:2243] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.011842 22480 raft_consensus.cc:2272] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.014014 22480 tablet_replica.cc:333] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.014559 22480 raft_consensus.cc:2243] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.015056 22480 raft_consensus.cc:2272] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.017030 22480 tablet_replica.cc:333] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.017526 22480 raft_consensus.cc:2243] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.017889 22480 raft_consensus.cc:2272] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.019697 22480 tablet_replica.cc:333] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.020309 22480 raft_consensus.cc:2243] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.020743 22480 raft_consensus.cc:2272] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.022737 22480 tablet_replica.cc:333] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.023283 22480 raft_consensus.cc:2243] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.023687 22480 raft_consensus.cc:2272] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.026150 22480 tablet_replica.cc:333] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.026763 22480 raft_consensus.cc:2243] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.027554 22480 raft_consensus.cc:2272] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.030006 22480 tablet_replica.cc:333] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.030788 22480 raft_consensus.cc:2243] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:16.031919 22480 raft_consensus.cc:2272] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.034660 22480 tablet_replica.cc:333] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.035221 22480 raft_consensus.cc:2243] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.035665 22480 raft_consensus.cc:2272] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.037691 22480 tablet_replica.cc:333] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.038290 22480 raft_consensus.cc:2243] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.038738 22480 raft_consensus.cc:2272] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.040961 22480 tablet_replica.cc:333] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.041473 22480 raft_consensus.cc:2243] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.041889 22480 raft_consensus.cc:2272] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.044039 22480 tablet_replica.cc:333] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.044591 22480 raft_consensus.cc:2243] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.044996 22480 raft_consensus.cc:2272] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.046727 22480 tablet_replica.cc:333] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325: stopping tablet replica
I20260709 13:12:16.047228 22480 raft_consensus.cc:2243] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:16.047662 22480 raft_consensus.cc:2272] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:16.059238 32024 consensus_peers.cc:597] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.064985 31950 consensus_peers.cc:597] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.077318 32098 consensus_peers.cc:597] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.079523 32024 consensus_peers.cc:597] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.082566 31950 consensus_peers.cc:597] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.084223 32024 consensus_peers.cc:597] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.087777 31950 consensus_peers.cc:597] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.109077 31950 consensus_peers.cc:597] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.114530 31950 consensus_peers.cc:597] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.115695 32024 consensus_peers.cc:597] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.116410 32098 consensus_peers.cc:597] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.135960 32098 consensus_peers.cc:597] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.139648 31950 consensus_peers.cc:597] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.140142 22480 tablet_server.cc:196] TabletServer@127.21.244.1:0 shutdown complete.
W20260709 13:12:16.181203 32098 consensus_peers.cc:597] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.184695 32098 consensus_peers.cc:597] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.186866 31950 consensus_peers.cc:597] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.215364 32024 consensus_peers.cc:597] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.240440 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:16.248394 32723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:16.248416 32722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:16.251466 32725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:16.254720 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:16.256476 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:16.256767 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:16.256973 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602736256958 us; error 0 us; skew 500 ppm
I20260709 13:12:16.257517 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:16.261407 22480 webserver.cc:533] Webserver started at http://127.21.244.1:43737/ using document root <none> and password file <none>
I20260709 13:12:16.262125 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:16.262367 22480 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:12:16.269810 32098 consensus_peers.cc:597] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.271860 22480 fs_manager.cc:714] Time spent opening directory manager: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:12:16.283504 32730 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:16.284929 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:16.285323 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-0-root
uuid: "936b035f23a5449fb43db3fd5f757325"
format_stamp: "Formatted at 2026-07-09 13:12:02 on dist-test-slave-j314"
I20260709 13:12:16.285863 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602440417847-22480-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:16.305114 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:16.306844 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:16.308754 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:16.314713 32737 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:12:16.426872 32707 raft_consensus.cc:493] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:16.435688 32707 raft_consensus.cc:515] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:16.439694 31839 debug-util.cc:398] Leaking SignalData structure 0x7b0800319fa0 after lost signal to thread 22483
I20260709 13:12:16.439872 32707 leader_election.cc:290] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
W20260709 13:12:16.441120 31839 debug-util.cc:398] Leaking SignalData structure 0x7b0800310660 after lost signal to thread 31842
I20260709 13:12:16.440006 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6829450035496cad51a237b822114a" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:16.444727 31839 debug-util.cc:398] Leaking SignalData structure 0x7b0800172b20 after lost signal to thread 32009
W20260709 13:12:16.446125 31839 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9bc0 after lost signal to thread 32083
W20260709 13:12:16.447456 31839 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1360 after lost signal to thread 32157
W20260709 13:12:16.448419 31950 leader_election.cc:336] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:16.448882 31950 leader_election.cc:304] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:16.449602 32707 raft_consensus.cc:2749] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.714999 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:12:16.715526 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.402s	user 0.008s	sys 0.001s
I20260709 13:12:16.715956 22480 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:12:16.735800 32737 tablet_bootstrap.cc:492] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:16.764436 32737 tablet_bootstrap.cc:492] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:16.765517 32737 tablet_bootstrap.cc:492] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:16.766192 32737 ts_tablet_manager.cc:1403] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.000s
I20260709 13:12:16.769217 32737 raft_consensus.cc:359] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:16.770030 32737 raft_consensus.cc:740] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.770824 32737 consensus_queue.cc:260] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:16.774995 32737 ts_tablet_manager.cc:1434] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:12:16.778581 32737 tablet_bootstrap.cc:492] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:16.820339 32737 tablet_bootstrap.cc:492] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:16.821605 32737 tablet_bootstrap.cc:492] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:16.822309 32737 ts_tablet_manager.cc:1403] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.016s
I20260709 13:12:16.833105 32737 raft_consensus.cc:359] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:16.833717 32737 raft_consensus.cc:740] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.834460 32737 consensus_queue.cc:260] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:16.837648 32737 ts_tablet_manager.cc:1434] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:12:16.838788 32737 tablet_bootstrap.cc:492] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:16.852982 32737 tablet_bootstrap.cc:492] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:16.853798 32737 tablet_bootstrap.cc:492] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:16.854431 32737 ts_tablet_manager.cc:1403] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.008s
I20260709 13:12:16.856618 32737 raft_consensus.cc:359] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:16.857213 32737 raft_consensus.cc:740] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.858109 32737 consensus_queue.cc:260] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:16.860145 32737 ts_tablet_manager.cc:1434] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:12:16.860992 32737 tablet_bootstrap.cc:492] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:16.898655 32737 tablet_bootstrap.cc:492] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:16.899775 32737 tablet_bootstrap.cc:492] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:16.900486 32737 ts_tablet_manager.cc:1403] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.008s
I20260709 13:12:16.903867 32737 raft_consensus.cc:359] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:16.904655 32737 raft_consensus.cc:740] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.905696 32737 consensus_queue.cc:260] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:16.908284 32737 ts_tablet_manager.cc:1434] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:12:16.909629 32737 tablet_bootstrap.cc:492] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:16.941706 32737 tablet_bootstrap.cc:492] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:16.943028 32737 tablet_bootstrap.cc:492] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:16.943985 32737 ts_tablet_manager.cc:1403] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.007s
I20260709 13:12:16.947288 32737 raft_consensus.cc:359] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:16.948108 32737 raft_consensus.cc:740] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.965077 32737 consensus_queue.cc:260] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:16.968554 32737 ts_tablet_manager.cc:1434] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:12:16.970925 32737 tablet_bootstrap.cc:492] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:16.999037 32737 tablet_bootstrap.cc:492] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.000524 32737 tablet_bootstrap.cc:492] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:17.001478 32737 ts_tablet_manager.cc:1403] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.004s
I20260709 13:12:17.004192 32737 raft_consensus.cc:359] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.004952 32737 raft_consensus.cc:740] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.005679 32737 consensus_queue.cc:260] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.008152 32737 ts_tablet_manager.cc:1434] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:17.009145 32737 tablet_bootstrap.cc:492] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:17.018306 32721 raft_consensus.cc:493] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.019141 32721 raft_consensus.cc:515] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.021158 32589 raft_consensus.cc:493] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.021430 32721 leader_election.cc:290] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.021785 32589 raft_consensus.cc:515] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.024950 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d018ee52cc46cebe51e75edec5abe5" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:17.030438 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.033365 32737 tablet_bootstrap.cc:492] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.034701 32737 tablet_bootstrap.cc:492] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:17.035538 32737 ts_tablet_manager.cc:1403] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.004s
I20260709 13:12:17.036237 32707 raft_consensus.cc:493] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.036854 32707 raft_consensus.cc:515] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.038635 32737 raft_consensus.cc:359] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.039520 32737 raft_consensus.cc:740] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.040532 32737 consensus_queue.cc:260] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.044005 32737 ts_tablet_manager.cc:1434] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:17.045018 32737 tablet_bootstrap.cc:492] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
W20260709 13:12:17.045650 31950 leader_election.cc:336] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.046358 32647 raft_consensus.cc:493] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.046852 32707 leader_election.cc:290] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:17.047000 32647 raft_consensus.cc:515] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.047497 32707 raft_consensus.cc:493] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.056130 32707 raft_consensus.cc:515] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.052973 32052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0126ecb33b074d9d8af32e047a43f067" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:17.058445 32707 leader_election.cc:290] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:17.057572 32589 leader_election.cc:290] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
W20260709 13:12:17.064308 32024 leader_election.cc:336] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.068176 32024 leader_election.cc:304] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:17.070313 32589 raft_consensus.cc:2749] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.071699 32052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
W20260709 13:12:17.076810 32024 leader_election.cc:336] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.077498 32024 leader_election.cc:304] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:17.078328 32721 raft_consensus.cc:2749] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.080623 32647 leader_election.cc:290] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.081914 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78093d7ec8724a248daf1d4269de3190" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:17.087637 32052 raft_consensus.cc:2468] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
W20260709 13:12:17.097945 31950 leader_election.cc:336] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.098830 31950 leader_election.cc:336] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.099421 31950 leader_election.cc:304] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:17.100780 32707 raft_consensus.cc:2749] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.110302 31951 leader_election.cc:304] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.111912 32747 raft_consensus.cc:2749] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.113068 31951 leader_election.cc:304] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.117740 32589 raft_consensus.cc:493] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.138031 32589 raft_consensus.cc:515] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.141065 32589 leader_election.cc:290] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.120152 32721 raft_consensus.cc:493] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.121312 32707 raft_consensus.cc:493] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.144157 32707 raft_consensus.cc:515] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.147037 32707 leader_election.cc:290] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.147995 32721 raft_consensus.cc:515] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.150839 32721 leader_election.cc:290] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.131314 32672 raft_consensus.cc:493] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.152186 32672 raft_consensus.cc:515] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:17.153072 31950 leader_election.cc:336] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.155092 32672 leader_election.cc:290] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.131358 32666 raft_consensus.cc:493] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.156075 32666 raft_consensus.cc:515] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.160930 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0126ecb33b074d9d8af32e047a43f067" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.161791 31980 raft_consensus.cc:2468] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:17.162477 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced69c1fedef46c1a15fcea51cc970f4" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:17.162511 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540d3a54268745adb1ed6108ca819925" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:17.163206 32666 leader_election.cc:290] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.161716 32747 raft_consensus.cc:2804] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.166643 32747 raft_consensus.cc:493] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.167088 32747 raft_consensus.cc:3060] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.168603 31949 leader_election.cc:304] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
W20260709 13:12:17.170413 31950 leader_election.cc:336] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.171789 32707 raft_consensus.cc:2749] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.172247 31950 leader_election.cc:304] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:17.173273 32707 raft_consensus.cc:2749] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:17.161095 31951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 48127.2us
I20260709 13:12:17.177922 32707 raft_consensus.cc:493] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.178503 32707 raft_consensus.cc:515] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:17.179862 32024 leader_election.cc:336] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.179665 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1c9b1a299481d9675857f807393c6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.180838 32737 tablet_bootstrap.cc:492] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:12:17.181137 32024 leader_election.cc:336] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.181981 32737 tablet_bootstrap.cc:492] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:17.181978 32707 leader_election.cc:290] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.182976 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:17.185770 22480 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:12:17.186192 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.470s	user 0.329s	sys 0.012s
I20260709 13:12:17.182996 32737 ts_tablet_manager.cc:1403] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.138s	user 0.021s	sys 0.008s
I20260709 13:12:17.190814 32737 raft_consensus.cc:359] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.191672 32737 raft_consensus.cc:740] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.192723 32737 consensus_queue.cc:260] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:17.189298 31950 leader_election.cc:336] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.193922 31950 leader_election.cc:304] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:17.194911 32737 ts_tablet_manager.cc:1434] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:17.195912 32737 tablet_bootstrap.cc:492] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:17.196326 32707 raft_consensus.cc:2749] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:17.197062 32023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 66469.2us
I20260709 13:12:17.197978 32589 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.198388 32024 leader_election.cc:304] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.198522 32589 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.200800 32589 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.202704 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:17.203056 32738 raft_consensus.cc:493] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.203598 32738 raft_consensus.cc:515] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.204732 32747 raft_consensus.cc:515] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.205827 32738 leader_election.cc:290] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.208451 32752 raft_consensus.cc:2804] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.208777 32747 leader_election.cc:290] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:17.208907 32752 raft_consensus.cc:493] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.209558 32752 raft_consensus.cc:3060] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.215056 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540d3a54268745adb1ed6108ca819925" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.217489 31980 raft_consensus.cc:2468] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
W20260709 13:12:17.214591 32098 leader_election.cc:336] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.220760 32098 leader_election.cc:304] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.224715 32698 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.231792 32698 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.233984 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:17.234318 32698 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.228292 32710 raft_consensus.cc:493] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.235103 32710 raft_consensus.cc:515] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.237224 32710 leader_election.cc:290] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.239740 32710 raft_consensus.cc:2804] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:17.239837 31950 leader_election.cc:336] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.230943 32738 raft_consensus.cc:493] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.234670 32058 raft_consensus.cc:3060] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:17.247927 32024 leader_election.cc:336] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.265967 32024 leader_election.cc:304] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:17.269277 32589 raft_consensus.cc:2749] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.249603 32752 raft_consensus.cc:515] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.273885 32752 leader_election.cc:290] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.251693 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6829450035496cad51a237b822114a" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.274753 31981 raft_consensus.cc:2468] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:17.275414 32738 raft_consensus.cc:515] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.276158 32747 raft_consensus.cc:493] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.276970 32747 raft_consensus.cc:515] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.278292 32738 leader_election.cc:290] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.280586 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eecdc9a6c45481b8148098fe8e47232" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:17.281582 32747 leader_election.cc:290] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.283447 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:17.290656 32129 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 3.
I20260709 13:12:17.294595 32747 raft_consensus.cc:493] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.296030 32023 leader_election.cc:304] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:17.240242 32710 raft_consensus.cc:493] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.229239 32737 tablet_bootstrap.cc:492] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.294742 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78093d7ec8724a248daf1d4269de3190" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.299178 32710 raft_consensus.cc:3060] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.299578 31981 raft_consensus.cc:2468] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:17.295645 32747 raft_consensus.cc:515] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
W20260709 13:12:17.287895 32024 leader_election.cc:336] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.274796 32058 raft_consensus.cc:2468] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 2.
I20260709 13:12:17.302420 32747 leader_election.cc:290] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:17.304494 32737 tablet_bootstrap.cc:492] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:17.305864 32589 raft_consensus.cc:2749] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.306294 32023 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.286263 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0126ecb33b074d9d8af32e047a43f067" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:17.316370 31980 raft_consensus.cc:3060] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.316800 32737 ts_tablet_manager.cc:1403] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.121s	user 0.017s	sys 0.004s
W20260709 13:12:17.309413 31950 leader_election.cc:336] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.311906 32698 raft_consensus.cc:493] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.324384 32698 raft_consensus.cc:515] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.327062 32698 leader_election.cc:290] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.327978 32589 raft_consensus.cc:493] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.328761 32589 raft_consensus.cc:515] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.328104 32737 raft_consensus.cc:359] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.330008 32737 raft_consensus.cc:740] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
W20260709 13:12:17.298307 32098 leader_election.cc:336] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.314155 32024 leader_election.cc:336] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.334481 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:17.335181 32058 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 3.
I20260709 13:12:17.336400 32752 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:17.336650 32052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d018ee52cc46cebe51e75edec5abe5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:17.336897 32752 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.337477 32752 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:17.338222 32053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:17.338958 32053 raft_consensus.cc:2468] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
W20260709 13:12:17.342207 32098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 43945.6us
I20260709 13:12:17.314172 31951 leader_election.cc:304] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.314455 32756 raft_consensus.cc:493] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.348623 32756 raft_consensus.cc:515] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.312736 32710 raft_consensus.cc:515] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.346740 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.337544 32052 raft_consensus.cc:2468] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:17.351456 31981 raft_consensus.cc:2468] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:17.347623 32099 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.353838 32710 leader_election.cc:290] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.349164 31951 leader_election.cc:304] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:17.349771 32747 raft_consensus.cc:2804] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.331254 32589 leader_election.cc:290] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.354800 32707 raft_consensus.cc:2804] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.354882 32747 raft_consensus.cc:697] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:17.355310 32707 raft_consensus.cc:493] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.355865 32707 raft_consensus.cc:3060] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.356283 32747 consensus_queue.cc:237] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.358829 32756 leader_election.cc:290] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
W20260709 13:12:17.350531 32098 leader_election.cc:336] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.331765 31950 leader_election.cc:304] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:17.362999 32098 leader_election.cc:304] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.363346 32748 raft_consensus.cc:2749] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.363998 32707 raft_consensus.cc:515] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
W20260709 13:12:17.364282 31950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 54932.9us
I20260709 13:12:17.365070 32710 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:17.365547 32710 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.365949 32710 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:17.366549 32698 raft_consensus.cc:2804] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.367084 32698 raft_consensus.cc:493] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.367507 32698 raft_consensus.cc:3060] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.370251 32589 raft_consensus.cc:493] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.370879 32589 raft_consensus.cc:515] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.357926 32024 leader_election.cc:304] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:17.372315 32751 raft_consensus.cc:2804] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.372700 32751 raft_consensus.cc:493] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.373059 32751 raft_consensus.cc:3060] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.374887 32589 leader_election.cc:290] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
W20260709 13:12:17.375603 32023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 69406.5us
I20260709 13:12:17.375898 32099 leader_election.cc:304] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.376967 32756 raft_consensus.cc:2804] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.377519 32756 raft_consensus.cc:493] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.346740 32752 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.378170 32756 raft_consensus.cc:3060] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.380885 32052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:17.381649 32052 raft_consensus.cc:2468] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:17.364326 32098 leader_election.cc:304] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.384323 32758 raft_consensus.cc:2804] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.386284 32758 raft_consensus.cc:493] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.383328 32737 consensus_queue.cc:260] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.387260 32748 raft_consensus.cc:493] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.390369 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540d3a54268745adb1ed6108ca819925" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:17.391172 31981 raft_consensus.cc:3060] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.391043 32748 raft_consensus.cc:515] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.393806 32748 leader_election.cc:290] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.350435 31980 raft_consensus.cc:2468] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 2.
I20260709 13:12:17.389433 32707 leader_election.cc:290] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
W20260709 13:12:17.389916 32024 leader_election.cc:336] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.397354 32737 ts_tablet_manager.cc:1434] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:12:17.390434 32758 raft_consensus.cc:3060] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.406929 32752 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 4 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.406153 31804 catalog_manager.cc:5697] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.410532 32737 tablet_bootstrap.cc:492] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
W20260709 13:12:17.398777 31950 leader_election.cc:336] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.413589 32052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:17.414085 32024 leader_election.cc:304] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.415797 32698 raft_consensus.cc:515] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.427202 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:17.427352 32589 raft_consensus.cc:2804] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.428846 32129 raft_consensus.cc:2468] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 1.
I20260709 13:12:17.429136 32589 raft_consensus.cc:697] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 2 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
W20260709 13:12:17.444921 32098 leader_election.cc:336] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.451819 32099 leader_election.cc:304] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.430173 32589 consensus_queue.cc:237] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.443473 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:17.443226 32738 raft_consensus.cc:493] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.423018 32751 raft_consensus.cc:515] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.464406 32762 raft_consensus.cc:493] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.465088 32762 raft_consensus.cc:515] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:17.467980 32024 leader_election.cc:336] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.468710 31950 leader_election.cc:336] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.468729 32024 leader_election.cc:336] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.467438 32762 leader_election.cc:290] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.488993 32647 raft_consensus.cc:493] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.493218 32647 raft_consensus.cc:515] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.493736 32698 leader_election.cc:290] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.489979 32672 raft_consensus.cc:493] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.494526 32698 raft_consensus.cc:2804] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.495003 32698 raft_consensus.cc:493] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.494640 32672 raft_consensus.cc:515] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.495523 32647 leader_election.cc:290] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:17.495451 32698 raft_consensus.cc:3060] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.497191 32052 raft_consensus.cc:2393] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ab61be703111416d9fba543ea97b2224 in current term 2: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
I20260709 13:12:17.463848 32738 raft_consensus.cc:515] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.509459 32672 leader_election.cc:290] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.511082 32738 leader_election.cc:290] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.490506 32762 raft_consensus.cc:493] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.512104 32762 raft_consensus.cc:515] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.514133 32762 leader_election.cc:290] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.514880 32758 raft_consensus.cc:515] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.495860 32761 raft_consensus.cc:493] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
W20260709 13:12:17.519989 31950 leader_election.cc:336] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.518996 31981 raft_consensus.cc:2468] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 2.
I20260709 13:12:17.538416 31951 leader_election.cc:304] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.546409 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:17.536005 32751 leader_election.cc:290] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.547189 32129 raft_consensus.cc:2468] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:17.542153 32707 raft_consensus.cc:2749] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.556113 32023 leader_election.cc:304] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
W20260709 13:12:17.573815 31950 leader_election.cc:336] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.556102 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:17.557194 31949 leader_election.cc:304] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.557301   300 raft_consensus.cc:493] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.558046 32762 raft_consensus.cc:493] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
W20260709 13:12:17.568619 32024 leader_election.cc:336] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.573760 32052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1c9b1a299481d9675857f807393c6" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:17.578120 31806 catalog_manager.cc:5697] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 2 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.585934 32672 raft_consensus.cc:2804] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.586731 32762 raft_consensus.cc:515] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.587186 31981 raft_consensus.cc:2393] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 27177ca9073b4128b8844b7cb37db32a in current term 2: Already voted for candidate ab61be703111416d9fba543ea97b2224 in this term.
I20260709 13:12:17.587433   300 raft_consensus.cc:515] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.589109 32589 raft_consensus.cc:2804] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.524099 32761 raft_consensus.cc:515] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.584450 32098 leader_election.cc:304] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.584465 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8212163be194b95a51643b109e411a8" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:17.593784 32758 leader_election.cc:290] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.595299 32710 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.596856 32756 raft_consensus.cc:515] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.607591 32128 raft_consensus.cc:2393] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27177ca9073b4128b8844b7cb37db32a in current term 4: Already voted for candidate eacc546e751240eb804795d98213a57c in this term.
I20260709 13:12:17.598448 32672 raft_consensus.cc:493] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.591687 32737 tablet_bootstrap.cc:492] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.609066 32672 raft_consensus.cc:3060] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.609922 32737 tablet_bootstrap.cc:492] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:17.610661 32737 ts_tablet_manager.cc:1403] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.200s	user 0.032s	sys 0.001s
W20260709 13:12:17.611343 31950 leader_election.cc:336] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.611016 32023 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:17.602232 32589 raft_consensus.cc:493] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.603086 32130 raft_consensus.cc:2468] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:17.631443 32589 raft_consensus.cc:3060] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.597664 32052 raft_consensus.cc:2468] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 1.
I20260709 13:12:17.612977 32024 leader_election.cc:304] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:17.633693 32750 raft_consensus.cc:2749] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:17.634258 31951 leader_election.cc:304] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.634449 32750 raft_consensus.cc:2749] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.610782 32698 raft_consensus.cc:515] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.636549 31949 leader_election.cc:304] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.637709 32698 leader_election.cc:290] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.641727 32589 raft_consensus.cc:515] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.648986 32748 raft_consensus.cc:2804] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.603350 32764 raft_consensus.cc:2804] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.651666 32762 leader_election.cc:290] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.652053 32707 raft_consensus.cc:2804] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.652750   300 leader_election.cc:290] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.658367 32710 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.653755 32761 leader_election.cc:290] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.656236 32756 leader_election.cc:290] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
W20260709 13:12:17.657648 32099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 168169us
I20260709 13:12:17.677692 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:17.678754 32056 raft_consensus.cc:2468] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:17.672336 32764 raft_consensus.cc:697] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:17.670818 32707 raft_consensus.cc:493] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.667299 32748 raft_consensus.cc:493] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.671914 32737 raft_consensus.cc:359] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.683753 32737 raft_consensus.cc:740] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.684610 32737 consensus_queue.cc:260] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:17.687172 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:17.683405 32707 raft_consensus.cc:3060] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.687873 32053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d018ee52cc46cebe51e75edec5abe5" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:17.688223 32128 raft_consensus.cc:2393] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 27177ca9073b4128b8844b7cb37db32a in current term 2: Already voted for candidate eacc546e751240eb804795d98213a57c in this term.
I20260709 13:12:17.688683 32053 raft_consensus.cc:3060] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.689703 32099 leader_election.cc:304] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.687433 32051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:17.690526 32589 leader_election.cc:290] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.691203 32051 raft_consensus.cc:2393] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 2: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
I20260709 13:12:17.684305 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:17.694455 32056 raft_consensus.cc:2393] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 4: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
I20260709 13:12:17.693099 32748 raft_consensus.cc:3060] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.686910 32737 ts_tablet_manager.cc:1434] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260709 13:12:17.692026 32710 raft_consensus.cc:2804] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.700515 32737 tablet_bootstrap.cc:492] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:17.700044 32710 raft_consensus.cc:493] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.705904 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6829450035496cad51a237b822114a" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:17.705992 32710 raft_consensus.cc:3060] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.706786 31980 raft_consensus.cc:3060] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.687491 32764 consensus_queue.cc:237] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.702878 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.714838 31983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.714968 31978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78093d7ec8724a248daf1d4269de3190" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:17.715844 31978 raft_consensus.cc:3060] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.715660 31983 raft_consensus.cc:2468] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:17.669694 32672 raft_consensus.cc:515] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.721329 31981 raft_consensus.cc:2393] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 2: Already voted for candidate ab61be703111416d9fba543ea97b2224 in this term.
I20260709 13:12:17.724998 31978 raft_consensus.cc:2468] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 2.
I20260709 13:12:17.727154 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
W20260709 13:12:17.733917 32098 leader_election.cc:336] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.734804 32098 leader_election.cc:336] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.728093 32130 raft_consensus.cc:3060] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:17.735939 32098 leader_election.cc:336] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.733284 32748 raft_consensus.cc:515] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:17.736083 32710 raft_consensus.cc:515] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:17.749660 32024 leader_election.cc:336] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.750178 32024 leader_election.cc:304] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a; no voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c
I20260709 13:12:17.750034 32098 leader_election.cc:304] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.753477 32053 raft_consensus.cc:2468] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 2.
I20260709 13:12:17.746886 31983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced69c1fedef46c1a15fcea51cc970f4" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.756091 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eecdc9a6c45481b8148098fe8e47232" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.756381 31983 raft_consensus.cc:2468] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:17.756819 31979 raft_consensus.cc:2468] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 1.
I20260709 13:12:17.758680 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8212163be194b95a51643b109e411a8" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:17.763139 31980 raft_consensus.cc:2468] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 2.
I20260709 13:12:17.724403 32672 leader_election.cc:290] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.765336 31807 catalog_manager.cc:5697] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 2 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.745157 32707 raft_consensus.cc:515] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.767446 31981 raft_consensus.cc:2393] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eacc546e751240eb804795d98213a57c in current term 2: Already voted for candidate ab61be703111416d9fba543ea97b2224 in this term.
I20260709 13:12:17.767699 32750 raft_consensus.cc:2749] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.768486 32707 leader_election.cc:290] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.776860 32762 raft_consensus.cc:2804] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.777370 32762 raft_consensus.cc:493] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.777285 32098 leader_election.cc:304] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.781821 32762 raft_consensus.cc:3060] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.782058 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8212163be194b95a51643b109e411a8" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:17.782769 32129 raft_consensus.cc:3060] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.782958   300 raft_consensus.cc:2804] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.783605   300 raft_consensus.cc:697] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:17.785386 32099 leader_election.cc:304] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.784518   300 consensus_queue.cc:237] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.789214 32129 raft_consensus.cc:2468] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 2.
I20260709 13:12:17.795140 31949 leader_election.cc:304] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.796801 32647 raft_consensus.cc:2804] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:12:17.794682 31950 leader_election.cc:336] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.797544 32098 leader_election.cc:304] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.798672 32738 raft_consensus.cc:2804] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.797744 32647 raft_consensus.cc:697] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:17.799091 32738 raft_consensus.cc:493] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.798844 32098 leader_election.cc:304] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.799535 32738 raft_consensus.cc:3060] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.800074 32758 raft_consensus.cc:2804] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.800601 32758 raft_consensus.cc:493] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:17.801122 32758 raft_consensus.cc:3060] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:17.801278 31950 leader_election.cc:336] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.802997 32098 leader_election.cc:304] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:17.801115 32647 consensus_queue.cc:237] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.804885   302 raft_consensus.cc:2804] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.794325 32756 raft_consensus.cc:2804] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:12:17.811815 32098 leader_election.cc:336] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.808043 31950 leader_election.cc:336] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.812357 32098 leader_election.cc:304] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
W20260709 13:12:17.817376 32098 leader_election.cc:336] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.815462 32756 raft_consensus.cc:697] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
W20260709 13:12:17.819903 32098 leader_election.cc:336] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.820655 32098 leader_election.cc:336] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.820588 32756 consensus_queue.cc:237] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:17.821447 32098 leader_election.cc:336] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.822144 32098 leader_election.cc:336] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.822808 32098 leader_election.cc:336] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.823449 32098 leader_election.cc:336] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.824158 32098 leader_election.cc:336] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.824679 32098 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.825850 32738 raft_consensus.cc:515] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.814742 32758 raft_consensus.cc:515] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.829692 32758 leader_election.cc:290] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.812805   302 raft_consensus.cc:697] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:17.830858 32761 raft_consensus.cc:2749] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:17.832178 32098 leader_election.cc:336] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.832377 32710 leader_election.cc:290] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:17.832780 32098 leader_election.cc:304] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:17.833686 32710 raft_consensus.cc:2749] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:17.834010 32098 leader_election.cc:336] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.834616 32098 leader_election.cc:304] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.835448 32710 raft_consensus.cc:2749] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.831290   302 consensus_queue.cc:237] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.847479 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eecdc9a6c45481b8148098fe8e47232" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:17.848268 31981 raft_consensus.cc:3060] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.848796 32051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:17.849942 32051 raft_consensus.cc:3060] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:17.855463 32098 leader_election.cc:336] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:17.856473 32098 leader_election.cc:336] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.876063 31981 raft_consensus.cc:2468] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 2.
I20260709 13:12:17.879072 32130 raft_consensus.cc:2468] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 2.
I20260709 13:12:17.881301 32698 raft_consensus.cc:2749] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.884233 32098 leader_election.cc:304] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.889416 31949 leader_election.cc:304] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.890950 32707 raft_consensus.cc:2804] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.892716 32707 raft_consensus.cc:697] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:17.893765 32707 consensus_queue.cc:237] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.888684 32710 raft_consensus.cc:2804] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.895308 32710 raft_consensus.cc:697] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:17.896346 32710 consensus_queue.cc:237] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:17.901140 32098 leader_election.cc:336] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:17.910494 32738 leader_election.cc:290] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.912309 32762 raft_consensus.cc:515] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.913767 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced69c1fedef46c1a15fcea51cc970f4" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:17.914758 31981 raft_consensus.cc:3060] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.925855 32058 raft_consensus.cc:1275] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Refusing update from remote peer ab61be703111416d9fba543ea97b2224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.930210 32766 consensus_queue.cc:1048] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:17.930831 32740 raft_consensus.cc:493] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.931703 32740 raft_consensus.cc:515] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:17.937016 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:17.937819 31980 raft_consensus.cc:3060] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.941762 32762 leader_election.cc:290] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.974758 32051 raft_consensus.cc:2468] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 2.
I20260709 13:12:17.978420 32099 leader_election.cc:304] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:17.981029 32740 leader_election.cc:290] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:17.991328 32737 tablet_bootstrap.cc:492] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.000068 32737 tablet_bootstrap.cc:492] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:18.000819 32737 ts_tablet_manager.cc:1403] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.301s	user 0.018s	sys 0.011s
I20260709 13:12:17.996138 32762 raft_consensus.cc:2804] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:18.010996 32737 raft_consensus.cc:359] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:18.011827 32737 raft_consensus.cc:740] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.012748 32737 consensus_queue.cc:260] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:18.014882 32737 ts_tablet_manager.cc:1434] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:12:18.015761 32737 tablet_bootstrap.cc:492] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:18.007961 32762 raft_consensus.cc:697] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
W20260709 13:12:18.021612 32098 leader_election.cc:336] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:18.030397 32748 leader_election.cc:290] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
W20260709 13:12:18.037214 32024 consensus_peers.cc:597] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:18.037389 31950 consensus_peers.cc:597] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:18.041916 31981 raft_consensus.cc:2468] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 2.
I20260709 13:12:18.047333 31980 raft_consensus.cc:2468] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 2.
I20260709 13:12:18.049919 32098 leader_election.cc:304] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:18.052852 32698 raft_consensus.cc:2804] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:18.053481 32698 raft_consensus.cc:697] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:18.053037 32762 consensus_queue.cc:237] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:18.054989 32098 leader_election.cc:304] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:18.062062 32698 consensus_queue.cc:237] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:18.073508   302 raft_consensus.cc:2804] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:18.078368   302 raft_consensus.cc:697] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:18.079300   302 consensus_queue.cc:237] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:18.099768 31980 raft_consensus.cc:1275] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer 27177ca9073b4128b8844b7cb37db32a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.124886 32589 consensus_queue.cc:1048] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:12:18.124377 32740 raft_consensus.cc:493] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.152906 32737 tablet_bootstrap.cc:492] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:12:18.159368 32098 consensus_peers.cc:597] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.148628 32051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e1c9b1a299481d9675857f807393c6" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:18.153606 32740 raft_consensus.cc:515] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:18.179414 32051 raft_consensus.cc:3060] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.282820 32737 tablet_bootstrap.cc:492] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:18.283692 32737 ts_tablet_manager.cc:1403] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.268s	user 0.018s	sys 0.012s
I20260709 13:12:18.299610 32737 raft_consensus.cc:359] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:18.300450 32737 raft_consensus.cc:740] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.309738 32737 consensus_queue.cc:260] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:18.299292 32051 raft_consensus.cc:2468] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 2.
W20260709 13:12:18.325950 31950 consensus_peers.cc:597] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.330009 31984 raft_consensus.cc:1275] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer eacc546e751240eb804795d98213a57c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.332600 31951 leader_election.cc:304] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:18.337116 32747 raft_consensus.cc:2804] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:18.337924 32740 leader_election.cc:290] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:18.347199 32128 raft_consensus.cc:1275] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer ab61be703111416d9fba543ea97b2224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.351449 31983 raft_consensus.cc:1275] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer eacc546e751240eb804795d98213a57c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.345408 32747 raft_consensus.cc:697] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:18.353899 32747 consensus_queue.cc:237] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:18.371982   339 raft_consensus.cc:493] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.372460 32647 consensus_queue.cc:1048] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:18.372893   339 raft_consensus.cc:515] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:18.358870 31804 catalog_manager.cc:5697] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:18.402483 31950 consensus_peers.cc:597] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:18.401124 31804 catalog_manager.cc:5697] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:18.418850   349 raft_consensus.cc:493] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.419720   349 raft_consensus.cc:515] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:18.421501 32737 ts_tablet_manager.cc:1434] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.137s	user 0.005s	sys 0.006s
I20260709 13:12:18.422757 32737 tablet_bootstrap.cc:492] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
W20260709 13:12:18.446591 32024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:45831, user_credentials={real_user=slave}} blocked reactor thread for 105737us
I20260709 13:12:18.455868 32056 raft_consensus.cc:1275] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Refusing update from remote peer eacc546e751240eb804795d98213a57c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:18.459951 32098 consensus_peers.cc:597] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:18.453436 32762 consensus_queue.cc:1048] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:12:18.433079   339 leader_election.cc:290] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
W20260709 13:12:18.479312 31951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.3:34161, user_credentials={real_user=slave}} blocked reactor thread for 146940us
W20260709 13:12:18.480916 32098 consensus_peers.cc:597] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:18.489723 32710 consensus_queue.cc:1048] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:18.491914 32130 raft_consensus.cc:1275] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer ab61be703111416d9fba543ea97b2224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.507141 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
W20260709 13:12:18.542421 31949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 62783.8us
I20260709 13:12:18.550951 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3e38a5bb6f4fd48b4bd695694eb7d9" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:18.504366   349 leader_election.cc:290] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:18.492326 32763 consensus_queue.cc:1048] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:12:18.546916   339 raft_consensus.cc:493] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.560943   339 raft_consensus.cc:515] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:18.563419   339 leader_election.cc:290] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:18.566596 31983 raft_consensus.cc:1275] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer eacc546e751240eb804795d98213a57c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.560242 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01da40464a4c3e907fbd4a05e7cf08" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:18.560307 32766 consensus_queue.cc:1048] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:12:18.586199   349 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.586905   349 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:18.600306 32098 consensus_peers.cc:597] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.557320 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:18.609243   349 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:18.609686 31979 raft_consensus.cc:1275] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer eacc546e751240eb804795d98213a57c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.610000   349 raft_consensus.cc:493] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.610481   349 raft_consensus.cc:515] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:18.641629 31980 raft_consensus.cc:1275] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer eacc546e751240eb804795d98213a57c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.642429   349 leader_election.cc:290] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:18.648779 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3e38a5bb6f4fd48b4bd695694eb7d9" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:18.650890 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7bb527b8174d1792395c79a82a224c" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:18.652211 32053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:18.653400 32053 raft_consensus.cc:2393] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 4: Already voted for candidate 27177ca9073b4128b8844b7cb37db32a in this term.
W20260709 13:12:18.653723 31950 consensus_peers.cc:597] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.654675 32052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:18.659281 32734 leader_election.cc:304] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:18.668622   349 raft_consensus.cc:2749] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:18.674636 31950 consensus_peers.cc:597] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:18.675392 31950 consensus_peers.cc:597] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:18.694159 31950 consensus_peers.cc:597] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.696367 32053 raft_consensus.cc:1275] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Refusing update from remote peer eacc546e751240eb804795d98213a57c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.698500 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:18.698700 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:18.699122 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7bb527b8174d1792395c79a82a224c" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:18.698395 31983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01da40464a4c3e907fbd4a05e7cf08" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
W20260709 13:12:18.713382 32023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 229170us
I20260709 13:12:18.717093 32733 leader_election.cc:304] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:18.718544   349 raft_consensus.cc:2749] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:18.719784 32733 leader_election.cc:304] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224
I20260709 13:12:18.721083   349 raft_consensus.cc:2749] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:18.723318 32024 consensus_peers.cc:597] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.724258 32733 leader_election.cc:304] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:18.733515   349 raft_consensus.cc:2749] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:18.727656 31950 consensus_peers.cc:597] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.729768 32737 tablet_bootstrap.cc:492] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:12:18.754185 31950 consensus_peers.cc:597] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:18.754257 32737 tablet_bootstrap.cc:492] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
W20260709 13:12:18.756254 31950 consensus_peers.cc:597] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.756400 32737 ts_tablet_manager.cc:1403] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.334s	user 0.020s	sys 0.009s
I20260709 13:12:18.757385   300 consensus_queue.cc:1048] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:18.761376 32758 consensus_queue.cc:1048] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.761804 32737 raft_consensus.cc:359] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:18.762804 32737 raft_consensus.cc:740] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.765089 32737 consensus_queue.cc:260] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:18.768306 32737 ts_tablet_manager.cc:1434] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:18.769202 32737 tablet_bootstrap.cc:492] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:18.770589 32764 consensus_queue.cc:1048] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:18.774180 32098 consensus_peers.cc:597] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:18.774745 32098 consensus_peers.cc:597] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:18.759479   300 consensus_queue.cc:1048] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:12:18.795341   349 raft_consensus.cc:493] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.796087   349 raft_consensus.cc:515] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:18.800920 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:18.800462 31807 catalog_manager.cc:5697] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 2 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.802186   349 leader_election.cc:290] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
W20260709 13:12:18.780501 31950 consensus_peers.cc:597] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.808717   349 raft_consensus.cc:493] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.809317   349 raft_consensus.cc:515] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:18.811383 31950 consensus_peers.cc:597] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:18.811866 32098 consensus_peers.cc:597] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:18.816812 32098 consensus_peers.cc:597] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:18.819233 32732 leader_election.cc:304] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:18.802623 31807 catalog_manager.cc:5697] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 2 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.820663   339 raft_consensus.cc:2749] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:18.813772 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eecdc9a6c45481b8148098fe8e47232" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:18.822238 31981 raft_consensus.cc:2393] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 2: Already voted for candidate eacc546e751240eb804795d98213a57c in this term.
I20260709 13:12:18.814229   349 leader_election.cc:290] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:18.826112 32737 tablet_bootstrap.cc:492] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.827474 32737 tablet_bootstrap.cc:492] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:18.830361 32737 ts_tablet_manager.cc:1403] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.000s
I20260709 13:12:18.828333 31807 catalog_manager.cc:5697] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 2 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.838655 31807 catalog_manager.cc:5697] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 2 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.846153 32737 raft_consensus.cc:359] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:18.857329 32737 raft_consensus.cc:740] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.853717 31807 catalog_manager.cc:5697] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 2 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.867398 31807 catalog_manager.cc:5697] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 2 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.860294 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:18.869349 32131 raft_consensus.cc:2393] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 936b035f23a5449fb43db3fd5f757325 in current term 4: Already voted for candidate eacc546e751240eb804795d98213a57c in this term.
I20260709 13:12:18.861063 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682585da6947c291d67650d6affddd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:18.861681 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:18.861866 32129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eecdc9a6c45481b8148098fe8e47232" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:18.865926 32737 consensus_queue.cc:260] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
W20260709 13:12:18.847280 31950 consensus_peers.cc:597] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:18.875138 31950 consensus_peers.cc:597] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.878708 32737 ts_tablet_manager.cc:1434] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 13:12:18.879938 32737 tablet_bootstrap.cc:492] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
W20260709 13:12:18.882309 32098 consensus_peers.cc:597] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.876341 31807 catalog_manager.cc:5697] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 2 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.894941 31983 raft_consensus.cc:1275] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer eacc546e751240eb804795d98213a57c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:18.901266 31950 consensus_peers.cc:597] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:18.924890 31806 catalog_manager.cc:5697] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 1 to 2, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.944646 32053 raft_consensus.cc:1275] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Refusing update from remote peer ab61be703111416d9fba543ea97b2224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:18.949155 32024 consensus_peers.cc:597] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:18.951104 32024 consensus_peers.cc:597] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:18.952292 32024 consensus_peers.cc:597] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:18.966100 31950 consensus_peers.cc:597] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:18.978976   344 consensus_queue.cc:1048] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:19.046835 32098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:45831, user_credentials={real_user=slave}} blocked reactor thread for 56648.9us
W20260709 13:12:19.060994 32024 consensus_peers.cc:597] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.096014   300 consensus_queue.cc:1048] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:19.099398 32732 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:19.101063   349 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:19.107851 32024 consensus_peers.cc:597] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.116636   349 raft_consensus.cc:2749] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:19.150007 32707 raft_consensus.cc:493] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.150775 32707 raft_consensus.cc:515] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:19.154353 32707 leader_election.cc:290] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:19.155192 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:19.156108 32056 raft_consensus.cc:2468] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 2.
I20260709 13:12:19.158035 31951 leader_election.cc:304] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:19.159822 32647 raft_consensus.cc:2804] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:19.160337 32647 raft_consensus.cc:493] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.160769 32647 raft_consensus.cc:3060] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.172492 32732 leader_election.cc:304] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:19.173995   339 raft_consensus.cc:493] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.174607   339 raft_consensus.cc:515] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.177285   339 leader_election.cc:290] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:19.177934   339 raft_consensus.cc:2749] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:19.180294 32056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:19.180398 32732 leader_election.cc:304] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:19.184741 32732 leader_election.cc:304] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:19.184937   339 raft_consensus.cc:2749] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:19.194515   339 raft_consensus.cc:3060] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.224077 32737 tablet_bootstrap.cc:492] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:12:19.226428 31950 consensus_peers.cc:597] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.185549 32098 consensus_peers.cc:597] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.233477 32098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 48004.9us
I20260709 13:12:19.187842 32647 raft_consensus.cc:515] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
W20260709 13:12:19.231109 31950 leader_election.cc:336] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:19.235997 32098 consensus_peers.cc:597] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.237660 32098 consensus_peers.cc:597] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.238368 32098 consensus_peers.cc:597] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.239094 32098 consensus_peers.cc:597] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.239653 32098 consensus_peers.cc:597] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.248152 32737 tablet_bootstrap.cc:492] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:19.249228 32647 leader_election.cc:290] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 3 election: Requested vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:19.249727 32737 ts_tablet_manager.cc:1403] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.370s	user 0.015s	sys 0.006s
I20260709 13:12:19.255219 32737 raft_consensus.cc:359] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:19.261427   339 raft_consensus.cc:2749] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:19.267140 32053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90689ee41da48e1bdcc50534b90c4b8" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:19.270146 32737 raft_consensus.cc:740] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.270319 32053 raft_consensus.cc:3060] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.271193 32737 consensus_queue.cc:260] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
W20260709 13:12:19.268987 32098 consensus_peers.cc:597] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.272550 32098 consensus_peers.cc:597] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.280505 32737 ts_tablet_manager.cc:1434] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:12:19.281666 32737 tablet_bootstrap.cc:492] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:19.284685 32053 raft_consensus.cc:2468] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 3.
I20260709 13:12:19.290076 31951 leader_election.cc:304] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:19.291074 32707 raft_consensus.cc:2804] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:19.291659 32707 raft_consensus.cc:697] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 3 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:19.292937 32707 consensus_queue.cc:237] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
W20260709 13:12:19.321321 31950 leader_election.cc:336] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:19.330083 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:19.353276 31807 catalog_manager.cc:5697] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 1 to 3, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 3 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.373323 32737 tablet_bootstrap.cc:492] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.373180 32732 leader_election.cc:304] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c
I20260709 13:12:19.374485 32737 tablet_bootstrap.cc:492] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:19.374614   339 raft_consensus.cc:2749] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:19.375279 32737 ts_tablet_manager.cc:1403] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.094s	user 0.019s	sys 0.003s
I20260709 13:12:19.378352 32737 raft_consensus.cc:359] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.392545 32737 raft_consensus.cc:740] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.403327 32737 consensus_queue.cc:260] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.406884 32737 ts_tablet_manager.cc:1434] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:12:19.406831 32751 raft_consensus.cc:493] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.407604 32751 raft_consensus.cc:515] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.408083 32737 tablet_bootstrap.cc:492] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:19.412261 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:19.413039 32128 raft_consensus.cc:2468] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 2.
I20260709 13:12:19.414961 32751 leader_election.cc:290] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:19.415369 32023 leader_election.cc:304] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:19.417394 32751 raft_consensus.cc:2804] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:19.417814 32751 raft_consensus.cc:493] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.418159 32751 raft_consensus.cc:3060] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:19.425787 32024 leader_election.cc:336] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:19.430546 32737 tablet_bootstrap.cc:492] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.431747 32737 tablet_bootstrap.cc:492] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:19.433713 32737 ts_tablet_manager.cc:1403] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.003s
I20260709 13:12:19.435716 32751 raft_consensus.cc:515] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.437017 32737 raft_consensus.cc:359] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.437839 32737 raft_consensus.cc:740] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.439149 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:19.439925 32128 raft_consensus.cc:3060] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.440845 32737 consensus_queue.cc:260] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.443636 32737 ts_tablet_manager.cc:1434] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:12:19.444593 32737 tablet_bootstrap.cc:492] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:19.452313 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.1:33269
I20260709 13:12:19.452489   425 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.1:33269 every 8 connection(s)
I20260709 13:12:19.453684 32751 leader_election.cc:290] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 3 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:19.460620 32128 raft_consensus.cc:2468] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 3.
I20260709 13:12:19.462286 32023 leader_election.cc:304] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:19.463510   346 raft_consensus.cc:2804] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:19.464314   346 raft_consensus.cc:697] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 3 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:19.465482   346 consensus_queue.cc:237] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.504918 32762 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.517433 32762 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.519658 32762 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:19.523525 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a" is_pre_election: true
I20260709 13:12:19.524578 32058 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 4.
I20260709 13:12:19.526449 32099 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:19.529835 32710 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:19.530738 32710 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.531656 32710 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:19.533231 31807 catalog_manager.cc:5697] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 1 to 3, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 3 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.586131 32710 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.588515 32710 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 5 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:19.589625 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:19.590350 32058 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:19.597968   388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325" is_pre_election: true
I20260709 13:12:19.598661 32058 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 5.
I20260709 13:12:19.598829   388 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 4.
I20260709 13:12:19.600102   383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfd4e6006ea4c7f9d4a960a1e0ffdc6" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:19.600476   384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "eacc546e751240eb804795d98213a57c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "936b035f23a5449fb43db3fd5f757325"
I20260709 13:12:19.600857 32099 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:19.601236   384 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:19.601742 32710 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:19.602247 32710 raft_consensus.cc:697] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 5 LEADER]: Becoming Leader. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:19.603133 32710 consensus_queue.cc:237] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:19.609208 32024 leader_election.cc:343] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.614087 32737 tablet_bootstrap.cc:492] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.615199 32737 tablet_bootstrap.cc:492] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:19.616197 32737 ts_tablet_manager.cc:1403] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.172s	user 0.013s	sys 0.008s
I20260709 13:12:19.617515   384 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eacc546e751240eb804795d98213a57c in term 5.
I20260709 13:12:19.619181 32737 raft_consensus.cc:359] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:19.619719 32737 raft_consensus.cc:740] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.620644 32737 consensus_queue.cc:260] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:19.623178 32737 ts_tablet_manager.cc:1434] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:19.624397 32737 tablet_bootstrap.cc:492] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:19.629935 31807 catalog_manager.cc:5697] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c reported cstate change: term changed from 3 to 5, leader changed from 936b035f23a5449fb43db3fd5f757325 (127.21.244.1) to eacc546e751240eb804795d98213a57c (127.21.244.4). New cstate: current_term: 5 leader_uuid: "eacc546e751240eb804795d98213a57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.669811   427 heartbeater.cc:344] Connected to a master server at 127.21.244.62:44861
I20260709 13:12:19.670267   427 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:19.670784 32737 tablet_bootstrap.cc:492] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.671231   427 heartbeater.cc:507] Master 127.21.244.62:44861 requested a full tablet report, sending...
I20260709 13:12:19.671893 32737 tablet_bootstrap.cc:492] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:19.672704 32737 ts_tablet_manager.cc:1403] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.003s
I20260709 13:12:19.675648 32737 raft_consensus.cc:359] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.676462 32737 raft_consensus.cc:740] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.678784 32737 consensus_queue.cc:260] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
W20260709 13:12:19.680619 32098 consensus_peers.cc:597] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.681115 32737 ts_tablet_manager.cc:1434] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:19.682189 32737 tablet_bootstrap.cc:492] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:19.701071 32737 tablet_bootstrap.cc:492] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.702095 32737 tablet_bootstrap.cc:492] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:19.702806 32737 ts_tablet_manager.cc:1403] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:12:19.705263 31807 ts_manager.cc:194] Re-registered known tserver with Master: 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:19.705375 32737 raft_consensus.cc:359] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:19.706269 32737 raft_consensus.cc:740] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.706975   381 raft_consensus.cc:3060] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.707021 32737 consensus_queue.cc:260] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:19.709954 32737 ts_tablet_manager.cc:1434] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:19.711045 32737 tablet_bootstrap.cc:492] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:19.756374   388 raft_consensus.cc:3060] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.760327 32737 tablet_bootstrap.cc:492] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.761420 32737 tablet_bootstrap.cc:492] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:19.762120 32737 ts_tablet_manager.cc:1403] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.023s
I20260709 13:12:19.764765 32737 raft_consensus.cc:359] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.765494 32737 raft_consensus.cc:740] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.766172 32737 consensus_queue.cc:260] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.768378 32737 ts_tablet_manager.cc:1434] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:19.769559 32737 tablet_bootstrap.cc:492] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:19.784932   388 raft_consensus.cc:1275] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Refusing update from remote peer ab61be703111416d9fba543ea97b2224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:19.788089   345 consensus_queue.cc:1048] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:19.800483 32053 raft_consensus.cc:1275] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Refusing update from remote peer ab61be703111416d9fba543ea97b2224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:19.802382 32737 tablet_bootstrap.cc:492] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.803670 32737 tablet_bootstrap.cc:492] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:19.804379 32737 ts_tablet_manager.cc:1403] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.035s	user 0.024s	sys 0.005s
I20260709 13:12:19.805333   345 consensus_queue.cc:1048] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:19.806746 31807 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51882
I20260709 13:12:19.806927 32737 raft_consensus.cc:359] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:19.807698 32737 raft_consensus.cc:740] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.812183   427 heartbeater.cc:499] Master 127.21.244.62:44861 was elected leader, sending a full tablet report...
I20260709 13:12:19.813421 32737 consensus_queue.cc:260] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:19.817159 32737 ts_tablet_manager.cc:1434] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 13:12:19.818027 32737 tablet_bootstrap.cc:492] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:19.822470   388 raft_consensus.cc:3060] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.825814   379 raft_consensus.cc:3060] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.876156   339 raft_consensus.cc:493] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eacc546e751240eb804795d98213a57c)
I20260709 13:12:19.876771   339 raft_consensus.cc:515] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:19.881770 31983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab61be703111416d9fba543ea97b2224" is_pre_election: true
I20260709 13:12:19.886487 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eacc546e751240eb804795d98213a57c" is_pre_election: true
I20260709 13:12:19.880595   339 leader_election.cc:290] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:19.888222 32732 leader_election.cc:304] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325; no voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c
I20260709 13:12:19.889163   450 raft_consensus.cc:2749] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:19.907469 32737 tablet_bootstrap.cc:492] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.908631 32737 tablet_bootstrap.cc:492] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:19.909520 32737 ts_tablet_manager.cc:1403] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.092s	user 0.031s	sys 0.044s
I20260709 13:12:19.912199 32737 raft_consensus.cc:359] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:19.912981 32737 raft_consensus.cc:740] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.913787 32737 consensus_queue.cc:260] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:19.915956 32737 ts_tablet_manager.cc:1434] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:19.916833 32737 tablet_bootstrap.cc:492] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:19.964529 32737 tablet_bootstrap.cc:492] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.965764 32737 tablet_bootstrap.cc:492] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:19.966523 32737 ts_tablet_manager.cc:1403] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.011s
I20260709 13:12:19.968578 32737 raft_consensus.cc:359] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.969252 32737 raft_consensus.cc:740] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.970019 32737 consensus_queue.cc:260] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:19.971980 32737 ts_tablet_manager.cc:1434] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:19.972672 32737 tablet_bootstrap.cc:492] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:19.995424 32737 tablet_bootstrap.cc:492] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:19.996269 32737 tablet_bootstrap.cc:492] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:19.996887 32737 ts_tablet_manager.cc:1403] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:12:19.999253 32737 raft_consensus.cc:359] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:19.999998 32737 raft_consensus.cc:740] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.000763 32737 consensus_queue.cc:260] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:20.003484 32737 ts_tablet_manager.cc:1434] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:20.004240 32737 tablet_bootstrap.cc:492] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:20.028609 32737 tablet_bootstrap.cc:492] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:20.029639 32737 tablet_bootstrap.cc:492] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:20.031351 32737 ts_tablet_manager.cc:1403] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 13:12:20.033380 32737 raft_consensus.cc:359] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:20.033952 32737 raft_consensus.cc:740] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.034866 32737 consensus_queue.cc:260] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:20.041116 32737 ts_tablet_manager.cc:1434] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 13:12:20.042049 32737 tablet_bootstrap.cc:492] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:20.072503   388 raft_consensus.cc:3060] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:20.096235 32128 raft_consensus.cc:1275] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Refusing update from remote peer 27177ca9073b4128b8844b7cb37db32a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:20.097263 32737 tablet_bootstrap.cc:492] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:20.097800 32751 consensus_queue.cc:1048] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.098457 32737 tablet_bootstrap.cc:492] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:20.099484 32737 ts_tablet_manager.cc:1403] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.058s	user 0.029s	sys 0.000s
I20260709 13:12:20.100067   384 raft_consensus.cc:3060] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:20.102828 32737 raft_consensus.cc:359] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:20.104206 32737 raft_consensus.cc:740] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.105047 32737 consensus_queue.cc:260] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:20.107036 32737 ts_tablet_manager.cc:1434] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:20.108018 32737 tablet_bootstrap.cc:492] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:20.127616   381 raft_consensus.cc:1275] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 5 FOLLOWER]: Refusing update from remote peer eacc546e751240eb804795d98213a57c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:20.145220 32762 consensus_queue.cc:1048] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:20.124039   384 raft_consensus.cc:1275] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Refusing update from remote peer 27177ca9073b4128b8844b7cb37db32a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:20.165067   346 consensus_queue.cc:1048] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:20.185660 32737 tablet_bootstrap.cc:492] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:20.187135 32737 tablet_bootstrap.cc:492] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:20.187829 32737 ts_tablet_manager.cc:1403] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.011s
I20260709 13:12:20.190366 32737 raft_consensus.cc:359] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:20.191177 32737 raft_consensus.cc:740] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.191919 32737 consensus_queue.cc:260] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:20.196125 32737 ts_tablet_manager.cc:1434] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:20.197101 32737 tablet_bootstrap.cc:492] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:20.210198 32058 raft_consensus.cc:1275] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 5 FOLLOWER]: Refusing update from remote peer eacc546e751240eb804795d98213a57c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:20.284091   465 consensus_queue.cc:1048] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:12:20.493368 32737 tablet_bootstrap.cc:492] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:20.510878 32737 tablet_bootstrap.cc:492] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
W20260709 13:12:20.514989 31950 consensus_peers.cc:597] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:20.520852 32737 ts_tablet_manager.cc:1403] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.324s	user 0.021s	sys 0.010s
I20260709 13:12:20.538890 32737 raft_consensus.cc:359] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:20.547178 32737 raft_consensus.cc:740] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.566896 32737 consensus_queue.cc:260] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:20.569314 32737 ts_tablet_manager.cc:1434] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.002s
I20260709 13:12:20.570552 32737 tablet_bootstrap.cc:492] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
W20260709 13:12:20.574168 32098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:45831, user_credentials={real_user=slave}} blocked reactor thread for 96121.2us
I20260709 13:12:20.758780   384 raft_consensus.cc:3060] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:20.842041 31950 consensus_peers.cc:597] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:20.949327 32737 tablet_bootstrap.cc:492] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:12:20.953398 32098 consensus_peers.cc:597] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:20.954728 32737 tablet_bootstrap.cc:492] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:20.956220 32737 ts_tablet_manager.cc:1403] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.386s	user 0.020s	sys 0.007s
W20260709 13:12:20.958683 32024 consensus_peers.cc:597] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:20.978533 32737 raft_consensus.cc:359] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:20.980001 32737 raft_consensus.cc:740] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.980937 32737 consensus_queue.cc:260] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:21.009086 32737 ts_tablet_manager.cc:1434] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.000s
I20260709 13:12:21.023156 32737 tablet_bootstrap.cc:492] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
W20260709 13:12:21.055693 32098 consensus_peers.cc:597] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:21.090548 32737 tablet_bootstrap.cc:492] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:12:21.091421 32098 consensus_peers.cc:597] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:21.092087 32737 tablet_bootstrap.cc:492] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.092799 32737 ts_tablet_manager.cc:1403] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.021s
I20260709 13:12:21.095129 32737 raft_consensus.cc:359] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:21.095774 32737 raft_consensus.cc:740] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.096481 32737 consensus_queue.cc:260] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:21.098559 32737 ts_tablet_manager.cc:1434] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:21.100069 32737 tablet_bootstrap.cc:492] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.122562 32737 tablet_bootstrap.cc:492] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.123586 32737 tablet_bootstrap.cc:492] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.124723 32737 ts_tablet_manager.cc:1403] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
W20260709 13:12:21.125317 31950 consensus_peers.cc:597] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:21.128839 32737 raft_consensus.cc:359] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:21.129488 32737 raft_consensus.cc:740] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.130157 32737 consensus_queue.cc:260] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:21.132349 32737 ts_tablet_manager.cc:1434] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:21.133693 32737 tablet_bootstrap.cc:492] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.158049 32737 tablet_bootstrap.cc:492] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.159543 32737 tablet_bootstrap.cc:492] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.160501 32737 ts_tablet_manager.cc:1403] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.003s
I20260709 13:12:21.163128 32737 raft_consensus.cc:359] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:21.163669 32737 raft_consensus.cc:740] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.164373 32737 consensus_queue.cc:260] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:21.166011 32737 ts_tablet_manager.cc:1434] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:21.166749 32737 tablet_bootstrap.cc:492] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
W20260709 13:12:21.190346 32098 consensus_peers.cc:597] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:21.193814 32737 tablet_bootstrap.cc:492] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.195003 32737 tablet_bootstrap.cc:492] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.195855 32737 ts_tablet_manager.cc:1403] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.007s
I20260709 13:12:21.198989 32737 raft_consensus.cc:359] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:21.199869 32737 raft_consensus.cc:740] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.200703 32737 consensus_queue.cc:260] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:21.203531 32737 ts_tablet_manager.cc:1434] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:21.205775 32737 tablet_bootstrap.cc:492] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.360271 32737 tablet_bootstrap.cc:492] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.361276 32737 tablet_bootstrap.cc:492] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.362035 32737 ts_tablet_manager.cc:1403] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.157s	user 0.026s	sys 0.024s
I20260709 13:12:21.391244   388 raft_consensus.cc:3060] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.442210 32737 raft_consensus.cc:359] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:21.443059 32737 raft_consensus.cc:740] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.448197 32737 consensus_queue.cc:260] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:21.454175 32737 ts_tablet_manager.cc:1434] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.092s	user 0.021s	sys 0.006s
I20260709 13:12:21.455129 32737 tablet_bootstrap.cc:492] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
W20260709 13:12:21.460070 31950 consensus_peers.cc:597] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:21.468580 31950 consensus_peers.cc:597] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:21.472272 31950 consensus_peers.cc:597] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:21.476197 31950 consensus_peers.cc:597] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:21.483469 32098 consensus_peers.cc:597] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:21.524752 32737 tablet_bootstrap.cc:492] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.525743 32737 tablet_bootstrap.cc:492] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.526387 32737 ts_tablet_manager.cc:1403] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.017s
I20260709 13:12:21.529172 32737 raft_consensus.cc:359] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:21.529886 32737 raft_consensus.cc:740] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.530670 32737 consensus_queue.cc:260] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:21.533088 32737 ts_tablet_manager.cc:1434] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:12:21.534245 32737 tablet_bootstrap.cc:492] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.578243 32737 tablet_bootstrap.cc:492] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.584136 32737 tablet_bootstrap.cc:492] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.584842 32737 ts_tablet_manager.cc:1403] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.006s
I20260709 13:12:21.587953 32737 raft_consensus.cc:359] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:21.588783 32737 raft_consensus.cc:740] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.589819 32737 consensus_queue.cc:260] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:21.596315 32737 ts_tablet_manager.cc:1434] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:12:21.597198 32737 tablet_bootstrap.cc:492] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.625581 32737 tablet_bootstrap.cc:492] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.626811 32737 tablet_bootstrap.cc:492] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.627543 32737 ts_tablet_manager.cc:1403] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.015s
I20260709 13:12:21.630340 32737 raft_consensus.cc:359] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:21.631322 32737 raft_consensus.cc:740] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.632089 32737 consensus_queue.cc:260] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:21.634169 32737 ts_tablet_manager.cc:1434] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:21.636327 32737 tablet_bootstrap.cc:492] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.653499 32737 tablet_bootstrap.cc:492] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.654672 32737 tablet_bootstrap.cc:492] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.655478 32737 ts_tablet_manager.cc:1403] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:12:21.658231 32737 raft_consensus.cc:359] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:21.659072 32737 raft_consensus.cc:740] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.659849 32737 consensus_queue.cc:260] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:21.662245 32737 ts_tablet_manager.cc:1434] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:21.663689 32737 tablet_bootstrap.cc:492] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.690953 32737 tablet_bootstrap.cc:492] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.691992 32737 tablet_bootstrap.cc:492] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.692685 32737 ts_tablet_manager.cc:1403] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 13:12:21.695201 32737 raft_consensus.cc:359] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:21.695896 32737 raft_consensus.cc:740] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.696627 32737 consensus_queue.cc:260] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:21.698518 32737 ts_tablet_manager.cc:1434] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:12:21.703275 32737 tablet_bootstrap.cc:492] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.716840   388 raft_consensus.cc:3060] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.730540 32737 tablet_bootstrap.cc:492] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.731719 32737 tablet_bootstrap.cc:492] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.732411 32737 ts_tablet_manager.cc:1403] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.012s
I20260709 13:12:21.735193 32737 raft_consensus.cc:359] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:21.735935 32737 raft_consensus.cc:740] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.736667 32737 consensus_queue.cc:260] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:21.738960 32737 ts_tablet_manager.cc:1434] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:12:21.739951 32737 tablet_bootstrap.cc:492] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.753971   388 raft_consensus.cc:3060] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.760010 32737 tablet_bootstrap.cc:492] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.761114 32737 tablet_bootstrap.cc:492] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.761802 32737 ts_tablet_manager.cc:1403] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:12:21.764575 32737 raft_consensus.cc:359] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:21.765295 32737 raft_consensus.cc:740] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.766016 32737 consensus_queue.cc:260] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:21.768420 32737 ts_tablet_manager.cc:1434] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:21.769487 32737 tablet_bootstrap.cc:492] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.804142 32737 tablet_bootstrap.cc:492] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.804966 32737 tablet_bootstrap.cc:492] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.805657 32737 ts_tablet_manager.cc:1403] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.012s
I20260709 13:12:21.808099 32737 raft_consensus.cc:359] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:21.808775 32737 raft_consensus.cc:740] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.809548 32737 consensus_queue.cc:260] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:21.811445 32737 ts_tablet_manager.cc:1434] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:21.812371 32737 tablet_bootstrap.cc:492] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.836164 32737 tablet_bootstrap.cc:492] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.836946 32737 tablet_bootstrap.cc:492] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.837579 32737 ts_tablet_manager.cc:1403] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:12:21.839466 32737 raft_consensus.cc:359] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:21.840103 32737 raft_consensus.cc:740] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.840684 32737 consensus_queue.cc:260] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:21.842705 32737 ts_tablet_manager.cc:1434] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:21.843617 32737 tablet_bootstrap.cc:492] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325: Bootstrap starting.
I20260709 13:12:21.861888   384 raft_consensus.cc:3060] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.895347 32737 tablet_bootstrap.cc:492] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:21.897114 32737 tablet_bootstrap.cc:492] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325: Bootstrap complete.
I20260709 13:12:21.898517 32737 ts_tablet_manager.cc:1403] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325: Time spent bootstrapping tablet: real 0.055s	user 0.029s	sys 0.020s
I20260709 13:12:21.902284 32737 raft_consensus.cc:359] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:21.903191 32737 raft_consensus.cc:740] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Initialized, Role: FOLLOWER
I20260709 13:12:21.904187 32737 consensus_queue.cc:260] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:21.906800 32737 ts_tablet_manager.cc:1434] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:22.024775   384 raft_consensus.cc:3060] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.063392   379 raft_consensus.cc:3060] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:22.171438   379 raft_consensus.cc:3060] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.541831 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:29.609042 31984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca"
dest_uuid: "ab61be703111416d9fba543ea97b2224"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:36466
I20260709 13:12:29.609702 31984 raft_consensus.cc:606] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:29.622460 32131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ae250d6acb34e1692cfe5ab3cce75ca"
dest_uuid: "eacc546e751240eb804795d98213a57c"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:49830
I20260709 13:12:29.623077 32131 raft_consensus.cc:606] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:29.626791 31984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "762054515f9846129075d921ceefcd1f"
dest_uuid: "ab61be703111416d9fba543ea97b2224"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:36466
I20260709 13:12:29.627374 31984 raft_consensus.cc:606] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:29.630873 31984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd"
dest_uuid: "ab61be703111416d9fba543ea97b2224"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:36466
I20260709 13:12:29.631481 31984 raft_consensus.cc:606] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:29.635164 31979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be53aa47c89a49dd98dd5050d875c00e"
dest_uuid: "ab61be703111416d9fba543ea97b2224"
mode: GRACEFUL
new_leader_uuid: "27177ca9073b4128b8844b7cb37db32a"
 from {username='slave'} at 127.0.0.1:36466
I20260709 13:12:29.635878 31979 raft_consensus.cc:606] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Received request to transfer leadership to TS 27177ca9073b4128b8844b7cb37db32a
I20260709 13:12:29.638630 31979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025"
dest_uuid: "ab61be703111416d9fba543ea97b2224"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:36466
I20260709 13:12:29.639110 31979 raft_consensus.cc:606] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:29.640857 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:29.642882 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:29.732640   534 raft_consensus.cc:993] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:29.733249   534 raft_consensus.cc:1081] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:29.735509   384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ae250d6acb34e1692cfe5ab3cce75ca"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47012
I20260709 13:12:29.736395   384 raft_consensus.cc:493] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.736984   384 raft_consensus.cc:3060] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.745428   384 raft_consensus.cc:515] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:29.748405   384 leader_election.cc:290] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:29.748781   531 raft_consensus.cc:993] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:29.748410 32050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae250d6acb34e1692cfe5ab3cce75ca" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:29.749351 32050 raft_consensus.cc:3060] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.750306   539 raft_consensus.cc:1081] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:29.756239 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae250d6acb34e1692cfe5ab3cce75ca" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:29.758473   388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47006
I20260709 13:12:29.758960 32050 raft_consensus.cc:2468] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:29.759135   388 raft_consensus.cc:493] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.759553   388 raft_consensus.cc:3060] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.758329 32131 raft_consensus.cc:3055] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:29.760345 32131 raft_consensus.cc:740] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:29.760390 32734 leader_election.cc:304] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:29.761212 32131 consensus_queue.cc:260] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:29.762671 32131 raft_consensus.cc:3060] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.763037   541 raft_consensus.cc:2804] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:29.769371   388 raft_consensus.cc:515] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:29.770329 32131 raft_consensus.cc:2468] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:29.772084   388 leader_election.cc:290] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:29.773939 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:29.774235   541 raft_consensus.cc:697] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:29.774631 31979 raft_consensus.cc:3055] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:29.774837 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc46a6c3f474cacfa16b058f035cd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:29.775491 32131 raft_consensus.cc:3060] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.775255 31979 raft_consensus.cc:740] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:29.776966 31979 consensus_queue.cc:260] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:29.775242   541 consensus_queue.cc:237] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:29.778267 31979 raft_consensus.cc:3060] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.783870 32131 raft_consensus.cc:2468] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 3.
I20260709 13:12:29.785184 32732 leader_election.cc:304] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:29.787118   542 raft_consensus.cc:2804] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:29.787987 31979 raft_consensus.cc:2468] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 3.
I20260709 13:12:29.790287   540 raft_consensus.cc:993] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:29.792002   542 raft_consensus.cc:697] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:29.792311   533 raft_consensus.cc:1081] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:29.793102   542 consensus_queue.cc:237] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:29.794082   384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "762054515f9846129075d921ceefcd1f"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47006
I20260709 13:12:29.797029   384 raft_consensus.cc:493] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.797499   384 raft_consensus.cc:3060] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.800117 31808 catalog_manager.cc:5697] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 1 to 2, leader changed from eacc546e751240eb804795d98213a57c (127.21.244.4) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:29.805743   384 raft_consensus.cc:515] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:29.808007   384 leader_election.cc:290] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:29.809414 32050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762054515f9846129075d921ceefcd1f" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:29.810232 32050 raft_consensus.cc:3060] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.812772 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762054515f9846129075d921ceefcd1f" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:29.813939 31979 raft_consensus.cc:3055] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:29.814271 31979 raft_consensus.cc:740] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:29.815059 31979 consensus_queue.cc:260] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:29.816635 31979 raft_consensus.cc:3060] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.821249 32050 raft_consensus.cc:2468] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:29.822589 32734 leader_election.cc:304] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:29.823395   542 raft_consensus.cc:2804] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:29.823900   542 raft_consensus.cc:697] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:29.824707   542 consensus_queue.cc:237] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:29.825496 31979 raft_consensus.cc:2468] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:29.832357 31808 catalog_manager.cc:5697] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 2 to 3, leader changed from ab61be703111416d9fba543ea97b2224 (127.21.244.2) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:29.847937 31808 catalog_manager.cc:5697] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 1 to 2, leader changed from ab61be703111416d9fba543ea97b2224 (127.21.244.2) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:29.875543   540 raft_consensus.cc:993] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224: : Instructing follower 27177ca9073b4128b8844b7cb37db32a to start an election
I20260709 13:12:29.876183   539 raft_consensus.cc:1081] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Signalling peer 27177ca9073b4128b8844b7cb37db32a to start an election
I20260709 13:12:29.877615 32050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be53aa47c89a49dd98dd5050d875c00e"
dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
 from {username='slave'} at 127.0.0.1:39598
I20260709 13:12:29.878111 32050 raft_consensus.cc:493] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.878477 32050 raft_consensus.cc:3060] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.883715 32050 raft_consensus.cc:515] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:29.885661 32050 leader_election.cc:290] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:29.886425 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be53aa47c89a49dd98dd5050d875c00e" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:29.886737 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be53aa47c89a49dd98dd5050d875c00e" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:29.887261 31979 raft_consensus.cc:3055] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:29.887344 32131 raft_consensus.cc:3060] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.887568 31979 raft_consensus.cc:740] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:29.888514 31979 consensus_queue.cc:260] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:29.889488 31979 raft_consensus.cc:3060] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.893767 32131 raft_consensus.cc:2468] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 2.
I20260709 13:12:29.895207 32023 leader_election.cc:304] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:29.896096   346 raft_consensus.cc:2804] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:29.896169 31979 raft_consensus.cc:2468] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 2.
I20260709 13:12:29.896653   346 raft_consensus.cc:697] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 2 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:29.897482   346 consensus_queue.cc:237] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:29.907568 31808 catalog_manager.cc:5697] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 1 to 2, leader changed from ab61be703111416d9fba543ea97b2224 (127.21.244.2) to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 2 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.002118   539 raft_consensus.cc:993] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:30.002784   533 raft_consensus.cc:1081] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:30.004487   384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47006
I20260709 13:12:30.005004   384 raft_consensus.cc:493] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:30.005357   384 raft_consensus.cc:3060] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:30.010951   384 raft_consensus.cc:515] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:30.012643   384 leader_election.cc:290] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:30.013513 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:30.013545 32050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58378bb5379a40ed94b3726a99108cca" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:30.014120 31979 raft_consensus.cc:3055] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:30.014420 31979 raft_consensus.cc:740] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:30.014428 32050 raft_consensus.cc:3060] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:30.015190 31979 consensus_queue.cc:260] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:30.016149 31979 raft_consensus.cc:3060] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:30.020431 32050 raft_consensus.cc:2468] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:30.021643 32734 leader_election.cc:304] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:30.021929 31979 raft_consensus.cc:2468] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:30.022527   542 raft_consensus.cc:2804] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:30.023011   542 raft_consensus.cc:697] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:30.023914   542 consensus_queue.cc:237] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:30.034065 31808 catalog_manager.cc:5697] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 1 to 2, leader changed from ab61be703111416d9fba543ea97b2224 (127.21.244.2) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.135511   540 raft_consensus.cc:993] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:30.136226   539 raft_consensus.cc:1081] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:30.138545   384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47006
I20260709 13:12:30.139189   384 raft_consensus.cc:493] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:30.139624   384 raft_consensus.cc:3060] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:30.146193   384 raft_consensus.cc:515] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:30.148435   384 leader_election.cc:290] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:30.149102 32131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:30.149807 32131 raft_consensus.cc:3060] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:30.149773 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f82695c4f13842c1a0e66c48751f9025" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:30.150462 31979 raft_consensus.cc:3055] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:30.150794 31979 raft_consensus.cc:740] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:30.151530 31979 consensus_queue.cc:260] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:30.152676 31979 raft_consensus.cc:3060] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:30.155565 32131 raft_consensus.cc:2468] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:30.156946 32732 leader_election.cc:304] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:30.157694   542 raft_consensus.cc:2804] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:30.157996 31979 raft_consensus.cc:2468] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:30.158217   542 raft_consensus.cc:697] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:30.159210   542 consensus_queue.cc:237] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:30.165755 32131 raft_consensus.cc:1275] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.167259   542 consensus_queue.cc:1048] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:30.169981 31808 catalog_manager.cc:5697] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 1 to 2, leader changed from ab61be703111416d9fba543ea97b2224 (127.21.244.2) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.176256 31979 raft_consensus.cc:1275] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:30.178160   542 consensus_queue.cc:1048] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:30.248318 31984 raft_consensus.cc:1275] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.250257   542 consensus_queue.cc:1048] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:30.267671 32732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 77956.4us
I20260709 13:12:30.270278 32131 raft_consensus.cc:1275] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:30.292907   542 consensus_queue.cc:1048] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:30.343637 32050 raft_consensus.cc:1275] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.345361 32058 raft_consensus.cc:1275] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:30.345988 32023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.4:43793, user_credentials={real_user=slave}} blocked reactor thread for 45296.5us
I20260709 13:12:30.348788   544 consensus_queue.cc:1048] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:30.352532   544 consensus_queue.cc:1048] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.424721 32128 raft_consensus.cc:1275] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer 27177ca9073b4128b8844b7cb37db32a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.438498   346 consensus_queue.cc:1048] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:30.445870 32098 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:33269, user_credentials={real_user=slave}} blocked reactor thread for 76007.5us
I20260709 13:12:30.483668 31983 raft_consensus.cc:1275] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.487720 31983 raft_consensus.cc:1275] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer 27177ca9073b4128b8844b7cb37db32a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.487666   542 consensus_queue.cc:1048] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:30.494686   553 consensus_queue.cc:1048] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:30.517055 32052 raft_consensus.cc:1275] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.520952   542 consensus_queue.cc:1048] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:30.644204 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:30.651479 32130 raft_consensus.cc:1275] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.653246   542 consensus_queue.cc:1048] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.673688 31981 raft_consensus.cc:1275] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.677716   560 consensus_queue.cc:1048] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:30.706952 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:30.749519 31981 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb"
dest_uuid: "ab61be703111416d9fba543ea97b2224"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:36466
I20260709 13:12:30.750385 31981 raft_consensus.cc:606] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:30.753458 32130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247"
dest_uuid: "eacc546e751240eb804795d98213a57c"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:49830
I20260709 13:12:30.754124 32130 raft_consensus.cc:606] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:30.757135 32130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a"
dest_uuid: "eacc546e751240eb804795d98213a57c"
mode: GRACEFUL
new_leader_uuid: "27177ca9073b4128b8844b7cb37db32a"
 from {username='slave'} at 127.0.0.1:49830
I20260709 13:12:30.757711 32130 raft_consensus.cc:606] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Received request to transfer leadership to TS 27177ca9073b4128b8844b7cb37db32a
I20260709 13:12:30.805496 31984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaedd9866a6e4923a483d1268ac000ea"
dest_uuid: "ab61be703111416d9fba543ea97b2224"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:36466
I20260709 13:12:30.808316 31984 raft_consensus.cc:606] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:30.863929 32128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd"
dest_uuid: "eacc546e751240eb804795d98213a57c"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:49830
I20260709 13:12:30.864938 32128 raft_consensus.cc:606] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:30.870118 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:30.936631 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:30.977056   539 raft_consensus.cc:993] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:30.980865   540 raft_consensus.cc:1081] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:30.984157   378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaedd9866a6e4923a483d1268ac000ea"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47006
I20260709 13:12:30.985134   378 raft_consensus.cc:493] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:30.985744   378 raft_consensus.cc:3060] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.002719   378 raft_consensus.cc:515] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:31.025246   378 leader_election.cc:290] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:31.026675 32053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaedd9866a6e4923a483d1268ac000ea" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:31.027189 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaedd9866a6e4923a483d1268ac000ea" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:31.027937 31979 raft_consensus.cc:3055] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:31.028292 31979 raft_consensus.cc:740] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:31.029266 31979 consensus_queue.cc:260] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:31.030858 31979 raft_consensus.cc:3060] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.031653   532 raft_consensus.cc:993] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:31.033448   532 raft_consensus.cc:1081] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:31.043597   379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47012
I20260709 13:12:31.044279   379 raft_consensus.cc:493] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.044677   379 raft_consensus.cc:3060] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.047379 31979 raft_consensus.cc:2468] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:31.049072 32733 leader_election.cc:304] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 27177ca9073b4128b8844b7cb37db32a
I20260709 13:12:31.050382   560 raft_consensus.cc:2804] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:31.051031   560 raft_consensus.cc:697] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:31.052323   560 consensus_queue.cc:237] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:31.053411   379 raft_consensus.cc:515] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:31.055626   379 leader_election.cc:290] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:31.056926 32051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:31.057241 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e0ed9b586e440c98baa7861469e247" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:31.058007 32128 raft_consensus.cc:3055] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:31.058017 32051 raft_consensus.cc:3060] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.058550 32128 raft_consensus.cc:740] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:31.059939 32128 consensus_queue.cc:260] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:31.062244 32128 raft_consensus.cc:3060] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.062551   532 raft_consensus.cc:993] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c: : Instructing follower 27177ca9073b4128b8844b7cb37db32a to start an election
I20260709 13:12:31.063441   535 raft_consensus.cc:1081] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Signalling peer 27177ca9073b4128b8844b7cb37db32a to start an election
I20260709 13:12:31.066695 32058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a"
dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
 from {username='slave'} at 127.0.0.1:39616
I20260709 13:12:31.067344 32058 raft_consensus.cc:493] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.067898 32058 raft_consensus.cc:3060] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.071651 32051 raft_consensus.cc:2468] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 3.
I20260709 13:12:31.075065 32734 leader_election.cc:304] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:31.076215   560 raft_consensus.cc:2804] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:31.076833   560 raft_consensus.cc:697] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:31.078001   560 consensus_queue.cc:237] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:31.079680 32058 raft_consensus.cc:515] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:31.083709   559 raft_consensus.cc:993] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:31.082525 31808 catalog_manager.cc:5697] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 1 to 2, leader changed from ab61be703111416d9fba543ea97b2224 (127.21.244.2) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:31.084359   559 raft_consensus.cc:1081] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:31.086517   379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47012
I20260709 13:12:31.087109 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:31.087903 32130 raft_consensus.cc:3055] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:31.088222 32130 raft_consensus.cc:740] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:31.089157 32130 consensus_queue.cc:260] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:31.090401 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68212da6ed34d7ca6eada16ee48977a" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:31.092020 32130 raft_consensus.cc:3060] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.092521 32128 raft_consensus.cc:2468] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 3.
I20260709 13:12:31.087211   379 raft_consensus.cc:493] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.094357   379 raft_consensus.cc:3060] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.091346 31981 raft_consensus.cc:3060] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.105361   379 raft_consensus.cc:515] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:31.107834 32058 leader_election.cc:290] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:31.109995 32130 raft_consensus.cc:2468] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 2.
I20260709 13:12:31.114737 32023 leader_election.cc:304] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:31.115834   346 raft_consensus.cc:2804] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:31.116401   346 raft_consensus.cc:697] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 2 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:31.117393   346 consensus_queue.cc:237] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:31.117712 31981 raft_consensus.cc:2468] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 2.
I20260709 13:12:31.121196 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:31.121937 32128 raft_consensus.cc:3055] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:31.122268 32128 raft_consensus.cc:740] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:31.122184 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4d256597f64c68b23aefc1246fefcd" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:31.120313   379 leader_election.cc:290] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:31.123404 31984 raft_consensus.cc:3060] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.123417 32128 consensus_queue.cc:260] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:31.152452 32128 raft_consensus.cc:3060] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.153012 31984 raft_consensus.cc:2468] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 3.
I20260709 13:12:31.157601 32733 leader_election.cc:304] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:31.158759   560 raft_consensus.cc:2804] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:31.159420   560 raft_consensus.cc:697] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:31.160651   560 consensus_queue.cc:237] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:31.165324 32128 raft_consensus.cc:2468] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 3.
I20260709 13:12:31.169518 31807 catalog_manager.cc:5697] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 1 to 2, leader changed from eacc546e751240eb804795d98213a57c (127.21.244.4) to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 2 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.184010 31808 catalog_manager.cc:5697] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 2 to 3, leader changed from eacc546e751240eb804795d98213a57c (127.21.244.4) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:31.185570 31808 catalog_manager.cc:5697] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 2 to 3, leader changed from eacc546e751240eb804795d98213a57c (127.21.244.4) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.311024   540 raft_consensus.cc:993] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:31.311671   540 raft_consensus.cc:1081] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:31.313369   379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47006
I20260709 13:12:31.313987   379 raft_consensus.cc:493] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.314321   379 raft_consensus.cc:3060] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.319862   379 raft_consensus.cc:515] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:31.322708 31984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:31.323004 32053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af6353e4b694dc58ca636af51b7f1eb" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:31.321936   379 leader_election.cc:290] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161)
I20260709 13:12:31.323630 32053 raft_consensus.cc:3060] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.325778 31984 raft_consensus.cc:3055] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:31.326192 31984 raft_consensus.cc:740] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:31.327541 31984 consensus_queue.cc:260] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:31.330210 31984 raft_consensus.cc:3060] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.333899 32053 raft_consensus.cc:2468] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 3.
I20260709 13:12:31.335141 32734 leader_election.cc:304] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:31.336035   560 raft_consensus.cc:2804] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:31.336943   560 raft_consensus.cc:697] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:31.337873   560 consensus_queue.cc:237] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } }
I20260709 13:12:31.339147 31984 raft_consensus.cc:2468] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 3.
I20260709 13:12:31.348829 31808 catalog_manager.cc:5697] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 2 to 3, leader changed from ab61be703111416d9fba543ea97b2224 (127.21.244.2) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.498852 32053 raft_consensus.cc:3060] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.507761 32053 raft_consensus.cc:1275] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:31.509250   560 consensus_queue.cc:1048] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:31.526403 31984 raft_consensus.cc:1275] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:31.528264   560 consensus_queue.cc:1048] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:31.573195 32128 raft_consensus.cc:1275] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.575093   560 consensus_queue.cc:1048] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:31.585989 31979 raft_consensus.cc:1275] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.588358   541 consensus_queue.cc:1048] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:31.599381 32130 raft_consensus.cc:1275] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer 27177ca9073b4128b8844b7cb37db32a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:31.600610 32058 raft_consensus.cc:1275] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.601114   553 consensus_queue.cc:1048] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:31.605952   560 consensus_queue.cc:1048] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:12:31.618698 31979 raft_consensus.cc:1275] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer 27177ca9073b4128b8844b7cb37db32a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:31.629099   520 consensus_queue.cc:1048] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:31.632580 32130 raft_consensus.cc:1275] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.634891   544 consensus_queue.cc:1048] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:31.744603 32058 raft_consensus.cc:1275] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.746073   560 consensus_queue.cc:1048] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.758966 31979 raft_consensus.cc:1275] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.760761   544 consensus_queue.cc:1048] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.977248 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:32.027506 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:32.071511 32128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c4dd4a38fc647e3a2ad4a953c649261"
dest_uuid: "eacc546e751240eb804795d98213a57c"
mode: GRACEFUL
new_leader_uuid: "27177ca9073b4128b8844b7cb37db32a"
 from {username='slave'} at 127.0.0.1:49830
I20260709 13:12:32.072162 32128 raft_consensus.cc:606] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Received request to transfer leadership to TS 27177ca9073b4128b8844b7cb37db32a
I20260709 13:12:32.074965 32128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe"
dest_uuid: "eacc546e751240eb804795d98213a57c"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:49830
I20260709 13:12:32.075487 32128 raft_consensus.cc:606] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:32.078083 32128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d6829450035496cad51a237b822114a"
dest_uuid: "eacc546e751240eb804795d98213a57c"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:49830
I20260709 13:12:32.078583 32128 raft_consensus.cc:606] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:32.081291 32128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6"
dest_uuid: "eacc546e751240eb804795d98213a57c"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:49830
I20260709 13:12:32.081844 32128 raft_consensus.cc:606] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 5 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:32.084951 32128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046"
dest_uuid: "eacc546e751240eb804795d98213a57c"
mode: GRACEFUL
new_leader_uuid: "27177ca9073b4128b8844b7cb37db32a"
 from {username='slave'} at 127.0.0.1:49830
I20260709 13:12:32.085472 32128 raft_consensus.cc:606] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Received request to transfer leadership to TS 27177ca9073b4128b8844b7cb37db32a
I20260709 13:12:32.086653 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:32.088675 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:32.123780   534 raft_consensus.cc:993] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:32.124388   559 raft_consensus.cc:1081] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:32.126112   384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d6829450035496cad51a237b822114a"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47012
I20260709 13:12:32.126613   384 raft_consensus.cc:493] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:32.126966   384 raft_consensus.cc:3060] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.132712   384 raft_consensus.cc:515] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:32.134732   384 leader_election.cc:290] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:32.138078 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6829450035496cad51a237b822114a" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:32.138710 31979 raft_consensus.cc:3060] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.139458 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6829450035496cad51a237b822114a" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:32.140245 32128 raft_consensus.cc:3055] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:32.140566 32128 raft_consensus.cc:740] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:32.141402 32128 consensus_queue.cc:260] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:32.142776 32128 raft_consensus.cc:3060] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.152544 32128 raft_consensus.cc:2468] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 3.
I20260709 13:12:32.153451   534 raft_consensus.cc:993] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c: : Instructing follower 27177ca9073b4128b8844b7cb37db32a to start an election
I20260709 13:12:32.154052   559 raft_consensus.cc:1081] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Signalling peer 27177ca9073b4128b8844b7cb37db32a to start an election
I20260709 13:12:32.149529 31979 raft_consensus.cc:2468] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 3.
I20260709 13:12:32.156021 32733 leader_election.cc:304] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:32.157500   541 raft_consensus.cc:2804] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:32.157388 32053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046"
dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
 from {username='slave'} at 127.0.0.1:39616
I20260709 13:12:32.158129   541 raft_consensus.cc:697] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:32.158820 32053 raft_consensus.cc:493] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:32.159268 32053 raft_consensus.cc:3060] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.159412   541 consensus_queue.cc:237] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:32.167470 32053 raft_consensus.cc:515] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:32.170871 32053 leader_election.cc:290] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:32.172345 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:32.172411 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b358dd69e0a54cdf8e94474ade4e7046" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:32.173038 32128 raft_consensus.cc:3055] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:32.173103 31979 raft_consensus.cc:3060] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.173401 32128 raft_consensus.cc:740] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:32.174132 31808 catalog_manager.cc:5697] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 2 to 3, leader changed from eacc546e751240eb804795d98213a57c (127.21.244.4) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 3 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.175421 32128 consensus_queue.cc:260] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:32.176936 32128 raft_consensus.cc:3060] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.180507 31979 raft_consensus.cc:2468] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 2.
I20260709 13:12:32.181964 32024 leader_election.cc:304] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:32.183430   553 raft_consensus.cc:2804] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:32.183972   553 raft_consensus.cc:697] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 2 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:32.184836 32128 raft_consensus.cc:2468] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 2.
I20260709 13:12:32.185030   553 consensus_queue.cc:237] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:32.198303 31808 catalog_manager.cc:5697] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 1 to 2, leader changed from eacc546e751240eb804795d98213a57c (127.21.244.4) to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 2 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.257987   559 raft_consensus.cc:993] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c: : Instructing follower 27177ca9073b4128b8844b7cb37db32a to start an election
I20260709 13:12:32.258634   535 raft_consensus.cc:1081] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Signalling peer 27177ca9073b4128b8844b7cb37db32a to start an election
I20260709 13:12:32.260445 32053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c4dd4a38fc647e3a2ad4a953c649261"
dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
 from {username='slave'} at 127.0.0.1:39616
I20260709 13:12:32.260975 32053 raft_consensus.cc:493] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:32.261333 32053 raft_consensus.cc:3060] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.267659 32053 raft_consensus.cc:515] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:32.269371 32053 leader_election.cc:290] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Requested vote from peers ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:32.269963 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c4dd4a38fc647e3a2ad4a953c649261" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:32.270519 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c4dd4a38fc647e3a2ad4a953c649261" candidate_uuid: "27177ca9073b4128b8844b7cb37db32a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:32.270659 31979 raft_consensus.cc:3060] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.271116 32128 raft_consensus.cc:3055] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:32.271677 32128 raft_consensus.cc:740] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:32.272516 32128 consensus_queue.cc:260] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:32.273754 32128 raft_consensus.cc:3060] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.276921 31979 raft_consensus.cc:2468] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 2.
I20260709 13:12:32.278059 32024 leader_election.cc:304] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:32.278944   346 raft_consensus.cc:2804] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:32.279366   346 raft_consensus.cc:697] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 2 LEADER]: Becoming Leader. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:32.280226   346 consensus_queue.cc:237] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:32.281565 32128 raft_consensus.cc:2468] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27177ca9073b4128b8844b7cb37db32a in term 2.
I20260709 13:12:32.290787 31808 catalog_manager.cc:5697] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a reported cstate change: term changed from 1 to 2, leader changed from eacc546e751240eb804795d98213a57c (127.21.244.4) to 27177ca9073b4128b8844b7cb37db32a (127.21.244.3). New cstate: current_term: 2 leader_uuid: "27177ca9073b4128b8844b7cb37db32a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.331208   559 raft_consensus.cc:993] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:32.331691   535 raft_consensus.cc:1081] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 5 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:32.333290   384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47012
I20260709 13:12:32.333843   384 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:32.334179   384 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:32.341161   384 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:32.343590 32053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:32.344250 32053 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:32.344446   384 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 6 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:32.345538 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4c0d34f8964520b2dfcb86f12a18b6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:32.346145 32128 raft_consensus.cc:3055] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:32.346447 32128 raft_consensus.cc:740] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:32.347249 32128 consensus_queue.cc:260] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:32.348301 32128 raft_consensus.cc:3060] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:32.352538 32053 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 6.
I20260709 13:12:32.355439 32734 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:32.356385   541 raft_consensus.cc:2804] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:32.356900   541 raft_consensus.cc:697] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 6 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:32.357775   541 consensus_queue.cc:237] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:32.372100 32128 raft_consensus.cc:2468] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 6.
I20260709 13:12:32.381353 31808 catalog_manager.cc:5697] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 5 to 6, leader changed from eacc546e751240eb804795d98213a57c (127.21.244.4) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 6 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:32.399825   535 raft_consensus.cc:993] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:32.400475   535 raft_consensus.cc:1081] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:32.402712   379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47012
I20260709 13:12:32.403333   379 raft_consensus.cc:493] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:32.403779   379 raft_consensus.cc:3060] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.409055   379 raft_consensus.cc:515] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:32.410744   379 leader_election.cc:290] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:32.411617 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:32.411844 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b78e7c3d1417b8b4035b246334cbe" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:32.412408 32058 raft_consensus.cc:3060] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.412490 32128 raft_consensus.cc:3055] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:32.412987 32128 raft_consensus.cc:740] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:32.413707 32128 consensus_queue.cc:260] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:32.414924 32128 raft_consensus.cc:3060] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.417557 32058 raft_consensus.cc:2468] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:32.418638 32734 leader_election.cc:304] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325; no voters: 
I20260709 13:12:32.419359   541 raft_consensus.cc:2804] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:32.420092   541 raft_consensus.cc:697] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:32.420672 32128 raft_consensus.cc:2468] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:32.421938   541 consensus_queue.cc:237] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:32.431857 31808 catalog_manager.cc:5697] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 1 to 2, leader changed from eacc546e751240eb804795d98213a57c (127.21.244.4) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:32.611959 32128 raft_consensus.cc:1275] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:32.613385   541 consensus_queue.cc:1048] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:32.647050 31984 raft_consensus.cc:1275] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:32.648690   560 consensus_queue.cc:1048] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:32.654027 31979 raft_consensus.cc:1275] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer 27177ca9073b4128b8844b7cb37db32a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.663076   553 consensus_queue.cc:1048] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:32.682279 32128 raft_consensus.cc:1275] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer 27177ca9073b4128b8844b7cb37db32a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.683698   613 consensus_queue.cc:1048] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:32.702567 31979 raft_consensus.cc:1275] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer 27177ca9073b4128b8844b7cb37db32a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.704281   553 consensus_queue.cc:1048] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:32.720825 32128 raft_consensus.cc:1275] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer 27177ca9073b4128b8844b7cb37db32a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.722052   613 consensus_queue.cc:1048] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:32.852056 32128 raft_consensus.cc:1275] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 6 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:32.853271   541 consensus_queue.cc:1048] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:32.867892 32058 raft_consensus.cc:1275] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 6 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:32.869581   560 consensus_queue.cc:1048] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:32.907980 32058 raft_consensus.cc:1275] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.909431   560 consensus_queue.cc:1048] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:32.927083 32128 raft_consensus.cc:1275] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.928565   544 consensus_queue.cc:1048] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:33.089537 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:33.135340 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:33.168572 32128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0"
dest_uuid: "eacc546e751240eb804795d98213a57c"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:49830
I20260709 13:12:33.169199 32128 raft_consensus.cc:606] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:33.196045 32058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46"
dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
mode: GRACEFUL
new_leader_uuid: "ab61be703111416d9fba543ea97b2224"
 from {username='slave'} at 127.0.0.1:33782
I20260709 13:12:33.196684 32058 raft_consensus.cc:606] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Received request to transfer leadership to TS ab61be703111416d9fba543ea97b2224
I20260709 13:12:33.197937 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:33.199239 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:33.597630   535 raft_consensus.cc:993] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:33.598238   559 raft_consensus.cc:1081] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:33.599866   378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47012
I20260709 13:12:33.600430   378 raft_consensus.cc:493] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:33.600737   378 raft_consensus.cc:3060] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.607626   378 raft_consensus.cc:515] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:33.610447   378 leader_election.cc:290] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:33.610780 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:33.610903 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2effe556ccc642379972492cef9bf0a0" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:33.611507 32130 raft_consensus.cc:3055] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:33.611532 31979 raft_consensus.cc:3060] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.611917 32130 raft_consensus.cc:740] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eacc546e751240eb804795d98213a57c, State: Running, Role: LEADER
I20260709 13:12:33.612761 32130 consensus_queue.cc:260] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:33.613924 32130 raft_consensus.cc:3060] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.617326 31979 raft_consensus.cc:2468] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:33.618681 32733 leader_election.cc:304] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224; no voters: 
I20260709 13:12:33.620042   544 raft_consensus.cc:2804] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:33.621091   544 raft_consensus.cc:697] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:33.621243 32130 raft_consensus.cc:2468] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:33.622177   544 consensus_queue.cc:237] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:33.641659 31807 catalog_manager.cc:5697] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 1 to 2, leader changed from eacc546e751240eb804795d98213a57c (127.21.244.4) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.658841   613 raft_consensus.cc:993] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a: : Instructing follower ab61be703111416d9fba543ea97b2224 to start an election
I20260709 13:12:33.659385   520 raft_consensus.cc:1081] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Signalling peer ab61be703111416d9fba543ea97b2224 to start an election
I20260709 13:12:33.660905 31979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46"
dest_uuid: "ab61be703111416d9fba543ea97b2224"
 from {username='slave'} at 127.0.0.1:58674
I20260709 13:12:33.661444 31979 raft_consensus.cc:493] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:33.661769 31979 raft_consensus.cc:3060] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.666859 31979 raft_consensus.cc:515] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:33.670069 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27177ca9073b4128b8844b7cb37db32a"
I20260709 13:12:33.670385 32130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ddd1afa9aee435da29e4c2ee2885a46" candidate_uuid: "ab61be703111416d9fba543ea97b2224" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:33.670760 32058 raft_consensus.cc:3055] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:33.670998 32130 raft_consensus.cc:3060] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.671137 32058 raft_consensus.cc:740] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27177ca9073b4128b8844b7cb37db32a, State: Running, Role: LEADER
I20260709 13:12:33.669519 31979 leader_election.cc:290] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Requested vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), eacc546e751240eb804795d98213a57c (127.21.244.4:43793)
I20260709 13:12:33.672158 32058 consensus_queue.cc:260] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:33.673857 32058 raft_consensus.cc:3060] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:33.678194 32130 raft_consensus.cc:2468] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 2.
I20260709 13:12:33.679590 31949 leader_election.cc:304] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab61be703111416d9fba543ea97b2224, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:33.680433   540 raft_consensus.cc:2804] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:33.682103   540 raft_consensus.cc:697] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Becoming Leader. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:33.683247   540 consensus_queue.cc:237] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } }
I20260709 13:12:33.685230 32058 raft_consensus.cc:2468] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab61be703111416d9fba543ea97b2224 in term 2.
I20260709 13:12:33.704049 31807 catalog_manager.cc:5697] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 reported cstate change: term changed from 1 to 2, leader changed from 27177ca9073b4128b8844b7cb37db32a (127.21.244.3) to ab61be703111416d9fba543ea97b2224 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "ab61be703111416d9fba543ea97b2224" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.097608 32130 raft_consensus.cc:1275] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer ab61be703111416d9fba543ea97b2224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:34.098901   635 consensus_queue.cc:1048] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:34.112938 32058 raft_consensus.cc:1275] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Refusing update from remote peer ab61be703111416d9fba543ea97b2224: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:34.116936   540 consensus_queue.cc:1048] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:34.199590 32128 raft_consensus.cc:1275] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:34.200274 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:34.201179   541 consensus_queue.cc:1048] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:34.217290 31979 raft_consensus.cc:1275] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:34.218897   541 consensus_queue.cc:1048] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:34.269937 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:34.310745 31979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4253f6805a1465ca31a5979bb0632e6"
dest_uuid: "ab61be703111416d9fba543ea97b2224"
mode: GRACEFUL
new_leader_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:36466
I20260709 13:12:34.311316 31979 raft_consensus.cc:606] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Received request to transfer leadership to TS 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:34.313129 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:12:34.315047 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:34.672856   540 raft_consensus.cc:993] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224: : Instructing follower 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:34.673377   635 raft_consensus.cc:1081] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Signalling peer 936b035f23a5449fb43db3fd5f757325 to start an election
I20260709 13:12:34.675333   378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4253f6805a1465ca31a5979bb0632e6"
dest_uuid: "936b035f23a5449fb43db3fd5f757325"
 from {username='slave'} at 127.0.0.1:47006
I20260709 13:12:34.675963   378 raft_consensus.cc:493] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:34.676342   378 raft_consensus.cc:3060] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.684398   378 raft_consensus.cc:515] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:34.686784   378 leader_election.cc:290] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Requested vote from peers eacc546e751240eb804795d98213a57c (127.21.244.4:43793), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:34.689620 32128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4253f6805a1465ca31a5979bb0632e6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eacc546e751240eb804795d98213a57c"
I20260709 13:12:34.690300 32128 raft_consensus.cc:3060] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.697995 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4253f6805a1465ca31a5979bb0632e6" candidate_uuid: "936b035f23a5449fb43db3fd5f757325" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab61be703111416d9fba543ea97b2224"
I20260709 13:12:34.697981 32128 raft_consensus.cc:2468] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:34.698683 31979 raft_consensus.cc:3055] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:34.699026 31979 raft_consensus.cc:740] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab61be703111416d9fba543ea97b2224, State: Running, Role: LEADER
I20260709 13:12:34.699848 31979 consensus_queue.cc:260] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:34.700091 32732 leader_election.cc:304] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 936b035f23a5449fb43db3fd5f757325, eacc546e751240eb804795d98213a57c; no voters: 
I20260709 13:12:34.700899 31979 raft_consensus.cc:3060] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.701022   650 raft_consensus.cc:2804] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:34.701579   650 raft_consensus.cc:697] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Becoming Leader. State: Replica: 936b035f23a5449fb43db3fd5f757325, State: Running, Role: LEADER
I20260709 13:12:34.702513   650 consensus_queue.cc:237] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:34.709427 31979 raft_consensus.cc:2468] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 936b035f23a5449fb43db3fd5f757325 in term 2.
I20260709 13:12:34.715198 31807 catalog_manager.cc:5697] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 reported cstate change: term changed from 1 to 2, leader changed from ab61be703111416d9fba543ea97b2224 (127.21.244.2) to 936b035f23a5449fb43db3fd5f757325 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "936b035f23a5449fb43db3fd5f757325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.124918 32130 raft_consensus.cc:1275] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:35.126608   544 consensus_queue.cc:1048] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:35.144421 31979 raft_consensus.cc:1275] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Refusing update from remote peer 936b035f23a5449fb43db3fd5f757325: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:35.148494   544 consensus_queue.cc:1048] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:35.316192 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:35.360630 22480 tablet_server.cc:179] TabletServer@127.21.244.1:33269 shutting down...
W20260709 13:12:35.380988 32098 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 286 similar messages]
W20260709 13:12:35.388451 32098 consensus_peers.cc:597] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.389290 32098 consensus_peers.cc:597] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.398108 32024 consensus_peers.cc:597] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.411187 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:35.412431 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.413422 22480 raft_consensus.cc:2243] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.414083 22480 raft_consensus.cc:2272] T 95d018ee52cc46cebe51e75edec5abe5 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.417366 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.418193 22480 raft_consensus.cc:2243] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.418735 22480 raft_consensus.cc:2272] T 9d653047328d4dd8b77f83bfc9318562 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.421458 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.422340 22480 raft_consensus.cc:2243] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.422821 22480 raft_consensus.cc:2272] T ced69c1fedef46c1a15fcea51cc970f4 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.425554 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.426445 22480 raft_consensus.cc:2243] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.426998 22480 raft_consensus.cc:2272] T 15722eb44a144050b7a810716b0fb150 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.428512 31950 consensus_peers.cc:597] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.429634 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.430435 22480 raft_consensus.cc:2243] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.430930 22480 raft_consensus.cc:2272] T 78093d7ec8724a248daf1d4269de3190 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.433314 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.433967 22480 raft_consensus.cc:2243] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.434396 22480 raft_consensus.cc:2272] T 858cfa025ea0471a97b28dd8a9d61990 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.436764 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.437403 22480 raft_consensus.cc:2243] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.437830 22480 raft_consensus.cc:2272] T c923d9fd0eba46a5bd77f4b0359907ad P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.440094 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.440748 22480 raft_consensus.cc:2243] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.441620 22480 raft_consensus.cc:2272] T 762054515f9846129075d921ceefcd1f P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.443902 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.444550 22480 raft_consensus.cc:2243] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.445011 22480 raft_consensus.cc:2272] T 0126ecb33b074d9d8af32e047a43f067 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.448149 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.448853 22480 raft_consensus.cc:2243] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.449395 22480 raft_consensus.cc:2272] T 8a5b51be38f84f3683f3fbe48c4d22af P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.451714 31950 consensus_peers.cc:597] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.452200 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.452981 22480 raft_consensus.cc:2243] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.453703 22480 raft_consensus.cc:2272] T aaedd9866a6e4923a483d1268ac000ea P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.456022 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.456780 22480 raft_consensus.cc:2243] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.457180 22480 raft_consensus.cc:2272] T 60f7547964fe4ef7aab61a37abdcb466 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.459939 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.460556 22480 raft_consensus.cc:2243] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.461452 22480 raft_consensus.cc:2272] T 7b7b78e7c3d1417b8b4035b246334cbe P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.463939 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.464681 22480 raft_consensus.cc:2243] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.465703 22480 raft_consensus.cc:2272] T 6ae250d6acb34e1692cfe5ab3cce75ca P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.468840 22480 tablet_replica.cc:333] stopping tablet replica
W20260709 13:12:35.468911 32098 consensus_peers.cc:597] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.469623 22480 raft_consensus.cc:2243] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.470451 22480 raft_consensus.cc:2272] T 2af6353e4b694dc58ca636af51b7f1eb P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.472823 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.473428 22480 raft_consensus.cc:2243] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.473932 22480 raft_consensus.cc:2272] T 540d3a54268745adb1ed6108ca819925 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.476118 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.476709 22480 raft_consensus.cc:2243] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.477171 22480 raft_consensus.cc:2272] T d90689ee41da48e1bdcc50534b90c4b8 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.479664 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.480568 22480 raft_consensus.cc:2243] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.481099 22480 raft_consensus.cc:2272] T 7ec8220975c3487fb08ddb14edb71cf5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.483944 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.484627 22480 raft_consensus.cc:2243] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.485060 22480 raft_consensus.cc:2272] T 209aeaad860746c39ef57d290c03b5fe P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.487646 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.488354 22480 raft_consensus.cc:2243] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.488878 22480 raft_consensus.cc:2272] T bdf375d76dea417eaf6400807194cf2d P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.491446 22480 tablet_replica.cc:333] stopping tablet replica
W20260709 13:12:35.491678 32024 consensus_peers.cc:597] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.492183 22480 raft_consensus.cc:2243] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.492853 22480 raft_consensus.cc:2272] T 5aa7046f9ae649068369e98a43c01171 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.495968 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.496658 22480 raft_consensus.cc:2243] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.497172 22480 raft_consensus.cc:2272] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.500293 22480 tablet_replica.cc:333] stopping tablet replica
W20260709 13:12:35.500918 31950 consensus_peers.cc:597] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.501168 22480 raft_consensus.cc:2243] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.502303 22480 raft_consensus.cc:2272] T 7d6829450035496cad51a237b822114a P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.504438 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.504967 22480 raft_consensus.cc:2243] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.505577 22480 raft_consensus.cc:2272] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.508322 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.509140 22480 raft_consensus.cc:2243] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.509507 22480 raft_consensus.cc:2272] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.511679 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.512292 22480 raft_consensus.cc:2243] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.512766 22480 raft_consensus.cc:2272] T c8212163be194b95a51643b109e411a8 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.515328 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.515918 22480 raft_consensus.cc:2243] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.516960 22480 raft_consensus.cc:2272] T a78fc46a6c3f474cacfa16b058f035cd P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.519842 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.520443 22480 raft_consensus.cc:2243] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:12:35.520810 32098 consensus_peers.cc:597] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.521334 22480 raft_consensus.cc:2272] T f4253f6805a1465ca31a5979bb0632e6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.524255 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.525074 22480 raft_consensus.cc:2243] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.525601 22480 raft_consensus.cc:2272] T 2c7bb527b8174d1792395c79a82a224c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.528926 22480 tablet_replica.cc:333] stopping tablet replica
W20260709 13:12:35.528954 31950 consensus_peers.cc:597] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.529862 22480 raft_consensus.cc:2243] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.530566 22480 raft_consensus.cc:2272] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 936b035f23a5449fb43db3fd5f757325 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.533449 22480 tablet_replica.cc:333] stopping tablet replica
W20260709 13:12:35.534040 32024 consensus_peers.cc:597] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.534355 22480 raft_consensus.cc:2243] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:35.534816 32098 consensus_peers.cc:597] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.534982 22480 raft_consensus.cc:2272] T 24a52eeb653346c286bc79d5ee09d7b5 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.538110 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.538846 22480 raft_consensus.cc:2243] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.539872 22480 raft_consensus.cc:2272] T 78e0ed9b586e440c98baa7861469e247 P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.542479 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.543292 22480 raft_consensus.cc:2243] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.544328 22480 raft_consensus.cc:2272] T f82695c4f13842c1a0e66c48751f9025 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.546015 31950 consensus_peers.cc:597] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.547621 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.548534 22480 raft_consensus.cc:2243] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.549088 22480 raft_consensus.cc:2272] T 4fcab21f469948228159fc838c35005b P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.552577 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.553373 22480 raft_consensus.cc:2243] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.553913 22480 raft_consensus.cc:2272] T f7682585da6947c291d67650d6affddd P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.556926 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.557672 22480 raft_consensus.cc:2243] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.558195 22480 raft_consensus.cc:2272] T 25e1c9b1a299481d9675857f807393c6 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.560847 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.561347 22480 raft_consensus.cc:2243] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.562189 22480 raft_consensus.cc:2272] T cd4d256597f64c68b23aefc1246fefcd P 936b035f23a5449fb43db3fd5f757325 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.564263 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.564793 22480 raft_consensus.cc:2243] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.565246 22480 raft_consensus.cc:2272] T 0eecdc9a6c45481b8148098fe8e47232 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.567488 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.568073 22480 raft_consensus.cc:2243] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.568493 22480 raft_consensus.cc:2272] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.570767 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.571429 22480 raft_consensus.cc:2243] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.571993 22480 raft_consensus.cc:2272] T 69fe566df0914a4799610044a0e01daa P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.574280 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.574904 22480 raft_consensus.cc:2243] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.575338 22480 raft_consensus.cc:2272] T 101f0f9b51684b15a3f577bf4685bb9c P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.577630 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.578241 22480 raft_consensus.cc:2243] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.579042 22480 raft_consensus.cc:2272] T 2effe556ccc642379972492cef9bf0a0 P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.581348 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.582002 22480 raft_consensus.cc:2243] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.582417 22480 raft_consensus.cc:2272] T fd01da40464a4c3e907fbd4a05e7cf08 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.584836 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.585460 22480 raft_consensus.cc:2243] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.585956 22480 raft_consensus.cc:2272] T 63d9f17e553345b4b6a7c1aad8e8c058 P 936b035f23a5449fb43db3fd5f757325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.588958 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:35.589706 22480 raft_consensus.cc:2243] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.590749 22480 raft_consensus.cc:2272] T 58378bb5379a40ed94b3726a99108cca P 936b035f23a5449fb43db3fd5f757325 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.590693 32098 consensus_peers.cc:597] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.593473 31950 consensus_peers.cc:597] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.594270 31950 consensus_peers.cc:597] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.599242 32024 consensus_peers.cc:597] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.627907 31950 consensus_peers.cc:597] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.663360 22480 tablet_server.cc:196] TabletServer@127.21.244.1:33269 shutdown complete.
W20260709 13:12:35.686991 32024 consensus_peers.cc:597] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.701768 32024 consensus_peers.cc:597] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.718103 32098 consensus_peers.cc:597] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.720732 32098 consensus_peers.cc:597] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.741726 32098 consensus_peers.cc:597] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.748654 31950 consensus_peers.cc:597] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.751502 32024 consensus_peers.cc:597] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.771011 22480 tablet_server.cc:179] TabletServer@127.21.244.2:0 shutting down...
W20260709 13:12:35.779683 31950 consensus_peers.cc:597] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.781607 32098 consensus_peers.cc:597] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.807049 31950 consensus_peers.cc:597] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.817852 32098 consensus_peers.cc:597] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.818905 32098 consensus_peers.cc:597] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.828740 32024 consensus_peers.cc:597] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.835927 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:35.836938 22480 tablet_replica.cc:333] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.837863 22480 raft_consensus.cc:2243] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.839005 22480 raft_consensus.cc:2272] T 15722eb44a144050b7a810716b0fb150 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.839672 32098 consensus_peers.cc:597] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c -> Peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Couldn't send request to peer 936b035f23a5449fb43db3fd5f757325. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.841984 22480 tablet_replica.cc:333] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.842940 22480 raft_consensus.cc:2243] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.843605 22480 raft_consensus.cc:2272] T 3c4dd4a38fc647e3a2ad4a953c649261 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.846351 22480 tablet_replica.cc:333] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.847158 22480 raft_consensus.cc:2243] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.847949 22480 raft_consensus.cc:2272] T 8ddd1afa9aee435da29e4c2ee2885a46 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.850077 22480 tablet_replica.cc:333] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.850896 22480 raft_consensus.cc:2243] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.851939 22480 raft_consensus.cc:2272] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.854497 22480 tablet_replica.cc:333] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.855149 22480 raft_consensus.cc:2243] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.855614 22480 raft_consensus.cc:2272] T 78093d7ec8724a248daf1d4269de3190 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.857682 22480 tablet_replica.cc:333] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.858320 22480 raft_consensus.cc:2243] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.858834 22480 raft_consensus.cc:2272] T 0eecdc9a6c45481b8148098fe8e47232 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.860980 22480 tablet_replica.cc:333] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.861591 22480 raft_consensus.cc:2243] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.862026 22480 raft_consensus.cc:2272] T a68212da6ed34d7ca6eada16ee48977a P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.864468 22480 tablet_replica.cc:333] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.865301 22480 raft_consensus.cc:2243] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.866302 22480 raft_consensus.cc:2272] T 60f7547964fe4ef7aab61a37abdcb466 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.870936 22480 tablet_replica.cc:333] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.871796 22480 raft_consensus.cc:2243] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.872872 22480 raft_consensus.cc:2272] T 5aa7046f9ae649068369e98a43c01171 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.874162 32024 consensus_peers.cc:597] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.876569 22480 tablet_replica.cc:333] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.877602 22480 raft_consensus.cc:2243] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.878243 22480 raft_consensus.cc:2272] T 8a5b51be38f84f3683f3fbe48c4d22af P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.881172 22480 tablet_replica.cc:333] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.881982 22480 raft_consensus.cc:2243] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.882869 22480 raft_consensus.cc:2272] T d1a83560836343219eaeb0ba1a0bc451 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.885143 22480 tablet_replica.cc:333] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.885841 22480 raft_consensus.cc:2243] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.886368 22480 raft_consensus.cc:2272] T 63d9f17e553345b4b6a7c1aad8e8c058 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.888659 22480 tablet_replica.cc:333] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.889308 22480 raft_consensus.cc:2243] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.889808 22480 raft_consensus.cc:2272] T b358dd69e0a54cdf8e94474ade4e7046 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.892027 22480 tablet_replica.cc:333] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.892829 22480 raft_consensus.cc:2243] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.893362 22480 raft_consensus.cc:2272] T 58378bb5379a40ed94b3726a99108cca P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.896076 22480 tablet_replica.cc:333] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.897235 22480 raft_consensus.cc:2243] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.897815 22480 raft_consensus.cc:2272] T 584ae225b8df4057bf6eb29eb393c7e2 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.899703 32024 consensus_peers.cc:597] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.900624 22480 tablet_replica.cc:333] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.901695 22480 raft_consensus.cc:2243] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.902251 22480 raft_consensus.cc:2272] T f9b84cbd41b64e929eaab29437b49118 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.904989 22480 tablet_replica.cc:333] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.905617 22480 raft_consensus.cc:2243] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.906634 22480 raft_consensus.cc:2272] T fd01da40464a4c3e907fbd4a05e7cf08 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.909006 22480 tablet_replica.cc:333] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.909755 22480 raft_consensus.cc:2243] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.910224 22480 raft_consensus.cc:2272] T be53aa47c89a49dd98dd5050d875c00e P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.910322 32024 consensus_peers.cc:597] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.911006 32024 consensus_peers.cc:597] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.912348 22480 tablet_replica.cc:333] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.913185 22480 raft_consensus.cc:2243] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.913713 22480 raft_consensus.cc:2272] T 540d3a54268745adb1ed6108ca819925 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.916652 22480 tablet_replica.cc:333] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.917426 22480 raft_consensus.cc:2243] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.918519 22480 raft_consensus.cc:2272] T d90689ee41da48e1bdcc50534b90c4b8 P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.921658 22480 tablet_replica.cc:333] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
W20260709 13:12:35.922048 32024 consensus_peers.cc:597] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.922479 22480 raft_consensus.cc:2243] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:35.922806 32024 consensus_peers.cc:597] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.923560 22480 raft_consensus.cc:2272] T decee8d0520647f5a637ec4bc4237722 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.926586 22480 tablet_replica.cc:333] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.927384 22480 raft_consensus.cc:2243] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.927925 22480 raft_consensus.cc:2272] T 2af6353e4b694dc58ca636af51b7f1eb P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.930730 22480 tablet_replica.cc:333] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.931572 22480 raft_consensus.cc:2243] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.932161 22480 raft_consensus.cc:2272] T cb7c99a3ac8c469995be8be36b6b8cf1 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.935158 22480 tablet_replica.cc:333] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.936000 22480 raft_consensus.cc:2243] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.937040 22480 raft_consensus.cc:2272] T 2c7bb527b8174d1792395c79a82a224c P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.939994 22480 tablet_replica.cc:333] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.940869 22480 raft_consensus.cc:2243] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.941427 22480 raft_consensus.cc:2272] T 24a52eeb653346c286bc79d5ee09d7b5 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.944192 22480 tablet_replica.cc:333] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.945019 22480 raft_consensus.cc:2243] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.946115 22480 raft_consensus.cc:2272] T bc70b216d7234eca9b4c4eaadc8ef7e7 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.948961 32098 consensus_peers.cc:597] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.949434 22480 tablet_replica.cc:333] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.950328 22480 raft_consensus.cc:2243] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.950855 22480 raft_consensus.cc:2272] T 7d6829450035496cad51a237b822114a P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.953675 22480 tablet_replica.cc:333] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.954502 22480 raft_consensus.cc:2243] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.955096 22480 raft_consensus.cc:2272] T 2a24126e79904519a77414eb98380575 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.957971 22480 tablet_replica.cc:333] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.958791 22480 raft_consensus.cc:2243] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.959865 22480 raft_consensus.cc:2272] T e98700f72c2d466b951e6776bdc74e2f P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.962627 22480 tablet_replica.cc:333] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.963387 22480 raft_consensus.cc:2243] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.963984 22480 raft_consensus.cc:2272] T 4fcab21f469948228159fc838c35005b P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.966614 22480 tablet_replica.cc:333] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.967361 22480 raft_consensus.cc:2243] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.967941 22480 raft_consensus.cc:2272] T 0126ecb33b074d9d8af32e047a43f067 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.972028 22480 tablet_replica.cc:333] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.972777 22480 raft_consensus.cc:2243] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.973328 22480 raft_consensus.cc:2272] T 762054515f9846129075d921ceefcd1f P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.976285 22480 tablet_replica.cc:333] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.977027 22480 raft_consensus.cc:2243] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.977584 22480 raft_consensus.cc:2272] T 63944c6b0e9a466dba494a0bcdefe7de P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.980875 22480 tablet_replica.cc:333] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.981675 22480 raft_consensus.cc:2243] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.982791 22480 raft_consensus.cc:2272] T 9d653047328d4dd8b77f83bfc9318562 P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.983223 32024 consensus_peers.cc:597] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.985903 22480 tablet_replica.cc:333] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.986806 22480 raft_consensus.cc:2243] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.987435 22480 raft_consensus.cc:2272] T 2effe556ccc642379972492cef9bf0a0 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.990260 22480 tablet_replica.cc:333] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.990959 22480 raft_consensus.cc:2243] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.991492 22480 raft_consensus.cc:2272] T f4253f6805a1465ca31a5979bb0632e6 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.994668 22480 tablet_replica.cc:333] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.995410 22480 raft_consensus.cc:2243] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.996464 22480 raft_consensus.cc:2272] T c8212163be194b95a51643b109e411a8 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.999290 22480 tablet_replica.cc:333] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:35.999984 22480 raft_consensus.cc:2243] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.000480 22480 raft_consensus.cc:2272] T a78fc46a6c3f474cacfa16b058f035cd P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:36.000334 32024 consensus_peers.cc:597] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:36.001109 32098 consensus_peers.cc:597] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:36.001240 32024 consensus_peers.cc:597] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.003090 22480 tablet_replica.cc:333] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:36.003808 22480 raft_consensus.cc:2243] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.004297 22480 raft_consensus.cc:2272] T aaedd9866a6e4923a483d1268ac000ea P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.006573 22480 tablet_replica.cc:333] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:36.007099 22480 raft_consensus.cc:2243] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.007560 22480 raft_consensus.cc:2272] T af49880db24d43b08da39dc862b4c37b P ab61be703111416d9fba543ea97b2224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.009683 22480 tablet_replica.cc:333] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:36.010258 22480 raft_consensus.cc:2243] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.010684 22480 raft_consensus.cc:2272] T ced69c1fedef46c1a15fcea51cc970f4 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.013229 22480 tablet_replica.cc:333] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:36.013769 22480 raft_consensus.cc:2243] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.014180 22480 raft_consensus.cc:2272] T cd4d256597f64c68b23aefc1246fefcd P ab61be703111416d9fba543ea97b2224 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.016417 22480 tablet_replica.cc:333] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:36.016945 22480 raft_consensus.cc:2243] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.017745 22480 raft_consensus.cc:2272] T 25e1c9b1a299481d9675857f807393c6 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.019837 22480 tablet_replica.cc:333] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224: stopping tablet replica
I20260709 13:12:36.020291 22480 raft_consensus.cc:2243] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.020705 22480 raft_consensus.cc:2272] T f82695c4f13842c1a0e66c48751f9025 P ab61be703111416d9fba543ea97b2224 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.095168 22480 tablet_server.cc:196] TabletServer@127.21.244.2:0 shutdown complete.
W20260709 13:12:36.119889 32024 consensus_peers.cc:597] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:45831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:36.143292 32098 consensus_peers.cc:597] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:45831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:36.167181 32098 consensus_peers.cc:597] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:45831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.192011 22480 tablet_server.cc:179] TabletServer@127.21.244.3:0 shutting down...
W20260709 13:12:36.220322 32098 consensus_peers.cc:597] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:45831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.252730 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:36.254516 22480 tablet_replica.cc:333] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.255484 22480 raft_consensus.cc:2243] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.256102 22480 raft_consensus.cc:2272] T 7ec8220975c3487fb08ddb14edb71cf5 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:36.258715 32024 consensus_peers.cc:597] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:45831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.259326 22480 tablet_replica.cc:333] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.260258 22480 raft_consensus.cc:2243] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.260959 22480 raft_consensus.cc:2272] T 7a7e6bd5627e4a1cb9053e79dd3e2332 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.263684 22480 tablet_replica.cc:333] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.264582 22480 raft_consensus.cc:2243] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.265623 22480 raft_consensus.cc:2272] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.268515 22480 tablet_replica.cc:333] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
W20260709 13:12:36.269207 32098 consensus_peers.cc:597] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:45831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.269510 22480 raft_consensus.cc:2243] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.270206 22480 raft_consensus.cc:2272] T 60f7547964fe4ef7aab61a37abdcb466 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.272943 22480 tablet_replica.cc:333] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.273761 22480 raft_consensus.cc:2243] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.274334 22480 raft_consensus.cc:2272] T af49880db24d43b08da39dc862b4c37b P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.277105 22480 tablet_replica.cc:333] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.277927 22480 raft_consensus.cc:2243] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.278842 22480 raft_consensus.cc:2272] T 584ae225b8df4057bf6eb29eb393c7e2 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.281339 22480 tablet_replica.cc:333] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.282053 22480 raft_consensus.cc:2243] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.282513 22480 raft_consensus.cc:2272] T 7b7b78e7c3d1417b8b4035b246334cbe P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.284485 22480 tablet_replica.cc:333] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.285213 22480 raft_consensus.cc:2243] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.285610 22480 raft_consensus.cc:2272] T 6ae250d6acb34e1692cfe5ab3cce75ca P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.287570 22480 tablet_replica.cc:333] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.288162 22480 raft_consensus.cc:2243] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.288553 22480 raft_consensus.cc:2272] T 78e0ed9b586e440c98baa7861469e247 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.290518 22480 tablet_replica.cc:333] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.291177 22480 raft_consensus.cc:2243] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.291883 22480 raft_consensus.cc:2272] T f9b84cbd41b64e929eaab29437b49118 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.294226 22480 tablet_replica.cc:333] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.294817 22480 raft_consensus.cc:2243] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.295719 22480 raft_consensus.cc:2272] T be53aa47c89a49dd98dd5050d875c00e P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.298081 22480 tablet_replica.cc:333] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.298735 22480 raft_consensus.cc:2243] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.299878 22480 raft_consensus.cc:2272] T be3e38a5bb6f4fd48b4bd695694eb7d9 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.303300 22480 tablet_replica.cc:333] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.304289 22480 raft_consensus.cc:2243] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.304951 22480 raft_consensus.cc:2272] T d90689ee41da48e1bdcc50534b90c4b8 P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.307880 22480 tablet_replica.cc:333] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.308746 22480 raft_consensus.cc:2243] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.309355 22480 raft_consensus.cc:2272] T decee8d0520647f5a637ec4bc4237722 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:36.310293 32098 consensus_peers.cc:597] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c -> Peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Couldn't send request to peer ab61be703111416d9fba543ea97b2224. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:45831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.311836 22480 tablet_replica.cc:333] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.312570 22480 raft_consensus.cc:2243] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.313087 22480 raft_consensus.cc:2272] T 2af6353e4b694dc58ca636af51b7f1eb P 27177ca9073b4128b8844b7cb37db32a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.315085 22480 tablet_replica.cc:333] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.315691 22480 raft_consensus.cc:2243] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.316200 22480 raft_consensus.cc:2272] T cb7c99a3ac8c469995be8be36b6b8cf1 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.318295 22480 tablet_replica.cc:333] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.318864 22480 raft_consensus.cc:2243] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.319659 22480 raft_consensus.cc:2272] T 8a5b51be38f84f3683f3fbe48c4d22af P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.321826 22480 tablet_replica.cc:333] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.322397 22480 raft_consensus.cc:2243] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.322820 22480 raft_consensus.cc:2272] T 209aeaad860746c39ef57d290c03b5fe P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.324956 22480 tablet_replica.cc:333] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.325616 22480 raft_consensus.cc:2243] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.326032 22480 raft_consensus.cc:2272] T bdf375d76dea417eaf6400807194cf2d P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.328068 22480 tablet_replica.cc:333] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.328641 22480 raft_consensus.cc:2243] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.329066 22480 raft_consensus.cc:2272] T f7682585da6947c291d67650d6affddd P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.331413 22480 tablet_replica.cc:333] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.332027 22480 raft_consensus.cc:2243] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.332831 22480 raft_consensus.cc:2272] T 4fcab21f469948228159fc838c35005b P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.335809 22480 tablet_replica.cc:333] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.336467 22480 raft_consensus.cc:2243] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.337656 22480 raft_consensus.cc:2272] T 0126ecb33b074d9d8af32e047a43f067 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:36.340516 32099 consensus_peers.cc:597] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c -> Peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Couldn't send request to peer 27177ca9073b4128b8844b7cb37db32a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.340585 22480 tablet_replica.cc:333] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.341740 22480 raft_consensus.cc:2243] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.342242 22480 raft_consensus.cc:2272] T 762054515f9846129075d921ceefcd1f P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.344473 22480 tablet_replica.cc:333] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.345074 22480 raft_consensus.cc:2243] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.345553 22480 raft_consensus.cc:2272] T 95d018ee52cc46cebe51e75edec5abe5 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.347611 22480 tablet_replica.cc:333] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.348258 22480 raft_consensus.cc:2243] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.348932 22480 raft_consensus.cc:2272] T bc70b216d7234eca9b4c4eaadc8ef7e7 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.351382 22480 tablet_replica.cc:333] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.352097 22480 raft_consensus.cc:2243] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.353039 22480 raft_consensus.cc:2272] T 63d9f17e553345b4b6a7c1aad8e8c058 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.355974 22480 tablet_replica.cc:333] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.356863 22480 raft_consensus.cc:2243] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.357333 22480 raft_consensus.cc:2272] T 58378bb5379a40ed94b3726a99108cca P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.359354 22480 tablet_replica.cc:333] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.360033 22480 raft_consensus.cc:2243] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.360777 22480 raft_consensus.cc:2272] T b358dd69e0a54cdf8e94474ade4e7046 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.363126 22480 tablet_replica.cc:333] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.363786 22480 raft_consensus.cc:2243] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.364858 22480 raft_consensus.cc:2272] T 63944c6b0e9a466dba494a0bcdefe7de P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:36.367009 32099 consensus_peers.cc:597] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c -> Peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Couldn't send request to peer 27177ca9073b4128b8844b7cb37db32a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.367650 22480 tablet_replica.cc:333] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.368428 22480 raft_consensus.cc:2243] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.368909 22480 raft_consensus.cc:2272] T 9d653047328d4dd8b77f83bfc9318562 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.372087 22480 tablet_replica.cc:333] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.372829 22480 raft_consensus.cc:2243] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.373425 22480 raft_consensus.cc:2272] T 25e1c9b1a299481d9675857f807393c6 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:36.374100 32099 consensus_peers.cc:597] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c -> Peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Couldn't send request to peer 27177ca9073b4128b8844b7cb37db32a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.376017 22480 tablet_replica.cc:333] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.376842 22480 raft_consensus.cc:2243] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.377602 22480 raft_consensus.cc:2272] T a68212da6ed34d7ca6eada16ee48977a P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.379485 22480 tablet_replica.cc:333] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.380066 22480 raft_consensus.cc:2243] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.380522 22480 raft_consensus.cc:2272] T 858cfa025ea0471a97b28dd8a9d61990 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.382562 22480 tablet_replica.cc:333] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.383112 22480 raft_consensus.cc:2243] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.383530 22480 raft_consensus.cc:2272] T 8ddd1afa9aee435da29e4c2ee2885a46 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.385491 22480 tablet_replica.cc:333] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.386034 22480 raft_consensus.cc:2243] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.386829 22480 raft_consensus.cc:2272] T c923d9fd0eba46a5bd77f4b0359907ad P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.388923 22480 tablet_replica.cc:333] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.389461 22480 raft_consensus.cc:2243] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.389904 22480 raft_consensus.cc:2272] T aaedd9866a6e4923a483d1268ac000ea P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.391870 22480 tablet_replica.cc:333] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.392413 22480 raft_consensus.cc:2243] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.393208 22480 raft_consensus.cc:2272] T 2a24126e79904519a77414eb98380575 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.395287 22480 tablet_replica.cc:333] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.396018 22480 raft_consensus.cc:2243] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.396656 22480 raft_consensus.cc:2272] T e98700f72c2d466b951e6776bdc74e2f P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.399530 22480 tablet_replica.cc:333] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.400291 22480 raft_consensus.cc:2243] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.400843 22480 raft_consensus.cc:2272] T d1a83560836343219eaeb0ba1a0bc451 P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.403647 22480 tablet_replica.cc:333] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.404336 22480 raft_consensus.cc:2243] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.405165 22480 raft_consensus.cc:2272] T 3c4dd4a38fc647e3a2ad4a953c649261 P 27177ca9073b4128b8844b7cb37db32a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.407219 22480 tablet_replica.cc:333] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.407832 22480 raft_consensus.cc:2243] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.408293 22480 raft_consensus.cc:2272] T 69fe566df0914a4799610044a0e01daa P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.410291 22480 tablet_replica.cc:333] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.410825 22480 raft_consensus.cc:2243] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.411621 22480 raft_consensus.cc:2272] T 101f0f9b51684b15a3f577bf4685bb9c P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.413671 22480 tablet_replica.cc:333] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.414307 22480 raft_consensus.cc:2243] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.414764 22480 raft_consensus.cc:2272] T 2c7bb527b8174d1792395c79a82a224c P 27177ca9073b4128b8844b7cb37db32a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.417584 22480 tablet_replica.cc:333] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a: stopping tablet replica
I20260709 13:12:36.418272 22480 raft_consensus.cc:2243] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.418829 22480 raft_consensus.cc:2272] T 8a4c0d34f8964520b2dfcb86f12a18b6 P 27177ca9073b4128b8844b7cb37db32a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.492741 22480 tablet_server.cc:196] TabletServer@127.21.244.3:0 shutdown complete.
I20260709 13:12:36.494127   672 raft_consensus.cc:493] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:36.494728   672 raft_consensus.cc:515] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:36.496515   672 leader_election.cc:290] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
W20260709 13:12:36.501103 32098 leader_election.cc:336] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:36.501706 32099 leader_election.cc:336] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Network error: Client connection negotiation failed: client connection to 127.21.244.3:34161: connect: Connection refused (error 111)
I20260709 13:12:36.502131 32099 leader_election.cc:304] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:36.502905   672 raft_consensus.cc:2749] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:36.549189 32099 consensus_peers.cc:597] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c -> Peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Couldn't send request to peer 27177ca9073b4128b8844b7cb37db32a. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:34161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.561810 22480 tablet_server.cc:179] TabletServer@127.21.244.4:0 shutting down...
W20260709 13:12:36.580844 32099 consensus_peers.cc:597] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c -> Peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Couldn't send request to peer 27177ca9073b4128b8844b7cb37db32a. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:34161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:36.591048 32099 consensus_peers.cc:597] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c -> Peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Couldn't send request to peer 27177ca9073b4128b8844b7cb37db32a. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:34161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:36.605149 32099 consensus_peers.cc:597] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c -> Peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Couldn't send request to peer 27177ca9073b4128b8844b7cb37db32a. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:34161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.610126 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:36.611130 22480 tablet_replica.cc:333] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.611951 22480 raft_consensus.cc:2243] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.612480 22480 raft_consensus.cc:2272] T 15722eb44a144050b7a810716b0fb150 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.615209 22480 tablet_replica.cc:333] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.615860 22480 raft_consensus.cc:2243] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.616639 22480 raft_consensus.cc:2272] T f7682585da6947c291d67650d6affddd P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.618521 22480 tablet_replica.cc:333] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.619122 22480 raft_consensus.cc:2243] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.619596 22480 raft_consensus.cc:2272] T 63944c6b0e9a466dba494a0bcdefe7de P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.621954 22480 tablet_replica.cc:333] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.622637 22480 raft_consensus.cc:2243] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.623566 22480 raft_consensus.cc:2272] T 78093d7ec8724a248daf1d4269de3190 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.626505 22480 tablet_replica.cc:333] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c: stopping tablet replica
W20260709 13:12:36.627089 32099 consensus_peers.cc:597] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c -> Peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Couldn't send request to peer 27177ca9073b4128b8844b7cb37db32a. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:34161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.627265 22480 raft_consensus.cc:2243] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.628219 22480 raft_consensus.cc:2272] T 7ec8220975c3487fb08ddb14edb71cf5 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.630170 22480 tablet_replica.cc:333] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.630722 22480 raft_consensus.cc:2243] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.631107 22480 raft_consensus.cc:2272] T 9dfd4e6006ea4c7f9d4a960a1e0ffdc6 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.632978 22480 tablet_replica.cc:333] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.633504 22480 raft_consensus.cc:2243] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.634192 22480 raft_consensus.cc:2272] T 0eecdc9a6c45481b8148098fe8e47232 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.636075 22480 tablet_replica.cc:333] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.636663 22480 raft_consensus.cc:2243] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.637167 22480 raft_consensus.cc:2272] T 5aa7046f9ae649068369e98a43c01171 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.639714 22480 tablet_replica.cc:333] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.640430 22480 raft_consensus.cc:2243] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.641057 22480 raft_consensus.cc:2272] T 584ae225b8df4057bf6eb29eb393c7e2 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.641215   672 raft_consensus.cc:493] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:36.641821   672 raft_consensus.cc:515] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:36.643769 22480 tablet_replica.cc:333] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.643978   672 leader_election.cc:290] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:36.644546 22480 raft_consensus.cc:2243] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.645169 22480 raft_consensus.cc:2272] T d1a83560836343219eaeb0ba1a0bc451 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.647926 22480 tablet_replica.cc:333] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c: stopping tablet replica
W20260709 13:12:36.648474 32098 leader_election.cc:336] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Network error: Client connection negotiation failed: client connection to 127.21.244.2:45831: connect: Connection refused (error 111)
I20260709 13:12:36.648706 22480 raft_consensus.cc:2243] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.649281 22480 raft_consensus.cc:2272] T 7b7b78e7c3d1417b8b4035b246334cbe P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:36.649528 32098 leader_election.cc:336] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:36.649964 32098 leader_election.cc:304] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:36.650624   672 raft_consensus.cc:2749] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.651597 22480 tablet_replica.cc:333] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.652302 22480 raft_consensus.cc:2243] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.652769 22480 raft_consensus.cc:2272] T 6ae250d6acb34e1692cfe5ab3cce75ca P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.654709 22480 tablet_replica.cc:333] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.655241 22480 raft_consensus.cc:2243] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.656086 22480 raft_consensus.cc:2272] T f9b84cbd41b64e929eaab29437b49118 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.657929 22480 tablet_replica.cc:333] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.658456 22480 raft_consensus.cc:2243] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.658854 22480 raft_consensus.cc:2272] T fd01da40464a4c3e907fbd4a05e7cf08 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.660815 22480 tablet_replica.cc:333] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.660737   672 raft_consensus.cc:493] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:36.661509 22480 raft_consensus.cc:2243] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.661343   672 raft_consensus.cc:515] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:36.662142 22480 raft_consensus.cc:2272] T be53aa47c89a49dd98dd5050d875c00e P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.663394   672 leader_election.cc:290] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:36.664721 22480 tablet_replica.cc:333] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.665625 22480 raft_consensus.cc:2243] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.666639 22480 raft_consensus.cc:2272] T 95d018ee52cc46cebe51e75edec5abe5 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:36.669418 32099 consensus_peers.cc:597] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c -> Peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Couldn't send request to peer 27177ca9073b4128b8844b7cb37db32a. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.3:34161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.670264 22480 tablet_replica.cc:333] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c: stopping tablet replica
W20260709 13:12:36.670761 32098 leader_election.cc:336] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:36.671214 22480 raft_consensus.cc:2243] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:12:36.671483 32098 leader_election.cc:336] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Network error: Client connection negotiation failed: client connection to 127.21.244.2:45831: connect: Connection refused (error 111)
I20260709 13:12:36.671885 32098 leader_election.cc:304] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:36.672317 22480 raft_consensus.cc:2272] T 540d3a54268745adb1ed6108ca819925 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.672588   672 raft_consensus.cc:2749] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:36.674641 22480 tablet_replica.cc:333] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.675356 22480 raft_consensus.cc:2243] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.675909 22480 raft_consensus.cc:2272] T decee8d0520647f5a637ec4bc4237722 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.678531 22480 tablet_replica.cc:333] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.679347 22480 raft_consensus.cc:2243] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.680301 22480 raft_consensus.cc:2272] T cb7c99a3ac8c469995be8be36b6b8cf1 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.682304 22480 tablet_replica.cc:333] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.682914 22480 raft_consensus.cc:2243] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.683344 22480 raft_consensus.cc:2272] T 8a4c0d34f8964520b2dfcb86f12a18b6 P eacc546e751240eb804795d98213a57c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.685266 22480 tablet_replica.cc:333] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.685838 22480 raft_consensus.cc:2243] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.686618 22480 raft_consensus.cc:2272] T 24a52eeb653346c286bc79d5ee09d7b5 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.688619 22480 tablet_replica.cc:333] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.689208 22480 raft_consensus.cc:2243] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.689690 22480 raft_consensus.cc:2272] T be3e38a5bb6f4fd48b4bd695694eb7d9 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.689954   672 raft_consensus.cc:493] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:36.690568   672 raft_consensus.cc:515] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:36.692440 22480 tablet_replica.cc:333] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.692936   672 leader_election.cc:290] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:36.693396 22480 raft_consensus.cc:2243] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.694406 22480 raft_consensus.cc:2272] T af49880db24d43b08da39dc862b4c37b P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.697224 22480 tablet_replica.cc:333] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c: stopping tablet replica
W20260709 13:12:36.697388 32098 leader_election.cc:336] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:36.698103 22480 raft_consensus.cc:2243] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:12:36.698395 32098 leader_election.cc:336] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Network error: Client connection negotiation failed: client connection to 127.21.244.2:45831: connect: Connection refused (error 111)
I20260709 13:12:36.698992 32098 leader_election.cc:304] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:36.699123 22480 raft_consensus.cc:2272] T ced69c1fedef46c1a15fcea51cc970f4 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.699605   672 raft_consensus.cc:2749] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.701891 22480 tablet_replica.cc:333] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.702549 22480 raft_consensus.cc:2243] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.703001 22480 raft_consensus.cc:2272] T b358dd69e0a54cdf8e94474ade4e7046 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.704535   672 raft_consensus.cc:493] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:36.705098 22480 tablet_replica.cc:333] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.705080   672 raft_consensus.cc:515] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27177ca9073b4128b8844b7cb37db32a" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 34161 } } peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } }
I20260709 13:12:36.705823 22480 raft_consensus.cc:2243] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.706308 22480 raft_consensus.cc:2272] T 2a24126e79904519a77414eb98380575 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.707420   672 leader_election.cc:290] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161), 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269)
I20260709 13:12:36.708777 22480 tablet_replica.cc:333] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.709612 22480 raft_consensus.cc:2243] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.710213 22480 raft_consensus.cc:2272] T e98700f72c2d466b951e6776bdc74e2f P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:36.711594 32099 leader_election.cc:336] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 27177ca9073b4128b8844b7cb37db32a (127.21.244.3:34161): Network error: Client connection negotiation failed: client connection to 127.21.244.3:34161: connect: Connection refused (error 111)
W20260709 13:12:36.712479 32098 leader_election.cc:336] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
I20260709 13:12:36.712877 32098 leader_election.cc:304] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 27177ca9073b4128b8844b7cb37db32a, 936b035f23a5449fb43db3fd5f757325
I20260709 13:12:36.712965 22480 tablet_replica.cc:333] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.713590 22480 raft_consensus.cc:2243] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.713536   672 raft_consensus.cc:2749] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:36.714221 22480 raft_consensus.cc:2272] T 7d6829450035496cad51a237b822114a P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.716364 22480 tablet_replica.cc:333] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.716938 22480 raft_consensus.cc:2243] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.717366 22480 raft_consensus.cc:2272] T 2effe556ccc642379972492cef9bf0a0 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.719425 22480 tablet_replica.cc:333] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.720039 22480 raft_consensus.cc:2243] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.720469 22480 raft_consensus.cc:2272] T 78e0ed9b586e440c98baa7861469e247 P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.722496 22480 tablet_replica.cc:333] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.723030 22480 raft_consensus.cc:2243] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.723868 22480 raft_consensus.cc:2272] T 209aeaad860746c39ef57d290c03b5fe P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.725752 22480 tablet_replica.cc:333] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.726317 22480 raft_consensus.cc:2243] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.727119 22480 raft_consensus.cc:2272] T bdf375d76dea417eaf6400807194cf2d P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.729036 22480 tablet_replica.cc:333] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.729638 22480 raft_consensus.cc:2243] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.730229 22480 raft_consensus.cc:2272] T f4253f6805a1465ca31a5979bb0632e6 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.732791 22480 tablet_replica.cc:333] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.733492 22480 raft_consensus.cc:2243] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.733881 22480 raft_consensus.cc:2272] T c8212163be194b95a51643b109e411a8 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.735843 22480 tablet_replica.cc:333] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.736308 22480 raft_consensus.cc:2243] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.736685 22480 raft_consensus.cc:2272] T a78fc46a6c3f474cacfa16b058f035cd P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.738622 22480 tablet_replica.cc:333] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.739154 22480 raft_consensus.cc:2243] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.739588 22480 raft_consensus.cc:2272] T 3c4dd4a38fc647e3a2ad4a953c649261 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.742129 22480 tablet_replica.cc:333] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.742875 22480 raft_consensus.cc:2243] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.743872 22480 raft_consensus.cc:2272] T 69fe566df0914a4799610044a0e01daa P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.746176 22480 tablet_replica.cc:333] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.746927 22480 raft_consensus.cc:2243] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.747347 22480 raft_consensus.cc:2272] T 101f0f9b51684b15a3f577bf4685bb9c P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.749269 22480 tablet_replica.cc:333] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.749830 22480 raft_consensus.cc:2243] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.750290 22480 raft_consensus.cc:2272] T a68212da6ed34d7ca6eada16ee48977a P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.751713   672 raft_consensus.cc:493] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 936b035f23a5449fb43db3fd5f757325)
I20260709 13:12:36.752415 22480 tablet_replica.cc:333] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.752209   672 raft_consensus.cc:515] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eacc546e751240eb804795d98213a57c" member_type: VOTER last_known_addr { host: "127.21.244.4" port: 43793 } } peers { permanent_uuid: "936b035f23a5449fb43db3fd5f757325" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 33269 } } peers { permanent_uuid: "ab61be703111416d9fba543ea97b2224" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 45831 } }
I20260709 13:12:36.753042 22480 raft_consensus.cc:2243] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.753872 22480 raft_consensus.cc:2272] T 858cfa025ea0471a97b28dd8a9d61990 P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.754222   672 leader_election.cc:290] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269), ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831)
I20260709 13:12:36.756590 22480 tablet_replica.cc:333] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.757283 22480 raft_consensus.cc:2243] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.757839 22480 raft_consensus.cc:2272] T 8ddd1afa9aee435da29e4c2ee2885a46 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:36.758193 32098 leader_election.cc:336] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 936b035f23a5449fb43db3fd5f757325 (127.21.244.1:33269): Network error: Client connection negotiation failed: client connection to 127.21.244.1:33269: connect: Connection refused (error 111)
W20260709 13:12:36.758829 32098 leader_election.cc:336] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ab61be703111416d9fba543ea97b2224 (127.21.244.2:45831): Network error: Client connection negotiation failed: client connection to 127.21.244.2:45831: connect: Connection refused (error 111)
I20260709 13:12:36.759135 32098 leader_election.cc:304] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eacc546e751240eb804795d98213a57c; no voters: 936b035f23a5449fb43db3fd5f757325, ab61be703111416d9fba543ea97b2224
I20260709 13:12:36.759712   672 raft_consensus.cc:2749] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:36.760294 22480 tablet_replica.cc:333] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.760854 22480 raft_consensus.cc:2243] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.761303 22480 raft_consensus.cc:2272] T c923d9fd0eba46a5bd77f4b0359907ad P eacc546e751240eb804795d98213a57c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.763150 22480 tablet_replica.cc:333] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.763609 22480 raft_consensus.cc:2243] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.764068 22480 raft_consensus.cc:2272] T cd4d256597f64c68b23aefc1246fefcd P eacc546e751240eb804795d98213a57c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.765846 22480 tablet_replica.cc:333] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c: stopping tablet replica
I20260709 13:12:36.766314 22480 raft_consensus.cc:2243] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.766758 22480 raft_consensus.cc:2272] T f82695c4f13842c1a0e66c48751f9025 P eacc546e751240eb804795d98213a57c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.833851 22480 tablet_server.cc:196] TabletServer@127.21.244.4:0 shutdown complete.
I20260709 13:12:36.897125 22480 master.cc:562] Master@127.21.244.62:44861 shutting down...
I20260709 13:12:36.925311 22480 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.926010 22480 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.926380 22480 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9c70f72e2da24b5f869af8f58d656fc7: stopping tablet replica
I20260709 13:12:36.975097 22480 master.cc:584] Master@127.21.244.62:44861 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34879 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:12:37.067314 22480 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.244.62:42731
I20260709 13:12:37.068569 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:37.075354   679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:37.075389   680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:37.075887   682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:37.076996 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:37.078292 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:37.078512 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:37.078652 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602757078640 us; error 0 us; skew 500 ppm
I20260709 13:12:37.079178 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:37.082126 22480 webserver.cc:533] Webserver started at http://127.21.244.62:41567/ using document root <none> and password file <none>
I20260709 13:12:37.082654 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:37.082840 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:37.083112 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:37.084379 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/master-0-root/instance:
uuid: "e7aa8a8dd83442239e19622f92799e4f"
format_stamp: "Formatted at 2026-07-09 13:12:37 on dist-test-slave-j314"
I20260709 13:12:37.089756 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:12:37.093400   687 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.094331 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:12:37.094717 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/master-0-root
uuid: "e7aa8a8dd83442239e19622f92799e4f"
format_stamp: "Formatted at 2026-07-09 13:12:37 on dist-test-slave-j314"
I20260709 13:12:37.095371 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:37.114316 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:37.115585 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:37.160820 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.62:42731
I20260709 13:12:37.160943   738 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.62:42731 every 8 connection(s)
I20260709 13:12:37.165329   739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.177007   739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f: Bootstrap starting.
I20260709 13:12:37.182160   739 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.186978   739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f: No bootstrap required, opened a new log
I20260709 13:12:37.189286   739 raft_consensus.cc:359] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa8a8dd83442239e19622f92799e4f" member_type: VOTER }
I20260709 13:12:37.189713   739 raft_consensus.cc:385] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.190007   739 raft_consensus.cc:740] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7aa8a8dd83442239e19622f92799e4f, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.190613   739 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa8a8dd83442239e19622f92799e4f" member_type: VOTER }
I20260709 13:12:37.191089   739 raft_consensus.cc:399] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:37.191341   739 raft_consensus.cc:493] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:37.191619   739 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.196748   739 raft_consensus.cc:515] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa8a8dd83442239e19622f92799e4f" member_type: VOTER }
I20260709 13:12:37.197312   739 leader_election.cc:304] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7aa8a8dd83442239e19622f92799e4f; no voters: 
I20260709 13:12:37.198585   739 leader_election.cc:290] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:37.199151   742 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.200752   742 raft_consensus.cc:697] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [term 1 LEADER]: Becoming Leader. State: Replica: e7aa8a8dd83442239e19622f92799e4f, State: Running, Role: LEADER
I20260709 13:12:37.201397   739 sys_catalog.cc:565] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:37.201403   742 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa8a8dd83442239e19622f92799e4f" member_type: VOTER }
I20260709 13:12:37.206773   743 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7aa8a8dd83442239e19622f92799e4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa8a8dd83442239e19622f92799e4f" member_type: VOTER } }
I20260709 13:12:37.207497   743 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:37.207818   744 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7aa8a8dd83442239e19622f92799e4f. Latest consensus state: current_term: 1 leader_uuid: "e7aa8a8dd83442239e19622f92799e4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa8a8dd83442239e19622f92799e4f" member_type: VOTER } }
I20260709 13:12:37.208564   744 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:37.211396   751 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:37.219591   751 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:37.220839 22480 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:37.229665   751 catalog_manager.cc:1383] Generated new cluster ID: f9ea315ef0744aafa8ffa32b76f26cad
I20260709 13:12:37.230000   751 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:37.253909   751 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:37.255295   751 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:37.269893   751 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f: Generated new TSK 0
I20260709 13:12:37.270578   751 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:37.287968 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:37.294800   760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:37.296192   761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:37.298797   763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:37.301875 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:37.302965 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:37.303159 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:37.303273 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602757303261 us; error 0 us; skew 500 ppm
I20260709 13:12:37.303911 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:37.306414 22480 webserver.cc:533] Webserver started at http://127.21.244.1:38887/ using document root <none> and password file <none>
I20260709 13:12:37.306903 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:37.307066 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:37.307282 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:37.308423 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-0-root/instance:
uuid: "7139fb3b1dfe460c8941ec114a267673"
format_stamp: "Formatted at 2026-07-09 13:12:37 on dist-test-slave-j314"
I20260709 13:12:37.313254 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:37.317438   768 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.318532 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:12:37.318890 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-0-root
uuid: "7139fb3b1dfe460c8941ec114a267673"
format_stamp: "Formatted at 2026-07-09 13:12:37 on dist-test-slave-j314"
I20260709 13:12:37.319205 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:37.333951 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:37.335340 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:37.337131 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:37.339715 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:37.340026 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.340314 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:37.340526 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.386940 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.1:42817
I20260709 13:12:37.387061   830 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.1:42817 every 8 connection(s)
I20260709 13:12:37.392823 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:37.400337   835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:37.401240   836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:37.408668 22480 server_base.cc:1061] running on GCE node
W20260709 13:12:37.409729   838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:37.409917   831 heartbeater.cc:344] Connected to a master server at 127.21.244.62:42731
I20260709 13:12:37.410519   831 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:37.411116 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:37.411482 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:37.411581   831 heartbeater.cc:507] Master 127.21.244.62:42731 requested a full tablet report, sending...
I20260709 13:12:37.411798 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602757411771 us; error 0 us; skew 500 ppm
I20260709 13:12:37.412712 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:37.414822   704 ts_manager.cc:194] Registered new tserver with Master: 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817)
I20260709 13:12:37.415992 22480 webserver.cc:533] Webserver started at http://127.21.244.2:37165/ using document root <none> and password file <none>
I20260709 13:12:37.416646 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:37.416893 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:37.417207 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:37.417234   704 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38184
I20260709 13:12:37.418707 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-1-root/instance:
uuid: "2034411b1c53426d8fe8c8de3faa928a"
format_stamp: "Formatted at 2026-07-09 13:12:37 on dist-test-slave-j314"
I20260709 13:12:37.425612 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:37.429929   843 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.430960 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:12:37.431398 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-1-root
uuid: "2034411b1c53426d8fe8c8de3faa928a"
format_stamp: "Formatted at 2026-07-09 13:12:37 on dist-test-slave-j314"
I20260709 13:12:37.431972 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:37.470762 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:37.472190 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:37.473927 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:37.476431 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:37.476688 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.476967 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:37.477171 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.525261 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.2:33955
I20260709 13:12:37.525408   905 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.2:33955 every 8 connection(s)
I20260709 13:12:37.530712 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:37.538918   909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:37.539573   910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:37.544831   912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:37.545696 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:37.547597 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:37.547633   906 heartbeater.cc:344] Connected to a master server at 127.21.244.62:42731
W20260709 13:12:37.548014 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:37.548285   906 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:37.548305 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602757548286 us; error 0 us; skew 500 ppm
I20260709 13:12:37.549273   906 heartbeater.cc:507] Master 127.21.244.62:42731 requested a full tablet report, sending...
I20260709 13:12:37.549281 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:37.552222   704 ts_manager.cc:194] Registered new tserver with Master: 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:37.553081 22480 webserver.cc:533] Webserver started at http://127.21.244.3:35473/ using document root <none> and password file <none>
I20260709 13:12:37.553777 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:37.554005 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:37.554195   704 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38190
I20260709 13:12:37.554327 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:37.556066 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-2-root/instance:
uuid: "bcf313584d14499ca6d072cad277fb28"
format_stamp: "Formatted at 2026-07-09 13:12:37 on dist-test-slave-j314"
I20260709 13:12:37.560913 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:12:37.564723   917 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.565930 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:12:37.566324 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-2-root
uuid: "bcf313584d14499ca6d072cad277fb28"
format_stamp: "Formatted at 2026-07-09 13:12:37 on dist-test-slave-j314"
I20260709 13:12:37.566666 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:37.579684 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:37.581018 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:37.582590 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:37.585047 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:37.585304 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.585559 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:37.585737 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.630580 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.3:39537
I20260709 13:12:37.630688   979 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.3:39537 every 8 connection(s)
I20260709 13:12:37.645126   980 heartbeater.cc:344] Connected to a master server at 127.21.244.62:42731
I20260709 13:12:37.645557   980 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:37.646404   980 heartbeater.cc:507] Master 127.21.244.62:42731 requested a full tablet report, sending...
I20260709 13:12:37.648516   704 ts_manager.cc:194] Registered new tserver with Master: bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:37.648809 22480 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014839168s
I20260709 13:12:37.650456   704 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38202
I20260709 13:12:37.677834   704 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38208:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:37.680887   704 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:37.776085   945 tablet_service.cc:1511] Processing CreateTablet for tablet 7956150d92a14f2187a67c3bc13565bf (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:37.777802   945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7956150d92a14f2187a67c3bc13565bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.790074   871 tablet_service.cc:1511] Processing CreateTablet for tablet 7956150d92a14f2187a67c3bc13565bf (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:37.792979   944 tablet_service.cc:1511] Processing CreateTablet for tablet 09449114c5a64c6d9d984d5f0882411f (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:37.794648   944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09449114c5a64c6d9d984d5f0882411f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.796967   943 tablet_service.cc:1511] Processing CreateTablet for tablet 665df68040504ecf9e42dc0b11fbd6bd (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:37.799657   942 tablet_service.cc:1511] Processing CreateTablet for tablet f006b75ac1cb4725babf514d7cad4aa8 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:37.801061   795 tablet_service.cc:1511] Processing CreateTablet for tablet 09449114c5a64c6d9d984d5f0882411f (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:37.802229   792 tablet_service.cc:1511] Processing CreateTablet for tablet 03c4e4ea5be945ff9b3aa47c466f9882 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:37.805524   795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09449114c5a64c6d9d984d5f0882411f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.803692   940 tablet_service.cc:1511] Processing CreateTablet for tablet 7eaaa5966c894a85b39aa94699226c23 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:37.805889   791 tablet_service.cc:1511] Processing CreateTablet for tablet 7eaaa5966c894a85b39aa94699226c23 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:37.804106   794 tablet_service.cc:1511] Processing CreateTablet for tablet 665df68040504ecf9e42dc0b11fbd6bd (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:37.807381   791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eaaa5966c894a85b39aa94699226c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.805080   939 tablet_service.cc:1511] Processing CreateTablet for tablet e174613a3500487aba780be14a9117ce (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:37.808444   794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 665df68040504ecf9e42dc0b11fbd6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.809652   871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7956150d92a14f2187a67c3bc13565bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.802273   941 tablet_service.cc:1511] Processing CreateTablet for tablet 03c4e4ea5be945ff9b3aa47c466f9882 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:37.799674   796 tablet_service.cc:1511] Processing CreateTablet for tablet 7956150d92a14f2187a67c3bc13565bf (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:37.815279   792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c4e4ea5be945ff9b3aa47c466f9882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.805387   793 tablet_service.cc:1511] Processing CreateTablet for tablet f006b75ac1cb4725babf514d7cad4aa8 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:37.813521   941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c4e4ea5be945ff9b3aa47c466f9882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.817509   793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f006b75ac1cb4725babf514d7cad4aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.818022   939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e174613a3500487aba780be14a9117ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.819712   796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7956150d92a14f2187a67c3bc13565bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.819556   790 tablet_service.cc:1511] Processing CreateTablet for tablet e174613a3500487aba780be14a9117ce (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:37.821249   790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e174613a3500487aba780be14a9117ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.821298   940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eaaa5966c894a85b39aa94699226c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.824100   943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 665df68040504ecf9e42dc0b11fbd6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.825742   942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f006b75ac1cb4725babf514d7cad4aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.826825   870 tablet_service.cc:1511] Processing CreateTablet for tablet 09449114c5a64c6d9d984d5f0882411f (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:37.828459   870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09449114c5a64c6d9d984d5f0882411f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.831640   869 tablet_service.cc:1511] Processing CreateTablet for tablet 665df68040504ecf9e42dc0b11fbd6bd (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:37.833756   869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 665df68040504ecf9e42dc0b11fbd6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.840169   789 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0dedae9c894b3d807d36078e7fdcf4 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:37.841322   866 tablet_service.cc:1511] Processing CreateTablet for tablet 7eaaa5966c894a85b39aa94699226c23 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:37.842197   789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0dedae9c894b3d807d36078e7fdcf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.843412   866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eaaa5966c894a85b39aa94699226c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.843915   868 tablet_service.cc:1511] Processing CreateTablet for tablet f006b75ac1cb4725babf514d7cad4aa8 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:37.846920   868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f006b75ac1cb4725babf514d7cad4aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.837443   867 tablet_service.cc:1511] Processing CreateTablet for tablet 03c4e4ea5be945ff9b3aa47c466f9882 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:37.849388   867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c4e4ea5be945ff9b3aa47c466f9882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.859961   938 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0dedae9c894b3d807d36078e7fdcf4 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:37.861713   938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0dedae9c894b3d807d36078e7fdcf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.865756   865 tablet_service.cc:1511] Processing CreateTablet for tablet e174613a3500487aba780be14a9117ce (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:37.867424   865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e174613a3500487aba780be14a9117ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.869171   864 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0dedae9c894b3d807d36078e7fdcf4 (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:37.871871   863 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac44e9eb6554e0d8d884847054ea51a (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:37.874821   862 tablet_service.cc:1511] Processing CreateTablet for tablet b01f80de6c1042e6858c677b49d5866d (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:37.880138   863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac44e9eb6554e0d8d884847054ea51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.882050   788 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac44e9eb6554e0d8d884847054ea51a (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:37.883898   788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac44e9eb6554e0d8d884847054ea51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.884655   864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0dedae9c894b3d807d36078e7fdcf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.888198   862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01f80de6c1042e6858c677b49d5866d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.894033   937 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac44e9eb6554e0d8d884847054ea51a (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:37.905814   787 tablet_service.cc:1511] Processing CreateTablet for tablet b01f80de6c1042e6858c677b49d5866d (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:37.907776   787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01f80de6c1042e6858c677b49d5866d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.915867   936 tablet_service.cc:1511] Processing CreateTablet for tablet b01f80de6c1042e6858c677b49d5866d (DEFAULT_TABLE table=test-workload [id=0e828f2570d143538a9c065d9e414d70]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:37.922736   937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac44e9eb6554e0d8d884847054ea51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.928071   995 tablet_bootstrap.cc:492] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28: Bootstrap starting.
I20260709 13:12:37.932943   936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01f80de6c1042e6858c677b49d5866d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.962375   995 tablet_bootstrap.cc:654] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.988940   997 tablet_bootstrap.cc:492] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a: Bootstrap starting.
I20260709 13:12:38.010290   997 tablet_bootstrap.cc:654] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.018234   995 tablet_bootstrap.cc:492] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28: No bootstrap required, opened a new log
I20260709 13:12:38.018868   995 ts_tablet_manager.cc:1403] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.003s
I20260709 13:12:38.022312   995 raft_consensus.cc:359] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:38.023115   995 raft_consensus.cc:385] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.023507   995 raft_consensus.cc:740] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.024686   995 consensus_queue.cc:260] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:38.040145   996 tablet_bootstrap.cc:492] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:38.041877   997 tablet_bootstrap.cc:492] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a: No bootstrap required, opened a new log
I20260709 13:12:38.052933   997 ts_tablet_manager.cc:1403] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.005s
I20260709 13:12:38.057165   997 raft_consensus.cc:359] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.058094   997 raft_consensus.cc:385] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.058470   997 raft_consensus.cc:740] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.059518   997 consensus_queue.cc:260] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.060971   980 heartbeater.cc:499] Master 127.21.244.62:42731 was elected leader, sending a full tablet report...
I20260709 13:12:38.061523   995 ts_tablet_manager.cc:1434] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28: Time spent starting tablet: real 0.042s	user 0.012s	sys 0.006s
I20260709 13:12:38.062688   995 tablet_bootstrap.cc:492] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28: Bootstrap starting.
I20260709 13:12:38.064329   996 tablet_bootstrap.cc:654] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.078434   995 tablet_bootstrap.cc:654] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.080093   906 heartbeater.cc:499] Master 127.21.244.62:42731 was elected leader, sending a full tablet report...
I20260709 13:12:38.080860   997 ts_tablet_manager.cc:1434] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a: Time spent starting tablet: real 0.027s	user 0.012s	sys 0.013s
I20260709 13:12:38.082129   997 tablet_bootstrap.cc:492] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a: Bootstrap starting.
I20260709 13:12:38.090781   996 tablet_bootstrap.cc:492] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673: No bootstrap required, opened a new log
I20260709 13:12:38.091610   996 ts_tablet_manager.cc:1403] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.016s
I20260709 13:12:38.091789  1001 raft_consensus.cc:493] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.092587  1001 raft_consensus.cc:515] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.095103  1001 leader_election.cc:290] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.100118   996 raft_consensus.cc:359] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.111264   996 raft_consensus.cc:385] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.111635   996 raft_consensus.cc:740] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.110085   997 tablet_bootstrap.cc:654] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.107052   995 tablet_bootstrap.cc:492] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28: No bootstrap required, opened a new log
I20260709 13:12:38.112562   996 consensus_queue.cc:260] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.113602   995 ts_tablet_manager.cc:1403] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.017s
I20260709 13:12:38.117499   995 raft_consensus.cc:359] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.119874   995 raft_consensus.cc:385] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.120234   995 raft_consensus.cc:740] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.124801   831 heartbeater.cc:499] Master 127.21.244.62:42731 was elected leader, sending a full tablet report...
I20260709 13:12:38.124423   995 consensus_queue.cc:260] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.129256   995 ts_tablet_manager.cc:1434] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:12:38.130668   995 tablet_bootstrap.cc:492] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28: Bootstrap starting.
I20260709 13:12:38.132709   996 ts_tablet_manager.cc:1434] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 13:12:38.131687   997 tablet_bootstrap.cc:492] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a: No bootstrap required, opened a new log
I20260709 13:12:38.133478   997 ts_tablet_manager.cc:1403] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.009s
W20260709 13:12:38.134997   981 tablet.cc:2406] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:38.130708   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01f80de6c1042e6858c677b49d5866d" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673" is_pre_election: true
I20260709 13:12:38.136301   997 raft_consensus.cc:359] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.137082   997 raft_consensus.cc:385] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.137395   997 raft_consensus.cc:740] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.138545   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01f80de6c1042e6858c677b49d5866d" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:38.138346   997 consensus_queue.cc:260] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
W20260709 13:12:38.140492   845 leader_election.cc:343] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.139389   955 raft_consensus.cc:2468] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 0.
I20260709 13:12:38.142568   995 tablet_bootstrap.cc:654] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.142639   845 leader_election.cc:304] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 7139fb3b1dfe460c8941ec114a267673
I20260709 13:12:38.143626   997 ts_tablet_manager.cc:1434] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:38.144507  1001 raft_consensus.cc:2804] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.144865   997 tablet_bootstrap.cc:492] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a: Bootstrap starting.
I20260709 13:12:38.144970  1001 raft_consensus.cc:493] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.145548  1001 raft_consensus.cc:3060] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.148697   996 tablet_bootstrap.cc:492] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:38.154175  1001 raft_consensus.cc:515] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.157618   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01f80de6c1042e6858c677b49d5866d" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
W20260709 13:12:38.159361   845 leader_election.cc:343] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.162019   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01f80de6c1042e6858c677b49d5866d" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:38.162825   955 raft_consensus.cc:3060] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.164670   997 tablet_bootstrap.cc:654] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.168812   996 tablet_bootstrap.cc:654] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.172152  1001 leader_election.cc:290] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.174600   955 raft_consensus.cc:2468] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 1.
I20260709 13:12:38.176129   845 leader_election.cc:304] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 7139fb3b1dfe460c8941ec114a267673
I20260709 13:12:38.178087  1001 raft_consensus.cc:2804] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.182088  1001 raft_consensus.cc:697] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 1 LEADER]: Becoming Leader. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:38.183034  1001 consensus_queue.cc:237] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.189043   996 tablet_bootstrap.cc:492] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673: No bootstrap required, opened a new log
I20260709 13:12:38.189349   995 tablet_bootstrap.cc:492] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28: No bootstrap required, opened a new log
I20260709 13:12:38.189945   996 ts_tablet_manager.cc:1403] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.006s
I20260709 13:12:38.190089   995 ts_tablet_manager.cc:1403] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.025s
I20260709 13:12:38.193186   997 tablet_bootstrap.cc:492] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a: No bootstrap required, opened a new log
I20260709 13:12:38.193806   997 ts_tablet_manager.cc:1403] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.015s
I20260709 13:12:38.193584   996 raft_consensus.cc:359] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.194542   996 raft_consensus.cc:385] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.194922   996 raft_consensus.cc:740] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.194818   995 raft_consensus.cc:359] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.195793   995 raft_consensus.cc:385] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.196198   995 raft_consensus.cc:740] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.195959   996 consensus_queue.cc:260] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.196905   997 raft_consensus.cc:359] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.197036   995 consensus_queue.cc:260] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.197667   997 raft_consensus.cc:385] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.199599   995 ts_tablet_manager.cc:1434] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:38.200304   996 ts_tablet_manager.cc:1434] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:38.200755   995 tablet_bootstrap.cc:492] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28: Bootstrap starting.
I20260709 13:12:38.201370   996 tablet_bootstrap.cc:492] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:38.201870   704 catalog_manager.cc:5697] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2). New cstate: current_term: 1 leader_uuid: "2034411b1c53426d8fe8c8de3faa928a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.198012   997 raft_consensus.cc:740] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.205113   997 consensus_queue.cc:260] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.207986   997 ts_tablet_manager.cc:1434] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:12:38.209281   997 tablet_bootstrap.cc:492] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a: Bootstrap starting.
I20260709 13:12:38.211750   996 tablet_bootstrap.cc:654] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.212273   995 tablet_bootstrap.cc:654] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.216586   997 tablet_bootstrap.cc:654] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.223959   996 tablet_bootstrap.cc:492] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673: No bootstrap required, opened a new log
I20260709 13:12:38.224486   996 ts_tablet_manager.cc:1403] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.003s
I20260709 13:12:38.227537   996 raft_consensus.cc:359] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.228315   996 raft_consensus.cc:385] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.234442   995 tablet_bootstrap.cc:492] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28: No bootstrap required, opened a new log
I20260709 13:12:38.234442   997 tablet_bootstrap.cc:492] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a: No bootstrap required, opened a new log
I20260709 13:12:38.235263   995 ts_tablet_manager.cc:1403] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.007s
I20260709 13:12:38.235705   997 ts_tablet_manager.cc:1403] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.012s
W20260709 13:12:38.238430   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:38.238744   997 raft_consensus.cc:359] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:38.238570   995 raft_consensus.cc:359] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.229705   996 raft_consensus.cc:740] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.239571   997 raft_consensus.cc:385] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.239842   995 raft_consensus.cc:385] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.240002   997 raft_consensus.cc:740] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.240442   995 raft_consensus.cc:740] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.240303   996 consensus_queue.cc:260] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.241057   997 consensus_queue.cc:260] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:38.241532   995 consensus_queue.cc:260] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.242806   996 ts_tablet_manager.cc:1434] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.002s
I20260709 13:12:38.244621   997 ts_tablet_manager.cc:1434] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:12:38.245738   997 tablet_bootstrap.cc:492] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a: Bootstrap starting.
I20260709 13:12:38.247385   996 tablet_bootstrap.cc:492] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:38.248561   995 ts_tablet_manager.cc:1434] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:12:38.251984   995 tablet_bootstrap.cc:492] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28: Bootstrap starting.
I20260709 13:12:38.252803   997 tablet_bootstrap.cc:654] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.258863   995 tablet_bootstrap.cc:654] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.262362   996 tablet_bootstrap.cc:654] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.270288   995 tablet_bootstrap.cc:492] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28: No bootstrap required, opened a new log
I20260709 13:12:38.270874   995 ts_tablet_manager.cc:1403] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:12:38.272965   996 tablet_bootstrap.cc:492] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673: No bootstrap required, opened a new log
I20260709 13:12:38.273603   996 ts_tablet_manager.cc:1403] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 13:12:38.274461   995 raft_consensus.cc:359] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.275327   995 raft_consensus.cc:385] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.275636   995 raft_consensus.cc:740] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.276604   995 consensus_queue.cc:260] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.277434   996 raft_consensus.cc:359] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.278579   996 raft_consensus.cc:385] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.278956   996 raft_consensus.cc:740] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.279024   995 ts_tablet_manager.cc:1434] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:38.280647   995 tablet_bootstrap.cc:492] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28: Bootstrap starting.
I20260709 13:12:38.288592   995 tablet_bootstrap.cc:654] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.292119  1000 raft_consensus.cc:493] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.292986  1000 raft_consensus.cc:515] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.306267  1000 leader_election.cc:290] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:38.307188   996 consensus_queue.cc:260] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.308439   997 tablet_bootstrap.cc:492] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a: No bootstrap required, opened a new log
I20260709 13:12:38.309208   997 ts_tablet_manager.cc:1403] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a: Time spent bootstrapping tablet: real 0.064s	user 0.038s	sys 0.023s
I20260709 13:12:38.309669   996 ts_tablet_manager.cc:1434] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:12:38.310820   996 tablet_bootstrap.cc:492] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:38.314265   997 raft_consensus.cc:359] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.315544   997 raft_consensus.cc:385] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.316020   997 raft_consensus.cc:740] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.318082   996 tablet_bootstrap.cc:654] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.317517   997 consensus_queue.cc:260] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.321208   997 ts_tablet_manager.cc:1434] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a: Time spent starting tablet: real 0.011s	user 0.012s	sys 0.000s
I20260709 13:12:38.322440   997 tablet_bootstrap.cc:492] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a: Bootstrap starting.
I20260709 13:12:38.326582  1001 raft_consensus.cc:493] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.327406  1001 raft_consensus.cc:515] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.329752  1001 leader_election.cc:290] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.330006   997 tablet_bootstrap.cc:654] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.331660   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac44e9eb6554e0d8d884847054ea51a" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673" is_pre_election: true
W20260709 13:12:38.333395   845 leader_election.cc:343] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.334824   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac44e9eb6554e0d8d884847054ea51a" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:38.326718  1007 raft_consensus.cc:493] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.336429  1007 raft_consensus.cc:515] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.338608   995 tablet_bootstrap.cc:492] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28: No bootstrap required, opened a new log
I20260709 13:12:38.339474   995 ts_tablet_manager.cc:1403] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.017s
I20260709 13:12:38.344599   995 raft_consensus.cc:359] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.345595   881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09449114c5a64c6d9d984d5f0882411f" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:38.346104   995 raft_consensus.cc:385] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.346411   881 raft_consensus.cc:2468] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 0.
I20260709 13:12:38.346627   995 raft_consensus.cc:740] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Initialized, Role: FOLLOWER
W20260709 13:12:38.349049   845 leader_election.cc:343] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.350265   845 leader_election.cc:304] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a; no voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28
I20260709 13:12:38.351681  1001 raft_consensus.cc:2749] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.349296  1007 leader_election.cc:290] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.348636   995 consensus_queue.cc:260] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.359390   996 tablet_bootstrap.cc:492] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673: No bootstrap required, opened a new log
I20260709 13:12:38.360323   996 ts_tablet_manager.cc:1403] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.003s
I20260709 13:12:38.360845   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09449114c5a64c6d9d984d5f0882411f" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673" is_pre_election: true
I20260709 13:12:38.361668   806 raft_consensus.cc:2468] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 0.
I20260709 13:12:38.363075   995 ts_tablet_manager.cc:1434] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.008s
I20260709 13:12:38.364828   996 raft_consensus.cc:359] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:38.365717   996 raft_consensus.cc:385] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.366101   996 raft_consensus.cc:740] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.365520   995 tablet_bootstrap.cc:492] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28: Bootstrap starting.
I20260709 13:12:38.366966   997 tablet_bootstrap.cc:492] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a: No bootstrap required, opened a new log
I20260709 13:12:38.367681   997 ts_tablet_manager.cc:1403] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.015s
I20260709 13:12:38.367081   996 consensus_queue.cc:260] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:38.363515   918 leader_election.cc:304] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:38.370378  1000 raft_consensus.cc:2804] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.370790  1000 raft_consensus.cc:493] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.371224  1000 raft_consensus.cc:3060] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.371424   997 raft_consensus.cc:359] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.372334   997 raft_consensus.cc:385] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.372656   997 raft_consensus.cc:740] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.373665   997 consensus_queue.cc:260] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.375586   995 tablet_bootstrap.cc:654] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.376780   997 ts_tablet_manager.cc:1434] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:12:38.377997   997 tablet_bootstrap.cc:492] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a: Bootstrap starting.
I20260709 13:12:38.385685   997 tablet_bootstrap.cc:654] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.393348   996 ts_tablet_manager.cc:1434] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:12:38.401773   997 tablet_bootstrap.cc:492] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a: No bootstrap required, opened a new log
I20260709 13:12:38.402436   997 ts_tablet_manager.cc:1403] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 13:12:38.405598   997 raft_consensus.cc:359] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.406447   997 raft_consensus.cc:385] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.406592   996 tablet_bootstrap.cc:492] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:38.406822   997 raft_consensus.cc:740] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.407672   997 consensus_queue.cc:260] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.413211   997 ts_tablet_manager.cc:1434] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260709 13:12:38.414366   997 tablet_bootstrap.cc:492] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a: Bootstrap starting.
I20260709 13:12:38.403080  1000 raft_consensus.cc:515] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.421844   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09449114c5a64c6d9d984d5f0882411f" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:38.422683   806 raft_consensus.cc:3060] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.424387   997 tablet_bootstrap.cc:654] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.436489   997 tablet_bootstrap.cc:492] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a: No bootstrap required, opened a new log
I20260709 13:12:38.437036   997 ts_tablet_manager.cc:1403] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:12:38.439914   997 raft_consensus.cc:359] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.440704   997 raft_consensus.cc:385] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.441017   997 raft_consensus.cc:740] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.441865   997 consensus_queue.cc:260] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.444084   881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09449114c5a64c6d9d984d5f0882411f" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:38.444959   881 raft_consensus.cc:3060] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.449069   997 ts_tablet_manager.cc:1434] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:38.449865   880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:38.450516   996 tablet_bootstrap.cc:654] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.450273   997 tablet_bootstrap.cc:492] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a: Bootstrap starting.
W20260709 13:12:38.453473   769 leader_election.cc:343] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.455878  1000 leader_election.cc:290] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:38.456604  1000 raft_consensus.cc:493] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.457072  1000 raft_consensus.cc:515] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.459203  1000 leader_election.cc:290] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:38.460446   805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eaaa5966c894a85b39aa94699226c23" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673" is_pre_election: true
W20260709 13:12:38.465466   919 leader_election.cc:343] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.466506   880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eaaa5966c894a85b39aa94699226c23" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
W20260709 13:12:38.468096   918 leader_election.cc:343] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.468617   918 leader_election.cc:304] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcf313584d14499ca6d072cad277fb28; no voters: 2034411b1c53426d8fe8c8de3faa928a, 7139fb3b1dfe460c8941ec114a267673
I20260709 13:12:38.469460   806 raft_consensus.cc:2468] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 1.
I20260709 13:12:38.470760  1000 raft_consensus.cc:2749] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.471027   919 leader_election.cc:304] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:38.473233   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:38.474409   955 raft_consensus.cc:2468] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 0.
I20260709 13:12:38.475327  1030 raft_consensus.cc:2804] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.475950  1030 raft_consensus.cc:697] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Becoming Leader. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:38.476037   770 leader_election.cc:304] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 2034411b1c53426d8fe8c8de3faa928a
I20260709 13:12:38.476533   881 raft_consensus.cc:2468] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 1.
I20260709 13:12:38.477437  1007 raft_consensus.cc:2804] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.477875  1007 raft_consensus.cc:493] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.478045   997 tablet_bootstrap.cc:654] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.478260  1007 raft_consensus.cc:3060] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.480201   995 tablet_bootstrap.cc:492] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28: No bootstrap required, opened a new log
I20260709 13:12:38.480769   995 ts_tablet_manager.cc:1403] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28: Time spent bootstrapping tablet: real 0.116s	user 0.028s	sys 0.051s
I20260709 13:12:38.482133   996 tablet_bootstrap.cc:492] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673: No bootstrap required, opened a new log
I20260709 13:12:38.482479  1000 raft_consensus.cc:493] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.476948  1030 consensus_queue.cc:237] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.483152  1000 raft_consensus.cc:515] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:38.483999   995 raft_consensus.cc:359] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.482692   996 ts_tablet_manager.cc:1403] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.005s
I20260709 13:12:38.484792   995 raft_consensus.cc:385] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.485185   995 raft_consensus.cc:740] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.485991   995 consensus_queue.cc:260] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.487814  1000 leader_election.cc:290] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:38.487077  1007 raft_consensus.cc:515] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.489328   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673" is_pre_election: true
I20260709 13:12:38.489425   996 raft_consensus.cc:359] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.490406   806 raft_consensus.cc:2468] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 0.
I20260709 13:12:38.490995   996 raft_consensus.cc:385] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.491499   996 raft_consensus.cc:740] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.492671   919 leader_election.cc:304] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:38.493323   880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:38.492980   996 consensus_queue.cc:260] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.494843   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:38.495046  1000 raft_consensus.cc:2804] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.495663  1000 raft_consensus.cc:493] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.496227  1000 raft_consensus.cc:3060] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:38.496423   769 leader_election.cc:343] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.495540   955 raft_consensus.cc:3060] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.491410  1007 leader_election.cc:290] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 election: Requested vote from peers 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.494838   881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:38.501341   881 raft_consensus.cc:2468] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 0.
I20260709 13:12:38.505298  1000 raft_consensus.cc:515] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:38.508224   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:38.508862   806 raft_consensus.cc:3060] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.509690   997 tablet_bootstrap.cc:492] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a: No bootstrap required, opened a new log
I20260709 13:12:38.510082   955 raft_consensus.cc:2468] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 1.
I20260709 13:12:38.510406   997 ts_tablet_manager.cc:1403] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.006s
I20260709 13:12:38.511437   770 leader_election.cc:304] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 2034411b1c53426d8fe8c8de3faa928a
I20260709 13:12:38.512965  1007 raft_consensus.cc:2804] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.513792   997 raft_consensus.cc:359] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.515306  1007 raft_consensus.cc:697] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 1 LEADER]: Becoming Leader. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Running, Role: LEADER
I20260709 13:12:38.517135  1007 consensus_queue.cc:237] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.517623   806 raft_consensus.cc:2468] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 1.
I20260709 13:12:38.515800  1036 raft_consensus.cc:493] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.510377   701 catalog_manager.cc:5697] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf313584d14499ca6d072cad277fb28 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "bcf313584d14499ca6d072cad277fb28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:38.518842   995 ts_tablet_manager.cc:1434] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28: Time spent starting tablet: real 0.038s	user 0.014s	sys 0.008s
I20260709 13:12:38.518910   997 raft_consensus.cc:385] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.519264   919 leader_election.cc:304] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:38.519569   997 raft_consensus.cc:740] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.520210   995 tablet_bootstrap.cc:492] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28: Bootstrap starting.
I20260709 13:12:38.520350  1034 raft_consensus.cc:2804] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.520743   997 consensus_queue.cc:260] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.521214  1034 raft_consensus.cc:697] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Becoming Leader. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:38.522255  1034 consensus_queue.cc:237] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:38.526693   996 ts_tablet_manager.cc:1434] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.008s
I20260709 13:12:38.527501   995 tablet_bootstrap.cc:654] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.531366   996 tablet_bootstrap.cc:492] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:38.531862   881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:38.532855   881 raft_consensus.cc:3060] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.536260  1035 raft_consensus.cc:493] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.526281  1036 raft_consensus.cc:515] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.536885  1035 raft_consensus.cc:515] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.540512  1036 leader_election.cc:290] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.541710  1000 leader_election.cc:290] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:38.542845   880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:38.543885   880 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 0.
I20260709 13:12:38.545621   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f006b75ac1cb4725babf514d7cad4aa8" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:38.546736   879 raft_consensus.cc:2468] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 0.
I20260709 13:12:38.549736   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f006b75ac1cb4725babf514d7cad4aa8" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:38.552580   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:38.553326   955 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 0.
I20260709 13:12:38.539647  1035 leader_election.cc:290] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.554773   769 leader_election.cc:304] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, 7139fb3b1dfe460c8941ec114a267673; no voters: 
I20260709 13:12:38.555981   996 tablet_bootstrap.cc:654] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.556368   769 leader_election.cc:304] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, 7139fb3b1dfe460c8941ec114a267673; no voters: 
I20260709 13:12:38.557566  1035 raft_consensus.cc:2804] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.557998  1035 raft_consensus.cc:493] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.558382  1035 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.564574   703 catalog_manager.cc:5697] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf313584d14499ca6d072cad277fb28 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "bcf313584d14499ca6d072cad277fb28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.567335  1035 raft_consensus.cc:515] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
W20260709 13:12:38.567685   770 leader_election.cc:343] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.572585  1007 raft_consensus.cc:2804] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.581660  1007 raft_consensus.cc:493] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.582391  1007 raft_consensus.cc:3060] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.580626   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:38.583309   955 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.580506   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:38.585247   879 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.579355  1035 leader_election.cc:290] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 election: Requested vote from peers 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.589398   997 ts_tablet_manager.cc:1434] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 13:12:38.589290  1001 raft_consensus.cc:493] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.590124  1001 raft_consensus.cc:515] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.590704   997 tablet_bootstrap.cc:492] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a: Bootstrap starting.
I20260709 13:12:38.592461  1001 leader_election.cc:290] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.594007   955 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 1.
I20260709 13:12:38.594971   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673" is_pre_election: true
I20260709 13:12:38.595409   770 leader_election.cc:304] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:38.595008   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:38.598129   881 raft_consensus.cc:2468] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 1.
I20260709 13:12:38.600209   997 tablet_bootstrap.cc:654] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.602244   879 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 1.
I20260709 13:12:38.582567   996 tablet_bootstrap.cc:492] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: No bootstrap required, opened a new log
I20260709 13:12:38.603924  1035 raft_consensus.cc:2804] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:38.602690   845 leader_election.cc:343] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.603521   996 ts_tablet_manager.cc:1403] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.012s
W20260709 13:12:38.604789   845 leader_election.cc:343] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.605301   845 leader_election.cc:304] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a; no voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28
I20260709 13:12:38.605798   995 tablet_bootstrap.cc:492] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28: No bootstrap required, opened a new log
I20260709 13:12:38.606357   995 ts_tablet_manager.cc:1403] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28: Time spent bootstrapping tablet: real 0.086s	user 0.029s	sys 0.044s
I20260709 13:12:38.606333  1011 raft_consensus.cc:2749] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.607232  1035 raft_consensus.cc:697] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 1 LEADER]: Becoming Leader. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Running, Role: LEADER
I20260709 13:12:38.608493  1011 consensus_queue.cc:1048] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.608680  1035 consensus_queue.cc:237] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.609608   995 raft_consensus.cc:359] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.610410   995 raft_consensus.cc:385] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.610627  1011 raft_consensus.cc:493] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.610698   995 raft_consensus.cc:740] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.611291  1011 raft_consensus.cc:515] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.611812   995 consensus_queue.cc:260] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.613440   996 raft_consensus.cc:359] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.614549   995 ts_tablet_manager.cc:1434] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:38.615682   995 tablet_bootstrap.cc:492] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28: Bootstrap starting.
I20260709 13:12:38.620834  1011 leader_election.cc:290] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.634649  1007 raft_consensus.cc:515] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.637247  1007 leader_election.cc:290] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 election: Requested vote from peers 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.622042   995 tablet_bootstrap.cc:654] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.614571   996 raft_consensus.cc:385] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.638065   996 raft_consensus.cc:740] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.638434   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f006b75ac1cb4725babf514d7cad4aa8" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:38.639128   879 raft_consensus.cc:3060] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.639022   996 consensus_queue.cc:260] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.639038   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f006b75ac1cb4725babf514d7cad4aa8" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:38.640434   954 raft_consensus.cc:3060] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.641856   996 ts_tablet_manager.cc:1434] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 13:12:38.643076   996 tablet_bootstrap.cc:492] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:38.624305   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e174613a3500487aba780be14a9117ce" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673" is_pre_election: true
I20260709 13:12:38.644388   806 raft_consensus.cc:2468] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 0.
I20260709 13:12:38.626564   953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e174613a3500487aba780be14a9117ce" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:38.645485   953 raft_consensus.cc:2468] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 0.
I20260709 13:12:38.603601   701 catalog_manager.cc:5697] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "7139fb3b1dfe460c8941ec114a267673" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.651000   954 raft_consensus.cc:2468] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 1.
I20260709 13:12:38.654286   845 leader_election.cc:304] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:38.655086   879 raft_consensus.cc:2468] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 1.
I20260709 13:12:38.655254  1011 raft_consensus.cc:2804] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.655953  1011 raft_consensus.cc:493] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.656425  1011 raft_consensus.cc:3060] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:38.656960   845 consensus_peers.cc:597] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:38.657356   996 tablet_bootstrap.cc:654] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.658197   770 leader_election.cc:304] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:38.659499  1007 raft_consensus.cc:2804] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.660104   997 tablet_bootstrap.cc:492] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a: No bootstrap required, opened a new log
I20260709 13:12:38.660059  1007 raft_consensus.cc:697] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 1 LEADER]: Becoming Leader. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Running, Role: LEADER
I20260709 13:12:38.660859   997 ts_tablet_manager.cc:1403] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a: Time spent bootstrapping tablet: real 0.070s	user 0.027s	sys 0.020s
I20260709 13:12:38.661410  1007 consensus_queue.cc:237] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.664031   997 raft_consensus.cc:359] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.664906   997 raft_consensus.cc:385] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.665202   997 raft_consensus.cc:740] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.666008   997 consensus_queue.cc:260] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.670053   995 tablet_bootstrap.cc:492] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28: No bootstrap required, opened a new log
I20260709 13:12:38.670616   995 ts_tablet_manager.cc:1403] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.001s
I20260709 13:12:38.674446   995 raft_consensus.cc:359] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.675455   995 raft_consensus.cc:385] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.675880   995 raft_consensus.cc:740] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.676848   995 consensus_queue.cc:260] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.667761   701 catalog_manager.cc:5697] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "7139fb3b1dfe460c8941ec114a267673" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.685707   995 ts_tablet_manager.cc:1434] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:12:38.687208   995 tablet_bootstrap.cc:492] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28: Bootstrap starting.
I20260709 13:12:38.705274   995 tablet_bootstrap.cc:654] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.723765   995 tablet_bootstrap.cc:492] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28: No bootstrap required, opened a new log
I20260709 13:12:38.724562   995 ts_tablet_manager.cc:1403] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.001s
I20260709 13:12:38.737406   995 raft_consensus.cc:359] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.738528   995 raft_consensus.cc:385] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.738907   995 raft_consensus.cc:740] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.745419   995 consensus_queue.cc:260] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.747838   995 ts_tablet_manager.cc:1434] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:12:38.748685   996 tablet_bootstrap.cc:492] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673: No bootstrap required, opened a new log
I20260709 13:12:38.749933   996 ts_tablet_manager.cc:1403] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.107s	user 0.031s	sys 0.032s
I20260709 13:12:38.764436  1001 raft_consensus.cc:493] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.765353  1001 raft_consensus.cc:515] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.773136   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673" is_pre_election: true
I20260709 13:12:38.776015  1011 raft_consensus.cc:515] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.793757  1011 leader_election.cc:290] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.786038  1001 leader_election.cc:290] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:38.794997   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e174613a3500487aba780be14a9117ce" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:38.795775   806 raft_consensus.cc:3060] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.796056   996 raft_consensus.cc:359] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.796792   997 ts_tablet_manager.cc:1434] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a: Time spent starting tablet: real 0.136s	user 0.065s	sys 0.066s
I20260709 13:12:38.784809   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:38.796841   996 raft_consensus.cc:385] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.798156   996 raft_consensus.cc:740] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.798983   996 consensus_queue.cc:260] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.799319   703 catalog_manager.cc:5697] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "7139fb3b1dfe460c8941ec114a267673" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.801932   996 ts_tablet_manager.cc:1434] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:12:38.802322   954 raft_consensus.cc:2393] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2034411b1c53426d8fe8c8de3faa928a in current term 1: Already voted for candidate 7139fb3b1dfe460c8941ec114a267673 in this term.
I20260709 13:12:38.803076   996 tablet_bootstrap.cc:492] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:38.804978   845 leader_election.cc:304] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a; no voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28
I20260709 13:12:38.806479  1048 raft_consensus.cc:3060] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.809973   996 tablet_bootstrap.cc:654] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.812306   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e174613a3500487aba780be14a9117ce" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:38.813046   954 raft_consensus.cc:3060] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.817226  1048 raft_consensus.cc:2749] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.823016   996 tablet_bootstrap.cc:492] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673: No bootstrap required, opened a new log
I20260709 13:12:38.823601   996 ts_tablet_manager.cc:1403] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 13:12:38.824759   954 raft_consensus.cc:2468] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 1.
I20260709 13:12:38.826056   845 leader_election.cc:304] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:38.826453   806 raft_consensus.cc:2468] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 1.
I20260709 13:12:38.826929  1048 raft_consensus.cc:2804] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.826486   996 raft_consensus.cc:359] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.827597   996 raft_consensus.cc:385] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.828084   996 raft_consensus.cc:740] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.827601  1048 raft_consensus.cc:697] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 1 LEADER]: Becoming Leader. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:38.828840   996 consensus_queue.cc:260] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.829239  1048 consensus_queue.cc:237] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.831300   996 ts_tablet_manager.cc:1434] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:12:38.832397   996 tablet_bootstrap.cc:492] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:38.839793   996 tablet_bootstrap.cc:654] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.843474   703 catalog_manager.cc:5697] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2). New cstate: current_term: 1 leader_uuid: "2034411b1c53426d8fe8c8de3faa928a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.844766   996 tablet_bootstrap.cc:492] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673: No bootstrap required, opened a new log
I20260709 13:12:38.845423   996 ts_tablet_manager.cc:1403] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.005s
I20260709 13:12:38.847483   996 raft_consensus.cc:359] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.848130   996 raft_consensus.cc:385] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.848380   996 raft_consensus.cc:740] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.849007   996 consensus_queue.cc:260] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.850658   996 ts_tablet_manager.cc:1434] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:12:38.896900  1034 raft_consensus.cc:493] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.897450  1034 raft_consensus.cc:515] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.899240  1034 leader_election.cc:290] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:38.900259   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673" is_pre_election: true
I20260709 13:12:38.900528   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:38.900975   806 raft_consensus.cc:2468] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 0.
I20260709 13:12:38.901278   879 raft_consensus.cc:2468] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 0.
I20260709 13:12:38.902100   919 leader_election.cc:304] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:38.902901  1034 raft_consensus.cc:2804] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.903273  1034 raft_consensus.cc:493] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.903506  1034 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.909536  1034 raft_consensus.cc:515] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.911760  1034 leader_election.cc:290] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:38.912678   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:38.912798   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:38.913465   806 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.913522   879 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.920984   806 raft_consensus.cc:2468] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 1.
I20260709 13:12:38.920984   879 raft_consensus.cc:2468] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 1.
I20260709 13:12:38.922407   919 leader_election.cc:304] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:38.923136  1034 raft_consensus.cc:2804] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.923717  1034 raft_consensus.cc:697] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Becoming Leader. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:38.924597  1034 consensus_queue.cc:237] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:38.933130   703 catalog_manager.cc:5697] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcf313584d14499ca6d072cad277fb28 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "bcf313584d14499ca6d072cad277fb28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:38.943439  1007 consensus_queue.cc:1048] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.951443  1034 consensus_queue.cc:1048] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.971583  1034 consensus_queue.cc:1048] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.973755  1007 consensus_queue.cc:1048] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.003086  1034 consensus_queue.cc:1048] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.006512  1048 raft_consensus.cc:493] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.007047  1048 raft_consensus.cc:515] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:39.009393  1048 leader_election.cc:290] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:39.010784   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eaaa5966c894a85b39aa94699226c23" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673" is_pre_election: true
I20260709 13:12:39.010998   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eaaa5966c894a85b39aa94699226c23" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:39.011775   954 raft_consensus.cc:2468] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 0.
I20260709 13:12:39.012302  1038 raft_consensus.cc:493] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.013052  1038 raft_consensus.cc:515] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:39.014528   845 leader_election.cc:304] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:39.011801   806 raft_consensus.cc:2468] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 0.
I20260709 13:12:39.015678  1048 raft_consensus.cc:2804] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.016112  1048 raft_consensus.cc:493] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.016495  1048 raft_consensus.cc:3060] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.016805  1000 consensus_queue.cc:1048] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.020089   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac44e9eb6554e0d8d884847054ea51a" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:39.020773   954 raft_consensus.cc:2468] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 0.
I20260709 13:12:39.022259   770 leader_election.cc:304] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:39.023254  1035 raft_consensus.cc:2804] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.023670  1035 raft_consensus.cc:493] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.024155  1035 raft_consensus.cc:3060] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.029978   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac44e9eb6554e0d8d884847054ea51a" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:39.030761   879 raft_consensus.cc:2468] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 0.
I20260709 13:12:39.031558  1048 raft_consensus.cc:515] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:39.022405  1038 leader_election.cc:290] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:39.034232  1048 leader_election.cc:290] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:39.035404   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eaaa5966c894a85b39aa94699226c23" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:39.036204   954 raft_consensus.cc:3060] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.037571   806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eaaa5966c894a85b39aa94699226c23" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:39.038209   806 raft_consensus.cc:3060] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.038627  1035 raft_consensus.cc:515] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:39.041062  1035 leader_election.cc:290] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 election: Requested vote from peers 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:39.041795   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac44e9eb6554e0d8d884847054ea51a" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:39.042440   879 raft_consensus.cc:3060] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.042827   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac44e9eb6554e0d8d884847054ea51a" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:39.043526   955 raft_consensus.cc:3060] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.048601   806 raft_consensus.cc:2468] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 1.
I20260709 13:12:39.050135   845 leader_election.cc:304] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, 7139fb3b1dfe460c8941ec114a267673; no voters: 
I20260709 13:12:39.050645   879 raft_consensus.cc:2468] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 1.
I20260709 13:12:39.051331  1048 raft_consensus.cc:2804] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.051930  1048 raft_consensus.cc:697] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 1 LEADER]: Becoming Leader. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:39.051993   769 leader_election.cc:304] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, 7139fb3b1dfe460c8941ec114a267673; no voters: 
I20260709 13:12:39.052912  1035 raft_consensus.cc:2804] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.053457  1035 raft_consensus.cc:697] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 1 LEADER]: Becoming Leader. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Running, Role: LEADER
I20260709 13:12:39.053004  1048 consensus_queue.cc:237] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:39.050099   954 raft_consensus.cc:2468] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 1.
I20260709 13:12:39.054347  1035 consensus_queue.cc:237] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:39.054716   955 raft_consensus.cc:2468] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7139fb3b1dfe460c8941ec114a267673 in term 1.
I20260709 13:12:39.064102   700 catalog_manager.cc:5697] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "7139fb3b1dfe460c8941ec114a267673" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.065344   703 catalog_manager.cc:5697] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2). New cstate: current_term: 1 leader_uuid: "2034411b1c53426d8fe8c8de3faa928a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.092321  1035 raft_consensus.cc:493] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.092973  1035 raft_consensus.cc:515] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:39.094858  1035 leader_election.cc:290] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:39.095573   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01f80de6c1042e6858c677b49d5866d" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:39.095942  1035 consensus_queue.cc:1048] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.096354   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01f80de6c1042e6858c677b49d5866d" candidate_uuid: "7139fb3b1dfe460c8941ec114a267673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:39.097857   770 leader_election.cc:304] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673; no voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28
I20260709 13:12:39.098850  1035 raft_consensus.cc:2749] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.108513  1038 consensus_queue.cc:1048] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.164208   806 raft_consensus.cc:3060] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.186177  1038 consensus_queue.cc:1048] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.190364 22480 ts_manager.cc:295] Set tserver state for 7139fb3b1dfe460c8941ec114a267673 to MAINTENANCE_MODE
I20260709 13:12:39.191293 22480 tablet_server.cc:179] TabletServer@127.21.244.1:0 shutting down...
I20260709 13:12:39.205533  1035 consensus_queue.cc:1048] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.239125 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:12:39.239547   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:39.240173 22480 tablet_replica.cc:333] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673: stopping tablet replica
I20260709 13:12:39.240928 22480 raft_consensus.cc:2243] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.241380 22480 raft_consensus.cc:2272] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.243674 22480 tablet_replica.cc:333] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673: stopping tablet replica
I20260709 13:12:39.244508 22480 raft_consensus.cc:2243] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.245010 22480 raft_consensus.cc:2272] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.247910 22480 tablet_replica.cc:333] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673: stopping tablet replica
I20260709 13:12:39.248608 22480 raft_consensus.cc:2243] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.249207 22480 raft_consensus.cc:2272] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.251156 22480 tablet_replica.cc:333] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673: stopping tablet replica
I20260709 13:12:39.251688 22480 raft_consensus.cc:2243] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.252183 22480 raft_consensus.cc:2272] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.254907 22480 tablet_replica.cc:333] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: stopping tablet replica
I20260709 13:12:39.255455 22480 raft_consensus.cc:2243] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.256110 22480 pending_rounds.cc:70] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Trying to abort 1 pending ops.
I20260709 13:12:39.256284 22480 pending_rounds.cc:77] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636901096566784 op_type: NO_OP noop_request { }
I20260709 13:12:39.256567 22480 raft_consensus.cc:2889] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:39.256814 22480 raft_consensus.cc:2272] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.259055 22480 tablet_replica.cc:333] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673: stopping tablet replica
I20260709 13:12:39.259600 22480 raft_consensus.cc:2243] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.260507 22480 raft_consensus.cc:2272] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.262776 22480 tablet_replica.cc:333] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673: stopping tablet replica
I20260709 13:12:39.263303 22480 raft_consensus.cc:2243] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.264441 22480 raft_consensus.cc:2272] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.266578 22480 tablet_replica.cc:333] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673: stopping tablet replica
I20260709 13:12:39.267071 22480 raft_consensus.cc:2243] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.267403 22480 raft_consensus.cc:2272] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.269255 22480 tablet_replica.cc:333] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673: stopping tablet replica
I20260709 13:12:39.269737 22480 raft_consensus.cc:2243] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.270479 22480 raft_consensus.cc:2272] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.272742 22480 tablet_replica.cc:333] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673: stopping tablet replica
I20260709 13:12:39.273175 22480 raft_consensus.cc:2243] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.273531 22480 raft_consensus.cc:2272] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.308323 22480 tablet_server.cc:196] TabletServer@127.21.244.1:0 shutdown complete.
I20260709 13:12:39.318334  1048 consensus_queue.cc:1048] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:39.320232   845 consensus_peers.cc:597] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.388170   919 consensus_peers.cc:597] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.443544  1034 consensus_queue.cc:1048] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:39.472018   919 consensus_peers.cc:597] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.539561   845 consensus_peers.cc:597] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.618798   919 consensus_peers.cc:597] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.647315  1075 consensus_queue.cc:1048] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:39.716281   845 consensus_peers.cc:597] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:40.240763   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:40.401938   845 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111) [suppressed 120 similar messages]
I20260709 13:12:40.455170  1048 raft_consensus.cc:493] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7139fb3b1dfe460c8941ec114a267673)
I20260709 13:12:40.455785  1048 raft_consensus.cc:515] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:40.457870  1048 leader_election.cc:290] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:40.459661   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
W20260709 13:12:40.461968   845 leader_election.cc:336] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111)
I20260709 13:12:40.462423   845 leader_election.cc:304] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a; no voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28
I20260709 13:12:40.463059  1048 raft_consensus.cc:2749] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.481985  1030 raft_consensus.cc:493] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7139fb3b1dfe460c8941ec114a267673)
I20260709 13:12:40.482576  1030 raft_consensus.cc:515] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:40.484697  1030 leader_election.cc:290] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:40.485988   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:40.486704   879 raft_consensus.cc:2468] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 1.
I20260709 13:12:40.488072   918 leader_election.cc:304] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:40.488916  1030 raft_consensus.cc:2804] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:40.489221   919 leader_election.cc:336] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111)
I20260709 13:12:40.489334  1030 raft_consensus.cc:493] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7139fb3b1dfe460c8941ec114a267673)
I20260709 13:12:40.489886  1030 raft_consensus.cc:3060] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.495709  1030 raft_consensus.cc:515] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:40.497710  1030 leader_election.cc:290] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:40.498994   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:40.499827   879 raft_consensus.cc:3060] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:40.501785   919 leader_election.cc:336] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111)
I20260709 13:12:40.506019   879 raft_consensus.cc:2468] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 2.
I20260709 13:12:40.507179   918 leader_election.cc:304] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 7139fb3b1dfe460c8941ec114a267673
I20260709 13:12:40.508092  1030 raft_consensus.cc:2804] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:40.508543  1030 raft_consensus.cc:697] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Becoming Leader. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:40.509454  1030 consensus_queue.cc:237] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:40.516732   703 catalog_manager.cc:5697] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 reported cstate change: term changed from 1 to 2, leader changed from 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1) to bcf313584d14499ca6d072cad277fb28 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "bcf313584d14499ca6d072cad277fb28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:40.606263  1030 raft_consensus.cc:493] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7139fb3b1dfe460c8941ec114a267673)
I20260709 13:12:40.606812  1030 raft_consensus.cc:515] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:40.608955  1030 leader_election.cc:290] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:40.610226   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f006b75ac1cb4725babf514d7cad4aa8" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:40.612356  1048 raft_consensus.cc:493] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7139fb3b1dfe460c8941ec114a267673)
I20260709 13:12:40.612782  1048 raft_consensus.cc:515] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
W20260709 13:12:40.613250   919 leader_election.cc:336] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111)
I20260709 13:12:40.613766   919 leader_election.cc:304] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcf313584d14499ca6d072cad277fb28; no voters: 2034411b1c53426d8fe8c8de3faa928a, 7139fb3b1dfe460c8941ec114a267673
I20260709 13:12:40.614552  1030 raft_consensus.cc:2749] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.614938  1048 leader_election.cc:290] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:40.616856   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f006b75ac1cb4725babf514d7cad4aa8" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
I20260709 13:12:40.617512   954 raft_consensus.cc:2468] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 1.
I20260709 13:12:40.618583   845 leader_election.cc:304] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:40.619480  1048 raft_consensus.cc:2804] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:40.619475   845 leader_election.cc:336] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111)
I20260709 13:12:40.619951  1048 raft_consensus.cc:493] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7139fb3b1dfe460c8941ec114a267673)
I20260709 13:12:40.620393  1048 raft_consensus.cc:3060] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.626040  1048 raft_consensus.cc:515] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:40.627929  1048 leader_election.cc:290] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:40.629585   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f006b75ac1cb4725babf514d7cad4aa8" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:40.630343   954 raft_consensus.cc:3060] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:40.632040   845 leader_election.cc:336] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111)
I20260709 13:12:40.635461   954 raft_consensus.cc:2468] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 2.
I20260709 13:12:40.636582   845 leader_election.cc:304] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 7139fb3b1dfe460c8941ec114a267673
I20260709 13:12:40.637223  1048 raft_consensus.cc:2804] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:40.637650  1048 raft_consensus.cc:697] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Becoming Leader. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:40.638382  1048 consensus_queue.cc:237] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:40.646559   703 catalog_manager.cc:5697] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a reported cstate change: term changed from 1 to 2, leader changed from 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1) to 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2). New cstate: current_term: 2 leader_uuid: "2034411b1c53426d8fe8c8de3faa928a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.699594  1048 raft_consensus.cc:493] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7139fb3b1dfe460c8941ec114a267673)
I20260709 13:12:40.700160  1048 raft_consensus.cc:515] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:40.701996  1048 leader_election.cc:290] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:40.703894   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bcf313584d14499ca6d072cad277fb28" is_pre_election: true
W20260709 13:12:40.706094   845 leader_election.cc:336] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111)
I20260709 13:12:40.706542   845 leader_election.cc:304] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a; no voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28
I20260709 13:12:40.707223  1048 raft_consensus.cc:2749] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.709674  1030 raft_consensus.cc:493] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7139fb3b1dfe460c8941ec114a267673)
I20260709 13:12:40.710208  1030 raft_consensus.cc:515] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:40.712347  1030 leader_election.cc:290] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:40.713562   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:40.714354   879 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 1.
I20260709 13:12:40.715543   918 leader_election.cc:304] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:40.716483  1030 raft_consensus.cc:2804] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:40.716878  1030 raft_consensus.cc:493] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7139fb3b1dfe460c8941ec114a267673)
W20260709 13:12:40.717141   919 leader_election.cc:336] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111)
I20260709 13:12:40.717286  1030 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.723129  1030 raft_consensus.cc:515] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:40.725021  1030 leader_election.cc:290] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:40.726213   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:40.726884   879 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:40.728844   919 leader_election.cc:336] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111)
I20260709 13:12:40.732714   879 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 2.
I20260709 13:12:40.734141   918 leader_election.cc:304] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 7139fb3b1dfe460c8941ec114a267673
I20260709 13:12:40.735064  1030 raft_consensus.cc:2804] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:40.735558  1030 raft_consensus.cc:697] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Becoming Leader. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:40.736492  1030 consensus_queue.cc:237] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:40.744299   703 catalog_manager.cc:5697] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 reported cstate change: term changed from 1 to 2, leader changed from 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1) to bcf313584d14499ca6d072cad277fb28 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "bcf313584d14499ca6d072cad277fb28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:40.976848   919 consensus_peers.cc:597] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.103569   845 consensus_peers.cc:597] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.117995   879 raft_consensus.cc:1275] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Refusing update from remote peer bcf313584d14499ca6d072cad277fb28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.119714  1030 consensus_queue.cc:1048] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:41.156833  1034 raft_consensus.cc:493] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.157589  1034 raft_consensus.cc:515] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:41.159943  1034 leader_election.cc:290] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:41.161439   879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac44e9eb6554e0d8d884847054ea51a" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a" is_pre_election: true
I20260709 13:12:41.162607   879 raft_consensus.cc:2468] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 1.
I20260709 13:12:41.164122   918 leader_election.cc:304] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 
W20260709 13:12:41.164669   919 leader_election.cc:336] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111)
I20260709 13:12:41.164870  1034 raft_consensus.cc:2804] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.165305  1034 raft_consensus.cc:493] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.165589  1034 raft_consensus.cc:3060] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.171241   879 raft_consensus.cc:1275] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Refusing update from remote peer bcf313584d14499ca6d072cad277fb28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.172948  1030 consensus_queue.cc:1048] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:41.177076  1034 raft_consensus.cc:515] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:41.179234   954 raft_consensus.cc:1275] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.179553  1034 leader_election.cc:290] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:41.181314   881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac44e9eb6554e0d8d884847054ea51a" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:41.182042   881 raft_consensus.cc:3060] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:41.185890   919 leader_election.cc:336] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111)
I20260709 13:12:41.184028  1001 consensus_queue.cc:1048] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:41.195384   881 raft_consensus.cc:2468] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 2.
I20260709 13:12:41.197345   918 leader_election.cc:304] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 7139fb3b1dfe460c8941ec114a267673
I20260709 13:12:41.198969  1034 raft_consensus.cc:2804] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.199631  1034 raft_consensus.cc:697] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Becoming Leader. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
W20260709 13:12:41.200719   919 consensus_peers.cc:597] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.202253  1034 consensus_queue.cc:237] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:41.217336   700 catalog_manager.cc:5697] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 reported cstate change: term changed from 1 to 2, leader changed from 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1) to bcf313584d14499ca6d072cad277fb28 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "bcf313584d14499ca6d072cad277fb28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:41.242090   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:41.613885   919 consensus_peers.cc:597] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.626148   881 raft_consensus.cc:1275] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Refusing update from remote peer bcf313584d14499ca6d072cad277fb28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:41.627578  1034 consensus_queue.cc:1048] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:41.854324   845 consensus_peers.cc:597] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:41.878068   919 consensus_peers.cc:597] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:41.990434   845 consensus_peers.cc:597] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.097004   845 consensus_peers.cc:597] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.232702   919 consensus_peers.cc:597] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.243178   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:42.255251   919 consensus_peers.cc:597] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:43.244550   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:43.481168   845 consensus_peers.cc:597] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:43.602815   919 consensus_peers.cc:597] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:43.727465   919 consensus_peers.cc:597] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:44.245656   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:44.334815 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:44.343243  1100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:44.346132  1103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:44.346758  1101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:44.347568 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:44.349457 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:44.349792 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
W20260709 13:12:44.349582   919 consensus_peers.cc:597] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:44.350097 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602764350075 us; error 0 us; skew 500 ppm
I20260709 13:12:44.350932 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:44.354367 22480 webserver.cc:533] Webserver started at http://127.21.244.1:38887/ using document root <none> and password file <none>
I20260709 13:12:44.354969 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:44.355207 22480 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:12:44.359848 22480 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:44.364425  1108 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:44.365935 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:12:44.366335 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-0-root
uuid: "7139fb3b1dfe460c8941ec114a267673"
format_stamp: "Formatted at 2026-07-09 13:12:37 on dist-test-slave-j314"
I20260709 13:12:44.366808 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602440417847-22480-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:44.384442 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:44.385761 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:44.387697 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:12:44.391227   919 consensus_peers.cc:597] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:44.392355  1115 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:12:44.432731   845 consensus_peers.cc:597] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:44.448943 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:12:44.449295 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.058s	user 0.003s	sys 0.000s
I20260709 13:12:44.449707 22480 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:12:44.456668  1115 tablet_bootstrap.cc:492] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:44.473232  1115 tablet_bootstrap.cc:492] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.474301  1115 tablet_bootstrap.cc:492] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap complete.
I20260709 13:12:44.475044  1115 ts_tablet_manager.cc:1403] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:12:44.477938  1115 raft_consensus.cc:359] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.478663  1115 raft_consensus.cc:740] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.479437  1115 consensus_queue.cc:260] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.482460  1115 ts_tablet_manager.cc:1434] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.005s
I20260709 13:12:44.483372  1115 tablet_bootstrap.cc:492] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:44.500494  1115 tablet_bootstrap.cc:492] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.501511  1115 tablet_bootstrap.cc:492] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap complete.
I20260709 13:12:44.502173  1115 ts_tablet_manager.cc:1403] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:12:44.505010  1115 raft_consensus.cc:359] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.505751  1115 raft_consensus.cc:740] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.506455  1115 consensus_queue.cc:260] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.508530  1115 ts_tablet_manager.cc:1434] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:44.509385  1115 tablet_bootstrap.cc:492] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:44.511385 22480 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:12:44.511816 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.062s	user 0.063s	sys 0.000s
I20260709 13:12:44.528679  1115 tablet_bootstrap.cc:492] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.529786  1115 tablet_bootstrap.cc:492] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673: Bootstrap complete.
I20260709 13:12:44.530375  1115 ts_tablet_manager.cc:1403] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:12:44.532595  1115 raft_consensus.cc:359] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.533182  1115 raft_consensus.cc:740] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.533905  1115 consensus_queue.cc:260] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.536046  1115 ts_tablet_manager.cc:1434] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:12:44.536895  1115 tablet_bootstrap.cc:492] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:44.554152  1115 tablet_bootstrap.cc:492] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.555310  1115 tablet_bootstrap.cc:492] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673: Bootstrap complete.
I20260709 13:12:44.556165  1115 ts_tablet_manager.cc:1403] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:12:44.559592  1115 raft_consensus.cc:359] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:44.560570  1115 raft_consensus.cc:740] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.561353  1115 consensus_queue.cc:260] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:44.563658  1115 ts_tablet_manager.cc:1434] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 13:12:44.564338   845 consensus_peers.cc:597] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:44.564594  1115 tablet_bootstrap.cc:492] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:44.578364 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.1:42817
I20260709 13:12:44.578469  1176 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.1:42817 every 8 connection(s)
I20260709 13:12:44.581733  1115 tablet_bootstrap.cc:492] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.582839  1115 tablet_bootstrap.cc:492] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673: Bootstrap complete.
I20260709 13:12:44.583693  1115 ts_tablet_manager.cc:1403] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:12:44.584384 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:44.586582  1115 raft_consensus.cc:359] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.587389  1115 raft_consensus.cc:740] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.588161  1115 consensus_queue.cc:260] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.591478  1115 ts_tablet_manager.cc:1434] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:44.592396  1115 tablet_bootstrap.cc:492] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:44.612633  1178 heartbeater.cc:344] Connected to a master server at 127.21.244.62:42731
I20260709 13:12:44.613098  1115 tablet_bootstrap.cc:492] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:12:44.613210  1178 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:44.614319  1115 tablet_bootstrap.cc:492] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Bootstrap complete.
I20260709 13:12:44.614317  1178 heartbeater.cc:507] Master 127.21.244.62:42731 requested a full tablet report, sending...
I20260709 13:12:44.615227  1115 ts_tablet_manager.cc:1403] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 13:12:44.618018  1115 raft_consensus.cc:359] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.618835  1115 raft_consensus.cc:740] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.620610  1115 consensus_queue.cc:260] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.624138   954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd"
dest_uuid: "bcf313584d14499ca6d072cad277fb28"
mode: GRACEFUL
new_leader_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:38184
I20260709 13:12:44.624703  1115 ts_tablet_manager.cc:1434] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:12:44.624845   700 ts_manager.cc:194] Re-registered known tserver with Master: 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817)
I20260709 13:12:44.625006   954 raft_consensus.cc:606] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Received request to transfer leadership to TS 2034411b1c53426d8fe8c8de3faa928a
I20260709 13:12:44.626010  1115 tablet_bootstrap.cc:492] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:44.628592   954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4"
dest_uuid: "bcf313584d14499ca6d072cad277fb28"
mode: GRACEFUL
new_leader_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:38184
I20260709 13:12:44.629463   954 raft_consensus.cc:606] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Received request to transfer leadership to TS 2034411b1c53426d8fe8c8de3faa928a
I20260709 13:12:44.630892 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:44.631621 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:44.632449 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:44.634976   845 consensus_peers.cc:597] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:44.638695   700 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38212
I20260709 13:12:44.642583  1178 heartbeater.cc:499] Master 127.21.244.62:42731 was elected leader, sending a full tablet report...
I20260709 13:12:44.643637  1115 tablet_bootstrap.cc:492] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.645035  1115 tablet_bootstrap.cc:492] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673: Bootstrap complete.
I20260709 13:12:44.645661  1115 ts_tablet_manager.cc:1403] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:12:44.648375  1115 raft_consensus.cc:359] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.649113  1099 raft_consensus.cc:993] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28: : Instructing follower 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:44.649186  1115 raft_consensus.cc:740] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.650048  1187 raft_consensus.cc:1081] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Signalling peer 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:44.650228  1115 consensus_queue.cc:260] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.652017   881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd"
dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:58284
I20260709 13:12:44.652467  1115 ts_tablet_manager.cc:1434] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:44.652644   881 raft_consensus.cc:493] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:44.653056   881 raft_consensus.cc:3060] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:44.653375  1115 tablet_bootstrap.cc:492] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:44.661759   881 raft_consensus.cc:515] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.664259   881 leader_election.cc:290] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 3 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:44.665097  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:44.665498   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "665df68040504ecf9e42dc0b11fbd6bd" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:44.665747  1152 raft_consensus.cc:3060] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:44.666227   954 raft_consensus.cc:3055] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:44.666579   954 raft_consensus.cc:740] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:44.667506   954 consensus_queue.cc:260] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.668251  1115 tablet_bootstrap.cc:492] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.668969   954 raft_consensus.cc:3060] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:44.669200  1115 tablet_bootstrap.cc:492] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap complete.
I20260709 13:12:44.670173  1115 ts_tablet_manager.cc:1403] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:12:44.674571  1115 raft_consensus.cc:359] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.675239  1115 raft_consensus.cc:740] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.675995  1115 consensus_queue.cc:260] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.678164  1115 ts_tablet_manager.cc:1434] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:12:44.678186  1152 raft_consensus.cc:2468] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 3.
I20260709 13:12:44.679107  1115 tablet_bootstrap.cc:492] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:44.679571   845 leader_election.cc:304] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, 7139fb3b1dfe460c8941ec114a267673; no voters: 
I20260709 13:12:44.678471   954 raft_consensus.cc:2468] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 3.
I20260709 13:12:44.680611  1094 raft_consensus.cc:2804] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:44.691568  1151 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.694229  1094 raft_consensus.cc:697] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 3 LEADER]: Becoming Leader. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:44.695936  1094 consensus_queue.cc:237] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.710427  1115 tablet_bootstrap.cc:492] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.711578  1115 tablet_bootstrap.cc:492] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673: Bootstrap complete.
I20260709 13:12:44.712265  1115 ts_tablet_manager.cc:1403] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.011s
I20260709 13:12:44.712868   703 catalog_manager.cc:5697] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a reported cstate change: term changed from 2 to 3, leader changed from bcf313584d14499ca6d072cad277fb28 (127.21.244.3) to 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2). New cstate: current_term: 3 leader_uuid: "2034411b1c53426d8fe8c8de3faa928a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.716881  1115 raft_consensus.cc:359] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.717628  1115 raft_consensus.cc:740] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.718300  1115 consensus_queue.cc:260] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.720317  1115 ts_tablet_manager.cc:1434] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:44.721158  1115 tablet_bootstrap.cc:492] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap starting.
I20260709 13:12:44.736470  1115 tablet_bootstrap.cc:492] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:44.737326  1115 tablet_bootstrap.cc:492] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673: Bootstrap complete.
I20260709 13:12:44.738013  1115 ts_tablet_manager.cc:1403] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 13:12:44.740262  1115 raft_consensus.cc:359] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.740808  1115 raft_consensus.cc:740] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7139fb3b1dfe460c8941ec114a267673, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.741467  1115 consensus_queue.cc:260] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.743237  1115 ts_tablet_manager.cc:1434] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:12:44.751916  1151 raft_consensus.cc:3060] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.757511  1151 pending_rounds.cc:85] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Aborting all ops after (but not including) 0
I20260709 13:12:44.757782  1151 pending_rounds.cc:107] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:12:44.758030  1151 raft_consensus.cc:2889] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:44.952309  1099 raft_consensus.cc:993] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28: : Instructing follower 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:44.952802  1187 raft_consensus.cc:1081] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Signalling peer 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:44.954617   881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4"
dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:58284
I20260709 13:12:44.955133   881 raft_consensus.cc:493] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:44.955497   881 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.961438   881 raft_consensus.cc:515] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.963289   881 leader_election.cc:290] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:44.964318  1151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:44.964483   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:44.964951  1151 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.965168   954 raft_consensus.cc:3055] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:44.965615   954 raft_consensus.cc:740] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:44.966434   954 consensus_queue.cc:260] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.967535   954 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.971184  1152 raft_consensus.cc:3060] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.973789  1151 raft_consensus.cc:2468] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 2.
I20260709 13:12:44.974563   954 raft_consensus.cc:2468] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 2.
I20260709 13:12:44.975162   845 leader_election.cc:304] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, 7139fb3b1dfe460c8941ec114a267673; no voters: 
I20260709 13:12:44.976079  1094 raft_consensus.cc:2804] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:44.976603  1094 raft_consensus.cc:697] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Becoming Leader. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:44.977660  1094 consensus_queue.cc:237] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:44.987406   700 catalog_manager.cc:5697] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a reported cstate change: term changed from 1 to 2, leader changed from bcf313584d14499ca6d072cad277fb28 (127.21.244.3) to 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2). New cstate: current_term: 2 leader_uuid: "2034411b1c53426d8fe8c8de3faa928a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:45.230841   954 raft_consensus.cc:1275] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:45.232239  1094 consensus_queue.cc:1048] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:45.245533  1152 raft_consensus.cc:1275] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:12:45.248786   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:45.250311  1189 consensus_queue.cc:1048] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:45.509488  1152 raft_consensus.cc:1275] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 2 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:45.511102  1209 consensus_queue.cc:1048] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:45.519678   954 raft_consensus.cc:1275] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:45.521214  1209 consensus_queue.cc:1048] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:45.642534 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:45.670748   881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4"
dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
mode: GRACEFUL
new_leader_uuid: "bcf313584d14499ca6d072cad277fb28"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:12:45.671587   881 raft_consensus.cc:606] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Received request to transfer leadership to TS bcf313584d14499ca6d072cad277fb28
I20260709 13:12:45.675166   881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f006b75ac1cb4725babf514d7cad4aa8"
dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
mode: GRACEFUL
new_leader_uuid: "bcf313584d14499ca6d072cad277fb28"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:12:45.675953   881 raft_consensus.cc:606] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Received request to transfer leadership to TS bcf313584d14499ca6d072cad277fb28
I20260709 13:12:45.677160 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:45.677739 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:45.678395 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:46.049608  1094 raft_consensus.cc:993] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a: : Instructing follower bcf313584d14499ca6d072cad277fb28 to start an election
I20260709 13:12:46.050303  1212 raft_consensus.cc:1081] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Signalling peer bcf313584d14499ca6d072cad277fb28 to start an election
I20260709 13:12:46.052176   954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f006b75ac1cb4725babf514d7cad4aa8"
dest_uuid: "bcf313584d14499ca6d072cad277fb28"
 from {username='slave'} at 127.0.0.1:38174
I20260709 13:12:46.052802   954 raft_consensus.cc:493] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:46.053123   954 raft_consensus.cc:3060] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.059796   954 raft_consensus.cc:515] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:46.061437   954 leader_election.cc:290] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 3 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:46.062510   881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f006b75ac1cb4725babf514d7cad4aa8" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:46.062355  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f006b75ac1cb4725babf514d7cad4aa8" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:46.063177   881 raft_consensus.cc:3055] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:46.063293  1152 raft_consensus.cc:3060] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.063488   881 raft_consensus.cc:740] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:46.064399   881 consensus_queue.cc:260] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:46.065402   881 raft_consensus.cc:3060] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.070235  1152 raft_consensus.cc:2468] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 3.
I20260709 13:12:46.071100  1209 raft_consensus.cc:993] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a: : Instructing follower bcf313584d14499ca6d072cad277fb28 to start an election
I20260709 13:12:46.071636  1094 raft_consensus.cc:1081] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Signalling peer bcf313584d14499ca6d072cad277fb28 to start an election
I20260709 13:12:46.072410   919 leader_election.cc:304] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:46.072800   881 raft_consensus.cc:2468] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 3.
I20260709 13:12:46.073356  1099 raft_consensus.cc:2804] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:46.073558   954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4"
dest_uuid: "bcf313584d14499ca6d072cad277fb28"
 from {username='slave'} at 127.0.0.1:38174
I20260709 13:12:46.074213   954 raft_consensus.cc:493] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:46.074654   954 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.075606  1099 raft_consensus.cc:697] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 3 LEADER]: Becoming Leader. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:46.076666  1099 consensus_queue.cc:237] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:46.081750   954 raft_consensus.cc:515] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:46.083434   954 leader_election.cc:290] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 3 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:46.084448   881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:46.084430  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:46.085256   881 raft_consensus.cc:3055] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:46.085330  1152 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.085736   881 raft_consensus.cc:740] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:46.085384   700 catalog_manager.cc:5697] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 reported cstate change: term changed from 2 to 3, leader changed from 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2) to bcf313584d14499ca6d072cad277fb28 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "bcf313584d14499ca6d072cad277fb28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:46.086669   881 consensus_queue.cc:260] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:46.088049   881 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.093020  1152 raft_consensus.cc:2468] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 3.
I20260709 13:12:46.094889   919 leader_election.cc:304] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:46.095863  1099 raft_consensus.cc:2804] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:46.095873   881 raft_consensus.cc:2468] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 3.
I20260709 13:12:46.096779  1099 raft_consensus.cc:697] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 3 LEADER]: Becoming Leader. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:46.097786  1099 consensus_queue.cc:237] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:46.115024   700 catalog_manager.cc:5697] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 reported cstate change: term changed from 2 to 3, leader changed from 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2) to bcf313584d14499ca6d072cad277fb28 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "bcf313584d14499ca6d072cad277fb28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:46.249930   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:46.490255   881 raft_consensus.cc:1275] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Refusing update from remote peer bcf313584d14499ca6d072cad277fb28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:46.491863  1099 consensus_queue.cc:1048] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:46.506855  1152 raft_consensus.cc:1275] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Refusing update from remote peer bcf313584d14499ca6d072cad277fb28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:46.508751  1099 consensus_queue.cc:1048] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:46.573691  1152 raft_consensus.cc:1275] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Refusing update from remote peer bcf313584d14499ca6d072cad277fb28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:46.575026  1099 consensus_queue.cc:1048] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:46.587136   881 raft_consensus.cc:1275] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Refusing update from remote peer bcf313584d14499ca6d072cad277fb28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:46.588497  1230 consensus_queue.cc:1048] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:46.685747 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:46.694411   954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882"
dest_uuid: "bcf313584d14499ca6d072cad277fb28"
mode: GRACEFUL
new_leader_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:38184
I20260709 13:12:46.694968   954 raft_consensus.cc:606] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Received request to transfer leadership to TS 2034411b1c53426d8fe8c8de3faa928a
I20260709 13:12:46.697978   954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf"
dest_uuid: "bcf313584d14499ca6d072cad277fb28"
mode: GRACEFUL
new_leader_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:38184
I20260709 13:12:46.698717   954 raft_consensus.cc:606] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Received request to transfer leadership to TS 2034411b1c53426d8fe8c8de3faa928a
I20260709 13:12:46.699694 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:46.700248 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:46.700861 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:46.998070  1224 raft_consensus.cc:993] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28: : Instructing follower 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:46.998618  1230 raft_consensus.cc:1081] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Signalling peer 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:47.000173   881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf"
dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:58284
I20260709 13:12:47.000593   881 raft_consensus.cc:493] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:47.000939   881 raft_consensus.cc:3060] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.005808   881 raft_consensus.cc:515] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:47.007885   881 leader_election.cc:290] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 election: Requested vote from peers bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537), 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817)
I20260709 13:12:47.008620   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:47.009027  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:47.009335   954 raft_consensus.cc:3055] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:47.009752   954 raft_consensus.cc:740] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:47.009817  1152 raft_consensus.cc:3060] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.010609   954 consensus_queue.cc:260] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:47.011940   954 raft_consensus.cc:3060] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:47.016079  1152 raft_consensus.cc:2468] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 2.
I20260709 13:12:47.016989   954 raft_consensus.cc:2468] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 2.
I20260709 13:12:47.017387   845 leader_election.cc:304] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, 7139fb3b1dfe460c8941ec114a267673; no voters: 
I20260709 13:12:47.018280  1094 raft_consensus.cc:2804] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:47.019284  1094 raft_consensus.cc:697] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Becoming Leader. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:47.020278  1094 consensus_queue.cc:237] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:47.027832   700 catalog_manager.cc:5697] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a reported cstate change: term changed from 1 to 2, leader changed from bcf313584d14499ca6d072cad277fb28 (127.21.244.3) to 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2). New cstate: current_term: 2 leader_uuid: "2034411b1c53426d8fe8c8de3faa928a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:47.231293  1224 raft_consensus.cc:993] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28: : Instructing follower 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:47.232138  1230 raft_consensus.cc:1081] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Signalling peer 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:47.233984   881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882"
dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:58284
I20260709 13:12:47.234479   881 raft_consensus.cc:493] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:47.234794   881 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:47.240208   881 raft_consensus.cc:515] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:47.241816   881 leader_election.cc:290] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 3 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:47.242754  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:47.242763   954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:47.243497  1152 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:47.243575   954 raft_consensus.cc:3055] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:47.244014   954 raft_consensus.cc:740] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:47.244753   954 consensus_queue.cc:260] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:47.245635   954 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:47.248847  1152 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 3.
I20260709 13:12:47.250106   845 leader_election.cc:304] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, 7139fb3b1dfe460c8941ec114a267673; no voters: 
I20260709 13:12:47.250869  1094 raft_consensus.cc:2804] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:12:47.250975   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:47.250890   954 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 3.
I20260709 13:12:47.251446  1094 raft_consensus.cc:697] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 3 LEADER]: Becoming Leader. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:47.252460  1094 consensus_queue.cc:237] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:47.259334   700 catalog_manager.cc:5697] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a reported cstate change: term changed from 2 to 3, leader changed from bcf313584d14499ca6d072cad277fb28 (127.21.244.3) to 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2). New cstate: current_term: 3 leader_uuid: "2034411b1c53426d8fe8c8de3faa928a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:47.456794  1152 raft_consensus.cc:1275] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 2 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:47.458292  1094 consensus_queue.cc:1048] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:47.472276   954 raft_consensus.cc:1275] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:47.473649  1241 consensus_queue.cc:1048] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:47.651546   954 raft_consensus.cc:1275] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:47.652962  1232 consensus_queue.cc:1048] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:47.663594  1151 raft_consensus.cc:1275] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:47.665468  1094 consensus_queue.cc:1048] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:47.707180 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:47.715385   881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882"
dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
mode: GRACEFUL
new_leader_uuid: "bcf313584d14499ca6d072cad277fb28"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:12:47.715946   881 raft_consensus.cc:606] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 3 LEADER]: Received request to transfer leadership to TS bcf313584d14499ca6d072cad277fb28
I20260709 13:12:47.718619   881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf"
dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
mode: GRACEFUL
new_leader_uuid: "bcf313584d14499ca6d072cad277fb28"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:12:47.719162   881 raft_consensus.cc:606] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Received request to transfer leadership to TS bcf313584d14499ca6d072cad277fb28
I20260709 13:12:47.720325 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:47.720872 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:47.721560 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:47.891571  1094 raft_consensus.cc:993] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a: : Instructing follower bcf313584d14499ca6d072cad277fb28 to start an election
I20260709 13:12:47.892323  1241 raft_consensus.cc:1081] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Signalling peer bcf313584d14499ca6d072cad277fb28 to start an election
I20260709 13:12:47.894016   954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf"
dest_uuid: "bcf313584d14499ca6d072cad277fb28"
 from {username='slave'} at 127.0.0.1:38174
I20260709 13:12:47.894485   954 raft_consensus.cc:493] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:47.894796   954 raft_consensus.cc:3060] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:47.899639   954 raft_consensus.cc:515] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:47.901078   954 leader_election.cc:290] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 3 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:47.902009  1151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:47.902209   881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7956150d92a14f2187a67c3bc13565bf" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:47.902745  1151 raft_consensus.cc:3060] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:47.902819   881 raft_consensus.cc:3055] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:47.903293   881 raft_consensus.cc:740] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:47.904004   881 consensus_queue.cc:260] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:47.904873   881 raft_consensus.cc:3060] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:47.908093  1151 raft_consensus.cc:2468] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 3.
I20260709 13:12:47.909190   919 leader_election.cc:304] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:47.909602   881 raft_consensus.cc:2468] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 3.
I20260709 13:12:47.910073  1230 raft_consensus.cc:2804] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:47.911221  1230 raft_consensus.cc:697] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 3 LEADER]: Becoming Leader. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:47.912091  1230 consensus_queue.cc:237] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } }
I20260709 13:12:47.918648   703 catalog_manager.cc:5697] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 reported cstate change: term changed from 2 to 3, leader changed from 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2) to bcf313584d14499ca6d072cad277fb28 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "bcf313584d14499ca6d072cad277fb28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.082949  1094 raft_consensus.cc:993] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a: : Instructing follower bcf313584d14499ca6d072cad277fb28 to start an election
I20260709 13:12:48.083498  1241 raft_consensus.cc:1081] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 3 LEADER]: Signalling peer bcf313584d14499ca6d072cad277fb28 to start an election
I20260709 13:12:48.085134   954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882"
dest_uuid: "bcf313584d14499ca6d072cad277fb28"
 from {username='slave'} at 127.0.0.1:38174
I20260709 13:12:48.085656   954 raft_consensus.cc:493] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:48.086040   954 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:48.090700   954 raft_consensus.cc:515] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:48.092285   954 leader_election.cc:290] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 4 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955)
I20260709 13:12:48.093245  1151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:48.093453   881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "bcf313584d14499ca6d072cad277fb28" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
I20260709 13:12:48.093916  1151 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:48.094091   881 raft_consensus.cc:3055] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:48.094568   881 raft_consensus.cc:740] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:48.095420   881 consensus_queue.cc:260] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:48.096447   881 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:48.099561  1151 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 4.
I20260709 13:12:48.100883   919 leader_election.cc:304] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7139fb3b1dfe460c8941ec114a267673, bcf313584d14499ca6d072cad277fb28; no voters: 
I20260709 13:12:48.101914  1230 raft_consensus.cc:2804] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:48.102545   881 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcf313584d14499ca6d072cad277fb28 in term 4.
I20260709 13:12:48.102741  1230 raft_consensus.cc:697] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 4 LEADER]: Becoming Leader. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:48.104450  1230 consensus_queue.cc:237] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:48.112144   703 catalog_manager.cc:5697] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 reported cstate change: term changed from 3 to 4, leader changed from 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2) to bcf313584d14499ca6d072cad277fb28 (127.21.244.3). New cstate: current_term: 4 leader_uuid: "bcf313584d14499ca6d072cad277fb28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:48.252334   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:48.380155  1151 raft_consensus.cc:1275] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Refusing update from remote peer bcf313584d14499ca6d072cad277fb28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:48.381578  1230 consensus_queue.cc:1048] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:48.391849   881 raft_consensus.cc:1275] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Refusing update from remote peer bcf313584d14499ca6d072cad277fb28: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:48.393479  1247 consensus_queue.cc:1048] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:48.600440   881 raft_consensus.cc:1275] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 4 FOLLOWER]: Refusing update from remote peer bcf313584d14499ca6d072cad277fb28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:48.601748  1247 consensus_queue.cc:1048] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:48.612550  1151 raft_consensus.cc:1275] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 4 FOLLOWER]: Refusing update from remote peer bcf313584d14499ca6d072cad277fb28: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:48.614907  1255 consensus_queue.cc:1048] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:48.729384 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:48.737141   955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882"
dest_uuid: "bcf313584d14499ca6d072cad277fb28"
mode: GRACEFUL
new_leader_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:38184
I20260709 13:12:48.737960   955 raft_consensus.cc:606] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 4 LEADER]: Received request to transfer leadership to TS 2034411b1c53426d8fe8c8de3faa928a
I20260709 13:12:48.740929   955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4"
dest_uuid: "bcf313584d14499ca6d072cad277fb28"
mode: GRACEFUL
new_leader_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:38184
I20260709 13:12:48.741492   955 raft_consensus.cc:606] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 3 LEADER]: Received request to transfer leadership to TS 2034411b1c53426d8fe8c8de3faa928a
I20260709 13:12:48.742780 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:48.743489 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:48.744158 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:49.014097  1230 raft_consensus.cc:993] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28: : Instructing follower 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:49.014559  1230 raft_consensus.cc:1081] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 4 LEADER]: Signalling peer 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:49.016180   881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882"
dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:58284
I20260709 13:12:49.016615   881 raft_consensus.cc:493] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.016850   881 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:49.021611   881 raft_consensus.cc:515] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:49.023064   881 leader_election.cc:290] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 5 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:49.024128  1151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:49.024431   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c4e4ea5be945ff9b3aa47c466f9882" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:49.024852  1151 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:49.025168   955 raft_consensus.cc:3055] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:49.025492   955 raft_consensus.cc:740] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:49.026345   955 consensus_queue.cc:260] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:49.027695   955 raft_consensus.cc:3060] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:49.032718  1151 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 5.
I20260709 13:12:49.034217   845 leader_election.cc:304] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, 7139fb3b1dfe460c8941ec114a267673; no voters: 
I20260709 13:12:49.035022  1094 raft_consensus.cc:2804] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:49.035892   955 raft_consensus.cc:2468] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 5.
I20260709 13:12:49.038064  1094 raft_consensus.cc:697] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 5 LEADER]: Becoming Leader. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:49.039830  1094 consensus_queue.cc:237] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:49.046679   700 catalog_manager.cc:5697] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a reported cstate change: term changed from 4 to 5, leader changed from bcf313584d14499ca6d072cad277fb28 (127.21.244.3) to 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2). New cstate: current_term: 5 leader_uuid: "2034411b1c53426d8fe8c8de3faa928a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.238214  1255 raft_consensus.cc:993] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28: : Instructing follower 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:49.238777  1230 raft_consensus.cc:1081] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 3 LEADER]: Signalling peer 2034411b1c53426d8fe8c8de3faa928a to start an election
I20260709 13:12:49.240602   881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4"
dest_uuid: "2034411b1c53426d8fe8c8de3faa928a"
 from {username='slave'} at 127.0.0.1:58284
I20260709 13:12:49.241109   881 raft_consensus.cc:493] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.241442   881 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:49.246435   881 raft_consensus.cc:515] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:49.248355   881 leader_election.cc:290] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 4 election: Requested vote from peers 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817), bcf313584d14499ca6d072cad277fb28 (127.21.244.3:39537)
I20260709 13:12:49.249053  1152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7139fb3b1dfe460c8941ec114a267673"
I20260709 13:12:49.249424   955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0dedae9c894b3d807d36078e7fdcf4" candidate_uuid: "2034411b1c53426d8fe8c8de3faa928a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bcf313584d14499ca6d072cad277fb28"
I20260709 13:12:49.250198   955 raft_consensus.cc:3055] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:49.250590   955 raft_consensus.cc:740] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bcf313584d14499ca6d072cad277fb28, State: Running, Role: LEADER
I20260709 13:12:49.251413   955 consensus_queue.cc:260] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:49.252480   955 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:49.253353   752 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:49.258412   955 raft_consensus.cc:2468] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2034411b1c53426d8fe8c8de3faa928a in term 4.
I20260709 13:12:49.259845   845 leader_election.cc:304] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2034411b1c53426d8fe8c8de3faa928a, bcf313584d14499ca6d072cad277fb28; no voters: 7139fb3b1dfe460c8941ec114a267673
I20260709 13:12:49.260563  1094 raft_consensus.cc:2804] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:49.261005  1094 raft_consensus.cc:697] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 4 LEADER]: Becoming Leader. State: Replica: 2034411b1c53426d8fe8c8de3faa928a, State: Running, Role: LEADER
I20260709 13:12:49.261755  1094 consensus_queue.cc:237] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } }
I20260709 13:12:49.268539   700 catalog_manager.cc:5697] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a reported cstate change: term changed from 3 to 4, leader changed from bcf313584d14499ca6d072cad277fb28 (127.21.244.3) to 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2). New cstate: current_term: 4 leader_uuid: "2034411b1c53426d8fe8c8de3faa928a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2034411b1c53426d8fe8c8de3faa928a" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.500268   955 raft_consensus.cc:1275] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 5 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:49.501667  1094 consensus_queue.cc:1048] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:49.512223  1152 raft_consensus.cc:1275] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 5 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:49.513725  1094 consensus_queue.cc:1048] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:49.640784  1152 raft_consensus.cc:3060] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:49.646436  1152 raft_consensus.cc:1275] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 4 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:49.648054  1256 consensus_queue.cc:1048] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7139fb3b1dfe460c8941ec114a267673" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:49.658089   955 raft_consensus.cc:1275] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 4 FOLLOWER]: Refusing update from remote peer 2034411b1c53426d8fe8c8de3faa928a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:49.660192  1266 consensus_queue.cc:1048] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcf313584d14499ca6d072cad277fb28" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:49.751060 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:49.782581 22480 tablet_server.cc:179] TabletServer@127.21.244.1:42817 shutting down...
I20260709 13:12:49.805984 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:49.806670 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:49.807365 22480 raft_consensus.cc:2243] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.808032 22480 raft_consensus.cc:2272] T 9b0dedae9c894b3d807d36078e7fdcf4 P 7139fb3b1dfe460c8941ec114a267673 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.810914 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:49.811502 22480 raft_consensus.cc:2243] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.811968 22480 raft_consensus.cc:2272] T 09449114c5a64c6d9d984d5f0882411f P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.813810 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:49.814378 22480 raft_consensus.cc:2243] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.814816 22480 raft_consensus.cc:2272] T 7956150d92a14f2187a67c3bc13565bf P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.816758 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:49.817327 22480 raft_consensus.cc:2243] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.817725 22480 raft_consensus.cc:2272] T b01f80de6c1042e6858c677b49d5866d P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.819530 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:49.820087 22480 raft_consensus.cc:2243] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.820515 22480 raft_consensus.cc:2272] T e174613a3500487aba780be14a9117ce P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.822309 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:49.822847 22480 raft_consensus.cc:2243] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.823339 22480 raft_consensus.cc:2272] T 665df68040504ecf9e42dc0b11fbd6bd P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.825208 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:49.825718 22480 raft_consensus.cc:2243] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.826122 22480 raft_consensus.cc:2272] T 8ac44e9eb6554e0d8d884847054ea51a P 7139fb3b1dfe460c8941ec114a267673 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.827984 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:49.828480 22480 raft_consensus.cc:2243] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.828890 22480 raft_consensus.cc:2272] T f006b75ac1cb4725babf514d7cad4aa8 P 7139fb3b1dfe460c8941ec114a267673 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.830639 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:49.831120 22480 raft_consensus.cc:2243] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.831517 22480 raft_consensus.cc:2272] T 7eaaa5966c894a85b39aa94699226c23 P 7139fb3b1dfe460c8941ec114a267673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.833302 22480 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:49.833943 22480 raft_consensus.cc:2243] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.834393 22480 raft_consensus.cc:2272] T 03c4e4ea5be945ff9b3aa47c466f9882 P 7139fb3b1dfe460c8941ec114a267673 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.855050 22480 tablet_server.cc:196] TabletServer@127.21.244.1:42817 shutdown complete.
W20260709 13:12:49.856624   919 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111) [suppressed 90 similar messages]
W20260709 13:12:49.860647   919 consensus_peers.cc:597] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.876207 22480 tablet_server.cc:179] TabletServer@127.21.244.2:0 shutting down...
W20260709 13:12:49.881845   918 consensus_peers.cc:597] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 -> Peer 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955): Couldn't send request to peer 2034411b1c53426d8fe8c8de3faa928a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:49.910614   845 consensus_peers.cc:597] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.911386 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:49.912253 22480 tablet_replica.cc:333] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a: stopping tablet replica
I20260709 13:12:49.913259 22480 raft_consensus.cc:2243] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:49.914237 22480 raft_consensus.cc:2272] T 665df68040504ecf9e42dc0b11fbd6bd P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.916469 22480 tablet_replica.cc:333] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a: stopping tablet replica
I20260709 13:12:49.917089 22480 raft_consensus.cc:2243] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:49.918128 22480 raft_consensus.cc:2272] T 9b0dedae9c894b3d807d36078e7fdcf4 P 2034411b1c53426d8fe8c8de3faa928a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.921243 22480 tablet_replica.cc:333] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a: stopping tablet replica
I20260709 13:12:49.921921 22480 raft_consensus.cc:2243] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.922467 22480 raft_consensus.cc:2272] T 09449114c5a64c6d9d984d5f0882411f P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.924795 22480 tablet_replica.cc:333] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a: stopping tablet replica
I20260709 13:12:49.925391 22480 raft_consensus.cc:2243] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.925869 22480 raft_consensus.cc:2272] T 7956150d92a14f2187a67c3bc13565bf P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.928022 22480 tablet_replica.cc:333] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a: stopping tablet replica
I20260709 13:12:49.928669 22480 raft_consensus.cc:2243] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:49.929564 22480 raft_consensus.cc:2272] T 7eaaa5966c894a85b39aa94699226c23 P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.932782 22480 tablet_replica.cc:333] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a: stopping tablet replica
I20260709 13:12:49.933485 22480 raft_consensus.cc:2243] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:12:49.934448 22480 raft_consensus.cc:2272] T 03c4e4ea5be945ff9b3aa47c466f9882 P 2034411b1c53426d8fe8c8de3faa928a [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:49.935817   845 consensus_peers.cc:597] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.937625 22480 tablet_replica.cc:333] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a: stopping tablet replica
I20260709 13:12:49.938338 22480 raft_consensus.cc:2243] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.938808 22480 raft_consensus.cc:2272] T f006b75ac1cb4725babf514d7cad4aa8 P 2034411b1c53426d8fe8c8de3faa928a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.941195 22480 tablet_replica.cc:333] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a: stopping tablet replica
I20260709 13:12:49.941778 22480 raft_consensus.cc:2243] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:49.942241 22480 raft_consensus.cc:2272] T 8ac44e9eb6554e0d8d884847054ea51a P 2034411b1c53426d8fe8c8de3faa928a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.944482 22480 tablet_replica.cc:333] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a: stopping tablet replica
I20260709 13:12:49.945080 22480 raft_consensus.cc:2243] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:49.945941 22480 raft_consensus.cc:2272] T e174613a3500487aba780be14a9117ce P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:49.948326 22480 tablet_replica.cc:333] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a: stopping tablet replica
I20260709 13:12:49.949100 22480 raft_consensus.cc:2243] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:49.950191 22480 raft_consensus.cc:2272] T b01f80de6c1042e6858c677b49d5866d P 2034411b1c53426d8fe8c8de3faa928a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:49.953341   918 consensus_peers.cc:597] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 -> Peer 2034411b1c53426d8fe8c8de3faa928a (127.21.244.2:33955): Couldn't send request to peer 2034411b1c53426d8fe8c8de3faa928a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.977078 22480 tablet_server.cc:196] TabletServer@127.21.244.2:0 shutdown complete.
I20260709 13:12:50.002087 22480 tablet_server.cc:179] TabletServer@127.21.244.3:0 shutting down...
W20260709 13:12:50.016906   919 consensus_peers.cc:597] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:50.031591   919 consensus_peers.cc:597] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 -> Peer 7139fb3b1dfe460c8941ec114a267673 (127.21.244.1:42817): Couldn't send request to peer 7139fb3b1dfe460c8941ec114a267673. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:50.034333 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:50.035176 22480 tablet_replica.cc:333] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28: stopping tablet replica
I20260709 13:12:50.035981 22480 raft_consensus.cc:2243] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.036521 22480 raft_consensus.cc:2272] T 9b0dedae9c894b3d807d36078e7fdcf4 P bcf313584d14499ca6d072cad277fb28 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.039361 22480 tablet_replica.cc:333] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28: stopping tablet replica
I20260709 13:12:50.040095 22480 raft_consensus.cc:2243] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.040616 22480 raft_consensus.cc:2272] T 665df68040504ecf9e42dc0b11fbd6bd P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.042783 22480 tablet_replica.cc:333] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28: stopping tablet replica
I20260709 13:12:50.043360 22480 raft_consensus.cc:2243] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:50.044368 22480 raft_consensus.cc:2272] T 09449114c5a64c6d9d984d5f0882411f P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.046746 22480 tablet_replica.cc:333] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28: stopping tablet replica
I20260709 13:12:50.047412 22480 raft_consensus.cc:2243] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.047991 22480 raft_consensus.cc:2272] T 7eaaa5966c894a85b39aa94699226c23 P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.050386 22480 tablet_replica.cc:333] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28: stopping tablet replica
I20260709 13:12:50.050979 22480 raft_consensus.cc:2243] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.051474 22480 raft_consensus.cc:2272] T 03c4e4ea5be945ff9b3aa47c466f9882 P bcf313584d14499ca6d072cad277fb28 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.054445 22480 tablet_replica.cc:333] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28: stopping tablet replica
I20260709 13:12:50.055090 22480 raft_consensus.cc:2243] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.055634 22480 raft_consensus.cc:2272] T e174613a3500487aba780be14a9117ce P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.057981 22480 tablet_replica.cc:333] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28: stopping tablet replica
I20260709 13:12:50.058597 22480 raft_consensus.cc:2243] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.059088 22480 raft_consensus.cc:2272] T b01f80de6c1042e6858c677b49d5866d P bcf313584d14499ca6d072cad277fb28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.061542 22480 tablet_replica.cc:333] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28: stopping tablet replica
I20260709 13:12:50.062089 22480 raft_consensus.cc:2243] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:50.062915 22480 raft_consensus.cc:2272] T 8ac44e9eb6554e0d8d884847054ea51a P bcf313584d14499ca6d072cad277fb28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.065255 22480 tablet_replica.cc:333] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28: stopping tablet replica
I20260709 13:12:50.065797 22480 raft_consensus.cc:2243] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:50.066627 22480 raft_consensus.cc:2272] T f006b75ac1cb4725babf514d7cad4aa8 P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.068936 22480 tablet_replica.cc:333] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28: stopping tablet replica
I20260709 13:12:50.069522 22480 raft_consensus.cc:2243] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:50.070393 22480 raft_consensus.cc:2272] T 7956150d92a14f2187a67c3bc13565bf P bcf313584d14499ca6d072cad277fb28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.103252 22480 tablet_server.cc:196] TabletServer@127.21.244.3:0 shutdown complete.
I20260709 13:12:50.134093 22480 master.cc:562] Master@127.21.244.62:42731 shutting down...
I20260709 13:12:50.160620 22480 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:50.161213 22480 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.161618 22480 tablet_replica.cc:333] T 00000000000000000000000000000000 P e7aa8a8dd83442239e19622f92799e4f: stopping tablet replica
I20260709 13:12:50.184703 22480 master.cc:584] Master@127.21.244.62:42731 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13163 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:12:50.231508 22480 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.244.62:36059
I20260709 13:12:50.232793 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:50.238941  1274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:50.238941  1275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:50.240083  1277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:50.240862 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:50.241817 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:50.241995 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:50.242115 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602770242103 us; error 0 us; skew 500 ppm
I20260709 13:12:50.242588 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:50.245169 22480 webserver.cc:533] Webserver started at http://127.21.244.62:33473/ using document root <none> and password file <none>
I20260709 13:12:50.245658 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:50.245817 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:50.246044 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:50.247201 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/master-0-root/instance:
uuid: "2749880017154b2fa4bd04d7229d1ad5"
format_stamp: "Formatted at 2026-07-09 13:12:50 on dist-test-slave-j314"
I20260709 13:12:50.252441 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:50.256233  1282 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:50.257355 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:12:50.257711 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/master-0-root
uuid: "2749880017154b2fa4bd04d7229d1ad5"
format_stamp: "Formatted at 2026-07-09 13:12:50 on dist-test-slave-j314"
I20260709 13:12:50.258143 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:50.287214 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:50.288602 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:50.330956 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.62:36059
I20260709 13:12:50.331053  1333 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.62:36059 every 8 connection(s)
I20260709 13:12:50.335347  1334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:50.348156  1334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5: Bootstrap starting.
I20260709 13:12:50.353521  1334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.358367  1334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5: No bootstrap required, opened a new log
I20260709 13:12:50.361100  1334 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2749880017154b2fa4bd04d7229d1ad5" member_type: VOTER }
I20260709 13:12:50.361528  1334 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.361799  1334 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2749880017154b2fa4bd04d7229d1ad5, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.362564  1334 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2749880017154b2fa4bd04d7229d1ad5" member_type: VOTER }
I20260709 13:12:50.363063  1334 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:50.363305  1334 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:50.363611  1334 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.369061  1334 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2749880017154b2fa4bd04d7229d1ad5" member_type: VOTER }
I20260709 13:12:50.369664  1334 leader_election.cc:304] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2749880017154b2fa4bd04d7229d1ad5; no voters: 
I20260709 13:12:50.371057  1334 leader_election.cc:290] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:50.371516  1337 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.372977  1337 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 2749880017154b2fa4bd04d7229d1ad5, State: Running, Role: LEADER
I20260709 13:12:50.373636  1337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2749880017154b2fa4bd04d7229d1ad5" member_type: VOTER }
I20260709 13:12:50.374310  1334 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:50.378988  1339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2749880017154b2fa4bd04d7229d1ad5. Latest consensus state: current_term: 1 leader_uuid: "2749880017154b2fa4bd04d7229d1ad5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2749880017154b2fa4bd04d7229d1ad5" member_type: VOTER } }
I20260709 13:12:50.379292  1338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2749880017154b2fa4bd04d7229d1ad5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2749880017154b2fa4bd04d7229d1ad5" member_type: VOTER } }
I20260709 13:12:50.379833  1338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:50.379871  1339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:50.382275  1344 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:50.389912  1344 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:50.391062 22480 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:50.399488  1344 catalog_manager.cc:1383] Generated new cluster ID: 1fef54166a154b74a5c5eea1a1905192
I20260709 13:12:50.399806  1344 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:50.434242  1344 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:50.435757  1344 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:50.452198  1344 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5: Generated new TSK 0
I20260709 13:12:50.452908  1344 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:50.457943 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:50.464787  1355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:50.466784  1356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:50.473219 22480 server_base.cc:1061] running on GCE node
W20260709 13:12:50.473573  1358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:50.474699 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:50.474900 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:50.475174 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602770475109 us; error 0 us; skew 500 ppm
I20260709 13:12:50.476068 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:50.479526 22480 webserver.cc:533] Webserver started at http://127.21.244.1:39875/ using document root <none> and password file <none>
I20260709 13:12:50.480142 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:50.480391 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:50.480710 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:50.481958 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-0-root/instance:
uuid: "bc01ffc20358413d8e0735c5d88463f0"
format_stamp: "Formatted at 2026-07-09 13:12:50 on dist-test-slave-j314"
I20260709 13:12:50.487346 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:12:50.491142  1363 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:50.492303 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:50.492691 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-0-root
uuid: "bc01ffc20358413d8e0735c5d88463f0"
format_stamp: "Formatted at 2026-07-09 13:12:50 on dist-test-slave-j314"
I20260709 13:12:50.493091 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:50.509488 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:50.510776 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:50.512300 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:50.514665 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:50.514858 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:50.515185 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:50.515326 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:50.559057 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.1:34905
I20260709 13:12:50.559165  1425 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.1:34905 every 8 connection(s)
I20260709 13:12:50.564589 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:50.572106  1430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:50.573985  1431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:50.576152 22480 server_base.cc:1061] running on GCE node
W20260709 13:12:50.575920  1433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:50.577749 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:50.577984 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:50.578140 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602770578127 us; error 0 us; skew 500 ppm
I20260709 13:12:50.578332  1426 heartbeater.cc:344] Connected to a master server at 127.21.244.62:36059
I20260709 13:12:50.578778  1426 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:50.578823 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:50.579691  1426 heartbeater.cc:507] Master 127.21.244.62:36059 requested a full tablet report, sending...
I20260709 13:12:50.581960 22480 webserver.cc:533] Webserver started at http://127.21.244.2:40137/ using document root <none> and password file <none>
I20260709 13:12:50.582336  1299 ts_manager.cc:194] Registered new tserver with Master: bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1:34905)
I20260709 13:12:50.582787 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:50.583154 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:50.583515 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:50.585270 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-1-root/instance:
uuid: "1c61ccd7dbb441859f3902507e9fb804"
format_stamp: "Formatted at 2026-07-09 13:12:50 on dist-test-slave-j314"
I20260709 13:12:50.585414  1299 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35556
I20260709 13:12:50.590405 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:50.594218  1438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:50.595105 22480 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:50.595366 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-1-root
uuid: "1c61ccd7dbb441859f3902507e9fb804"
format_stamp: "Formatted at 2026-07-09 13:12:50 on dist-test-slave-j314"
I20260709 13:12:50.595649 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:50.622099 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:50.623335 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:50.625051 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:50.627343 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:50.627592 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:50.627858 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:50.628037 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:50.670605 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.2:43703
I20260709 13:12:50.670727  1500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.2:43703 every 8 connection(s)
I20260709 13:12:50.675964 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:50.682826  1504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:50.684401  1505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:50.687104  1508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:50.688161 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:50.689201  1501 heartbeater.cc:344] Connected to a master server at 127.21.244.62:36059
I20260709 13:12:50.689394 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:50.689631  1501 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:50.689755 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:50.690176 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602770690157 us; error 0 us; skew 500 ppm
I20260709 13:12:50.690722  1501 heartbeater.cc:507] Master 127.21.244.62:36059 requested a full tablet report, sending...
I20260709 13:12:50.690801 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:50.693748  1299 ts_manager.cc:194] Registered new tserver with Master: 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2:43703)
I20260709 13:12:50.693869 22480 webserver.cc:533] Webserver started at http://127.21.244.3:44965/ using document root <none> and password file <none>
I20260709 13:12:50.694792 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:50.695068 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:50.695436 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:50.696045  1299 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35566
I20260709 13:12:50.697278 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-2-root/instance:
uuid: "b8f92f9a2d1445eab695371cd939c9b4"
format_stamp: "Formatted at 2026-07-09 13:12:50 on dist-test-slave-j314"
I20260709 13:12:50.702752 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:50.706844  1512 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:50.707999 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:50.708382 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-2-root
uuid: "b8f92f9a2d1445eab695371cd939c9b4"
format_stamp: "Formatted at 2026-07-09 13:12:50 on dist-test-slave-j314"
I20260709 13:12:50.708680 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602440417847-22480-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:50.724910 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:50.726282 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:50.728024 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:50.730592 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:50.730803 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:50.731207 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:50.731508 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:12:50.779059 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.3:35953
I20260709 13:12:50.779229  1574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.3:35953 every 8 connection(s)
I20260709 13:12:50.794224  1575 heartbeater.cc:344] Connected to a master server at 127.21.244.62:36059
I20260709 13:12:50.794819  1575 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:50.795781  1575 heartbeater.cc:507] Master 127.21.244.62:36059 requested a full tablet report, sending...
I20260709 13:12:50.798048  1299 ts_manager.cc:194] Registered new tserver with Master: b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3:35953)
I20260709 13:12:50.799015 22480 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016277414s
I20260709 13:12:50.799642  1299 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35578
I20260709 13:12:50.827637  1299 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35594:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:50.830015  1299 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:50.875789  1540 tablet_service.cc:1511] Processing CreateTablet for tablet c43c108cc9454e6fa46fef840dccf71e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b598d666f5234d1d8b375a0eb06b305d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:50.875927  1539 tablet_service.cc:1511] Processing CreateTablet for tablet 56d7daa8ec0c4d8cab9cfa32109927d9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b598d666f5234d1d8b375a0eb06b305d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:50.877617  1540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43c108cc9454e6fa46fef840dccf71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:50.880636  1539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d7daa8ec0c4d8cab9cfa32109927d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:50.887914  1466 tablet_service.cc:1511] Processing CreateTablet for tablet c43c108cc9454e6fa46fef840dccf71e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b598d666f5234d1d8b375a0eb06b305d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:50.888554  1465 tablet_service.cc:1511] Processing CreateTablet for tablet 56d7daa8ec0c4d8cab9cfa32109927d9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b598d666f5234d1d8b375a0eb06b305d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:50.889490  1466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43c108cc9454e6fa46fef840dccf71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:50.890234  1465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d7daa8ec0c4d8cab9cfa32109927d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:50.894282  1391 tablet_service.cc:1511] Processing CreateTablet for tablet c43c108cc9454e6fa46fef840dccf71e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b598d666f5234d1d8b375a0eb06b305d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:50.895812  1391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43c108cc9454e6fa46fef840dccf71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:50.897637  1390 tablet_service.cc:1511] Processing CreateTablet for tablet 56d7daa8ec0c4d8cab9cfa32109927d9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b598d666f5234d1d8b375a0eb06b305d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:50.899066  1390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d7daa8ec0c4d8cab9cfa32109927d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:50.921195  1591 tablet_bootstrap.cc:492] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0: Bootstrap starting.
I20260709 13:12:50.929590  1591 tablet_bootstrap.cc:654] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.938683  1590 tablet_bootstrap.cc:492] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4: Bootstrap starting.
I20260709 13:12:50.940834  1591 tablet_bootstrap.cc:492] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0: No bootstrap required, opened a new log
I20260709 13:12:50.941620  1591 ts_tablet_manager.cc:1403] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 13:12:50.944566  1594 tablet_bootstrap.cc:492] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804: Bootstrap starting.
I20260709 13:12:50.945333  1591 raft_consensus.cc:359] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:50.946509  1591 raft_consensus.cc:385] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.946941  1591 raft_consensus.cc:740] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01ffc20358413d8e0735c5d88463f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.947853  1591 consensus_queue.cc:260] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:50.950105  1590 tablet_bootstrap.cc:654] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.982756  1591 ts_tablet_manager.cc:1434] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.003s
I20260709 13:12:50.983759  1594 tablet_bootstrap.cc:654] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.985061  1426 heartbeater.cc:499] Master 127.21.244.62:36059 was elected leader, sending a full tablet report...
I20260709 13:12:50.987186  1591 tablet_bootstrap.cc:492] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0: Bootstrap starting.
I20260709 13:12:50.989427  1590 tablet_bootstrap.cc:492] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4: No bootstrap required, opened a new log
I20260709 13:12:50.990588  1590 ts_tablet_manager.cc:1403] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.004s
I20260709 13:12:50.997874  1590 raft_consensus.cc:359] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:50.999668  1590 raft_consensus.cc:385] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.000406  1591 tablet_bootstrap.cc:654] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.000164  1590 raft_consensus.cc:740] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8f92f9a2d1445eab695371cd939c9b4, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.001427  1594 tablet_bootstrap.cc:492] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804: No bootstrap required, opened a new log
I20260709 13:12:51.002314  1594 ts_tablet_manager.cc:1403] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.015s
I20260709 13:12:51.001860  1590 consensus_queue.cc:260] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:51.007488  1594 raft_consensus.cc:359] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:51.008836  1594 raft_consensus.cc:385] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.009292  1594 raft_consensus.cc:740] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c61ccd7dbb441859f3902507e9fb804, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.010417  1594 consensus_queue.cc:260] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:51.012674  1590 ts_tablet_manager.cc:1434] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4: Time spent starting tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:12:51.014448  1575 heartbeater.cc:499] Master 127.21.244.62:36059 was elected leader, sending a full tablet report...
I20260709 13:12:51.020918  1594 ts_tablet_manager.cc:1434] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 13:12:51.021438  1501 heartbeater.cc:499] Master 127.21.244.62:36059 was elected leader, sending a full tablet report...
I20260709 13:12:51.023218  1590 tablet_bootstrap.cc:492] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4: Bootstrap starting.
I20260709 13:12:51.027904  1594 tablet_bootstrap.cc:492] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804: Bootstrap starting.
I20260709 13:12:51.028170  1591 tablet_bootstrap.cc:492] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0: No bootstrap required, opened a new log
I20260709 13:12:51.028802  1591 ts_tablet_manager.cc:1403] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0: Time spent bootstrapping tablet: real 0.042s	user 0.023s	sys 0.010s
I20260709 13:12:51.033005  1590 tablet_bootstrap.cc:654] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.032657  1591 raft_consensus.cc:359] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.036926  1591 raft_consensus.cc:385] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.037082  1594 tablet_bootstrap.cc:654] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.037403  1591 raft_consensus.cc:740] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01ffc20358413d8e0735c5d88463f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.038339  1591 consensus_queue.cc:260] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.041097  1591 ts_tablet_manager.cc:1434] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:12:51.044837  1590 tablet_bootstrap.cc:492] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4: No bootstrap required, opened a new log
I20260709 13:12:51.045516  1590 ts_tablet_manager.cc:1403] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 13:12:51.045846  1598 raft_consensus.cc:493] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.047022  1598 raft_consensus.cc:515] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:51.050393  1590 raft_consensus.cc:359] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.051167  1590 raft_consensus.cc:385] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.051499  1590 raft_consensus.cc:740] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8f92f9a2d1445eab695371cd939c9b4, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.052277  1594 tablet_bootstrap.cc:492] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804: No bootstrap required, opened a new log
I20260709 13:12:51.052976  1594 ts_tablet_manager.cc:1403] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.006s
I20260709 13:12:51.052981  1590 consensus_queue.cc:260] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.059324  1598 leader_election.cc:290] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2:43703), bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1:34905)
I20260709 13:12:51.065801  1594 raft_consensus.cc:359] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.067045  1594 raft_consensus.cc:385] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.067492  1594 raft_consensus.cc:740] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c61ccd7dbb441859f3902507e9fb804, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.068979  1594 consensus_queue.cc:260] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.071606  1594 ts_tablet_manager.cc:1434] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:12:51.071609  1590 ts_tablet_manager.cc:1434] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4: Time spent starting tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 13:12:51.075618  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43c108cc9454e6fa46fef840dccf71e" candidate_uuid: "b8f92f9a2d1445eab695371cd939c9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c61ccd7dbb441859f3902507e9fb804" is_pre_election: true
I20260709 13:12:51.077081  1476 raft_consensus.cc:2468] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8f92f9a2d1445eab695371cd939c9b4 in term 0.
I20260709 13:12:51.081183  1515 leader_election.cc:304] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, b8f92f9a2d1445eab695371cd939c9b4; no voters: 
I20260709 13:12:51.086412  1603 raft_consensus.cc:2804] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.086627  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43c108cc9454e6fa46fef840dccf71e" candidate_uuid: "b8f92f9a2d1445eab695371cd939c9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01ffc20358413d8e0735c5d88463f0" is_pre_election: true
I20260709 13:12:51.086982  1603 raft_consensus.cc:493] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.087415  1603 raft_consensus.cc:3060] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.087484  1401 raft_consensus.cc:2468] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8f92f9a2d1445eab695371cd939c9b4 in term 0.
I20260709 13:12:51.096977  1603 raft_consensus.cc:515] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:51.098775  1603 leader_election.cc:290] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [CANDIDATE]: Term 1 election: Requested vote from peers 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2:43703), bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1:34905)
I20260709 13:12:51.099769  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43c108cc9454e6fa46fef840dccf71e" candidate_uuid: "b8f92f9a2d1445eab695371cd939c9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c61ccd7dbb441859f3902507e9fb804"
I20260709 13:12:51.100391  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43c108cc9454e6fa46fef840dccf71e" candidate_uuid: "b8f92f9a2d1445eab695371cd939c9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01ffc20358413d8e0735c5d88463f0"
I20260709 13:12:51.100438  1476 raft_consensus.cc:3060] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.100970  1401 raft_consensus.cc:3060] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.107900  1476 raft_consensus.cc:2468] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8f92f9a2d1445eab695371cd939c9b4 in term 1.
I20260709 13:12:51.108139  1595 raft_consensus.cc:493] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.108062  1401 raft_consensus.cc:2468] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8f92f9a2d1445eab695371cd939c9b4 in term 1.
I20260709 13:12:51.108916  1595 raft_consensus.cc:515] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.109249  1515 leader_election.cc:304] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, b8f92f9a2d1445eab695371cd939c9b4; no voters: 
I20260709 13:12:51.110157  1603 raft_consensus.cc:2804] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.110613  1603 raft_consensus.cc:697] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 1 LEADER]: Becoming Leader. State: Replica: b8f92f9a2d1445eab695371cd939c9b4, State: Running, Role: LEADER
I20260709 13:12:51.111464  1603 consensus_queue.cc:237] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:51.113291  1595 leader_election.cc:290] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2:43703), b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3:35953)
I20260709 13:12:51.123119  1299 catalog_manager.cc:5697] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "b8f92f9a2d1445eab695371cd939c9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.130789  1550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d7daa8ec0c4d8cab9cfa32109927d9" candidate_uuid: "bc01ffc20358413d8e0735c5d88463f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4" is_pre_election: true
I20260709 13:12:51.131098  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d7daa8ec0c4d8cab9cfa32109927d9" candidate_uuid: "bc01ffc20358413d8e0735c5d88463f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c61ccd7dbb441859f3902507e9fb804" is_pre_election: true
I20260709 13:12:51.131671  1550 raft_consensus.cc:2468] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01ffc20358413d8e0735c5d88463f0 in term 0.
I20260709 13:12:51.131930  1476 raft_consensus.cc:2468] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc01ffc20358413d8e0735c5d88463f0 in term 0.
I20260709 13:12:51.133304  1366 leader_election.cc:304] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, bc01ffc20358413d8e0735c5d88463f0; no voters: 
I20260709 13:12:51.134332  1595 raft_consensus.cc:2804] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.134770  1595 raft_consensus.cc:493] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.135082  1595 raft_consensus.cc:3060] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.143270  1595 raft_consensus.cc:515] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.145205  1595 leader_election.cc:290] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [CANDIDATE]: Term 1 election: Requested vote from peers 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2:43703), b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3:35953)
I20260709 13:12:51.145979  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d7daa8ec0c4d8cab9cfa32109927d9" candidate_uuid: "bc01ffc20358413d8e0735c5d88463f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c61ccd7dbb441859f3902507e9fb804"
I20260709 13:12:51.146286  1550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d7daa8ec0c4d8cab9cfa32109927d9" candidate_uuid: "bc01ffc20358413d8e0735c5d88463f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4"
I20260709 13:12:51.146569  1476 raft_consensus.cc:3060] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.146857  1550 raft_consensus.cc:3060] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.152567  1476 raft_consensus.cc:2468] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01ffc20358413d8e0735c5d88463f0 in term 1.
I20260709 13:12:51.153764  1366 leader_election.cc:304] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, bc01ffc20358413d8e0735c5d88463f0; no voters: 
I20260709 13:12:51.153810  1550 raft_consensus.cc:2468] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01ffc20358413d8e0735c5d88463f0 in term 1.
I20260709 13:12:51.154824  1595 raft_consensus.cc:2804] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.156322  1595 raft_consensus.cc:697] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 1 LEADER]: Becoming Leader. State: Replica: bc01ffc20358413d8e0735c5d88463f0, State: Running, Role: LEADER
I20260709 13:12:51.157349  1595 consensus_queue.cc:237] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.164840  1299 catalog_manager.cc:5697] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "bc01ffc20358413d8e0735c5d88463f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.206785  1299 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35610:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:51.209451  1299 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:51.239713  1390 tablet_service.cc:1511] Processing CreateTablet for tablet b16f46a54aae42cbb69b33d2bfa14c10 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb1c6a5777f24e89bc052ad4f2beff83]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:51.240983  1465 tablet_service.cc:1511] Processing CreateTablet for tablet b16f46a54aae42cbb69b33d2bfa14c10 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb1c6a5777f24e89bc052ad4f2beff83]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:51.241487  1390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16f46a54aae42cbb69b33d2bfa14c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:51.242496  1465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16f46a54aae42cbb69b33d2bfa14c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:51.242452  1540 tablet_service.cc:1511] Processing CreateTablet for tablet b16f46a54aae42cbb69b33d2bfa14c10 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb1c6a5777f24e89bc052ad4f2beff83]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:51.243944  1540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b16f46a54aae42cbb69b33d2bfa14c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:51.247653  1466 tablet_service.cc:1511] Processing CreateTablet for tablet 3afbe0aa719748fe9bc2da4ea68ba5ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb1c6a5777f24e89bc052ad4f2beff83]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:51.248890  1391 tablet_service.cc:1511] Processing CreateTablet for tablet 3afbe0aa719748fe9bc2da4ea68ba5ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb1c6a5777f24e89bc052ad4f2beff83]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:51.249255  1466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afbe0aa719748fe9bc2da4ea68ba5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:51.249202  1539 tablet_service.cc:1511] Processing CreateTablet for tablet 3afbe0aa719748fe9bc2da4ea68ba5ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=fb1c6a5777f24e89bc052ad4f2beff83]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:51.250299  1391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afbe0aa719748fe9bc2da4ea68ba5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:51.250587  1539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afbe0aa719748fe9bc2da4ea68ba5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:51.270141  1590 tablet_bootstrap.cc:492] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4: Bootstrap starting.
I20260709 13:12:51.277441  1590 tablet_bootstrap.cc:654] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.279778  1594 tablet_bootstrap.cc:492] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804: Bootstrap starting.
I20260709 13:12:51.281713  1591 tablet_bootstrap.cc:492] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0: Bootstrap starting.
I20260709 13:12:51.290200  1594 tablet_bootstrap.cc:654] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.290838  1591 tablet_bootstrap.cc:654] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.295070  1590 tablet_bootstrap.cc:492] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4: No bootstrap required, opened a new log
I20260709 13:12:51.295642  1590 ts_tablet_manager.cc:1403] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.008s
I20260709 13:12:51.299085  1590 raft_consensus.cc:359] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.299456  1594 tablet_bootstrap.cc:492] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804: No bootstrap required, opened a new log
I20260709 13:12:51.299456  1591 tablet_bootstrap.cc:492] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0: No bootstrap required, opened a new log
I20260709 13:12:51.299687  1590 raft_consensus.cc:385] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.300369  1591 ts_tablet_manager.cc:1403] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.006s
I20260709 13:12:51.300369  1594 ts_tablet_manager.cc:1403] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 13:12:51.300415  1590 raft_consensus.cc:740] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8f92f9a2d1445eab695371cd939c9b4, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.301684  1590 consensus_queue.cc:260] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.303903  1590 ts_tablet_manager.cc:1434] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:51.304031  1594 raft_consensus.cc:359] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.304932  1594 raft_consensus.cc:385] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.305040  1590 tablet_bootstrap.cc:492] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4: Bootstrap starting.
I20260709 13:12:51.305356  1594 raft_consensus.cc:740] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c61ccd7dbb441859f3902507e9fb804, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.306301  1594 consensus_queue.cc:260] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.310788  1594 ts_tablet_manager.cc:1434] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:12:51.312107  1594 tablet_bootstrap.cc:492] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804: Bootstrap starting.
I20260709 13:12:51.312585  1590 tablet_bootstrap.cc:654] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.304230  1591 raft_consensus.cc:359] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.314517  1591 raft_consensus.cc:385] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.314916  1591 raft_consensus.cc:740] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01ffc20358413d8e0735c5d88463f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.315796  1591 consensus_queue.cc:260] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.319716  1594 tablet_bootstrap.cc:654] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.323172  1591 ts_tablet_manager.cc:1434] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:12:51.328634  1591 tablet_bootstrap.cc:492] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0: Bootstrap starting.
I20260709 13:12:51.338506  1591 tablet_bootstrap.cc:654] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.343950  1590 tablet_bootstrap.cc:492] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4: No bootstrap required, opened a new log
I20260709 13:12:51.343979  1594 tablet_bootstrap.cc:492] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804: No bootstrap required, opened a new log
I20260709 13:12:51.344540  1590 ts_tablet_manager.cc:1403] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.026s
I20260709 13:12:51.344669  1594 ts_tablet_manager.cc:1403] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.019s
I20260709 13:12:51.345237  1591 tablet_bootstrap.cc:492] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0: No bootstrap required, opened a new log
I20260709 13:12:51.345736  1591 ts_tablet_manager.cc:1403] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 13:12:51.347894  1594 raft_consensus.cc:359] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.348090  1590 raft_consensus.cc:359] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.348152  1591 raft_consensus.cc:359] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.348788  1594 raft_consensus.cc:385] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.348896  1590 raft_consensus.cc:385] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.349050  1591 raft_consensus.cc:385] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.349193  1594 raft_consensus.cc:740] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c61ccd7dbb441859f3902507e9fb804, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.349304  1590 raft_consensus.cc:740] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8f92f9a2d1445eab695371cd939c9b4, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.349627  1591 raft_consensus.cc:740] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc01ffc20358413d8e0735c5d88463f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.350328  1590 consensus_queue.cc:260] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.350560  1591 consensus_queue.cc:260] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.350328  1594 consensus_queue.cc:260] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.352998  1594 ts_tablet_manager.cc:1434] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:12:51.354698  1590 ts_tablet_manager.cc:1434] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:12:51.355239  1591 ts_tablet_manager.cc:1434] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:12:51.379905  1600 raft_consensus.cc:493] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.380558  1600 raft_consensus.cc:515] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.382733  1600 leader_election.cc:290] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1:34905), b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3:35953)
W20260709 13:12:51.385949  1347 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:51.394166  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10" candidate_uuid: "1c61ccd7dbb441859f3902507e9fb804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01ffc20358413d8e0735c5d88463f0" is_pre_election: true
I20260709 13:12:51.394991  1401 raft_consensus.cc:2468] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c61ccd7dbb441859f3902507e9fb804 in term 0.
I20260709 13:12:51.395953  1550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10" candidate_uuid: "1c61ccd7dbb441859f3902507e9fb804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4" is_pre_election: true
I20260709 13:12:51.396190  1442 leader_election.cc:304] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, bc01ffc20358413d8e0735c5d88463f0; no voters: 
I20260709 13:12:51.396559  1550 raft_consensus.cc:2468] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c61ccd7dbb441859f3902507e9fb804 in term 0.
I20260709 13:12:51.397105  1600 raft_consensus.cc:2804] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.397497  1600 raft_consensus.cc:493] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.397831  1600 raft_consensus.cc:3060] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.403633  1600 raft_consensus.cc:515] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.405417  1600 leader_election.cc:290] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [CANDIDATE]: Term 1 election: Requested vote from peers bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1:34905), b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3:35953)
I20260709 13:12:51.406443  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10" candidate_uuid: "1c61ccd7dbb441859f3902507e9fb804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01ffc20358413d8e0735c5d88463f0"
I20260709 13:12:51.406797  1550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10" candidate_uuid: "1c61ccd7dbb441859f3902507e9fb804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4"
I20260709 13:12:51.407087  1401 raft_consensus.cc:3060] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.407440  1550 raft_consensus.cc:3060] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.412762  1401 raft_consensus.cc:2468] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c61ccd7dbb441859f3902507e9fb804 in term 1.
I20260709 13:12:51.412982  1550 raft_consensus.cc:2468] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c61ccd7dbb441859f3902507e9fb804 in term 1.
I20260709 13:12:51.413988  1442 leader_election.cc:304] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, bc01ffc20358413d8e0735c5d88463f0; no voters: 
I20260709 13:12:51.414631  1600 raft_consensus.cc:2804] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.415544  1600 raft_consensus.cc:697] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 1 LEADER]: Becoming Leader. State: Replica: 1c61ccd7dbb441859f3902507e9fb804, State: Running, Role: LEADER
I20260709 13:12:51.416271  1600 consensus_queue.cc:237] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.425271  1297 catalog_manager.cc:5697] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "1c61ccd7dbb441859f3902507e9fb804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.542237  1600 raft_consensus.cc:493] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.542718  1600 raft_consensus.cc:515] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.544620  1600 leader_election.cc:290] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1:34905), b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3:35953)
I20260709 13:12:51.545442  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbe0aa719748fe9bc2da4ea68ba5ae" candidate_uuid: "1c61ccd7dbb441859f3902507e9fb804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01ffc20358413d8e0735c5d88463f0" is_pre_election: true
I20260709 13:12:51.545684  1550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbe0aa719748fe9bc2da4ea68ba5ae" candidate_uuid: "1c61ccd7dbb441859f3902507e9fb804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4" is_pre_election: true
I20260709 13:12:51.546172  1401 raft_consensus.cc:2468] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c61ccd7dbb441859f3902507e9fb804 in term 0.
I20260709 13:12:51.546259  1550 raft_consensus.cc:2468] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c61ccd7dbb441859f3902507e9fb804 in term 0.
I20260709 13:12:51.547566  1442 leader_election.cc:304] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, bc01ffc20358413d8e0735c5d88463f0; no voters: 
I20260709 13:12:51.548447  1600 raft_consensus.cc:2804] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.548837  1600 raft_consensus.cc:493] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.549238  1600 raft_consensus.cc:3060] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.548946  1603 consensus_queue.cc:1048] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:51.556308  1600 raft_consensus.cc:515] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.561388  1549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbe0aa719748fe9bc2da4ea68ba5ae" candidate_uuid: "1c61ccd7dbb441859f3902507e9fb804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4"
I20260709 13:12:51.562077  1549 raft_consensus.cc:3060] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.563864  1595 consensus_queue.cc:1048] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.571858  1600 leader_election.cc:290] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [CANDIDATE]: Term 1 election: Requested vote from peers bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1:34905), b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3:35953)
I20260709 13:12:51.572276  1400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbe0aa719748fe9bc2da4ea68ba5ae" candidate_uuid: "1c61ccd7dbb441859f3902507e9fb804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc01ffc20358413d8e0735c5d88463f0"
I20260709 13:12:51.573248  1400 raft_consensus.cc:3060] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.574146  1549 raft_consensus.cc:2468] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c61ccd7dbb441859f3902507e9fb804 in term 1.
I20260709 13:12:51.575857  1442 leader_election.cc:304] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, b8f92f9a2d1445eab695371cd939c9b4; no voters: 
I20260709 13:12:51.577126  1600 raft_consensus.cc:2804] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.577713  1600 raft_consensus.cc:697] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 1 LEADER]: Becoming Leader. State: Replica: 1c61ccd7dbb441859f3902507e9fb804, State: Running, Role: LEADER
I20260709 13:12:51.578610  1600 consensus_queue.cc:237] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.582165  1400 raft_consensus.cc:2468] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c61ccd7dbb441859f3902507e9fb804 in term 1.
I20260709 13:12:51.592095  1298 catalog_manager.cc:5697] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "1c61ccd7dbb441859f3902507e9fb804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.596581  1630 consensus_queue.cc:1048] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.597033  1631 consensus_queue.cc:1048] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.654248  1550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c43c108cc9454e6fa46fef840dccf71e"
dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4"
mode: GRACEFUL
new_leader_uuid: "bc01ffc20358413d8e0735c5d88463f0"
 from {username='slave'} at 127.0.0.1:58488
I20260709 13:12:51.654871  1550 raft_consensus.cc:606] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 1 LEADER]: Received request to transfer leadership to TS bc01ffc20358413d8e0735c5d88463f0
I20260709 13:12:51.667678  1400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56d7daa8ec0c4d8cab9cfa32109927d9"
dest_uuid: "bc01ffc20358413d8e0735c5d88463f0"
mode: GRACEFUL
new_leader_uuid: "1c61ccd7dbb441859f3902507e9fb804"
 from {username='slave'} at 127.0.0.1:36120
I20260709 13:12:51.668300  1400 raft_consensus.cc:606] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 1 LEADER]: Received request to transfer leadership to TS 1c61ccd7dbb441859f3902507e9fb804
I20260709 13:12:51.684088  1476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10"
dest_uuid: "1c61ccd7dbb441859f3902507e9fb804"
mode: GRACEFUL
new_leader_uuid: "bc01ffc20358413d8e0735c5d88463f0"
 from {username='slave'} at 127.0.0.1:42744
I20260709 13:12:51.684728  1476 raft_consensus.cc:606] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 1 LEADER]: Received request to transfer leadership to TS bc01ffc20358413d8e0735c5d88463f0
I20260709 13:12:51.691589  1476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3afbe0aa719748fe9bc2da4ea68ba5ae"
dest_uuid: "1c61ccd7dbb441859f3902507e9fb804"
mode: GRACEFUL
new_leader_uuid: "bc01ffc20358413d8e0735c5d88463f0"
 from {username='slave'} at 127.0.0.1:42744
I20260709 13:12:51.692382  1476 raft_consensus.cc:606] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 1 LEADER]: Received request to transfer leadership to TS bc01ffc20358413d8e0735c5d88463f0
I20260709 13:12:51.808774  1600 consensus_queue.cc:1048] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.817677  1623 raft_consensus.cc:993] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804: : Instructing follower bc01ffc20358413d8e0735c5d88463f0 to start an election
I20260709 13:12:51.818392  1600 raft_consensus.cc:1081] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 1 LEADER]: Signalling peer bc01ffc20358413d8e0735c5d88463f0 to start an election
I20260709 13:12:51.822886  1401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10"
dest_uuid: "bc01ffc20358413d8e0735c5d88463f0"
 from {username='slave'} at 127.0.0.1:36104
I20260709 13:12:51.824985  1401 raft_consensus.cc:493] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:51.825487  1401 raft_consensus.cc:3060] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.833226  1401 raft_consensus.cc:515] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.835453  1639 consensus_queue.cc:1048] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.838074  1401 leader_election.cc:290] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [CANDIDATE]: Term 2 election: Requested vote from peers 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2:43703), b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3:35953)
I20260709 13:12:51.839291  1549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10" candidate_uuid: "bc01ffc20358413d8e0735c5d88463f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4"
I20260709 13:12:51.839968  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10" candidate_uuid: "bc01ffc20358413d8e0735c5d88463f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c61ccd7dbb441859f3902507e9fb804"
I20260709 13:12:51.840797  1476 raft_consensus.cc:3055] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:51.841137  1476 raft_consensus.cc:740] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c61ccd7dbb441859f3902507e9fb804, State: Running, Role: LEADER
I20260709 13:12:51.842211  1476 consensus_queue.cc:260] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.843623  1476 raft_consensus.cc:3060] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.853749  1476 raft_consensus.cc:2468] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01ffc20358413d8e0735c5d88463f0 in term 2.
I20260709 13:12:51.855042  1366 leader_election.cc:304] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, bc01ffc20358413d8e0735c5d88463f0; no voters: b8f92f9a2d1445eab695371cd939c9b4
I20260709 13:12:51.855906  1630 raft_consensus.cc:2804] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:51.856483  1630 raft_consensus.cc:697] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 2 LEADER]: Becoming Leader. State: Replica: bc01ffc20358413d8e0735c5d88463f0, State: Running, Role: LEADER
I20260709 13:12:51.857750  1630 consensus_queue.cc:237] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:51.865656  1298 catalog_manager.cc:5697] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 reported cstate change: term changed from 1 to 2, leader changed from 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2) to bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "bc01ffc20358413d8e0735c5d88463f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.000231  1639 consensus_queue.cc:1048] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:52.007941  1623 raft_consensus.cc:993] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804: : Instructing follower bc01ffc20358413d8e0735c5d88463f0 to start an election
I20260709 13:12:52.008430  1623 raft_consensus.cc:1081] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 1 LEADER]: Signalling peer bc01ffc20358413d8e0735c5d88463f0 to start an election
I20260709 13:12:52.010591  1400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3afbe0aa719748fe9bc2da4ea68ba5ae"
dest_uuid: "bc01ffc20358413d8e0735c5d88463f0"
 from {username='slave'} at 127.0.0.1:36104
I20260709 13:12:52.011227  1400 raft_consensus.cc:493] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.011644  1400 raft_consensus.cc:3060] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.016674  1600 consensus_queue.cc:1048] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.019604  1400 raft_consensus.cc:515] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:52.021641  1401 raft_consensus.cc:1240] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Rejecting Update request from peer 1c61ccd7dbb441859f3902507e9fb804 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:52.025038  1400 leader_election.cc:290] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [CANDIDATE]: Term 2 election: Requested vote from peers 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2:43703), b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3:35953)
I20260709 13:12:52.025846  1549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbe0aa719748fe9bc2da4ea68ba5ae" candidate_uuid: "bc01ffc20358413d8e0735c5d88463f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4"
I20260709 13:12:52.027510  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbe0aa719748fe9bc2da4ea68ba5ae" candidate_uuid: "bc01ffc20358413d8e0735c5d88463f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c61ccd7dbb441859f3902507e9fb804"
I20260709 13:12:52.028342  1476 raft_consensus.cc:3055] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:52.028721  1476 raft_consensus.cc:740] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c61ccd7dbb441859f3902507e9fb804, State: Running, Role: LEADER
I20260709 13:12:52.030092  1476 consensus_queue.cc:260] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:52.031049  1600 consensus_queue.cc:1059] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:52.032353  1476 raft_consensus.cc:3060] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.038604  1476 raft_consensus.cc:2468] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01ffc20358413d8e0735c5d88463f0 in term 2.
I20260709 13:12:52.039777  1366 leader_election.cc:304] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, bc01ffc20358413d8e0735c5d88463f0; no voters: b8f92f9a2d1445eab695371cd939c9b4
I20260709 13:12:52.040735  1630 raft_consensus.cc:2804] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:52.041213  1630 raft_consensus.cc:697] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 2 LEADER]: Becoming Leader. State: Replica: bc01ffc20358413d8e0735c5d88463f0, State: Running, Role: LEADER
I20260709 13:12:52.042114  1630 consensus_queue.cc:237] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:52.049357  1298 catalog_manager.cc:5697] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 reported cstate change: term changed from 1 to 2, leader changed from 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2) to bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "bc01ffc20358413d8e0735c5d88463f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.106609  1608 raft_consensus.cc:993] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0: : Instructing follower 1c61ccd7dbb441859f3902507e9fb804 to start an election
I20260709 13:12:52.107160  1608 raft_consensus.cc:1081] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 1 LEADER]: Signalling peer 1c61ccd7dbb441859f3902507e9fb804 to start an election
I20260709 13:12:52.109133  1476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56d7daa8ec0c4d8cab9cfa32109927d9"
dest_uuid: "1c61ccd7dbb441859f3902507e9fb804"
 from {username='slave'} at 127.0.0.1:42732
I20260709 13:12:52.109688  1476 raft_consensus.cc:493] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.110121  1476 raft_consensus.cc:3060] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.115834  1476 raft_consensus.cc:515] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:52.117669  1476 leader_election.cc:290] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [CANDIDATE]: Term 2 election: Requested vote from peers bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1:34905), b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3:35953)
I20260709 13:12:52.118525  1400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d7daa8ec0c4d8cab9cfa32109927d9" candidate_uuid: "1c61ccd7dbb441859f3902507e9fb804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc01ffc20358413d8e0735c5d88463f0"
I20260709 13:12:52.118788  1550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d7daa8ec0c4d8cab9cfa32109927d9" candidate_uuid: "1c61ccd7dbb441859f3902507e9fb804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4"
I20260709 13:12:52.119233  1400 raft_consensus.cc:3055] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:52.119462  1550 raft_consensus.cc:3060] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.119649  1400 raft_consensus.cc:740] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc01ffc20358413d8e0735c5d88463f0, State: Running, Role: LEADER
I20260709 13:12:52.120590  1400 consensus_queue.cc:260] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:52.121884  1400 raft_consensus.cc:3060] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.127241  1550 raft_consensus.cc:2468] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c61ccd7dbb441859f3902507e9fb804 in term 2.
I20260709 13:12:52.128630  1442 leader_election.cc:304] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, b8f92f9a2d1445eab695371cd939c9b4; no voters: 
I20260709 13:12:52.128881  1400 raft_consensus.cc:2468] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c61ccd7dbb441859f3902507e9fb804 in term 2.
I20260709 13:12:52.129441  1600 raft_consensus.cc:2804] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:52.130018  1600 raft_consensus.cc:697] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 2 LEADER]: Becoming Leader. State: Replica: 1c61ccd7dbb441859f3902507e9fb804, State: Running, Role: LEADER
I20260709 13:12:52.130834  1600 consensus_queue.cc:237] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:52.137821  1298 catalog_manager.cc:5697] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 reported cstate change: term changed from 1 to 2, leader changed from bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1) to 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "1c61ccd7dbb441859f3902507e9fb804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.164572  1598 raft_consensus.cc:993] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4: : Instructing follower bc01ffc20358413d8e0735c5d88463f0 to start an election
I20260709 13:12:52.165107  1603 raft_consensus.cc:1081] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 1 LEADER]: Signalling peer bc01ffc20358413d8e0735c5d88463f0 to start an election
I20260709 13:12:52.166890  1400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c43c108cc9454e6fa46fef840dccf71e"
dest_uuid: "bc01ffc20358413d8e0735c5d88463f0"
 from {username='slave'} at 127.0.0.1:36094
I20260709 13:12:52.167528  1400 raft_consensus.cc:493] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.167997  1400 raft_consensus.cc:3060] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.173885  1400 raft_consensus.cc:515] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:52.175594  1400 leader_election.cc:290] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [CANDIDATE]: Term 2 election: Requested vote from peers b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3:35953), 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2:43703)
I20260709 13:12:52.176514  1550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43c108cc9454e6fa46fef840dccf71e" candidate_uuid: "bc01ffc20358413d8e0735c5d88463f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4"
I20260709 13:12:52.176836  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43c108cc9454e6fa46fef840dccf71e" candidate_uuid: "bc01ffc20358413d8e0735c5d88463f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c61ccd7dbb441859f3902507e9fb804"
I20260709 13:12:52.177201  1550 raft_consensus.cc:3055] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:52.177444  1476 raft_consensus.cc:3060] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.177580  1550 raft_consensus.cc:740] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8f92f9a2d1445eab695371cd939c9b4, State: Running, Role: LEADER
I20260709 13:12:52.178447  1550 consensus_queue.cc:260] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:52.179512  1550 raft_consensus.cc:3060] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.183389  1476 raft_consensus.cc:2468] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01ffc20358413d8e0735c5d88463f0 in term 2.
I20260709 13:12:52.185173  1366 leader_election.cc:304] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, bc01ffc20358413d8e0735c5d88463f0; no voters: 
I20260709 13:12:52.185892  1608 raft_consensus.cc:2804] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:52.186398  1608 raft_consensus.cc:697] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 2 LEADER]: Becoming Leader. State: Replica: bc01ffc20358413d8e0735c5d88463f0, State: Running, Role: LEADER
I20260709 13:12:52.186864  1550 raft_consensus.cc:2468] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc01ffc20358413d8e0735c5d88463f0 in term 2.
I20260709 13:12:52.187358  1608 consensus_queue.cc:237] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } }
I20260709 13:12:52.194450  1298 catalog_manager.cc:5697] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 reported cstate change: term changed from 1 to 2, leader changed from b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3) to bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "bc01ffc20358413d8e0735c5d88463f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.396590  1476 raft_consensus.cc:1275] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Refusing update from remote peer bc01ffc20358413d8e0735c5d88463f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.398154  1608 consensus_queue.cc:1048] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.407104  1550 raft_consensus.cc:3060] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.415258  1550 raft_consensus.cc:1275] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Refusing update from remote peer bc01ffc20358413d8e0735c5d88463f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.416671  1608 consensus_queue.cc:1048] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.453219 22480 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:12:52.455108 22480 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:12:52.455562 22480 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:12:52.468542  1400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10"
dest_uuid: "bc01ffc20358413d8e0735c5d88463f0"
mode: GRACEFUL
new_leader_uuid: "b8f92f9a2d1445eab695371cd939c9b4"
 from {username='slave'} at 127.0.0.1:36134
I20260709 13:12:52.469053  1400 raft_consensus.cc:606] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 2 LEADER]: Received request to transfer leadership to TS b8f92f9a2d1445eab695371cd939c9b4
I20260709 13:12:52.470108 22480 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:12:52.530642  1400 raft_consensus.cc:1275] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Refusing update from remote peer 1c61ccd7dbb441859f3902507e9fb804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.532260  1600 consensus_queue.cc:1048] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.541610  1550 raft_consensus.cc:1275] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Refusing update from remote peer 1c61ccd7dbb441859f3902507e9fb804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.543262  1600 consensus_queue.cc:1048] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.608783  1550 raft_consensus.cc:3060] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.616071  1550 raft_consensus.cc:1275] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Refusing update from remote peer bc01ffc20358413d8e0735c5d88463f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.617718  1608 consensus_queue.cc:1048] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.627384  1476 raft_consensus.cc:1275] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Refusing update from remote peer bc01ffc20358413d8e0735c5d88463f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.629410  1643 consensus_queue.cc:1048] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.632642  1550 raft_consensus.cc:1275] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Refusing update from remote peer bc01ffc20358413d8e0735c5d88463f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.634161  1608 consensus_queue.cc:1048] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.645673  1476 raft_consensus.cc:1275] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Refusing update from remote peer bc01ffc20358413d8e0735c5d88463f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.647169  1608 consensus_queue.cc:1048] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.860960  1608 raft_consensus.cc:993] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0: : Instructing follower b8f92f9a2d1445eab695371cd939c9b4 to start an election
I20260709 13:12:52.861438  1643 raft_consensus.cc:1081] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 2 LEADER]: Signalling peer b8f92f9a2d1445eab695371cd939c9b4 to start an election
I20260709 13:12:52.863219  1550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10"
dest_uuid: "b8f92f9a2d1445eab695371cd939c9b4"
 from {username='slave'} at 127.0.0.1:58468
I20260709 13:12:52.863812  1550 raft_consensus.cc:493] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.864187  1550 raft_consensus.cc:3060] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.870273  1550 raft_consensus.cc:515] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:52.871974  1550 leader_election.cc:290] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [CANDIDATE]: Term 3 election: Requested vote from peers bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1:34905), 1c61ccd7dbb441859f3902507e9fb804 (127.21.244.2:43703)
I20260709 13:12:52.873201  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10" candidate_uuid: "b8f92f9a2d1445eab695371cd939c9b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c61ccd7dbb441859f3902507e9fb804"
I20260709 13:12:52.873062  1400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b16f46a54aae42cbb69b33d2bfa14c10" candidate_uuid: "b8f92f9a2d1445eab695371cd939c9b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc01ffc20358413d8e0735c5d88463f0"
I20260709 13:12:52.873989  1476 raft_consensus.cc:3060] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.874039  1400 raft_consensus.cc:3055] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:52.874636  1400 raft_consensus.cc:740] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc01ffc20358413d8e0735c5d88463f0, State: Running, Role: LEADER
I20260709 13:12:52.875622  1400 consensus_queue.cc:260] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:52.877151  1400 raft_consensus.cc:3060] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.882869  1476 raft_consensus.cc:2468] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8f92f9a2d1445eab695371cd939c9b4 in term 3.
I20260709 13:12:52.884541  1515 leader_election.cc:304] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c61ccd7dbb441859f3902507e9fb804, b8f92f9a2d1445eab695371cd939c9b4; no voters: 
I20260709 13:12:52.885149  1400 raft_consensus.cc:2468] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8f92f9a2d1445eab695371cd939c9b4 in term 3.
I20260709 13:12:52.885340  1603 raft_consensus.cc:2804] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:52.886584  1603 raft_consensus.cc:697] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 3 LEADER]: Becoming Leader. State: Replica: b8f92f9a2d1445eab695371cd939c9b4, State: Running, Role: LEADER
I20260709 13:12:52.887305  1603 consensus_queue.cc:237] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } }
I20260709 13:12:52.893453  1297 catalog_manager.cc:5697] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 reported cstate change: term changed from 2 to 3, leader changed from bc01ffc20358413d8e0735c5d88463f0 (127.21.244.1) to b8f92f9a2d1445eab695371cd939c9b4 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "b8f92f9a2d1445eab695371cd939c9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc01ffc20358413d8e0735c5d88463f0" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 34905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c61ccd7dbb441859f3902507e9fb804" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 43703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8f92f9a2d1445eab695371cd939c9b4" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 35953 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.106217 22480 tablet_server.cc:179] TabletServer@127.21.244.1:0 shutting down...
I20260709 13:12:53.128863 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:53.129609 22480 tablet_replica.cc:333] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0: stopping tablet replica
I20260709 13:12:53.130194 22480 raft_consensus.cc:2243] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:53.130620 22480 raft_consensus.cc:2272] T b16f46a54aae42cbb69b33d2bfa14c10 P bc01ffc20358413d8e0735c5d88463f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.133021 22480 tablet_replica.cc:333] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0: stopping tablet replica
I20260709 13:12:53.133595 22480 raft_consensus.cc:2243] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:53.134405 22480 raft_consensus.cc:2272] T 3afbe0aa719748fe9bc2da4ea68ba5ae P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.137051 22480 tablet_replica.cc:333] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0: stopping tablet replica
I20260709 13:12:53.137674 22480 raft_consensus.cc:2243] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:53.138177 22480 raft_consensus.cc:2272] T 56d7daa8ec0c4d8cab9cfa32109927d9 P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.140560 22480 tablet_replica.cc:333] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0: stopping tablet replica
I20260709 13:12:53.141103 22480 raft_consensus.cc:2243] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:53.141891 22480 raft_consensus.cc:2272] T c43c108cc9454e6fa46fef840dccf71e P bc01ffc20358413d8e0735c5d88463f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.166687 22480 tablet_server.cc:196] TabletServer@127.21.244.1:0 shutdown complete.
I20260709 13:12:53.181891 22480 tablet_server.cc:179] TabletServer@127.21.244.2:0 shutting down...
I20260709 13:12:53.205555 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:53.206269 22480 tablet_replica.cc:333] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804: stopping tablet replica
I20260709 13:12:53.206835 22480 raft_consensus.cc:2243] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:53.207314 22480 raft_consensus.cc:2272] T 3afbe0aa719748fe9bc2da4ea68ba5ae P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.209568 22480 tablet_replica.cc:333] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804: stopping tablet replica
I20260709 13:12:53.210129 22480 raft_consensus.cc:2243] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:53.210570 22480 raft_consensus.cc:2272] T b16f46a54aae42cbb69b33d2bfa14c10 P 1c61ccd7dbb441859f3902507e9fb804 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.213140 22480 tablet_replica.cc:333] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804: stopping tablet replica
I20260709 13:12:53.213680 22480 raft_consensus.cc:2243] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:53.214464 22480 raft_consensus.cc:2272] T 56d7daa8ec0c4d8cab9cfa32109927d9 P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.217015 22480 tablet_replica.cc:333] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804: stopping tablet replica
I20260709 13:12:53.217520 22480 raft_consensus.cc:2243] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:53.217936 22480 raft_consensus.cc:2272] T c43c108cc9454e6fa46fef840dccf71e P 1c61ccd7dbb441859f3902507e9fb804 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.241423 22480 tablet_server.cc:196] TabletServer@127.21.244.2:0 shutdown complete.
I20260709 13:12:53.255595 22480 tablet_server.cc:179] TabletServer@127.21.244.3:0 shutting down...
I20260709 13:12:53.279929 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:53.280674 22480 tablet_replica.cc:333] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4: stopping tablet replica
I20260709 13:12:53.281219 22480 raft_consensus.cc:2243] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:53.281872 22480 pending_rounds.cc:70] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4: Trying to abort 1 pending ops.
I20260709 13:12:53.282080 22480 pending_rounds.cc:77] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636957754077184 op_type: NO_OP noop_request { }
I20260709 13:12:53.282375 22480 raft_consensus.cc:2889] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:53.282673 22480 raft_consensus.cc:2272] T b16f46a54aae42cbb69b33d2bfa14c10 P b8f92f9a2d1445eab695371cd939c9b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.285072 22480 tablet_replica.cc:333] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4: stopping tablet replica
I20260709 13:12:53.285610 22480 raft_consensus.cc:2243] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:53.286037 22480 raft_consensus.cc:2272] T 3afbe0aa719748fe9bc2da4ea68ba5ae P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.288378 22480 tablet_replica.cc:333] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4: stopping tablet replica
I20260709 13:12:53.288910 22480 raft_consensus.cc:2243] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:53.289368 22480 raft_consensus.cc:2272] T 56d7daa8ec0c4d8cab9cfa32109927d9 P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.291455 22480 tablet_replica.cc:333] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4: stopping tablet replica
I20260709 13:12:53.292063 22480 raft_consensus.cc:2243] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:53.292532 22480 raft_consensus.cc:2272] T c43c108cc9454e6fa46fef840dccf71e P b8f92f9a2d1445eab695371cd939c9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.316309 22480 tablet_server.cc:196] TabletServer@127.21.244.3:0 shutdown complete.
I20260709 13:12:53.331558 22480 master.cc:562] Master@127.21.244.62:36059 shutting down...
I20260709 13:12:53.352051 22480 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:53.352638 22480 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:53.352989 22480 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2749880017154b2fa4bd04d7229d1ad5: stopping tablet replica
I20260709 13:12:53.366628 22480 master.cc:584] Master@127.21.244.62:36059 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3172 ms)
[----------] 6 tests from LeaderRebalancerTest (332816 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:12:53.404371 22480 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.244.62:40225
I20260709 13:12:53.405586 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:53.411223  1655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:53.411301  1654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:53.414319 22480 server_base.cc:1061] running on GCE node
W20260709 13:12:53.414471  1657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:53.415510 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:53.415700 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:53.415930 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602773415893 us; error 0 us; skew 500 ppm
I20260709 13:12:53.416463 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:53.418821 22480 webserver.cc:533] Webserver started at http://127.21.244.62:36669/ using document root <none> and password file <none>
I20260709 13:12:53.419327 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:53.419520 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:53.419859 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:53.420987 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/master-0-root/instance:
uuid: "13d01bf08bd947c4960cd7188858dcad"
format_stamp: "Formatted at 2026-07-09 13:12:53 on dist-test-slave-j314"
I20260709 13:12:53.425380 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:12:53.428907  1662 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:53.429824 22480 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:12:53.430087 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/master-0-root
uuid: "13d01bf08bd947c4960cd7188858dcad"
format_stamp: "Formatted at 2026-07-09 13:12:53 on dist-test-slave-j314"
I20260709 13:12:53.430323 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:53.457455 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:53.458688 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:53.499796 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.62:40225
I20260709 13:12:53.499902  1713 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.62:40225 every 8 connection(s)
I20260709 13:12:53.503798  1714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:53.515026  1714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad: Bootstrap starting.
I20260709 13:12:53.519949  1714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.524114  1714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad: No bootstrap required, opened a new log
I20260709 13:12:53.526204  1714 raft_consensus.cc:359] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d01bf08bd947c4960cd7188858dcad" member_type: VOTER }
I20260709 13:12:53.526577  1714 raft_consensus.cc:385] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.526746  1714 raft_consensus.cc:740] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d01bf08bd947c4960cd7188858dcad, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.527316  1714 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d01bf08bd947c4960cd7188858dcad" member_type: VOTER }
I20260709 13:12:53.527765  1714 raft_consensus.cc:399] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:53.528031  1714 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:53.528244  1714 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.533116  1714 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d01bf08bd947c4960cd7188858dcad" member_type: VOTER }
I20260709 13:12:53.533589  1714 leader_election.cc:304] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13d01bf08bd947c4960cd7188858dcad; no voters: 
I20260709 13:12:53.534690  1714 leader_election.cc:290] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:53.535045  1717 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.536463  1717 raft_consensus.cc:697] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [term 1 LEADER]: Becoming Leader. State: Replica: 13d01bf08bd947c4960cd7188858dcad, State: Running, Role: LEADER
I20260709 13:12:53.537109  1717 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d01bf08bd947c4960cd7188858dcad" member_type: VOTER }
I20260709 13:12:53.537549  1714 sys_catalog.cc:565] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:53.540143  1719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13d01bf08bd947c4960cd7188858dcad. Latest consensus state: current_term: 1 leader_uuid: "13d01bf08bd947c4960cd7188858dcad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d01bf08bd947c4960cd7188858dcad" member_type: VOTER } }
I20260709 13:12:53.540078  1718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13d01bf08bd947c4960cd7188858dcad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d01bf08bd947c4960cd7188858dcad" member_type: VOTER } }
I20260709 13:12:53.540899  1719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:53.541211  1718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:53.544072  1722 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:53.549408  1722 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:53.553984 22480 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:53.558961  1722 catalog_manager.cc:1383] Generated new cluster ID: f7047c8470294af2994d4457cf1b22b2
I20260709 13:12:53.559288  1722 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:53.577083  1722 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:53.578573  1722 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:53.591028  1722 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad: Generated new TSK 0
I20260709 13:12:53.591665  1722 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:53.620746 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:53.627233  1735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:53.628396  1736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:53.629938  1738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:53.630748 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:53.631794 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:53.632066 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:53.632241 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602773632223 us; error 0 us; skew 500 ppm
I20260709 13:12:53.632784 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:53.635035 22480 webserver.cc:533] Webserver started at http://127.21.244.1:46059/ using document root <none> and password file <none>
I20260709 13:12:53.635538 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:53.635790 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:53.636111 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:53.637198 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-0-root/instance:
uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
format_stamp: "Formatted at 2026-07-09 13:12:53 on dist-test-slave-j314"
I20260709 13:12:53.642014 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:12:53.645512  1743 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:53.646490 22480 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:53.646764 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-0-root
uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
format_stamp: "Formatted at 2026-07-09 13:12:53 on dist-test-slave-j314"
I20260709 13:12:53.647069 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:53.666086 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:53.667340 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:53.668978 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:53.671669 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:53.671972 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:53.672236 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:53.672416 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:53.716408 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.1:46883
I20260709 13:12:53.716552  1805 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.1:46883 every 8 connection(s)
I20260709 13:12:53.721637 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:53.729884  1811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:53.731977  1810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:53.736150 22480 server_base.cc:1061] running on GCE node
W20260709 13:12:53.736150  1813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:53.736909  1806 heartbeater.cc:344] Connected to a master server at 127.21.244.62:40225
I20260709 13:12:53.738175  1806 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:53.738624 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:53.738963 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:53.739109  1806 heartbeater.cc:507] Master 127.21.244.62:40225 requested a full tablet report, sending...
I20260709 13:12:53.739187 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602773739153 us; error 0 us; skew 500 ppm
I20260709 13:12:53.740232 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:53.741808  1679 ts_manager.cc:194] Registered new tserver with Master: 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883)
I20260709 13:12:53.743095 22480 webserver.cc:533] Webserver started at http://127.21.244.2:40829/ using document root <none> and password file <none>
I20260709 13:12:53.743716 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:53.744011 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:53.744071  1679 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49030
I20260709 13:12:53.744308 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:53.745707 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-1-root/instance:
uuid: "f0ba87a2379743149a9508b8ad634cae"
format_stamp: "Formatted at 2026-07-09 13:12:53 on dist-test-slave-j314"
I20260709 13:12:53.751094 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:53.754995  1818 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:53.756031 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:53.756347 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-1-root
uuid: "f0ba87a2379743149a9508b8ad634cae"
format_stamp: "Formatted at 2026-07-09 13:12:53 on dist-test-slave-j314"
I20260709 13:12:53.756642 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:53.782227 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:53.783478 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:53.785429 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:53.788015 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:53.788268 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:53.788553 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:53.788740 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:53.833917 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.2:46399
I20260709 13:12:53.834115  1880 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.2:46399 every 8 connection(s)
I20260709 13:12:53.839430 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:53.848129  1884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:53.849900  1885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:53.853431 22480 server_base.cc:1061] running on GCE node
I20260709 13:12:53.854322  1881 heartbeater.cc:344] Connected to a master server at 127.21.244.62:40225
W20260709 13:12:53.854470  1887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:53.854805  1881 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:53.855590 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:53.855899 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:53.855679  1881 heartbeater.cc:507] Master 127.21.244.62:40225 requested a full tablet report, sending...
I20260709 13:12:53.856244 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602773856210 us; error 0 us; skew 500 ppm
I20260709 13:12:53.857002 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:53.858659  1679 ts_manager.cc:194] Registered new tserver with Master: f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:53.859874 22480 webserver.cc:533] Webserver started at http://127.21.244.3:42679/ using document root <none> and password file <none>
I20260709 13:12:53.860340  1679 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49046
I20260709 13:12:53.860438 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:53.860883 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:53.861176 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:53.862466 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-2-root/instance:
uuid: "40fbbe9948ea487489997bbeed3f30b0"
format_stamp: "Formatted at 2026-07-09 13:12:53 on dist-test-slave-j314"
I20260709 13:12:53.867244 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:53.871182  1892 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:53.872097 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:53.872448 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-2-root
uuid: "40fbbe9948ea487489997bbeed3f30b0"
format_stamp: "Formatted at 2026-07-09 13:12:53 on dist-test-slave-j314"
I20260709 13:12:53.872759 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602440417847-22480-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:53.886646 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:53.887987 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:53.889631 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:53.892234 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:53.892493 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:53.892776 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:53.892978 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:53.938566 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.3:42267
I20260709 13:12:53.938660  1954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.3:42267 every 8 connection(s)
I20260709 13:12:53.954319  1955 heartbeater.cc:344] Connected to a master server at 127.21.244.62:40225
I20260709 13:12:53.954834  1955 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:53.955626  1955 heartbeater.cc:507] Master 127.21.244.62:40225 requested a full tablet report, sending...
I20260709 13:12:53.957926  1679 ts_manager.cc:194] Registered new tserver with Master: 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:53.958389 22480 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016353218s
I20260709 13:12:53.959431  1679 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49060
I20260709 13:12:53.986431  1679 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49070:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:53.989199  1679 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:54.060344  1918 tablet_service.cc:1511] Processing CreateTablet for tablet 8da96cacabf1428cb89f110eafb7f5ae (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:54.062335  1918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da96cacabf1428cb89f110eafb7f5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.065236  1920 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb22b538cb14452b67cf0442352ea21 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:54.066874  1920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb22b538cb14452b67cf0442352ea21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.068933  1919 tablet_service.cc:1511] Processing CreateTablet for tablet cd46f30d2b024cf4b6d7ad97e2e82c7f (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:54.070617  1919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd46f30d2b024cf4b6d7ad97e2e82c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.074199  1917 tablet_service.cc:1511] Processing CreateTablet for tablet a8d30b7afca64b948b52677694480b2e (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:54.075690  1917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d30b7afca64b948b52677694480b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.079300  1771 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb22b538cb14452b67cf0442352ea21 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:54.081048  1771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb22b538cb14452b67cf0442352ea21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.083415  1770 tablet_service.cc:1511] Processing CreateTablet for tablet cd46f30d2b024cf4b6d7ad97e2e82c7f (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:54.085410  1770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd46f30d2b024cf4b6d7ad97e2e82c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.088030  1916 tablet_service.cc:1511] Processing CreateTablet for tablet f023cfc6395d4aed82163043c9ed9ec1 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:54.089908  1916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f023cfc6395d4aed82163043c9ed9ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.096844  1769 tablet_service.cc:1511] Processing CreateTablet for tablet 8da96cacabf1428cb89f110eafb7f5ae (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:54.098045  1845 tablet_service.cc:1511] Processing CreateTablet for tablet cd46f30d2b024cf4b6d7ad97e2e82c7f (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:54.098630  1769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da96cacabf1428cb89f110eafb7f5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.098913  1766 tablet_service.cc:1511] Processing CreateTablet for tablet 964f8309fb664b0e882a7bdae4e7bedc (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:54.105566  1844 tablet_service.cc:1511] Processing CreateTablet for tablet 8da96cacabf1428cb89f110eafb7f5ae (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:54.099659  1845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd46f30d2b024cf4b6d7ad97e2e82c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.107640  1844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da96cacabf1428cb89f110eafb7f5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.111444  1843 tablet_service.cc:1511] Processing CreateTablet for tablet a8d30b7afca64b948b52677694480b2e (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:54.112973  1843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d30b7afca64b948b52677694480b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.112509  1765 tablet_service.cc:1511] Processing CreateTablet for tablet 8a160b0f55ec47d18cffc7e2ec0b0023 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:54.115322  1764 tablet_service.cc:1511] Processing CreateTablet for tablet e5d03af4eb0c41a8b4d8c30c71548102 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:54.101477  1766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964f8309fb664b0e882a7bdae4e7bedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.102711  1768 tablet_service.cc:1511] Processing CreateTablet for tablet a8d30b7afca64b948b52677694480b2e (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:54.120841  1768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d30b7afca64b948b52677694480b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.124369  1765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a160b0f55ec47d18cffc7e2ec0b0023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.123898  1842 tablet_service.cc:1511] Processing CreateTablet for tablet f023cfc6395d4aed82163043c9ed9ec1 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:54.124621  1763 tablet_service.cc:1511] Processing CreateTablet for tablet bce427dc947841f08cb1639fd9be063d (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:54.125630  1842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f023cfc6395d4aed82163043c9ed9ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.126281  1763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce427dc947841f08cb1639fd9be063d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.127189  1764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5d03af4eb0c41a8b4d8c30c71548102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.101547  1767 tablet_service.cc:1511] Processing CreateTablet for tablet f023cfc6395d4aed82163043c9ed9ec1 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:54.128433  1767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f023cfc6395d4aed82163043c9ed9ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.129348  1841 tablet_service.cc:1511] Processing CreateTablet for tablet 964f8309fb664b0e882a7bdae4e7bedc (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:54.130901  1841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964f8309fb664b0e882a7bdae4e7bedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.131253  1915 tablet_service.cc:1511] Processing CreateTablet for tablet 964f8309fb664b0e882a7bdae4e7bedc (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:54.132905  1915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964f8309fb664b0e882a7bdae4e7bedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.137082  1914 tablet_service.cc:1511] Processing CreateTablet for tablet 8a160b0f55ec47d18cffc7e2ec0b0023 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:54.138823  1914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a160b0f55ec47d18cffc7e2ec0b0023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.139994  1840 tablet_service.cc:1511] Processing CreateTablet for tablet 8a160b0f55ec47d18cffc7e2ec0b0023 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:54.140954  1912 tablet_service.cc:1511] Processing CreateTablet for tablet bce427dc947841f08cb1639fd9be063d (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:54.142536  1912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce427dc947841f08cb1639fd9be063d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.143580  1839 tablet_service.cc:1511] Processing CreateTablet for tablet e5d03af4eb0c41a8b4d8c30c71548102 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:54.144759  1913 tablet_service.cc:1511] Processing CreateTablet for tablet e5d03af4eb0c41a8b4d8c30c71548102 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:54.146337  1913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5d03af4eb0c41a8b4d8c30c71548102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.103380  1846 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb22b538cb14452b67cf0442352ea21 (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:54.141608  1840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a160b0f55ec47d18cffc7e2ec0b0023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.150677  1839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5d03af4eb0c41a8b4d8c30c71548102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.152276  1846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb22b538cb14452b67cf0442352ea21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.168951  1838 tablet_service.cc:1511] Processing CreateTablet for tablet bce427dc947841f08cb1639fd9be063d (DEFAULT_TABLE table=test-workload [id=996c26e08a0046fd9f5c4e628b7e9139]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:54.171135  1838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce427dc947841f08cb1639fd9be063d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.328290  1970 tablet_bootstrap.cc:492] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:54.336859  1970 tablet_bootstrap.cc:654] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.341373  1972 tablet_bootstrap.cc:492] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:54.343204  1971 tablet_bootstrap.cc:492] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:54.344241  1970 tablet_bootstrap.cc:492] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:54.344852  1970 ts_tablet_manager.cc:1403] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:12:54.348351  1970 raft_consensus.cc:359] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.348837  1971 tablet_bootstrap.cc:654] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.349244  1972 tablet_bootstrap.cc:654] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.349254  1970 raft_consensus.cc:385] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.349861  1970 raft_consensus.cc:740] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.350751  1970 consensus_queue.cc:260] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.354569  1806 heartbeater.cc:499] Master 127.21.244.62:40225 was elected leader, sending a full tablet report...
I20260709 13:12:54.355314  1972 tablet_bootstrap.cc:492] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:54.355230  1970 ts_tablet_manager.cc:1434] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:12:54.356047  1972 ts_tablet_manager.cc:1403] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:12:54.356705  1970 tablet_bootstrap.cc:492] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:54.359385  1972 raft_consensus.cc:359] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.360276  1972 raft_consensus.cc:385] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.360649  1972 raft_consensus.cc:740] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.361559  1972 consensus_queue.cc:260] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.364056  1970 tablet_bootstrap.cc:654] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.364146  1971 tablet_bootstrap.cc:492] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:54.368631  1971 ts_tablet_manager.cc:1403] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:12:54.372167  1971 raft_consensus.cc:359] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.373072  1971 raft_consensus.cc:385] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.373452  1971 raft_consensus.cc:740] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.374434  1971 consensus_queue.cc:260] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.380498  1970 tablet_bootstrap.cc:492] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:54.381417  1970 ts_tablet_manager.cc:1403] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.009s
I20260709 13:12:54.382323  1971 ts_tablet_manager.cc:1434] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:12:54.383308  1881 heartbeater.cc:499] Master 127.21.244.62:40225 was elected leader, sending a full tablet report...
I20260709 13:12:54.385869  1970 raft_consensus.cc:359] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:54.387107  1970 raft_consensus.cc:385] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.387497  1970 raft_consensus.cc:740] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.388175  1955 heartbeater.cc:499] Master 127.21.244.62:40225 was elected leader, sending a full tablet report...
I20260709 13:12:54.388859  1972 ts_tablet_manager.cc:1434] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.032s	user 0.012s	sys 0.020s
I20260709 13:12:54.388510  1970 consensus_queue.cc:260] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:54.390031  1972 tablet_bootstrap.cc:492] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:54.394080  1970 ts_tablet_manager.cc:1434] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:12:54.390043  1971 tablet_bootstrap.cc:492] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:54.395383  1970 tablet_bootstrap.cc:492] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:54.397642  1972 tablet_bootstrap.cc:654] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.402614  1971 tablet_bootstrap.cc:654] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.404584  1970 tablet_bootstrap.cc:654] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.412911  1972 tablet_bootstrap.cc:492] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:54.413661  1972 ts_tablet_manager.cc:1403] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 13:12:54.416462  1970 tablet_bootstrap.cc:492] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:54.417116  1970 ts_tablet_manager.cc:1403] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:12:54.417092  1972 raft_consensus.cc:359] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.418138  1972 raft_consensus.cc:385] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.418480  1972 raft_consensus.cc:740] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.419512  1972 consensus_queue.cc:260] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.420871  1970 raft_consensus.cc:359] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.421753  1970 raft_consensus.cc:385] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.421968  1972 ts_tablet_manager.cc:1434] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:12:54.422107  1970 raft_consensus.cc:740] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.423178  1972 tablet_bootstrap.cc:492] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:54.423183  1970 consensus_queue.cc:260] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.429092  1970 ts_tablet_manager.cc:1434] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:54.430476  1970 tablet_bootstrap.cc:492] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:54.431710  1972 tablet_bootstrap.cc:654] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.438788  1970 tablet_bootstrap.cc:654] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.447278  1972 tablet_bootstrap.cc:492] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:54.448040  1972 ts_tablet_manager.cc:1403] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.004s
I20260709 13:12:54.450659  1970 tablet_bootstrap.cc:492] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:54.451251  1970 ts_tablet_manager.cc:1403] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:12:54.451152  1972 raft_consensus.cc:359] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.452140  1972 raft_consensus.cc:385] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.452468  1972 raft_consensus.cc:740] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.453804  1972 consensus_queue.cc:260] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.454442  1970 raft_consensus.cc:359] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.455214  1970 raft_consensus.cc:385] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.455528  1970 raft_consensus.cc:740] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.456491  1972 ts_tablet_manager.cc:1434] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:54.456532  1970 consensus_queue.cc:260] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.457717  1972 tablet_bootstrap.cc:492] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:54.461019  1970 ts_tablet_manager.cc:1434] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:12:54.462167  1970 tablet_bootstrap.cc:492] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:54.464593  1972 tablet_bootstrap.cc:654] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.469720  1970 tablet_bootstrap.cc:654] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.476760  1972 tablet_bootstrap.cc:492] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:54.477490  1972 ts_tablet_manager.cc:1403] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:12:54.482465  1970 tablet_bootstrap.cc:492] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:54.482563  1972 raft_consensus.cc:359] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.483310  1970 ts_tablet_manager.cc:1403] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:12:54.483510  1972 raft_consensus.cc:385] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.483871  1972 raft_consensus.cc:740] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.484376  1971 tablet_bootstrap.cc:492] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:54.485064  1971 ts_tablet_manager.cc:1403] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.095s	user 0.018s	sys 0.061s
I20260709 13:12:54.484650  1972 consensus_queue.cc:260] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.487437  1972 ts_tablet_manager.cc:1434] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:12:54.487442  1970 raft_consensus.cc:359] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.488368  1970 raft_consensus.cc:385] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.488637  1972 tablet_bootstrap.cc:492] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:54.488565  1971 raft_consensus.cc:359] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.489585  1971 raft_consensus.cc:385] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.489970  1971 raft_consensus.cc:740] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.490756  1974 raft_consensus.cc:493] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.490927  1971 consensus_queue.cc:260] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.491376  1974 raft_consensus.cc:515] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.488654  1970 raft_consensus.cc:740] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.493606  1970 consensus_queue.cc:260] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.497540  1971 ts_tablet_manager.cc:1434] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:12:54.498750  1971 tablet_bootstrap.cc:492] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:54.499038  1972 tablet_bootstrap.cc:654] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.499948  1977 raft_consensus.cc:493] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.500537  1977 raft_consensus.cc:515] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.502424  1974 leader_election.cc:290] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:54.504700  1970 ts_tablet_manager.cc:1434] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:12:54.505824  1970 tablet_bootstrap.cc:492] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:54.511092  1977 leader_election.cc:290] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.519302  1977 raft_consensus.cc:493] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.521934  1977 raft_consensus.cc:515] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.523903  1988 raft_consensus.cc:493] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.524709  1988 raft_consensus.cc:515] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.527027  1977 leader_election.cc:290] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.528702  1988 leader_election.cc:290] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:54.542428  1970 tablet_bootstrap.cc:654] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:54.548682  1727 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:54.550320  1990 raft_consensus.cc:493] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.550972  1990 raft_consensus.cc:515] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.552135  1971 tablet_bootstrap.cc:654] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.553787  1990 leader_election.cc:290] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:54.558792  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da96cacabf1428cb89f110eafb7f5ae" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:54.564788  1854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
W20260709 13:12:54.566023  1745 leader_election.cc:343] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.566071  1855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:54.567088  1855 raft_consensus.cc:2468] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 0.
W20260709 13:12:54.567888  1745 leader_election.cc:343] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.564824  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:54.568408  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:54.569381  1780 raft_consensus.cc:2468] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
W20260709 13:12:54.569621  1894 leader_election.cc:343] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.566151  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:54.571127  1856 raft_consensus.cc:2468] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
I20260709 13:12:54.570847  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:54.572142  1893 leader_election.cc:304] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:54.572721  1894 leader_election.cc:304] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:54.573251  1977 raft_consensus.cc:2804] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.572166  1745 leader_election.cc:304] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:54.573818  1977 raft_consensus.cc:493] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.572750  1781 raft_consensus.cc:2468] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
I20260709 13:12:54.574216  1977 raft_consensus.cc:3060] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.580163  1990 raft_consensus.cc:2804] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.580962  1972 tablet_bootstrap.cc:492] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:54.581955  1972 ts_tablet_manager.cc:1403] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.019s
I20260709 13:12:54.583885  1970 tablet_bootstrap.cc:492] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:54.584537  1970 ts_tablet_manager.cc:1403] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.010s
I20260709 13:12:54.586190  1972 raft_consensus.cc:359] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.581116  1990 raft_consensus.cc:493] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.588495  1990 raft_consensus.cc:3060] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.587298  1977 raft_consensus.cc:515] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.590740  1971 tablet_bootstrap.cc:492] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:54.590812  1977 leader_election.cc:290] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.591475  1971 ts_tablet_manager.cc:1403] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.012s
I20260709 13:12:54.591585  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:54.591631  1977 raft_consensus.cc:2804] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.592332  1781 raft_consensus.cc:3060] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.592460  1977 raft_consensus.cc:493] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.593050  1977 raft_consensus.cc:3060] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.594841  1971 raft_consensus.cc:359] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.587841  1970 raft_consensus.cc:359] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.596387  1970 raft_consensus.cc:385] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.596702  1970 raft_consensus.cc:740] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.597599  1970 consensus_queue.cc:260] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.600374  1781 raft_consensus.cc:2468] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:54.600703  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:54.587343  1972 raft_consensus.cc:385] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.601075  1977 raft_consensus.cc:515] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.601812  1972 raft_consensus.cc:740] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.601768  1893 leader_election.cc:304] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:54.603132  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da96cacabf1428cb89f110eafb7f5ae" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:54.602876  1972 consensus_queue.cc:260] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.604682  1929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:54.607806  1977 leader_election.cc:290] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.608273  1929 raft_consensus.cc:2393] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d84ce79592440a4bed9a3e8ccb48a69 in current term 1: Already voted for candidate 40fbbe9948ea487489997bbeed3f30b0 in this term.
I20260709 13:12:54.608671  1977 raft_consensus.cc:2804] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.605171  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:54.609251  1977 raft_consensus.cc:697] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:54.607276  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
W20260709 13:12:54.603745  1894 leader_election.cc:343] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.605612  1970 ts_tablet_manager.cc:1434] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:12:54.610857  1977 consensus_queue.cc:237] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.611893  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:54.612522  1856 raft_consensus.cc:3060] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.616422  1972 ts_tablet_manager.cc:1434] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.009s
I20260709 13:12:54.617592  1972 tablet_bootstrap.cc:492] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:54.611444  1970 tablet_bootstrap.cc:492] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
W20260709 13:12:54.621380  1747 leader_election.cc:343] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.622098  1747 leader_election.cc:304] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:54.624289  1972 tablet_bootstrap.cc:654] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.625986  1970 tablet_bootstrap.cc:654] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.626447  1988 raft_consensus.cc:2749] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.606658  1990 raft_consensus.cc:515] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.629463  1781 raft_consensus.cc:2393] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 40fbbe9948ea487489997bbeed3f30b0 in current term 1: Already voted for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in this term.
I20260709 13:12:54.630373  1856 raft_consensus.cc:2468] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:54.632462  1894 leader_election.cc:304] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:54.634065  1997 raft_consensus.cc:2804] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.634733  1997 raft_consensus.cc:697] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:54.635771  1990 leader_election.cc:290] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:54.635803  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:54.636847  1853 raft_consensus.cc:2393] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d84ce79592440a4bed9a3e8ccb48a69 in current term 1: Already voted for candidate 40fbbe9948ea487489997bbeed3f30b0 in this term.
I20260709 13:12:54.635854  1997 consensus_queue.cc:237] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.640170  1929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:54.641799  1747 leader_election.cc:304] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:54.644034  1990 raft_consensus.cc:2749] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.644958  1972 tablet_bootstrap.cc:492] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:54.645531  1747 leader_election.cc:304] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:54.644893  1678 catalog_manager.cc:5697] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.645879  1972 ts_tablet_manager.cc:1403] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.016s
I20260709 13:12:54.646346  1977 raft_consensus.cc:493] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.646898  1977 raft_consensus.cc:515] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.647732  1990 raft_consensus.cc:2749] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.595645  1971 raft_consensus.cc:385] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.648712  1971 raft_consensus.cc:740] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.649695  1971 consensus_queue.cc:260] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.650239  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:54.651194  1781 raft_consensus.cc:2468] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
I20260709 13:12:54.655269  1971 ts_tablet_manager.cc:1434] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:12:54.656476  1971 tablet_bootstrap.cc:492] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:54.657558  1893 leader_election.cc:304] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:54.658949  1997 raft_consensus.cc:2804] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.659345  1997 raft_consensus.cc:493] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.659685  1997 raft_consensus.cc:3060] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.661191  1972 raft_consensus.cc:359] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.662526  1972 raft_consensus.cc:385] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.663057  1972 raft_consensus.cc:740] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.664323  1972 consensus_queue.cc:260] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.667714  1972 ts_tablet_manager.cc:1434] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:12:54.667912  1977 leader_election.cc:290] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.668254  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:54.669435  1972 tablet_bootstrap.cc:492] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
W20260709 13:12:54.670137  1894 leader_election.cc:343] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.673904  1997 raft_consensus.cc:515] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.675612  1970 tablet_bootstrap.cc:492] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:54.676262  1970 ts_tablet_manager.cc:1403] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.065s	user 0.030s	sys 0.013s
I20260709 13:12:54.678267  1972 tablet_bootstrap.cc:654] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.679558  1970 raft_consensus.cc:359] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.680413  1970 raft_consensus.cc:385] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.680728  1970 raft_consensus.cc:740] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.681597  1970 consensus_queue.cc:260] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.682152  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:54.682859  1781 raft_consensus.cc:3060] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.683694  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
W20260709 13:12:54.685695  1894 leader_election.cc:343] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.686407  1971 tablet_bootstrap.cc:654] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.688428  1970 ts_tablet_manager.cc:1434] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:54.689599  1970 tablet_bootstrap.cc:492] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:54.690150  1997 leader_election.cc:290] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.692934  1781 raft_consensus.cc:2468] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:54.693565  1971 tablet_bootstrap.cc:492] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:54.694870  1893 leader_election.cc:304] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:54.695115  1971 ts_tablet_manager.cc:1403] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.000s
I20260709 13:12:54.696158  1997 raft_consensus.cc:2804] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.696545  1970 tablet_bootstrap.cc:654] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.696702  1997 raft_consensus.cc:697] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:54.697698  1997 consensus_queue.cc:237] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.699075  1971 raft_consensus.cc:359] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.700302  1971 raft_consensus.cc:385] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.700814  1971 raft_consensus.cc:740] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.701941  1971 consensus_queue.cc:260] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.704419  1971 ts_tablet_manager.cc:1434] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:12:54.705540  1971 tablet_bootstrap.cc:492] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:54.706195  1972 tablet_bootstrap.cc:492] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:54.706780  1972 ts_tablet_manager.cc:1403] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.002s
I20260709 13:12:54.710299  1972 raft_consensus.cc:359] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.711057  1972 raft_consensus.cc:385] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.711369  1972 raft_consensus.cc:740] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.712994  1972 consensus_queue.cc:260] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.716611  1972 ts_tablet_manager.cc:1434] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:12:54.718304  1972 tablet_bootstrap.cc:492] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:54.714689  1971 tablet_bootstrap.cc:654] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.725510  1970 tablet_bootstrap.cc:492] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:54.726068  1970 ts_tablet_manager.cc:1403] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.004s
I20260709 13:12:54.728533  1970 raft_consensus.cc:359] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.729231  1970 raft_consensus.cc:385] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.729502  1970 raft_consensus.cc:740] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.730249  1970 consensus_queue.cc:260] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.731698  1972 tablet_bootstrap.cc:654] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.733017  1677 catalog_manager.cc:5697] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.735154  1677 catalog_manager.cc:5697] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.740053  1970 ts_tablet_manager.cc:1434] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:12:54.748414  1970 tablet_bootstrap.cc:492] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:54.754333  1970 tablet_bootstrap.cc:654] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.758539  1971 tablet_bootstrap.cc:492] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:54.759071  1972 tablet_bootstrap.cc:492] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:54.759266  1971 ts_tablet_manager.cc:1403] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.011s
I20260709 13:12:54.759625  1972 ts_tablet_manager.cc:1403] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.019s
I20260709 13:12:54.762410  1972 raft_consensus.cc:359] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:54.763123  1972 raft_consensus.cc:385] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.762635  1971 raft_consensus.cc:359] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.763411  1972 raft_consensus.cc:740] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.763551  1971 raft_consensus.cc:385] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.763900  1971 raft_consensus.cc:740] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.764194  1972 consensus_queue.cc:260] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:54.764639  1971 consensus_queue.cc:260] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.765499  1970 tablet_bootstrap.cc:492] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:54.765995  1970 ts_tablet_manager.cc:1403] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:12:54.766680  1972 ts_tablet_manager.cc:1434] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:54.767665  1972 tablet_bootstrap.cc:492] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:54.769235  1971 ts_tablet_manager.cc:1434] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:12:54.770383  1971 tablet_bootstrap.cc:492] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:54.768893  1970 raft_consensus.cc:359] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.774645  1972 tablet_bootstrap.cc:654] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.774780  1970 raft_consensus.cc:385] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.775130  1970 raft_consensus.cc:740] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.775903  1970 consensus_queue.cc:260] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.778615  1970 ts_tablet_manager.cc:1434] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:54.782824  1971 tablet_bootstrap.cc:654] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.783288  1972 tablet_bootstrap.cc:492] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:54.783905  1972 ts_tablet_manager.cc:1403] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.007s
I20260709 13:12:54.786199  1990 raft_consensus.cc:493] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.786868  1972 raft_consensus.cc:359] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.786975  1990 raft_consensus.cc:515] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.787827  1972 raft_consensus.cc:385] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.788280  1972 raft_consensus.cc:740] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.789124  1972 consensus_queue.cc:260] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.791289  1972 ts_tablet_manager.cc:1434] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:54.791677  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f8309fb664b0e882a7bdae4e7bedc" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:54.792737  1856 raft_consensus.cc:2468] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 0.
I20260709 13:12:54.793852  1997 raft_consensus.cc:493] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.794516  1990 leader_election.cc:290] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:54.795171  1745 leader_election.cc:304] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:54.796065  1990 raft_consensus.cc:2804] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.796442  1990 raft_consensus.cc:493] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.796378  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f8309fb664b0e882a7bdae4e7bedc" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:54.796969  1990 raft_consensus.cc:3060] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.797185  1928 raft_consensus.cc:2468] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 0.
I20260709 13:12:54.797824  1971 tablet_bootstrap.cc:492] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:54.798414  1971 ts_tablet_manager.cc:1403] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.008s
I20260709 13:12:54.794544  1997 raft_consensus.cc:515] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:54.800424  1997 leader_election.cc:290] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.801348  1971 raft_consensus.cc:359] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.802174  1971 raft_consensus.cc:385] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.802376  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb22b538cb14452b67cf0442352ea21" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:54.802464  1971 raft_consensus.cc:740] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.803228  1781 raft_consensus.cc:2468] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
I20260709 13:12:54.803756  1971 consensus_queue.cc:260] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.804661  1893 leader_election.cc:304] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:54.806329  1971 ts_tablet_manager.cc:1434] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:54.806283  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb22b538cb14452b67cf0442352ea21" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:54.806660  1990 raft_consensus.cc:515] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.807452  1997 raft_consensus.cc:2804] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.807597  1971 tablet_bootstrap.cc:492] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:54.807950  1997 raft_consensus.cc:493] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:54.808000  1894 leader_election.cc:343] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.808454  1997 raft_consensus.cc:3060] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.809326  1990 leader_election.cc:290] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:54.809952  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f8309fb664b0e882a7bdae4e7bedc" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:54.810577  1856 raft_consensus.cc:3060] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.810842  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f8309fb664b0e882a7bdae4e7bedc" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:54.811432  1928 raft_consensus.cc:3060] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.816143  1971 tablet_bootstrap.cc:654] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.818572  1856 raft_consensus.cc:2468] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 1.
I20260709 13:12:54.819446  1979 raft_consensus.cc:493] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.820026  1979 raft_consensus.cc:515] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.820113  1745 leader_election.cc:304] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:54.821399  1990 raft_consensus.cc:2804] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.821904  1990 raft_consensus.cc:697] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:54.822752  1990 consensus_queue.cc:237] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.829332  1997 raft_consensus.cc:515] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:54.830536  1971 tablet_bootstrap.cc:492] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:54.830771  1979 leader_election.cc:290] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:54.831298  1928 raft_consensus.cc:2468] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 1.
I20260709 13:12:54.832281  1971 ts_tablet_manager.cc:1403] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.010s
I20260709 13:12:54.834306  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb22b538cb14452b67cf0442352ea21" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:54.834908  1781 raft_consensus.cc:3060] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.834959  1997 leader_election.cc:290] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.837265  1971 raft_consensus.cc:359] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:54.838234  1971 raft_consensus.cc:385] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.838596  1677 catalog_manager.cc:5697] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.838609  1971 raft_consensus.cc:740] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.841631  1971 consensus_queue.cc:260] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:54.842806  1781 raft_consensus.cc:2468] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:54.844117  1971 ts_tablet_manager.cc:1434] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:54.844197  1893 leader_election.cc:304] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:54.845206  1997 raft_consensus.cc:2804] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.845571  1971 tablet_bootstrap.cc:492] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:54.845676  1997 raft_consensus.cc:697] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:54.846644  1997 consensus_queue.cc:237] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:54.851058  1977 raft_consensus.cc:493] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.852105  1977 raft_consensus.cc:515] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.852939  1979 raft_consensus.cc:493] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.853479  1979 raft_consensus.cc:515] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.854242  1971 tablet_bootstrap.cc:654] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.854849  1977 leader_election.cc:290] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.857311  1979 leader_election.cc:290] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:54.858359  1977 raft_consensus.cc:493] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.858517  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce427dc947841f08cb1639fd9be063d" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:54.858880  1977 raft_consensus.cc:515] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.859475  1781 raft_consensus.cc:2468] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
I20260709 13:12:54.861280  1977 leader_election.cc:290] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.861090  1893 leader_election.cc:304] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:54.863404  1997 raft_consensus.cc:2804] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.863821  1997 raft_consensus.cc:493] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.864176  1997 raft_consensus.cc:3060] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.867841  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb22b538cb14452b67cf0442352ea21" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:54.868567  1856 raft_consensus.cc:3060] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.869933  1971 tablet_bootstrap.cc:492] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:54.870508  1971 ts_tablet_manager.cc:1403] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.003s
I20260709 13:12:54.870422  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f023cfc6395d4aed82163043c9ed9ec1" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:54.871922  1997 raft_consensus.cc:515] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.873797  1971 raft_consensus.cc:359] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.874743  1971 raft_consensus.cc:385] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.872370  1781 raft_consensus.cc:2468] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
I20260709 13:12:54.875039  1971 raft_consensus.cc:740] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.867887  1677 catalog_manager.cc:5697] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.875165  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce427dc947841f08cb1639fd9be063d" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:54.875913  1780 raft_consensus.cc:3060] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.875856  1971 consensus_queue.cc:260] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.878440  1971 ts_tablet_manager.cc:1434] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:54.879103  1893 leader_election.cc:304] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:54.881368  1997 leader_election.cc:290] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.881525  1929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce427dc947841f08cb1639fd9be063d" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:54.881860  1856 raft_consensus.cc:2468] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:54.882207  1997 raft_consensus.cc:2804] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.882427  1929 raft_consensus.cc:2393] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ba87a2379743149a9508b8ad634cae in current term 1: Already voted for candidate 40fbbe9948ea487489997bbeed3f30b0 in this term.
I20260709 13:12:54.882804  1997 raft_consensus.cc:493] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.883239  1997 raft_consensus.cc:3060] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.883635  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce427dc947841f08cb1639fd9be063d" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:54.884312  1856 raft_consensus.cc:2468] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
I20260709 13:12:54.884634  1780 raft_consensus.cc:2468] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:54.885291  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f023cfc6395d4aed82163043c9ed9ec1" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:54.885977  1853 raft_consensus.cc:2468] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
I20260709 13:12:54.885936  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f023cfc6395d4aed82163043c9ed9ec1" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:54.887821  1893 leader_election.cc:304] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:54.889608  1998 raft_consensus.cc:2804] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.890177  1998 raft_consensus.cc:697] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:54.890332  1997 raft_consensus.cc:515] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.891466  1928 raft_consensus.cc:2393] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ba87a2379743149a9508b8ad634cae in current term 1: Already voted for candidate 40fbbe9948ea487489997bbeed3f30b0 in this term.
I20260709 13:12:54.890988  1998 consensus_queue.cc:237] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.893021  1997 leader_election.cc:290] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.894264  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f023cfc6395d4aed82163043c9ed9ec1" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:54.879386  1971 tablet_bootstrap.cc:492] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:54.895035  1780 raft_consensus.cc:3060] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.899977  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce427dc947841f08cb1639fd9be063d" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:54.900702  1853 raft_consensus.cc:3060] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.901078  1971 tablet_bootstrap.cc:654] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.902940  1780 raft_consensus.cc:2468] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:54.905202  1979 raft_consensus.cc:493] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.905592  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f023cfc6395d4aed82163043c9ed9ec1" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:54.905732  1979 raft_consensus.cc:515] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.906244  1856 raft_consensus.cc:3060] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.908057  1979 leader_election.cc:290] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:54.910398  1853 raft_consensus.cc:2468] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:54.910189  1893 leader_election.cc:304] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:54.911942  1998 raft_consensus.cc:2804] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.912652  1998 raft_consensus.cc:697] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:54.913177  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:54.913506  1998 consensus_queue.cc:237] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.914093  1856 raft_consensus.cc:2468] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:54.914305  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce427dc947841f08cb1639fd9be063d" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:54.915155  1781 raft_consensus.cc:2393] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ba87a2379743149a9508b8ad634cae in current term 1: Already voted for candidate 40fbbe9948ea487489997bbeed3f30b0 in this term.
I20260709 13:12:54.917160  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:54.903081  1677 catalog_manager.cc:5697] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.918279  1781 raft_consensus.cc:2393] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ba87a2379743149a9508b8ad634cae in current term 1: Already voted for candidate 40fbbe9948ea487489997bbeed3f30b0 in this term.
I20260709 13:12:54.913307  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f023cfc6395d4aed82163043c9ed9ec1" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:54.921631  1780 raft_consensus.cc:2393] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ba87a2379743149a9508b8ad634cae in current term 1: Already voted for candidate 40fbbe9948ea487489997bbeed3f30b0 in this term.
I20260709 13:12:54.920194  1819 leader_election.cc:304] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ba87a2379743149a9508b8ad634cae; no voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:54.923956  1979 raft_consensus.cc:2749] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.925839  1819 leader_election.cc:304] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ba87a2379743149a9508b8ad634cae; no voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:54.928354  1979 raft_consensus.cc:3060] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.928787  1819 leader_election.cc:304] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ba87a2379743149a9508b8ad634cae; no voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:54.930230  1998 raft_consensus.cc:493] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.930789  1998 raft_consensus.cc:515] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.932634  1971 tablet_bootstrap.cc:492] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:54.933239  1971 ts_tablet_manager.cc:1403] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.015s
I20260709 13:12:54.933650  1998 leader_election.cc:290] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.934036  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:54.934782  1780 raft_consensus.cc:2468] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
I20260709 13:12:54.936156  1893 leader_election.cc:304] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:54.936880  1979 raft_consensus.cc:2749] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.937026  1998 raft_consensus.cc:2804] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.937599  1998 raft_consensus.cc:493] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.937150  1971 raft_consensus.cc:359] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.937842  1979 raft_consensus.cc:2749] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.937969  1998 raft_consensus.cc:3060] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.938977  1971 raft_consensus.cc:385] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.939342  1971 raft_consensus.cc:740] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.940244  1971 consensus_queue.cc:260] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.941053  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:54.941823  1856 raft_consensus.cc:2468] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
I20260709 13:12:54.941452  1677 catalog_manager.cc:5697] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.943069  1971 ts_tablet_manager.cc:1434] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 13:12:54.945996  1998 raft_consensus.cc:515] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.948930  1998 leader_election.cc:290] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:54.949519  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:54.950098  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:54.950767  1856 raft_consensus.cc:3060] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.950246  1780 raft_consensus.cc:3060] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.956955  1856 raft_consensus.cc:2468] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:54.958575  1894 leader_election.cc:304] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:54.959465  1998 raft_consensus.cc:2804] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.959707  1780 raft_consensus.cc:2468] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:54.959972  1998 raft_consensus.cc:697] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:54.960898  1998 consensus_queue.cc:237] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:54.968921  1677 catalog_manager.cc:5697] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.035185  2024 raft_consensus.cc:493] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.035861  2024 raft_consensus.cc:515] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.038086  2024 leader_election.cc:290] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:55.039031  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da96cacabf1428cb89f110eafb7f5ae" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:55.039425  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da96cacabf1428cb89f110eafb7f5ae" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:55.039783  1780 raft_consensus.cc:2468] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 0.
I20260709 13:12:55.040120  1928 raft_consensus.cc:2468] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 0.
I20260709 13:12:55.041035  1819 leader_election.cc:304] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:55.041811  2024 raft_consensus.cc:2804] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.042279  2024 raft_consensus.cc:493] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.042604  2024 raft_consensus.cc:3060] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.048729  2024 raft_consensus.cc:515] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.050696  2024 leader_election.cc:290] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:55.051698  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da96cacabf1428cb89f110eafb7f5ae" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:55.051867  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da96cacabf1428cb89f110eafb7f5ae" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:55.052311  1780 raft_consensus.cc:3060] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.052491  1928 raft_consensus.cc:3060] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.057910  1780 raft_consensus.cc:2468] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 1.
I20260709 13:12:55.058599  1928 raft_consensus.cc:2468] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 1.
I20260709 13:12:55.059288  1819 leader_election.cc:304] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:55.060241  2024 raft_consensus.cc:2804] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.060716  2024 raft_consensus.cc:697] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:55.061532  2024 consensus_queue.cc:237] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.069628  1677 catalog_manager.cc:5697] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 1 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.078356  1998 consensus_queue.cc:1048] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.093017  1998 consensus_queue.cc:1048] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.187618  2024 raft_consensus.cc:493] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.188165  2024 raft_consensus.cc:515] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.190634  2024 leader_election.cc:290] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:55.191359  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:55.191908  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:55.192374  1780 raft_consensus.cc:2393] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ba87a2379743149a9508b8ad634cae in current term 1: Already voted for candidate 40fbbe9948ea487489997bbeed3f30b0 in this term.
I20260709 13:12:55.193831  1822 leader_election.cc:304] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ba87a2379743149a9508b8ad634cae; no voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:55.194734  2024 raft_consensus.cc:3060] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.201372  2024 raft_consensus.cc:2749] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.205595  1928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bb22b538cb14452b67cf0442352ea21"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
mode: GRACEFUL
new_leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:12:55.206266  1928 raft_consensus.cc:606] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Received request to transfer leadership to TS 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:55.212458  1928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
mode: GRACEFUL
new_leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:12:55.213047  1928 raft_consensus.cc:606] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Received request to transfer leadership to TS 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:55.222734  1998 consensus_queue.cc:1048] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.223945  1977 consensus_queue.cc:1048] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.230974  1855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8da96cacabf1428cb89f110eafb7f5ae"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
mode: GRACEFUL
new_leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:60784
I20260709 13:12:55.231632  1855 raft_consensus.cc:606] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Received request to transfer leadership to TS 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:55.236366  1977 consensus_queue.cc:1048] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.243391  1928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
mode: GRACEFUL
new_leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:12:55.244220  1928 raft_consensus.cc:606] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Received request to transfer leadership to TS 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:55.244536  1997 consensus_queue.cc:1048] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.257946  1928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f023cfc6395d4aed82163043c9ed9ec1"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
mode: GRACEFUL
new_leader_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:12:55.258723  1928 raft_consensus.cc:606] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Received request to transfer leadership to TS f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:55.263168  2036 raft_consensus.cc:993] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0: : Instructing follower 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:55.263893  1998 raft_consensus.cc:1081] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Signalling peer 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:55.271411  1781 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:38152
I20260709 13:12:55.276072  1781 raft_consensus.cc:493] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:55.276567  1781 raft_consensus.cc:3060] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.278610  1780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "964f8309fb664b0e882a7bdae4e7bedc"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
mode: GRACEFUL
new_leader_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:38172
I20260709 13:12:55.279309  1780 raft_consensus.cc:606] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Received request to transfer leadership to TS f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:55.287122  1928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
mode: GRACEFUL
new_leader_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:12:55.287818  1928 raft_consensus.cc:606] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Received request to transfer leadership to TS f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:55.288525  1781 raft_consensus.cc:515] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.293905  1855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:55.294673  1997 raft_consensus.cc:993] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0: : Instructing follower f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:55.294869  1928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
mode: GRACEFUL
new_leader_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:12:55.295239  1781 leader_election.cc:290] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:55.295302  1997 raft_consensus.cc:1081] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Signalling peer f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:55.296725  1929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:55.297132  1855 raft_consensus.cc:3060] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.297415  1929 raft_consensus.cc:3055] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:55.297749  1929 raft_consensus.cc:740] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:55.298465  1856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:60782
I20260709 13:12:55.298604  1929 consensus_queue.cc:260] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.299319  1856 raft_consensus.cc:493] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:55.299846  1856 raft_consensus.cc:3060] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.300248  1929 raft_consensus.cc:3060] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.301753  1928 raft_consensus.cc:606] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Received request to transfer leadership to TS f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:55.305498  1855 raft_consensus.cc:2468] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:55.305656  1856 raft_consensus.cc:515] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.307117  1745 leader_election.cc:304] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:55.308017  1990 raft_consensus.cc:2804] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:55.308555  1990 raft_consensus.cc:697] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:55.309034  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:55.309828  1781 raft_consensus.cc:3060] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.309480  1990 consensus_queue.cc:237] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.311254  1929 raft_consensus.cc:2468] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:55.313056  1856 leader_election.cc:290] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:55.313668  1929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a160b0f55ec47d18cffc7e2ec0b0023" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:55.314311  1929 raft_consensus.cc:3055] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:55.314680  1929 raft_consensus.cc:740] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:55.315598  1929 consensus_queue.cc:260] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.316587  1929 raft_consensus.cc:3060] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.318878  1781 raft_consensus.cc:2468] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:55.320528  1819 leader_election.cc:304] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:55.320405  1678 catalog_manager.cc:5697] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 1 to 2, leader changed from 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3) to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.321568  2024 raft_consensus.cc:2804] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:55.322114  2024 raft_consensus.cc:697] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:55.322964  2024 consensus_queue.cc:237] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.324184  1929 raft_consensus.cc:2468] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:55.329749  1997 consensus_queue.cc:1048] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.332240  1997 consensus_queue.cc:1048] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.332319  1679 catalog_manager.cc:5697] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 1 to 2, leader changed from 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3) to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 2 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.339211  1998 raft_consensus.cc:993] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0: : Instructing follower f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:55.339706  1998 raft_consensus.cc:1081] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Signalling peer f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:55.343946  1855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f023cfc6395d4aed82163043c9ed9ec1"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:60782
I20260709 13:12:55.344596  1855 raft_consensus.cc:493] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:55.345001  1855 raft_consensus.cc:3060] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.349812  1977 consensus_queue.cc:1048] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.355083  1855 raft_consensus.cc:515] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.357394  1855 leader_election.cc:290] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:55.358687  1929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f023cfc6395d4aed82163043c9ed9ec1" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:55.359386  1929 raft_consensus.cc:3055] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:55.359778  1929 raft_consensus.cc:740] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:55.360620  1929 consensus_queue.cc:260] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.361953  1929 raft_consensus.cc:3060] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.362002  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f023cfc6395d4aed82163043c9ed9ec1" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:55.364385  1781 raft_consensus.cc:3060] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.367959  1990 consensus_queue.cc:1048] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.370823  1998 consensus_queue.cc:1048] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.371927  1929 raft_consensus.cc:2468] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:55.373569  1822 leader_election.cc:304] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:55.374501  2024 raft_consensus.cc:2804] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:55.374974  2024 raft_consensus.cc:697] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:55.375861  2024 consensus_queue.cc:237] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.377121  1988 consensus_queue.cc:1048] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.386471  1998 consensus_queue.cc:1048] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.389130  1781 raft_consensus.cc:2468] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:55.395164  1988 raft_consensus.cc:993] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69: : Instructing follower f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:55.397383  1990 raft_consensus.cc:1081] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Signalling peer f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:55.399576  1855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "964f8309fb664b0e882a7bdae4e7bedc"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:60768
I20260709 13:12:55.400579  1855 raft_consensus.cc:493] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:55.401225  1855 raft_consensus.cc:3060] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.401794  1678 catalog_manager.cc:5697] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 1 to 2, leader changed from 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3) to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 2 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.403203  1998 consensus_queue.cc:1048] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.414595  1855 raft_consensus.cc:515] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.418404  1977 raft_consensus.cc:993] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0: : Instructing follower f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:55.421617  1997 raft_consensus.cc:993] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0: : Instructing follower 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:55.428417  1977 raft_consensus.cc:1081] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Signalling peer f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:55.428966  1997 raft_consensus.cc:1081] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Signalling peer 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:55.431715  1779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bb22b538cb14452b67cf0442352ea21"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:38152
I20260709 13:12:55.431958  1853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:60782
I20260709 13:12:55.432384  1779 raft_consensus.cc:493] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:55.432675  1853 raft_consensus.cc:493] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:55.433188  1853 raft_consensus.cc:3060] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.432845  1779 raft_consensus.cc:3060] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.438951  1856 raft_consensus.cc:1240] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Rejecting Update request from peer 7d84ce79592440a4bed9a3e8ccb48a69 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:55.439929  1997 consensus_queue.cc:1048] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.441330  1990 consensus_queue.cc:1059] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.447672  1997 consensus_queue.cc:1048] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.448450  2047 raft_consensus.cc:3055] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:55.449153  2047 raft_consensus.cc:740] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:55.449390  1855 leader_election.cc:290] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:55.450277  2047 consensus_queue.cc:260] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.452176  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f8309fb664b0e882a7bdae4e7bedc" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:55.453713  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964f8309fb664b0e882a7bdae4e7bedc" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:55.454316  1928 raft_consensus.cc:3060] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.451395  1779 raft_consensus.cc:515] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:55.455224  1853 raft_consensus.cc:515] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.457587  1853 leader_election.cc:290] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:55.458972  1929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb22b538cb14452b67cf0442352ea21" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:55.459664  1929 raft_consensus.cc:3055] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:55.452103  2047 raft_consensus.cc:3060] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.460084  1929 raft_consensus.cc:740] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:55.461023  1929 consensus_queue.cc:260] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:55.462013  1929 raft_consensus.cc:3060] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.465029  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:55.465713  1930 raft_consensus.cc:3055] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:55.465474  1777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:55.466097  1930 raft_consensus.cc:740] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:55.466249  1779 leader_election.cc:290] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Requested vote from peers 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:55.466985  1930 consensus_queue.cc:260] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.468276  1930 raft_consensus.cc:3060] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.471463  1928 raft_consensus.cc:2468] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:55.476925  1822 leader_election.cc:304] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:55.477872  2024 raft_consensus.cc:2804] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:55.478376  2024 raft_consensus.cc:697] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:55.479175  2024 consensus_queue.cc:237] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.481062  1930 raft_consensus.cc:2468] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:55.482256  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb22b538cb14452b67cf0442352ea21" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:55.482928  1853 raft_consensus.cc:3060] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.484055  1822 leader_election.cc:304] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:55.485675  1979 raft_consensus.cc:2804] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:55.486148  1979 raft_consensus.cc:697] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:55.486994  1979 consensus_queue.cc:237] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.490945  1853 raft_consensus.cc:2468] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:55.494083  1929 raft_consensus.cc:2468] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:55.495438  1747 leader_election.cc:304] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:55.496376  2047 raft_consensus.cc:2804] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:55.497037  2047 raft_consensus.cc:697] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:55.495682  2024 consensus_queue.cc:1048] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:55.497942  2047 consensus_queue.cc:237] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } }
I20260709 13:12:55.500903  1678 catalog_manager.cc:5697] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 1 to 2, leader changed from 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1) to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 2 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.501909  1780 raft_consensus.cc:2468] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:55.510226  1977 raft_consensus.cc:993] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0: : Instructing follower 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:55.510720  1977 raft_consensus.cc:1081] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Signalling peer 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:55.513236  1780 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:38152
I20260709 13:12:55.514079  1780 raft_consensus.cc:493] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:55.515544  1679 catalog_manager.cc:5697] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 1 to 2, leader changed from 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3) to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.518949  1780 raft_consensus.cc:3060] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.522600  1979 raft_consensus.cc:993] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae: : Instructing follower 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:55.524611  2024 raft_consensus.cc:1081] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Signalling peer 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:55.526649  1779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8da96cacabf1428cb89f110eafb7f5ae"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:38156
I20260709 13:12:55.527346  1779 raft_consensus.cc:493] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:55.527837  1779 raft_consensus.cc:3060] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.528623  1780 raft_consensus.cc:515] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.532686  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:55.533679  1853 raft_consensus.cc:3060] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.535530  1779 raft_consensus.cc:515] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.529011  1678 catalog_manager.cc:5697] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 1 to 2, leader changed from 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3) to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 2 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.538746  1780 leader_election.cc:290] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:55.543897  1778 raft_consensus.cc:1240] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Rejecting Update request from peer f0ba87a2379743149a9508b8ad634cae for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:55.544287  1853 raft_consensus.cc:2468] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:55.545568  1745 leader_election.cc:304] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:55.546865  1779 leader_election.cc:290] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:55.546495  2047 raft_consensus.cc:2804] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:55.547686  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da96cacabf1428cb89f110eafb7f5ae" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:55.548135  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da96cacabf1428cb89f110eafb7f5ae" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:55.548377  2047 raft_consensus.cc:697] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:55.548457  1856 raft_consensus.cc:3055] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:55.548883  1930 raft_consensus.cc:3060] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.549049  1856 raft_consensus.cc:740] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:55.549487  2047 consensus_queue.cc:237] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.550076  1856 consensus_queue.cc:260] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.551293  1856 raft_consensus.cc:3060] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.546414  1929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d30b7afca64b948b52677694480b2e" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:55.556552  1929 raft_consensus.cc:3055] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:55.556974  1929 raft_consensus.cc:740] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:55.559211  1856 raft_consensus.cc:2468] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:55.557936  1929 consensus_queue.cc:260] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.560571  1745 leader_election.cc:304] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:55.561172  1929 raft_consensus.cc:3060] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.561494  2047 raft_consensus.cc:2804] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:55.562150  2047 raft_consensus.cc:697] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:55.563019  2047 consensus_queue.cc:237] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:55.565932  1930 raft_consensus.cc:2468] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:55.566329  1677 catalog_manager.cc:5697] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 1 to 2, leader changed from 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3) to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.572064  1929 raft_consensus.cc:2468] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:55.583000  1677 catalog_manager.cc:5697] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 1 to 2, leader changed from f0ba87a2379743149a9508b8ad634cae (127.21.244.2) to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.761724  1779 raft_consensus.cc:1275] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.763374  1979 consensus_queue.cc:1048] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:55.770380  1779 raft_consensus.cc:1275] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.772770  2053 consensus_queue.cc:1048] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:55.776772  1929 raft_consensus.cc:1275] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.779402  2053 consensus_queue.cc:1048] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:55.786926  1929 raft_consensus.cc:1275] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.789206  2047 consensus_queue.cc:1048] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:55.790802  1928 raft_consensus.cc:1275] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.798444  2052 consensus_queue.cc:1048] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:55.801993  1856 raft_consensus.cc:1275] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.804791  1990 consensus_queue.cc:1048] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:55.861713  1930 raft_consensus.cc:1275] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.863399  2052 consensus_queue.cc:1048] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.872733  1779 raft_consensus.cc:1275] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.875017  2052 consensus_queue.cc:1048] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:55.939036  1930 raft_consensus.cc:1275] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.940810  1990 consensus_queue.cc:1048] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:55.949883  1856 raft_consensus.cc:1275] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.952303  1990 consensus_queue.cc:1048] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:55.987906  1930 raft_consensus.cc:1275] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.989490  1990 consensus_queue.cc:1048] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:55.997797  1856 raft_consensus.cc:1275] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:55.999745  2047 consensus_queue.cc:1048] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:56.025552  1930 raft_consensus.cc:1275] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:56.027081  2052 consensus_queue.cc:1048] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:56.035670  1779 raft_consensus.cc:3060] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.043946  1779 raft_consensus.cc:1275] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:56.045477  2052 consensus_queue.cc:1048] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:56.106003  1856 raft_consensus.cc:1275] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:56.107788  2047 consensus_queue.cc:1048] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:56.117096  1930 raft_consensus.cc:1275] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:56.118824  1988 consensus_queue.cc:1048] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.344738  1678 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48738:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:58.347863  1678 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:58.404997  1763 tablet_service.cc:1511] Processing CreateTablet for tablet 6690e34721914449bf95f1635e24ce8a (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:58.406090  1843 tablet_service.cc:1511] Processing CreateTablet for tablet 6690e34721914449bf95f1635e24ce8a (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:58.407379  1763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6690e34721914449bf95f1635e24ce8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.407632  1843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6690e34721914449bf95f1635e24ce8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.407770  1917 tablet_service.cc:1511] Processing CreateTablet for tablet 6690e34721914449bf95f1635e24ce8a (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:58.409284  1917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6690e34721914449bf95f1635e24ce8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.412516  1840 tablet_service.cc:1511] Processing CreateTablet for tablet e64592f23f4b4f14a625714595608a7c (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:58.412866  1920 tablet_service.cc:1511] Processing CreateTablet for tablet e64592f23f4b4f14a625714595608a7c (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:58.414354  1920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64592f23f4b4f14a625714595608a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.416745  1844 tablet_service.cc:1511] Processing CreateTablet for tablet b660273fdd3c40cc90f91a7f58349df5 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:58.417899  1764 tablet_service.cc:1511] Processing CreateTablet for tablet e64592f23f4b4f14a625714595608a7c (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:58.419425  1764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64592f23f4b4f14a625714595608a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.419221  1913 tablet_service.cc:1511] Processing CreateTablet for tablet b660273fdd3c40cc90f91a7f58349df5 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:58.420679  1913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b660273fdd3c40cc90f91a7f58349df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.420816  1766 tablet_service.cc:1511] Processing CreateTablet for tablet b660273fdd3c40cc90f91a7f58349df5 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:58.423369  1912 tablet_service.cc:1511] Processing CreateTablet for tablet 49ba430145064203a2f793635f1a0e3d (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:58.423679  1770 tablet_service.cc:1511] Processing CreateTablet for tablet 49ba430145064203a2f793635f1a0e3d (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:58.424942  1912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ba430145064203a2f793635f1a0e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.425910  1846 tablet_service.cc:1511] Processing CreateTablet for tablet 49ba430145064203a2f793635f1a0e3d (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:58.437561  1765 tablet_service.cc:1511] Processing CreateTablet for tablet 8beaed1e7006424e9876c81ac4b79958 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:58.439250  1765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8beaed1e7006424e9876c81ac4b79958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.440304  1770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ba430145064203a2f793635f1a0e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.447994  1766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b660273fdd3c40cc90f91a7f58349df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.448550  1845 tablet_service.cc:1511] Processing CreateTablet for tablet 8beaed1e7006424e9876c81ac4b79958 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:58.452129  1918 tablet_service.cc:1511] Processing CreateTablet for tablet 8beaed1e7006424e9876c81ac4b79958 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:58.453796  1768 tablet_service.cc:1511] Processing CreateTablet for tablet d6dab56252f146dba10732aa254f4ce7 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:58.454317  1918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8beaed1e7006424e9876c81ac4b79958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.455348  1768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6dab56252f146dba10732aa254f4ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.414350  1840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64592f23f4b4f14a625714595608a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.458607  1838 tablet_service.cc:1511] Processing CreateTablet for tablet d6dab56252f146dba10732aa254f4ce7 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:58.459741  1845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8beaed1e7006424e9876c81ac4b79958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.460522  1838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6dab56252f146dba10732aa254f4ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.463589  1846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ba430145064203a2f793635f1a0e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.464308  1844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b660273fdd3c40cc90f91a7f58349df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.469429  1919 tablet_service.cc:1511] Processing CreateTablet for tablet d6dab56252f146dba10732aa254f4ce7 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:58.471132  1919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6dab56252f146dba10732aa254f4ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.475601  1767 tablet_service.cc:1511] Processing CreateTablet for tablet 83062d2678eb49f5a277d536680db37a (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:58.477438  1767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83062d2678eb49f5a277d536680db37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.480077  1915 tablet_service.cc:1511] Processing CreateTablet for tablet 83062d2678eb49f5a277d536680db37a (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:58.481529  1915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83062d2678eb49f5a277d536680db37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.483368  1841 tablet_service.cc:1511] Processing CreateTablet for tablet 83062d2678eb49f5a277d536680db37a (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:58.484804  1841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83062d2678eb49f5a277d536680db37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.516093  1842 tablet_service.cc:1511] Processing CreateTablet for tablet 08131c16fd9743d5ab94e04fbbaecee4 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:58.517572  1842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08131c16fd9743d5ab94e04fbbaecee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.517318  1769 tablet_service.cc:1511] Processing CreateTablet for tablet 08131c16fd9743d5ab94e04fbbaecee4 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:58.518680  1769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08131c16fd9743d5ab94e04fbbaecee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.523850  1914 tablet_service.cc:1511] Processing CreateTablet for tablet 08131c16fd9743d5ab94e04fbbaecee4 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:58.525662  1914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08131c16fd9743d5ab94e04fbbaecee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.531783  1839 tablet_service.cc:1511] Processing CreateTablet for tablet 91bdb66bf92b44ea944b0baa79e108b6 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:58.533902  1839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bdb66bf92b44ea944b0baa79e108b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.540444  1916 tablet_service.cc:1511] Processing CreateTablet for tablet 91bdb66bf92b44ea944b0baa79e108b6 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:58.542734  1916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bdb66bf92b44ea944b0baa79e108b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.568223  2067 tablet_bootstrap.cc:492] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:58.581413  2066 tablet_bootstrap.cc:492] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:58.581837  1765 tablet_service.cc:1511] Processing CreateTablet for tablet 91bdb66bf92b44ea944b0baa79e108b6 (DEFAULT_TABLE table=soft_deleted_table [id=791954fb213341dbae0894140c734152]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:58.587790  1765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bdb66bf92b44ea944b0baa79e108b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:58.607288  1727 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:58.612445  2066 tablet_bootstrap.cc:654] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.628700  2069 tablet_bootstrap.cc:492] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:58.640924  2067 tablet_bootstrap.cc:654] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.653314  2069 tablet_bootstrap.cc:654] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.663225  2066 tablet_bootstrap.cc:492] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:58.663972  2066 ts_tablet_manager.cc:1403] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.013s
I20260709 13:12:58.668347  2066 raft_consensus.cc:359] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.669476  2066 raft_consensus.cc:385] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.669894  2066 raft_consensus.cc:740] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.672716  2069 tablet_bootstrap.cc:492] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:58.673421  2069 ts_tablet_manager.cc:1403] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.005s
I20260709 13:12:58.673861  2066 consensus_queue.cc:260] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.676605  2066 ts_tablet_manager.cc:1434] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:12:58.677253  2069 raft_consensus.cc:359] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.678218  2069 raft_consensus.cc:385] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.678547  2069 raft_consensus.cc:740] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.679869  2066 tablet_bootstrap.cc:492] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:58.679379  2069 consensus_queue.cc:260] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.682540  2069 ts_tablet_manager.cc:1434] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:12:58.684492  2069 tablet_bootstrap.cc:492] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:58.687609  2066 tablet_bootstrap.cc:654] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.692037  2069 tablet_bootstrap.cc:654] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.695585  2067 tablet_bootstrap.cc:492] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:58.696458  2067 ts_tablet_manager.cc:1403] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.021s
I20260709 13:12:58.699674  2066 tablet_bootstrap.cc:492] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:58.700294  2066 ts_tablet_manager.cc:1403] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 13:12:58.701110  2067 raft_consensus.cc:359] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.702001  2067 raft_consensus.cc:385] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.702351  2067 raft_consensus.cc:740] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.703291  2067 consensus_queue.cc:260] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.703523  2066 raft_consensus.cc:359] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.704304  2066 raft_consensus.cc:385] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.704638  2066 raft_consensus.cc:740] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.705435  2066 consensus_queue.cc:260] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.706220  2067 ts_tablet_manager.cc:1434] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:12:58.708055  2066 ts_tablet_manager.cc:1434] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:12:58.708144  2067 tablet_bootstrap.cc:492] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:58.710067  2066 tablet_bootstrap.cc:492] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:58.711467  2069 tablet_bootstrap.cc:492] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:58.712172  2069 ts_tablet_manager.cc:1403] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.012s
I20260709 13:12:58.715948  2069 raft_consensus.cc:359] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.716801  2069 raft_consensus.cc:385] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.716972  2067 tablet_bootstrap.cc:654] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.717162  2069 raft_consensus.cc:740] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.717684  2066 tablet_bootstrap.cc:654] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.718309  2069 consensus_queue.cc:260] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.721429  2069 ts_tablet_manager.cc:1434] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:58.722523  2069 tablet_bootstrap.cc:492] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:58.729749  2066 tablet_bootstrap.cc:492] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:58.730396  2066 ts_tablet_manager.cc:1403] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.013s
I20260709 13:12:58.733698  2066 raft_consensus.cc:359] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.734467  2066 raft_consensus.cc:385] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.734774  2066 raft_consensus.cc:740] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.735702  2066 consensus_queue.cc:260] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.736959  2069 tablet_bootstrap.cc:654] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.738924  2066 ts_tablet_manager.cc:1434] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:12:58.742751  2066 tablet_bootstrap.cc:492] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:58.749567  2066 tablet_bootstrap.cc:654] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.755898  2067 tablet_bootstrap.cc:492] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:58.756778  2067 ts_tablet_manager.cc:1403] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.006s
I20260709 13:12:58.761588  2067 raft_consensus.cc:359] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.762750  2067 raft_consensus.cc:385] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.763181  2067 raft_consensus.cc:740] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.765749  2067 consensus_queue.cc:260] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.768594  2067 ts_tablet_manager.cc:1434] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:12:58.769820  2067 tablet_bootstrap.cc:492] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:58.771194  2069 tablet_bootstrap.cc:492] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:58.771864  2069 ts_tablet_manager.cc:1403] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.016s
I20260709 13:12:58.777379  2067 tablet_bootstrap.cc:654] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.775521  2069 raft_consensus.cc:359] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.778007  2069 raft_consensus.cc:385] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.778380  2069 raft_consensus.cc:740] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.778748  2066 tablet_bootstrap.cc:492] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:58.779284  2066 ts_tablet_manager.cc:1403] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.011s
I20260709 13:12:58.779385  2069 consensus_queue.cc:260] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.782480  2066 raft_consensus.cc:359] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.783245  2066 raft_consensus.cc:385] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.783556  2066 raft_consensus.cc:740] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.784373  2066 consensus_queue.cc:260] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.786877  2066 ts_tablet_manager.cc:1434] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:12:58.788048  2066 tablet_bootstrap.cc:492] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:58.790339  2069 ts_tablet_manager.cc:1434] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:12:58.792023  2067 tablet_bootstrap.cc:492] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:58.792683  2067 ts_tablet_manager.cc:1403] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.010s
I20260709 13:12:58.794874  2066 tablet_bootstrap.cc:654] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.796041  2067 raft_consensus.cc:359] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.796921  2067 raft_consensus.cc:385] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.797258  2067 raft_consensus.cc:740] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.798105  2067 consensus_queue.cc:260] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.800336  2069 tablet_bootstrap.cc:492] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:58.800925  2067 ts_tablet_manager.cc:1434] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:58.802130  2067 tablet_bootstrap.cc:492] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:58.809840  2067 tablet_bootstrap.cc:654] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.811120  2069 tablet_bootstrap.cc:654] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.821022  2066 tablet_bootstrap.cc:492] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:58.821513  2066 ts_tablet_manager.cc:1403] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.021s
I20260709 13:12:58.821835  2067 tablet_bootstrap.cc:492] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:58.821859  2069 tablet_bootstrap.cc:492] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:58.822650  2067 ts_tablet_manager.cc:1403] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.001s
I20260709 13:12:58.822750  2069 ts_tablet_manager.cc:1403] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.001s
I20260709 13:12:58.824538  2066 raft_consensus.cc:359] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.825049  2067 raft_consensus.cc:359] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.825347  2066 raft_consensus.cc:385] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.825770  2067 raft_consensus.cc:385] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.825836  2066 raft_consensus.cc:740] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.826180  2067 raft_consensus.cc:740] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.825904  2069 raft_consensus.cc:359] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.826860  2069 raft_consensus.cc:385] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.826917  2066 consensus_queue.cc:260] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.827301  2069 raft_consensus.cc:740] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.827135  2067 consensus_queue.cc:260] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.828477  2069 consensus_queue.cc:260] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.829587  2066 ts_tablet_manager.cc:1434] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:12:58.829736  2067 ts_tablet_manager.cc:1434] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:12:58.830725  2066 tablet_bootstrap.cc:492] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:58.830865  2067 tablet_bootstrap.cc:492] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:58.834568  2069 ts_tablet_manager.cc:1434] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:12:58.836654  2069 tablet_bootstrap.cc:492] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:58.838527  2067 tablet_bootstrap.cc:654] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.838523  2066 tablet_bootstrap.cc:654] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.843773  2069 tablet_bootstrap.cc:654] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.849615  2068 raft_consensus.cc:493] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.850492  2067 tablet_bootstrap.cc:492] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:58.850205  2068 raft_consensus.cc:515] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.850744  2066 tablet_bootstrap.cc:492] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:58.851469  2066 ts_tablet_manager.cc:1403] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:12:58.852501  2068 leader_election.cc:290] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:58.853657  2067 ts_tablet_manager.cc:1403] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 13:12:58.853677  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64592f23f4b4f14a625714595608a7c" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:58.854919  2066 raft_consensus.cc:359] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.855712  2066 raft_consensus.cc:385] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.856072  2066 raft_consensus.cc:740] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
W20260709 13:12:58.856283  1747 leader_election.cc:343] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.853989  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64592f23f4b4f14a625714595608a7c" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:58.857195  2067 raft_consensus.cc:359] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.857052  2066 consensus_queue.cc:260] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.857934  2067 raft_consensus.cc:385] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:58.858012  1745 leader_election.cc:343] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.858389  2067 raft_consensus.cc:740] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.858583  1745 leader_election.cc:304] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:58.859797  2066 ts_tablet_manager.cc:1434] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:12:58.859369  2067 consensus_queue.cc:260] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.860055  2068 raft_consensus.cc:2749] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.860978  2066 tablet_bootstrap.cc:492] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:58.862028  2067 ts_tablet_manager.cc:1434] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:12:58.863197  2067 tablet_bootstrap.cc:492] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:58.866645  2069 tablet_bootstrap.cc:492] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:58.867352  2069 ts_tablet_manager.cc:1403] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.001s
I20260709 13:12:58.869514  2066 tablet_bootstrap.cc:654] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.869750  2067 tablet_bootstrap.cc:654] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.870666  2069 raft_consensus.cc:359] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.871503  2069 raft_consensus.cc:385] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.871852  2069 raft_consensus.cc:740] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.872941  2069 consensus_queue.cc:260] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.876879  2069 ts_tablet_manager.cc:1434] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:12:58.878382  2069 tablet_bootstrap.cc:492] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:58.881564  2066 tablet_bootstrap.cc:492] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:58.882172  2066 ts_tablet_manager.cc:1403] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.010s
I20260709 13:12:58.883901  2068 raft_consensus.cc:493] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.884450  2068 raft_consensus.cc:515] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.885346  2066 raft_consensus.cc:359] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.886180  2066 raft_consensus.cc:385] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.886489  2066 raft_consensus.cc:740] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.886650  2068 leader_election.cc:290] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:58.887481  2066 consensus_queue.cc:260] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.887792  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:58.889845  1856 raft_consensus.cc:2468] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 0.
I20260709 13:12:58.891144  1745 leader_election.cc:304] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:58.892197  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:58.892887  1930 raft_consensus.cc:2468] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 0.
I20260709 13:12:58.895517  2068 raft_consensus.cc:2804] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.896013  2068 raft_consensus.cc:493] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.896343  2068 raft_consensus.cc:3060] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.898288  2052 raft_consensus.cc:493] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.898839  2052 raft_consensus.cc:515] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.899818  2066 ts_tablet_manager.cc:1434] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:12:58.901136  2052 leader_election.cc:290] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:58.901971  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:58.903051  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
W20260709 13:12:58.904026  1819 leader_election.cc:343] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.904062  1930 raft_consensus.cc:2468] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 0.
I20260709 13:12:58.906008  2066 tablet_bootstrap.cc:492] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:58.905869  1822 leader_election.cc:304] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:58.908614  2052 raft_consensus.cc:2804] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.909075  2052 raft_consensus.cc:493] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.909708  2052 raft_consensus.cc:3060] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.911386  2069 tablet_bootstrap.cc:654] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.913311  2066 tablet_bootstrap.cc:654] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.909297  2068 raft_consensus.cc:515] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.917050  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:58.917843  1856 raft_consensus.cc:3060] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.923594  2073 raft_consensus.cc:493] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.924448  2073 raft_consensus.cc:515] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.928547  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ba430145064203a2f793635f1a0e3d" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:58.929705  1779 raft_consensus.cc:2468] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 0.
I20260709 13:12:58.930420  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:58.931360  1930 raft_consensus.cc:3060] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.932119  1819 leader_election.cc:304] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:58.935293  2073 leader_election.cc:290] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:58.936267  2073 raft_consensus.cc:2804] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.936101  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ba430145064203a2f793635f1a0e3d" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:58.937952  1928 raft_consensus.cc:2468] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 0.
I20260709 13:12:58.938052  2068 leader_election.cc:290] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:58.939589  2073 raft_consensus.cc:493] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.940634  2073 raft_consensus.cc:3060] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.940675  1856 raft_consensus.cc:2468] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 1.
I20260709 13:12:58.946130  1745 leader_election.cc:304] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:58.947531  2068 raft_consensus.cc:2804] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.948518  2068 raft_consensus.cc:697] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:58.950026  2068 consensus_queue.cc:237] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.953523  1997 raft_consensus.cc:493] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.959939  1997 raft_consensus.cc:515] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.964706  1997 leader_election.cc:290] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:58.958751  2054 raft_consensus.cc:493] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.964545  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:58.965499  2054 raft_consensus.cc:515] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
W20260709 13:12:58.966867  1893 leader_election.cc:343] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.954988  2069 tablet_bootstrap.cc:492] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:58.968539  2054 leader_election.cc:290] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:58.973030  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dab56252f146dba10732aa254f4ce7" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:58.970587  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dab56252f146dba10732aa254f4ce7" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:58.971395  2066 tablet_bootstrap.cc:492] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:58.975452  2066 ts_tablet_manager.cc:1403] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.043s
I20260709 13:12:58.975868  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
W20260709 13:12:58.976488  1747 leader_election.cc:343] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.976608  1853 raft_consensus.cc:2468] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 0.
I20260709 13:12:58.974226  2069 ts_tablet_manager.cc:1403] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.006s
I20260709 13:12:58.977897  1894 leader_election.cc:304] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:58.978968  1856 raft_consensus.cc:2468] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 0.
I20260709 13:12:58.979425  1997 raft_consensus.cc:2804] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.979997  1997 raft_consensus.cc:493] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.980449  1997 raft_consensus.cc:3060] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.980685  1745 leader_election.cc:304] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 40fbbe9948ea487489997bbeed3f30b0
I20260709 13:12:58.982574  2054 raft_consensus.cc:2804] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.983457  2054 raft_consensus.cc:493] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.984130  2054 raft_consensus.cc:3060] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.968693  1930 raft_consensus.cc:2468] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 1.
I20260709 13:12:58.978729  2066 raft_consensus.cc:359] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.992230  2066 raft_consensus.cc:385] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.992616  2066 raft_consensus.cc:740] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.993429  2066 consensus_queue.cc:260] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.996049  2066 ts_tablet_manager.cc:1434] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:12:58.997062  2066 tablet_bootstrap.cc:492] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae: Bootstrap starting.
I20260709 13:12:58.996634  2069 raft_consensus.cc:359] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:58.997639  2069 raft_consensus.cc:385] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.998064  2069 raft_consensus.cc:740] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.999130  2069 consensus_queue.cc:260] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.009119  2054 raft_consensus.cc:515] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.012009  2066 tablet_bootstrap.cc:654] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.013325  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dab56252f146dba10732aa254f4ce7" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:59.014070  1856 raft_consensus.cc:3060] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.022073  2066 tablet_bootstrap.cc:492] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae: No bootstrap required, opened a new log
I20260709 13:12:59.022722  2066 ts_tablet_manager.cc:1403] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.001s
I20260709 13:12:59.023658  1856 raft_consensus.cc:2468] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 1.
I20260709 13:12:59.027609  2069 ts_tablet_manager.cc:1434] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:12:59.028349  2054 leader_election.cc:290] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.026052  2066 raft_consensus.cc:359] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.026391  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dab56252f146dba10732aa254f4ce7" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.029114  2066 raft_consensus.cc:385] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.029517  2066 raft_consensus.cc:740] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.028903  1745 leader_election.cc:304] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.030427  2066 consensus_queue.cc:260] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
W20260709 13:12:59.031442  1747 leader_election.cc:343] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.032827  2066 ts_tablet_manager.cc:1434] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:12:59.034247  2054 raft_consensus.cc:2804] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.034969  2054 raft_consensus.cc:697] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:59.035446  2095 raft_consensus.cc:493] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.036597  2052 raft_consensus.cc:515] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.036262  2069 tablet_bootstrap.cc:492] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:59.040886  2073 raft_consensus.cc:515] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.041694  2052 leader_election.cc:290] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.036845  2067 tablet_bootstrap.cc:492] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:59.021422  1678 catalog_manager.cc:5697] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.042551  2067 ts_tablet_manager.cc:1403] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.180s	user 0.055s	sys 0.093s
I20260709 13:12:59.042966  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:59.035913  2068 raft_consensus.cc:493] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.044070  2068 raft_consensus.cc:515] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.044263  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ba430145064203a2f793635f1a0e3d" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.045146  1928 raft_consensus.cc:3060] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.037181  2054 consensus_queue.cc:237] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.046444  2068 leader_election.cc:290] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
W20260709 13:12:59.048457  1819 leader_election.cc:343] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.050138  1929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bdb66bf92b44ea944b0baa79e108b6" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:59.050747  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ba430145064203a2f793635f1a0e3d" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:59.036780  2095 raft_consensus.cc:515] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.038233  1997 raft_consensus.cc:515] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.052331  1779 raft_consensus.cc:3060] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.056879  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bdb66bf92b44ea944b0baa79e108b6" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:59.057530  1856 raft_consensus.cc:2468] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 0.
I20260709 13:12:59.052917  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.054570  2095 leader_election.cc:290] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.058662  1930 raft_consensus.cc:3060] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.058509  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:59.059568  1853 raft_consensus.cc:2468] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 0.
I20260709 13:12:59.061975  1745 leader_election.cc:304] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.062412  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:59.062958  2095 raft_consensus.cc:2804] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.055503  1928 raft_consensus.cc:2468] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 1.
I20260709 13:12:59.063411  1778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:59.063788  2095 raft_consensus.cc:493] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.063036  1745 leader_election.cc:304] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.064472  2095 raft_consensus.cc:3060] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.064787  1822 leader_election.cc:304] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.065032  2068 raft_consensus.cc:2804] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.065661  2068 raft_consensus.cc:493] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.065798  2052 raft_consensus.cc:2804] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.066057  2068 raft_consensus.cc:3060] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.066358  2052 raft_consensus.cc:697] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:59.067273  2052 consensus_queue.cc:237] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.063035  1853 raft_consensus.cc:3060] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:59.071967  1747 leader_election.cc:343] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.051903  2073 leader_election.cc:290] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.060672  2067 raft_consensus.cc:359] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.058205  1997 leader_election.cc:290] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:59.081641  2067 raft_consensus.cc:385] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.093628  1853 raft_consensus.cc:2468] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 1.
I20260709 13:12:59.093226  2068 raft_consensus.cc:515] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.097577  1778 raft_consensus.cc:2393] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 40fbbe9948ea487489997bbeed3f30b0 in current term 1: Already voted for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in this term.
I20260709 13:12:59.098625  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:59.089180  2067 raft_consensus.cc:740] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.099656  1928 raft_consensus.cc:2393] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d84ce79592440a4bed9a3e8ccb48a69 in current term 1: Already voted for candidate 40fbbe9948ea487489997bbeed3f30b0 in this term.
I20260709 13:12:59.100260  2067 consensus_queue.cc:260] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.087090  1779 raft_consensus.cc:2468] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 1.
I20260709 13:12:59.107000  2069 tablet_bootstrap.cc:654] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.109370  1930 raft_consensus.cc:2468] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 1.
I20260709 13:12:59.110702  2067 ts_tablet_manager.cc:1434] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 13:12:59.113345  1679 catalog_manager.cc:5697] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 1 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.118914  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:59.119766  1856 raft_consensus.cc:2393] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d84ce79592440a4bed9a3e8ccb48a69 in current term 1: Already voted for candidate 40fbbe9948ea487489997bbeed3f30b0 in this term.
I20260709 13:12:59.121486  2095 raft_consensus.cc:515] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.122874  2067 tablet_bootstrap.cc:492] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:59.125828  1822 leader_election.cc:304] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:59.125921  1894 leader_election.cc:304] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:59.127053  2073 raft_consensus.cc:2804] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.127378  2098 raft_consensus.cc:2804] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.127578  2073 raft_consensus.cc:697] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:59.127980  2098 raft_consensus.cc:697] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:12:59.128583  2073 consensus_queue.cc:237] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.128756  2098 consensus_queue.cc:237] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.134727  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bdb66bf92b44ea944b0baa79e108b6" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:59.135136  2068 leader_election.cc:290] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.136526  1856 raft_consensus.cc:3060] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.135586  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.139256  1747 leader_election.cc:304] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:59.142470  2068 raft_consensus.cc:2749] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.139374  2095 leader_election.cc:290] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.142699  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bdb66bf92b44ea944b0baa79e108b6" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
W20260709 13:12:59.145025  1747 leader_election.cc:343] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.147235  2067 tablet_bootstrap.cc:654] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.157433  1856 raft_consensus.cc:2468] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 1.
I20260709 13:12:59.158043  2069 tablet_bootstrap.cc:492] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:59.160370  2069 ts_tablet_manager.cc:1403] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.008s
I20260709 13:12:59.160302  1745 leader_election.cc:304] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 40fbbe9948ea487489997bbeed3f30b0
I20260709 13:12:59.161185  2095 raft_consensus.cc:2804] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.161759  2095 raft_consensus.cc:697] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:59.162801  2095 consensus_queue.cc:237] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.170356  2073 raft_consensus.cc:493] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.171360  2073 raft_consensus.cc:515] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.179332  2073 leader_election.cc:290] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.179939  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64592f23f4b4f14a625714595608a7c" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:59.180385  2073 raft_consensus.cc:493] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.180727  1930 raft_consensus.cc:2468] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 0.
I20260709 13:12:59.180876  2073 raft_consensus.cc:515] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.179939  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64592f23f4b4f14a625714595608a7c" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:59.182229  1779 raft_consensus.cc:2468] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 0.
I20260709 13:12:59.183529  1822 leader_election.cc:304] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.184422  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83062d2678eb49f5a277d536680db37a" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
W20260709 13:12:59.185865  1819 leader_election.cc:343] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.184590  2052 raft_consensus.cc:2804] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.186772  2052 raft_consensus.cc:493] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.187294  2052 raft_consensus.cc:3060] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.195766  2073 leader_election.cc:290] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.163782  2069 raft_consensus.cc:359] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.196781  2067 tablet_bootstrap.cc:492] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:59.197180  2069 raft_consensus.cc:385] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.197428  2067 ts_tablet_manager.cc:1403] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.005s
I20260709 13:12:59.197309  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83062d2678eb49f5a277d536680db37a" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:59.198473  2069 raft_consensus.cc:740] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.200037  2069 consensus_queue.cc:260] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.201185  1679 catalog_manager.cc:5697] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 1 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.203835  1678 catalog_manager.cc:5697] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.201130  2067 raft_consensus.cc:359] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.207623  2067 raft_consensus.cc:385] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.208853  1930 raft_consensus.cc:2468] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 0.
I20260709 13:12:59.211850  1822 leader_election.cc:304] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:59.213100  2073 raft_consensus.cc:2804] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.214633  2073 raft_consensus.cc:493] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.213547  2052 raft_consensus.cc:515] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.215009  2073 raft_consensus.cc:3060] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.218541  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64592f23f4b4f14a625714595608a7c" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:59.219462  1779 raft_consensus.cc:3060] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.208850  2067 raft_consensus.cc:740] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.222381  2067 consensus_queue.cc:260] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.225376  2067 ts_tablet_manager.cc:1434] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:12:59.226454  2067 tablet_bootstrap.cc:492] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:59.226823  2069 ts_tablet_manager.cc:1434] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 13:12:59.233019  2067 tablet_bootstrap.cc:654] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.232990  2052 leader_election.cc:290] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.234167  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64592f23f4b4f14a625714595608a7c" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.234611  2069 tablet_bootstrap.cc:492] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:59.234807  1930 raft_consensus.cc:3060] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.235186  1779 raft_consensus.cc:2468] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 1.
I20260709 13:12:59.236351  1819 leader_election.cc:304] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.237140  2052 raft_consensus.cc:2804] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.237627  2052 raft_consensus.cc:697] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:59.238562  2052 consensus_queue.cc:237] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.239522  2073 raft_consensus.cc:515] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.242527  1679 catalog_manager.cc:5697] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.244446  2069 tablet_bootstrap.cc:654] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.249423  1678 catalog_manager.cc:5697] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.255995  1930 raft_consensus.cc:2468] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 1.
I20260709 13:12:59.259639  2073 leader_election.cc:290] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.260046  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83062d2678eb49f5a277d536680db37a" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
W20260709 13:12:59.261605  1819 leader_election.cc:343] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.262522  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83062d2678eb49f5a277d536680db37a" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.263274  1928 raft_consensus.cc:3060] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.274258  1928 raft_consensus.cc:2468] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 1.
I20260709 13:12:59.281594  2073 raft_consensus.cc:493] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.281472  1822 leader_election.cc:304] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:59.282212  2073 raft_consensus.cc:515] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.282986  2090 raft_consensus.cc:2804] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.284469  2073 leader_election.cc:290] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.285737  2069 tablet_bootstrap.cc:492] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:59.286260  2069 ts_tablet_manager.cc:1403] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.008s
I20260709 13:12:59.286147  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08131c16fd9743d5ab94e04fbbaecee4" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
W20260709 13:12:59.287921  1822 leader_election.cc:343] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.289495  2069 raft_consensus.cc:359] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.290542  2069 raft_consensus.cc:385] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.290907  2069 raft_consensus.cc:740] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.291810  2069 consensus_queue.cc:260] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.292459  2067 tablet_bootstrap.cc:492] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:59.293967  2067 ts_tablet_manager.cc:1403] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.068s	user 0.022s	sys 0.011s
I20260709 13:12:59.294389  2069 ts_tablet_manager.cc:1434] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:59.298324  2067 raft_consensus.cc:359] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.301209  2067 raft_consensus.cc:385] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.300576  2090 raft_consensus.cc:697] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:59.301537  2067 raft_consensus.cc:740] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.302328  2067 consensus_queue.cc:260] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.304373  2067 ts_tablet_manager.cc:1434] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:59.295589  2069 tablet_bootstrap.cc:492] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69: Bootstrap starting.
I20260709 13:12:59.304814  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08131c16fd9743d5ab94e04fbbaecee4" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
W20260709 13:12:59.306851  1819 leader_election.cc:343] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.307379  1819 leader_election.cc:304] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ba87a2379743149a9508b8ad634cae; no voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:59.308247  2073 raft_consensus.cc:2749] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.310926  2069 tablet_bootstrap.cc:654] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.314108  2067 tablet_bootstrap.cc:492] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0: Bootstrap starting.
I20260709 13:12:59.313231  1677 catalog_manager.cc:5697] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 1 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.302517  2090 consensus_queue.cc:237] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.321170  2067 tablet_bootstrap.cc:654] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.329461  2069 tablet_bootstrap.cc:492] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69: No bootstrap required, opened a new log
I20260709 13:12:59.330044  2069 ts_tablet_manager.cc:1403] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.005s
I20260709 13:12:59.332635  2067 tablet_bootstrap.cc:492] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0: No bootstrap required, opened a new log
I20260709 13:12:59.335325  2067 ts_tablet_manager.cc:1403] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:12:59.333134  2069 raft_consensus.cc:359] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.335866  2069 raft_consensus.cc:385] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.334554  1677 catalog_manager.cc:5697] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 1 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.336206  2069 raft_consensus.cc:740] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.337073  2069 consensus_queue.cc:260] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.338778  2067 raft_consensus.cc:359] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.339601  2067 raft_consensus.cc:385] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.339951  2067 raft_consensus.cc:740] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.341018  2067 consensus_queue.cc:260] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.343561  2067 ts_tablet_manager.cc:1434] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:59.344833  2069 ts_tablet_manager.cc:1434] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:12:59.389189  2098 raft_consensus.cc:493] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.389815  2098 raft_consensus.cc:515] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.391903  2098 leader_election.cc:290] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:59.393088  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dab56252f146dba10732aa254f4ce7" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:59.393117  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dab56252f146dba10732aa254f4ce7" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:59.394243  1856 raft_consensus.cc:2393] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40fbbe9948ea487489997bbeed3f30b0 in current term 1: Already voted for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in this term.
I20260709 13:12:59.395344  1894 leader_election.cc:304] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0; no voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:59.396123  2098 raft_consensus.cc:3060] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.401772  2098 raft_consensus.cc:2749] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.459416  2095 consensus_queue.cc:1048] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.465600  2095 consensus_queue.cc:1048] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.473610  2054 consensus_queue.cc:1048] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.479245  2094 raft_consensus.cc:493] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.479802  2094 raft_consensus.cc:515] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.481617  2095 consensus_queue.cc:1048] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.490669  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08131c16fd9743d5ab94e04fbbaecee4" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:59.491719  1853 raft_consensus.cc:2468] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 0.
I20260709 13:12:59.494051  1745 leader_election.cc:304] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.495846  2054 raft_consensus.cc:2804] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.496420  2054 raft_consensus.cc:493] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.496881  2054 raft_consensus.cc:3060] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.503412  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08131c16fd9743d5ab94e04fbbaecee4" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:59.504357  1928 raft_consensus.cc:2468] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 0.
I20260709 13:12:59.495836  2094 leader_election.cc:290] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.510593  2094 raft_consensus.cc:493] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.510893  2054 raft_consensus.cc:515] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.511082  2094 raft_consensus.cc:515] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.513749  2054 leader_election.cc:290] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.515034  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08131c16fd9743d5ab94e04fbbaecee4" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:59.515395  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:59.515794  1853 raft_consensus.cc:3060] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.516215  1928 raft_consensus.cc:2393] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d84ce79592440a4bed9a3e8ccb48a69 in current term 1: Already voted for candidate f0ba87a2379743149a9508b8ad634cae in this term.
I20260709 13:12:59.517023  1929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08131c16fd9743d5ab94e04fbbaecee4" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.517753  1929 raft_consensus.cc:3060] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.517839  2094 leader_election.cc:290] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.517753  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:59.521090  1745 leader_election.cc:304] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:59.522918  2054 raft_consensus.cc:3060] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.526798  1929 raft_consensus.cc:2468] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 1.
I20260709 13:12:59.529855  1747 leader_election.cc:304] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:59.530959  2094 raft_consensus.cc:2804] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.531566  2094 raft_consensus.cc:697] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:59.532567  2094 consensus_queue.cc:237] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.536190  2054 raft_consensus.cc:2749] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.542243  1853 raft_consensus.cc:2468] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 1.
I20260709 13:12:59.549172  1677 catalog_manager.cc:5697] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.558754  1997 consensus_queue.cc:1048] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.571381  2127 consensus_queue.cc:1048] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.637575  2090 consensus_queue.cc:1048] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.649858  2073 consensus_queue.cc:1048] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.650202  1853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
mode: GRACEFUL
new_leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:60784
I20260709 13:12:59.652136  1853 raft_consensus.cc:606] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Received request to transfer leadership to TS 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:59.661756  2090 raft_consensus.cc:993] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae: : Instructing follower 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:59.661928  1853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e64592f23f4b4f14a625714595608a7c"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
mode: GRACEFUL
new_leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:60784
I20260709 13:12:59.663378  2090 raft_consensus.cc:1081] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Signalling peer 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:59.663404  1853 raft_consensus.cc:606] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Received request to transfer leadership to TS 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:59.666273  1930 raft_consensus.cc:3060] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.668922  1779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:38156
I20260709 13:12:59.669624  1779 raft_consensus.cc:493] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.669661  1929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
mode: GRACEFUL
new_leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:12:59.670060  1779 raft_consensus.cc:3060] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.670395  1929 raft_consensus.cc:606] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Received request to transfer leadership to TS 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:59.675647  2073 consensus_queue.cc:1048] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.678246  2073 consensus_queue.cc:1048] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.678568  1779 raft_consensus.cc:515] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.681653  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:59.682233  1856 raft_consensus.cc:3055] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.682529  1856 raft_consensus.cc:740] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:59.682431  1853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49ba430145064203a2f793635f1a0e3d"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
mode: GRACEFUL
new_leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:60784
I20260709 13:12:59.683180  1853 raft_consensus.cc:606] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Received request to transfer leadership to TS 7d84ce79592440a4bed9a3e8ccb48a69
I20260709 13:12:59.684643  2127 raft_consensus.cc:493] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.683436  1856 consensus_queue.cc:260] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.685230  1779 leader_election.cc:290] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.685248  2127 raft_consensus.cc:515] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.686033  1856 raft_consensus.cc:3060] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.686425  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.687070  1928 raft_consensus.cc:3060] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.688973  2094 consensus_queue.cc:1048] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.690794  2127 leader_election.cc:290] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:12:59.691642  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bdb66bf92b44ea944b0baa79e108b6" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" is_pre_election: true
I20260709 13:12:59.694414  1855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bdb66bf92b44ea944b0baa79e108b6" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:59.695909  1894 leader_election.cc:304] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0; no voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:59.697800  2127 raft_consensus.cc:2749] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.699240  2094 raft_consensus.cc:493] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.699826  2094 raft_consensus.cc:515] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.701042  2054 consensus_queue.cc:1048] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.702121  2094 leader_election.cc:290] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.704195  1856 raft_consensus.cc:2468] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:59.704275  1930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83062d2678eb49f5a277d536680db37a" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fbbe9948ea487489997bbeed3f30b0" is_pre_election: true
I20260709 13:12:59.705253  1930 raft_consensus.cc:2393] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d84ce79592440a4bed9a3e8ccb48a69 in current term 1: Already voted for candidate f0ba87a2379743149a9508b8ad634cae in this term.
I20260709 13:12:59.706415  1928 raft_consensus.cc:2468] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:59.711161  1745 leader_election.cc:304] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.715179  2095 raft_consensus.cc:2804] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.715823  2095 raft_consensus.cc:697] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:59.716686  2095 consensus_queue.cc:237] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.718081  1777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
mode: GRACEFUL
new_leader_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:38172
I20260709 13:12:59.718756  1777 raft_consensus.cc:606] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Received request to transfer leadership to TS f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:59.720924  2073 consensus_queue.cc:1048] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.723225  1853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83062d2678eb49f5a277d536680db37a" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ba87a2379743149a9508b8ad634cae" is_pre_election: true
I20260709 13:12:59.726414  2073 raft_consensus.cc:993] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae: : Instructing follower 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:59.727125  2052 raft_consensus.cc:1081] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Signalling peer 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:59.730741  1745 leader_election.cc:304] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:59.732375  2095 raft_consensus.cc:3060] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.740720  2095 raft_consensus.cc:2749] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.746498  1779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49ba430145064203a2f793635f1a0e3d"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:38156
I20260709 13:12:59.747534  1779 raft_consensus.cc:493] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.748179  1779 raft_consensus.cc:3060] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.749086  1780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6dab56252f146dba10732aa254f4ce7"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
mode: GRACEFUL
new_leader_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:38172
I20260709 13:12:59.749806  1780 raft_consensus.cc:606] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Received request to transfer leadership to TS f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:59.760200  1779 raft_consensus.cc:515] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.761622  1778 raft_consensus.cc:1240] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Rejecting Update request from peer f0ba87a2379743149a9508b8ad634cae for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.767828  2073 consensus_queue.cc:1059] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.769480  2090 raft_consensus.cc:3055] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.770087  2090 raft_consensus.cc:740] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:59.771003  2090 consensus_queue.cc:260] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.772400  1779 leader_election.cc:290] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.772581  2090 raft_consensus.cc:3060] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.773845  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ba430145064203a2f793635f1a0e3d" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:59.773752  1677 catalog_manager.cc:5697] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 1 to 2, leader changed from f0ba87a2379743149a9508b8ad634cae (127.21.244.2) to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.776330  2052 raft_consensus.cc:993] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae: : Instructing follower 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:59.776531  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ba430145064203a2f793635f1a0e3d" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.777102  2112 raft_consensus.cc:1081] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Signalling peer 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:59.777179  1928 raft_consensus.cc:3060] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.777750  1779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08131c16fd9743d5ab94e04fbbaecee4"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
mode: GRACEFUL
new_leader_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:38172
I20260709 13:12:59.778409  1779 raft_consensus.cc:606] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Received request to transfer leadership to TS f0ba87a2379743149a9508b8ad634cae
I20260709 13:12:59.785652  1779 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e64592f23f4b4f14a625714595608a7c"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:38156
I20260709 13:12:59.789502  1928 raft_consensus.cc:2468] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:59.794615  2112 consensus_queue.cc:1048] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.801980  1856 raft_consensus.cc:2468] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:59.805073  1745 leader_election.cc:304] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.805302  1778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91bdb66bf92b44ea944b0baa79e108b6"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
mode: GRACEFUL
new_leader_uuid: "40fbbe9948ea487489997bbeed3f30b0"
 from {username='slave'} at 127.0.0.1:38172
I20260709 13:12:59.806107  2094 raft_consensus.cc:2804] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.806803  2094 raft_consensus.cc:697] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:59.807286  1779 raft_consensus.cc:493] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.807806  1779 raft_consensus.cc:3060] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.807703  2094 consensus_queue.cc:237] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.806155  1778 raft_consensus.cc:606] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Received request to transfer leadership to TS 40fbbe9948ea487489997bbeed3f30b0
I20260709 13:12:59.817915  1678 catalog_manager.cc:5697] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 1 to 2, leader changed from f0ba87a2379743149a9508b8ad634cae (127.21.244.2) to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.819293  1779 raft_consensus.cc:515] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.822678  1779 leader_election.cc:290] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.823496  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64592f23f4b4f14a625714595608a7c" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:12:59.824183  1856 raft_consensus.cc:3055] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.824510  1856 raft_consensus.cc:740] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:59.824615  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64592f23f4b4f14a625714595608a7c" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.825284  1928 raft_consensus.cc:3060] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.825304  1856 consensus_queue.cc:260] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.826524  1856 raft_consensus.cc:3060] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.831832  1928 raft_consensus.cc:2468] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:59.832648  1856 raft_consensus.cc:2468] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:12:59.833214  1747 leader_election.cc:304] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:12:59.834136  2094 raft_consensus.cc:2804] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.834632  2094 raft_consensus.cc:697] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:59.835616  2094 consensus_queue.cc:237] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.843262  1678 catalog_manager.cc:5697] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 1 to 2, leader changed from f0ba87a2379743149a9508b8ad634cae (127.21.244.2) to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.896145  2138 consensus_queue.cc:1048] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.907862  2112 consensus_queue.cc:1048] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.909523  2136 raft_consensus.cc:993] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69: : Instructing follower f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:59.910115  2136 raft_consensus.cc:1081] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Signalling peer f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:59.920554  2136 raft_consensus.cc:993] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69: : Instructing follower f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:59.920754  2135 consensus_queue.cc:1048] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.921167  2136 raft_consensus.cc:1081] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Signalling peer f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:59.926841  1853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6dab56252f146dba10732aa254f4ce7"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:60768
I20260709 13:12:59.927618  1853 raft_consensus.cc:493] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.928215  1853 raft_consensus.cc:3060] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.932017  1856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:60768
I20260709 13:12:59.932717  1856 raft_consensus.cc:493] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.933069  1856 raft_consensus.cc:3060] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.942299  2135 consensus_queue.cc:1048] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.954077  2135 raft_consensus.cc:993] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69: : Instructing follower f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:59.954741  2094 raft_consensus.cc:1081] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Signalling peer f0ba87a2379743149a9508b8ad634cae to start an election
I20260709 13:12:59.949110  1853 raft_consensus.cc:515] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.957000  1855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08131c16fd9743d5ab94e04fbbaecee4"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
 from {username='slave'} at 127.0.0.1:60768
I20260709 13:12:59.957700  1855 raft_consensus.cc:493] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.958007  1779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dab56252f146dba10732aa254f4ce7" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:59.958760  1779 raft_consensus.cc:3055] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.959033  1779 raft_consensus.cc:740] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:59.958101  1855 raft_consensus.cc:3060] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.959798  1779 consensus_queue.cc:260] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.960613  1853 leader_election.cc:290] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.960819  1779 raft_consensus.cc:3060] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.959959  1856 raft_consensus.cc:515] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.966039  1856 leader_election.cc:290] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.966818  1778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:59.967484  1778 raft_consensus.cc:3055] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.967814  1778 raft_consensus.cc:740] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:59.967873  1927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.968705  1927 raft_consensus.cc:3060] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.968839  1778 consensus_queue.cc:260] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.970160  1778 raft_consensus.cc:3060] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.972914  1928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6dab56252f146dba10732aa254f4ce7" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.973263  1855 raft_consensus.cc:515] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.973675  1928 raft_consensus.cc:3060] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.977047  1927 raft_consensus.cc:2468] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:59.978492  1822 leader_election.cc:304] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.978866  1929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08131c16fd9743d5ab94e04fbbaecee4" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:12:59.979411  2112 raft_consensus.cc:2804] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.979560  1929 raft_consensus.cc:3060] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.979957  2112 raft_consensus.cc:697] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:59.980285  1777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08131c16fd9743d5ab94e04fbbaecee4" candidate_uuid: "f0ba87a2379743149a9508b8ad634cae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:12:59.981129  1777 raft_consensus.cc:3055] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.980868  2112 consensus_queue.cc:237] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.981545  1777 raft_consensus.cc:740] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:12:59.982547  1777 consensus_queue.cc:260] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.985258  1777 raft_consensus.cc:3060] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.987082  1928 raft_consensus.cc:2468] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:59.987643  1778 raft_consensus.cc:2468] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:59.988593  1822 leader_election.cc:304] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.989454  2127 raft_consensus.cc:993] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0: : Instructing follower 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:59.989583  2112 raft_consensus.cc:2804] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.989955  1855 leader_election.cc:290] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:12:59.990075  2127 raft_consensus.cc:1081] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Signalling peer 7d84ce79592440a4bed9a3e8ccb48a69 to start an election
I20260709 13:12:59.990392  2112 raft_consensus.cc:697] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:59.991353  2112 consensus_queue.cc:237] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:12:59.993412  1780 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
 from {username='slave'} at 127.0.0.1:38152
I20260709 13:12:59.994118  1780 raft_consensus.cc:493] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.994514  1780 raft_consensus.cc:3060] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.996721  1777 raft_consensus.cc:2468] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:59.998229  1819 leader_election.cc:304] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:12:59.999293  2138 raft_consensus.cc:2804] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.999389  1929 raft_consensus.cc:2468] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:12:59.999958  2138 raft_consensus.cc:697] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Becoming Leader. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:12:59.968677  1779 raft_consensus.cc:2468] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ba87a2379743149a9508b8ad634cae in term 2.
I20260709 13:13:00.000909  2138 consensus_queue.cc:237] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:00.003422  1780 raft_consensus.cc:515] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:00.005215  1678 catalog_manager.cc:5697] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 1 to 2, leader changed from 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1) to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 2 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.006428  1855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:13:00.007222  1855 raft_consensus.cc:3060] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.006776  1678 catalog_manager.cc:5697] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 1 to 2, leader changed from 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1) to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 2 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.011343  1780 leader_election.cc:290] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Requested vote from peers f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399), 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3:42267)
I20260709 13:13:00.012933  1927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b660273fdd3c40cc90f91a7f58349df5" candidate_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
I20260709 13:13:00.013567  1927 raft_consensus.cc:3055] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.013885  1927 raft_consensus.cc:740] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:13:00.014683  1927 consensus_queue.cc:260] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:00.015563  1855 raft_consensus.cc:2468] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:13:00.016103  1927 raft_consensus.cc:3060] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.016369  1856 raft_consensus.cc:1240] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Rejecting Update request from peer 40fbbe9948ea487489997bbeed3f30b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:00.019172  1745 leader_election.cc:304] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d84ce79592440a4bed9a3e8ccb48a69, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:13:00.020051  2094 raft_consensus.cc:2804] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.020561  2094 raft_consensus.cc:697] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Becoming Leader. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:13:00.021368  2094 consensus_queue.cc:237] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:00.023350  1927 raft_consensus.cc:2468] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d84ce79592440a4bed9a3e8ccb48a69 in term 2.
I20260709 13:13:00.024181  1678 catalog_manager.cc:5697] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae reported cstate change: term changed from 1 to 2, leader changed from 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1) to f0ba87a2379743149a9508b8ad634cae (127.21.244.2). New cstate: current_term: 2 leader_uuid: "f0ba87a2379743149a9508b8ad634cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.029733  1679 catalog_manager.cc:5697] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 reported cstate change: term changed from 1 to 2, leader changed from 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3) to 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.111248  2135 raft_consensus.cc:993] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69: : Instructing follower 40fbbe9948ea487489997bbeed3f30b0 to start an election
I20260709 13:13:00.111760  2094 raft_consensus.cc:1081] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Signalling peer 40fbbe9948ea487489997bbeed3f30b0 to start an election
I20260709 13:13:00.113368  1927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91bdb66bf92b44ea944b0baa79e108b6"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
 from {username='slave'} at 127.0.0.1:33514
I20260709 13:13:00.113945  1927 raft_consensus.cc:493] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.114244  1927 raft_consensus.cc:3060] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.119386  1927 raft_consensus.cc:515] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:00.121520  1927 leader_election.cc:290] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 2 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:13:00.122509  1855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bdb66bf92b44ea944b0baa79e108b6" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:13:00.122527  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bdb66bf92b44ea944b0baa79e108b6" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:13:00.123292  1855 raft_consensus.cc:3060] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.123472  1780 raft_consensus.cc:3055] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.123979  1780 raft_consensus.cc:740] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:13:00.124722  1780 consensus_queue.cc:260] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:00.125701  1780 raft_consensus.cc:3060] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.129220  1855 raft_consensus.cc:2468] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 2.
I20260709 13:13:00.130456  1894 leader_election.cc:304] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:13:00.131153  1780 raft_consensus.cc:2468] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 2.
I20260709 13:13:00.131261  1997 raft_consensus.cc:2804] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.131896  1997 raft_consensus.cc:697] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:13:00.132754  1997 consensus_queue.cc:237] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:00.139822  1679 catalog_manager.cc:5697] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 1 to 2, leader changed from 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1) to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.197351  1855 raft_consensus.cc:1275] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.198869  2094 consensus_queue.cc:1048] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.200632  1929 raft_consensus.cc:1275] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.202335  2094 consensus_queue.cc:1048] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.212881  1929 raft_consensus.cc:1275] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.215884  2135 consensus_queue.cc:1048] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.217703  1856 raft_consensus.cc:1275] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.220324  2135 consensus_queue.cc:1048] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.365355  1927 raft_consensus.cc:1275] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.366662  2135 consensus_queue.cc:1048] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.374625  1855 raft_consensus.cc:1275] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.376689  2136 consensus_queue.cc:1048] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.416144  1927 raft_consensus.cc:1275] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.417701  2112 consensus_queue.cc:1048] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.423477  1929 raft_consensus.cc:1275] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.426783  1780 raft_consensus.cc:1275] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.427533  1929 raft_consensus.cc:1275] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.429167  2138 consensus_queue.cc:1048] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.429327  2090 consensus_queue.cc:1048] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.430570  2136 consensus_queue.cc:1048] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.438964  1777 raft_consensus.cc:1275] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.440703  2090 consensus_queue.cc:1048] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.448208  1780 raft_consensus.cc:1275] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.450330  2112 consensus_queue.cc:1048] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.457464  1855 raft_consensus.cc:1275] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Refusing update from remote peer 7d84ce79592440a4bed9a3e8ccb48a69: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.459347  2136 consensus_queue.cc:1048] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.460160  1927 raft_consensus.cc:1275] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Refusing update from remote peer f0ba87a2379743149a9508b8ad634cae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.463358  2112 consensus_queue.cc:1048] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.589685  1855 raft_consensus.cc:1275] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Refusing update from remote peer 40fbbe9948ea487489997bbeed3f30b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.591058  1997 consensus_queue.cc:1048] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.599943  1777 raft_consensus.cc:1275] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Refusing update from remote peer 40fbbe9948ea487489997bbeed3f30b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.602381  1997 consensus_queue.cc:1048] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.815840  1676 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48738:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:02.842483  1676 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48738:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:02.911895 22480 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:03.135226  2190 tablet.cc:1724] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:03.156375  2165 log.cc:927] Time spent T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
W20260709 13:13:03.173568  2172 log.cc:927] Time spent T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:13:03.187223  2180 log.cc:927] Time spent T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:13:03.204641  2181 log.cc:927] Time spent T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69: Append to log took a long time: real 0.099s	user 0.006s	sys 0.000s
W20260709 13:13:03.207209  2187 log.cc:927] Time spent T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:13:03.188199  1745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:46399, user_credentials={real_user=slave}} blocked reactor thread for 54375.4us
W20260709 13:13:03.245143  1894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:46399, user_credentials={real_user=slave}} blocked reactor thread for 71654.9us
W20260709 13:13:03.249817  1807 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:e64592f23f4b4f14a625714595608a7c)
I20260709 13:13:03.244578  2195 tablet.cc:1724] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:03.249784  2192 log.cc:927] Time spent T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:13:03.248238  2206 tablet.cc:1724] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.263247  2205 tablet.cc:1724] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.256111  2202 tablet.cc:1724] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:03.272716  2196 log.cc:927] Time spent T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:13:03.252977  2203 tablet.cc:1724] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:03.296680  1807 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:d6dab56252f146dba10732aa254f4ce7)
I20260709 13:13:03.306107  2216 tablet.cc:1724] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.296990  2208 tablet.cc:1724] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.300877  2211 tablet.cc:1724] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:03.363694  1882 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:83062d2678eb49f5a277d536680db37a)
I20260709 13:13:03.366291  1781 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
mode: GRACEFUL
new_leader_uuid: "40fbbe9948ea487489997bbeed3f30b0"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:03.367365  1781 raft_consensus.cc:606] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Received request to transfer leadership to TS 40fbbe9948ea487489997bbeed3f30b0
I20260709 13:13:03.371404  2193 raft_consensus.cc:993] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69: : Instructing follower 40fbbe9948ea487489997bbeed3f30b0 to start an election
I20260709 13:13:03.372418  2147 raft_consensus.cc:1081] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Signalling peer 40fbbe9948ea487489997bbeed3f30b0 to start an election
I20260709 13:13:03.293650  2209 tablet.cc:1724] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.377398  1925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
 from {username='slave'} at 127.0.0.1:33514
I20260709 13:13:03.408524  2212 tablet.cc:1724] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.420488  2214 tablet.cc:1724] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.411343  1925 raft_consensus.cc:493] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:03.428290  1925 raft_consensus.cc:3060] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.430510  2206 tablet.cc:1724] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.433255  2216 tablet.cc:1724] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.444097  2211 tablet.cc:1724] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.448505  2205 tablet.cc:1724] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.452291  2208 tablet.cc:1724] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.452454  2195 tablet.cc:1724] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.467787  2209 tablet.cc:1724] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.477701  2190 tablet.cc:1724] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.487195  2203 tablet.cc:1724] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.491125  1925 raft_consensus.cc:515] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.493896  1925 leader_election.cc:290] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 3 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:13:03.495816  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:13:03.496659  1781 raft_consensus.cc:3055] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:03.497045  1781 raft_consensus.cc:740] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:13:03.497706  2195 tablet.cc:1724] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.498008  1781 consensus_queue.cc:260] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.499418  1781 raft_consensus.cc:3060] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.501199  1852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6690e34721914449bf95f1635e24ce8a" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:13:03.511274  1852 raft_consensus.cc:3060] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.513777  2190 tablet.cc:1724] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.518880  2202 tablet.cc:1724] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.520659  2212 tablet.cc:1724] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.526320  2216 tablet.cc:1724] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.527252  1856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
mode: GRACEFUL
new_leader_uuid: "40fbbe9948ea487489997bbeed3f30b0"
 from {username='slave'} at 127.0.0.1:57418
I20260709 13:13:03.528079  1856 raft_consensus.cc:606] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Received request to transfer leadership to TS 40fbbe9948ea487489997bbeed3f30b0
I20260709 13:13:03.530087 22480 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:13:03.533890 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:03.548171  2214 tablet.cc:1724] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.549618  1780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f"
dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
mode: GRACEFUL
new_leader_uuid: "40fbbe9948ea487489997bbeed3f30b0"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:03.550438  1780 raft_consensus.cc:606] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Received request to transfer leadership to TS 40fbbe9948ea487489997bbeed3f30b0
I20260709 13:13:03.554729  1856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102"
dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
mode: GRACEFUL
new_leader_uuid: "40fbbe9948ea487489997bbeed3f30b0"
 from {username='slave'} at 127.0.0.1:57418
I20260709 13:13:03.555397  1856 raft_consensus.cc:606] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Received request to transfer leadership to TS 40fbbe9948ea487489997bbeed3f30b0
I20260709 13:13:03.556864  1781 raft_consensus.cc:2468] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 3.
I20260709 13:13:03.566547 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:03.567813  1852 raft_consensus.cc:2468] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 3.
I20260709 13:13:03.568303 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:03.569521  1894 leader_election.cc:304] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:13:03.570469  2215 raft_consensus.cc:2804] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:03.571046  2215 raft_consensus.cc:697] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 3 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:13:03.572047  2215 consensus_queue.cc:237] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.590296  1676 catalog_manager.cc:5697] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 2 to 3, leader changed from 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1) to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.611083  1676 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad: soft_deleted_table [id=791954fb213341dbae0894140c734152] alter complete (version 1)
I20260709 13:13:03.642373  2090 raft_consensus.cc:993] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae: : Instructing follower 40fbbe9948ea487489997bbeed3f30b0 to start an election
I20260709 13:13:03.643076  2178 raft_consensus.cc:1081] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Signalling peer 40fbbe9948ea487489997bbeed3f30b0 to start an election
I20260709 13:13:03.645046  1928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
 from {username='slave'} at 127.0.0.1:33524
I20260709 13:13:03.645651  1928 raft_consensus.cc:493] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:03.645968  2068 raft_consensus.cc:993] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69: : Instructing follower 40fbbe9948ea487489997bbeed3f30b0 to start an election
I20260709 13:13:03.646121  1928 raft_consensus.cc:3060] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.646916  2147 raft_consensus.cc:1081] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Signalling peer 40fbbe9948ea487489997bbeed3f30b0 to start an election
I20260709 13:13:03.648751  1925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
 from {username='slave'} at 127.0.0.1:33514
I20260709 13:13:03.649524  1925 raft_consensus.cc:493] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:03.649895  1925 raft_consensus.cc:3060] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.655651  1928 raft_consensus.cc:515] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.656457  1925 raft_consensus.cc:515] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.657976  1928 leader_election.cc:290] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 3 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:13:03.659025  1925 leader_election.cc:290] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 3 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:13:03.659981  1781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:13:03.660094  1856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:13:03.660773  1781 raft_consensus.cc:3060] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.660846  1856 raft_consensus.cc:3060] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.661401  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd46f30d2b024cf4b6d7ad97e2e82c7f" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:13:03.662206  1780 raft_consensus.cc:3055] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:03.662570  1780 raft_consensus.cc:740] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d84ce79592440a4bed9a3e8ccb48a69, State: Running, Role: LEADER
I20260709 13:13:03.663574  1780 consensus_queue.cc:260] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.665230  1780 raft_consensus.cc:3060] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.667506  1781 raft_consensus.cc:2468] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 3.
I20260709 13:13:03.661394  1852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5d03af4eb0c41a8b4d8c30c71548102" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:13:03.668809  1852 raft_consensus.cc:3055] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:03.669271  1852 raft_consensus.cc:740] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:13:03.669425  1893 leader_election.cc:304] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:13:03.669862  1856 raft_consensus.cc:2468] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 3.
I20260709 13:13:03.670578  2215 raft_consensus.cc:2804] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:03.671170  2215 raft_consensus.cc:697] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 3 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:13:03.672066  1894 leader_election.cc:304] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, f0ba87a2379743149a9508b8ad634cae; no voters: 
I20260709 13:13:03.672385  2215 consensus_queue.cc:237] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.673147  2200 raft_consensus.cc:2804] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:03.673740  2200 raft_consensus.cc:697] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 3 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:13:03.671175  1852 consensus_queue.cc:260] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.674880  2200 consensus_queue.cc:237] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.676177  1852 raft_consensus.cc:3060] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.679574  1780 raft_consensus.cc:2468] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 3.
I20260709 13:13:03.690011  1852 raft_consensus.cc:2468] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 3.
I20260709 13:13:03.692262  1677 catalog_manager.cc:5697] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 2 to 3, leader changed from f0ba87a2379743149a9508b8ad634cae (127.21.244.2) to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.706889  1677 catalog_manager.cc:5697] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 2 to 3, leader changed from 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1) to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.853293  2090 raft_consensus.cc:993] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae: : Instructing follower 40fbbe9948ea487489997bbeed3f30b0 to start an election
I20260709 13:13:03.853780  2090 raft_consensus.cc:1081] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Signalling peer 40fbbe9948ea487489997bbeed3f30b0 to start an election
I20260709 13:13:03.855347  1925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958"
dest_uuid: "40fbbe9948ea487489997bbeed3f30b0"
 from {username='slave'} at 127.0.0.1:33524
I20260709 13:13:03.855899  1925 raft_consensus.cc:493] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:03.856281  1925 raft_consensus.cc:3060] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.861740  1925 raft_consensus.cc:515] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.863333  1925 leader_election.cc:290] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 3 election: Requested vote from peers 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883), f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399)
I20260709 13:13:03.864327  1780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7d84ce79592440a4bed9a3e8ccb48a69"
I20260709 13:13:03.864480  1852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8beaed1e7006424e9876c81ac4b79958" candidate_uuid: "40fbbe9948ea487489997bbeed3f30b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f0ba87a2379743149a9508b8ad634cae"
I20260709 13:13:03.864992  1780 raft_consensus.cc:3060] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.865247  1852 raft_consensus.cc:3055] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:03.865626  1852 raft_consensus.cc:740] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0ba87a2379743149a9508b8ad634cae, State: Running, Role: LEADER
I20260709 13:13:03.866426  1852 consensus_queue.cc:260] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.867467  1852 raft_consensus.cc:3060] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.870743  1780 raft_consensus.cc:2468] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 3.
I20260709 13:13:03.871930  1893 leader_election.cc:304] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fbbe9948ea487489997bbeed3f30b0, 7d84ce79592440a4bed9a3e8ccb48a69; no voters: 
I20260709 13:13:03.872893  2215 raft_consensus.cc:2804] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:03.873451  2215 raft_consensus.cc:697] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 3 LEADER]: Becoming Leader. State: Replica: 40fbbe9948ea487489997bbeed3f30b0, State: Running, Role: LEADER
I20260709 13:13:03.874779  1852 raft_consensus.cc:2468] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40fbbe9948ea487489997bbeed3f30b0 in term 3.
I20260709 13:13:03.874679  2215 consensus_queue.cc:237] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } }
I20260709 13:13:03.882323  1677 catalog_manager.cc:5697] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 reported cstate change: term changed from 2 to 3, leader changed from f0ba87a2379743149a9508b8ad634cae (127.21.244.2) to 40fbbe9948ea487489997bbeed3f30b0 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "40fbbe9948ea487489997bbeed3f30b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fbbe9948ea487489997bbeed3f30b0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 42267 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.994437  1852 raft_consensus.cc:1275] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Refusing update from remote peer 40fbbe9948ea487489997bbeed3f30b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:03.995910  2215 consensus_queue.cc:1048] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:04.006563  1780 raft_consensus.cc:1275] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Refusing update from remote peer 40fbbe9948ea487489997bbeed3f30b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:04.008929  2201 consensus_queue.cc:1048] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:04.110354  1780 raft_consensus.cc:1275] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Refusing update from remote peer 40fbbe9948ea487489997bbeed3f30b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:04.111617  2201 consensus_queue.cc:1048] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:04.121683  1852 raft_consensus.cc:1275] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Refusing update from remote peer 40fbbe9948ea487489997bbeed3f30b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:04.123664  2215 consensus_queue.cc:1048] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:04.136804  1780 raft_consensus.cc:1275] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Refusing update from remote peer 40fbbe9948ea487489997bbeed3f30b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:04.139217  2201 consensus_queue.cc:1048] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:04.154795  1852 raft_consensus.cc:1275] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Refusing update from remote peer 40fbbe9948ea487489997bbeed3f30b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:04.156256  2200 consensus_queue.cc:1048] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:04.366775  1780 raft_consensus.cc:1275] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Refusing update from remote peer 40fbbe9948ea487489997bbeed3f30b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:04.368252  2200 consensus_queue.cc:1048] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d84ce79592440a4bed9a3e8ccb48a69" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:04.381455  1852 raft_consensus.cc:1275] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Refusing update from remote peer 40fbbe9948ea487489997bbeed3f30b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:04.382910  2215 consensus_queue.cc:1048] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ba87a2379743149a9508b8ad634cae" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:04.637924 22480 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:04.644791 22480 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:13:04.645416 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:04.652586 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:13:04.653111 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:05.685794 22480 tablet_server.cc:179] TabletServer@127.21.244.1:0 shutting down...
W20260709 13:13:05.704756  1819 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:13:05.709627  1819 consensus_peers.cc:597] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae -> Peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Couldn't send request to peer 7d84ce79592440a4bed9a3e8ccb48a69. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.725986 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:05.726843 22480 tablet_replica.cc:333] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.727881 22480 raft_consensus.cc:2243] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.728426 22480 raft_consensus.cc:2272] T 83062d2678eb49f5a277d536680db37a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.730635 22480 tablet_replica.cc:333] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.731309 22480 raft_consensus.cc:2243] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.731933 22480 raft_consensus.cc:2272] T 08131c16fd9743d5ab94e04fbbaecee4 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.734009 22480 tablet_replica.cc:333] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.734643 22480 raft_consensus.cc:2243] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.735118 22480 raft_consensus.cc:2272] T 6690e34721914449bf95f1635e24ce8a P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.737470 22480 tablet_replica.cc:333] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.738251 22480 raft_consensus.cc:2243] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.739235 22480 raft_consensus.cc:2272] T b660273fdd3c40cc90f91a7f58349df5 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.742190 22480 tablet_replica.cc:333] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.743100 22480 raft_consensus.cc:2243] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.744100 22480 raft_consensus.cc:2272] T 49ba430145064203a2f793635f1a0e3d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.745451  1819 consensus_peers.cc:597] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae -> Peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Couldn't send request to peer 7d84ce79592440a4bed9a3e8ccb48a69. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.747294 22480 tablet_replica.cc:333] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.748379 22480 raft_consensus.cc:2243] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.748968 22480 raft_consensus.cc:2272] T d6dab56252f146dba10732aa254f4ce7 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.751889 22480 tablet_replica.cc:333] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.752841 22480 raft_consensus.cc:2243] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.753471 22480 raft_consensus.cc:2272] T 91bdb66bf92b44ea944b0baa79e108b6 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.756459 22480 tablet_replica.cc:333] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.757346 22480 raft_consensus.cc:2243] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.757905 22480 raft_consensus.cc:2272] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.758963  1893 consensus_peers.cc:597] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 -> Peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Couldn't send request to peer 7d84ce79592440a4bed9a3e8ccb48a69. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.761044 22480 tablet_replica.cc:333] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.762010 22480 raft_consensus.cc:2243] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.763125 22480 raft_consensus.cc:2272] T e64592f23f4b4f14a625714595608a7c P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.765921 22480 tablet_replica.cc:333] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.766489 22480 raft_consensus.cc:2243] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.767067 22480 raft_consensus.cc:2272] T bce427dc947841f08cb1639fd9be063d P 7d84ce79592440a4bed9a3e8ccb48a69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.769539 22480 tablet_replica.cc:333] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.770138 22480 raft_consensus.cc:2243] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.770571 22480 raft_consensus.cc:2272] T 8beaed1e7006424e9876c81ac4b79958 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.772580 22480 tablet_replica.cc:333] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.773067 22480 raft_consensus.cc:2243] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.773592 22480 raft_consensus.cc:2272] T e5d03af4eb0c41a8b4d8c30c71548102 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.776312 22480 tablet_replica.cc:333] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.776995 22480 raft_consensus.cc:2243] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.777480 22480 raft_consensus.cc:2272] T 964f8309fb664b0e882a7bdae4e7bedc P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.779675 22480 tablet_replica.cc:333] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.780270 22480 raft_consensus.cc:2243] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.781172 22480 raft_consensus.cc:2272] T 8da96cacabf1428cb89f110eafb7f5ae P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.783360 22480 tablet_replica.cc:333] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.783942 22480 raft_consensus.cc:2243] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.784806 22480 raft_consensus.cc:2272] T 1bb22b538cb14452b67cf0442352ea21 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.787703 22480 tablet_replica.cc:333] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.788476 22480 raft_consensus.cc:2243] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.789120 22480 raft_consensus.cc:2272] T f023cfc6395d4aed82163043c9ed9ec1 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.789040  1893 consensus_peers.cc:597] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 -> Peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Couldn't send request to peer 7d84ce79592440a4bed9a3e8ccb48a69. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.791810 22480 tablet_replica.cc:333] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.792408 22480 raft_consensus.cc:2243] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.792883 22480 raft_consensus.cc:2272] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.795074 22480 tablet_replica.cc:333] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69: stopping tablet replica
I20260709 13:13:05.795585 22480 raft_consensus.cc:2243] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.796470 22480 raft_consensus.cc:2272] T a8d30b7afca64b948b52677694480b2e P 7d84ce79592440a4bed9a3e8ccb48a69 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.838711 22480 tablet_server.cc:196] TabletServer@127.21.244.1:0 shutdown complete.
W20260709 13:13:05.864564  1893 consensus_peers.cc:597] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 -> Peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Couldn't send request to peer 7d84ce79592440a4bed9a3e8ccb48a69. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:46883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.872246  1819 consensus_peers.cc:597] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae -> Peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Couldn't send request to peer 7d84ce79592440a4bed9a3e8ccb48a69. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:46883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.882263 22480 tablet_server.cc:179] TabletServer@127.21.244.2:0 shutting down...
W20260709 13:13:05.891583  1893 consensus_peers.cc:597] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 -> Peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Couldn't send request to peer 7d84ce79592440a4bed9a3e8ccb48a69. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:46883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.910375  1819 consensus_peers.cc:597] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae -> Peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Couldn't send request to peer 7d84ce79592440a4bed9a3e8ccb48a69. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:46883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.911058  1819 consensus_peers.cc:597] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae -> Peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Couldn't send request to peer 7d84ce79592440a4bed9a3e8ccb48a69. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:46883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.927017 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:05.927974 22480 tablet_replica.cc:333] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.928752 22480 raft_consensus.cc:2243] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.929271 22480 raft_consensus.cc:2272] T 49ba430145064203a2f793635f1a0e3d P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.931422 22480 tablet_replica.cc:333] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.932124 22480 raft_consensus.cc:2243] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.932605 22480 raft_consensus.cc:2272] T b660273fdd3c40cc90f91a7f58349df5 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.934700 22480 tablet_replica.cc:333] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.935290 22480 raft_consensus.cc:2243] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.936362 22480 raft_consensus.cc:2272] T d6dab56252f146dba10732aa254f4ce7 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.938727 22480 tablet_replica.cc:333] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.939584 22480 raft_consensus.cc:2243] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:05.940160  1894 consensus_peers.cc:597] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 -> Peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Couldn't send request to peer f0ba87a2379743149a9508b8ad634cae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.940448 22480 raft_consensus.cc:2272] T 83062d2678eb49f5a277d536680db37a P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.942637 22480 tablet_replica.cc:333] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.943255 22480 raft_consensus.cc:2243] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.943769 22480 raft_consensus.cc:2272] T 8da96cacabf1428cb89f110eafb7f5ae P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.945912 22480 tablet_replica.cc:333] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.946504 22480 raft_consensus.cc:2243] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.946959 22480 raft_consensus.cc:2272] T 1bb22b538cb14452b67cf0442352ea21 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.949435 22480 tablet_replica.cc:333] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.950124 22480 raft_consensus.cc:2243] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.951117 22480 raft_consensus.cc:2272] T f023cfc6395d4aed82163043c9ed9ec1 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.953294 22480 tablet_replica.cc:333] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.953866 22480 raft_consensus.cc:2243] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.954334 22480 raft_consensus.cc:2272] T 91bdb66bf92b44ea944b0baa79e108b6 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.956619 22480 tablet_replica.cc:333] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.957208 22480 raft_consensus.cc:2243] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.957685 22480 raft_consensus.cc:2272] T e64592f23f4b4f14a625714595608a7c P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.959694 22480 tablet_replica.cc:333] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.960309 22480 raft_consensus.cc:2243] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.960738 22480 raft_consensus.cc:2272] T cd46f30d2b024cf4b6d7ad97e2e82c7f P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.962636 22480 tablet_replica.cc:333] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.963210 22480 raft_consensus.cc:2243] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.963629 22480 raft_consensus.cc:2272] T 8beaed1e7006424e9876c81ac4b79958 P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.965622 22480 tablet_replica.cc:333] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.966167 22480 raft_consensus.cc:2243] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.966588 22480 raft_consensus.cc:2272] T bce427dc947841f08cb1639fd9be063d P f0ba87a2379743149a9508b8ad634cae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.968575 22480 tablet_replica.cc:333] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.969084 22480 raft_consensus.cc:2243] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.969848 22480 raft_consensus.cc:2272] T 08131c16fd9743d5ab94e04fbbaecee4 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.972354 22480 tablet_replica.cc:333] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.972999 22480 raft_consensus.cc:2243] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.973471 22480 raft_consensus.cc:2272] T 6690e34721914449bf95f1635e24ce8a P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.976097 22480 tablet_replica.cc:333] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
W20260709 13:13:05.976191  1893 consensus_peers.cc:597] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 -> Peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Couldn't send request to peer 7d84ce79592440a4bed9a3e8ccb48a69. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:46883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.976902 22480 raft_consensus.cc:2243] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.977464 22480 raft_consensus.cc:2272] T e5d03af4eb0c41a8b4d8c30c71548102 P f0ba87a2379743149a9508b8ad634cae [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.978842  1894 consensus_peers.cc:597] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 -> Peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Couldn't send request to peer f0ba87a2379743149a9508b8ad634cae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.980217 22480 tablet_replica.cc:333] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.980777 22480 raft_consensus.cc:2243] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.981593 22480 raft_consensus.cc:2272] T 964f8309fb664b0e882a7bdae4e7bedc P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.984244 22480 tablet_replica.cc:333] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.984762 22480 raft_consensus.cc:2243] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.985606 22480 raft_consensus.cc:2272] T 8a160b0f55ec47d18cffc7e2ec0b0023 P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.987834 22480 tablet_replica.cc:333] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae: stopping tablet replica
I20260709 13:13:05.988315 22480 raft_consensus.cc:2243] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.988776 22480 raft_consensus.cc:2272] T a8d30b7afca64b948b52677694480b2e P f0ba87a2379743149a9508b8ad634cae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.032526 22480 tablet_server.cc:196] TabletServer@127.21.244.2:0 shutdown complete.
W20260709 13:13:06.049870  1893 consensus_peers.cc:597] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 -> Peer 7d84ce79592440a4bed9a3e8ccb48a69 (127.21.244.1:46883): Couldn't send request to peer 7d84ce79592440a4bed9a3e8ccb48a69. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:46883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:06.051599  1894 consensus_peers.cc:597] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 -> Peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Couldn't send request to peer f0ba87a2379743149a9508b8ad634cae. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:46399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.072007 22480 tablet_server.cc:179] TabletServer@127.21.244.3:0 shutting down...
I20260709 13:13:06.100785 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:06.101884 22480 tablet_replica.cc:333] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.103086 22480 raft_consensus.cc:2243] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.103967 22480 raft_consensus.cc:2272] T d6dab56252f146dba10732aa254f4ce7 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.106621 22480 tablet_replica.cc:333] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.107494 22480 raft_consensus.cc:2243] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.108078 22480 raft_consensus.cc:2272] T 83062d2678eb49f5a277d536680db37a P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.110514 22480 tablet_replica.cc:333] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.111162 22480 raft_consensus.cc:2243] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.111647 22480 raft_consensus.cc:2272] T b660273fdd3c40cc90f91a7f58349df5 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.113682 22480 tablet_replica.cc:333] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.114303 22480 raft_consensus.cc:2243] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.114735 22480 raft_consensus.cc:2272] T 08131c16fd9743d5ab94e04fbbaecee4 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.116730 22480 tablet_replica.cc:333] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.117278 22480 raft_consensus.cc:2243] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.118021 22480 raft_consensus.cc:2272] T 6690e34721914449bf95f1635e24ce8a P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.120002 22480 tablet_replica.cc:333] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.120520 22480 raft_consensus.cc:2243] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.120968 22480 raft_consensus.cc:2272] T 49ba430145064203a2f793635f1a0e3d P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.122882 22480 tablet_replica.cc:333] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.123411 22480 raft_consensus.cc:2243] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.124239 22480 raft_consensus.cc:2272] T e5d03af4eb0c41a8b4d8c30c71548102 P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.126245 22480 tablet_replica.cc:333] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.126824 22480 raft_consensus.cc:2243] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.127278 22480 raft_consensus.cc:2272] T 8da96cacabf1428cb89f110eafb7f5ae P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.129385 22480 tablet_replica.cc:333] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.129971 22480 raft_consensus.cc:2243] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.130440 22480 raft_consensus.cc:2272] T 964f8309fb664b0e882a7bdae4e7bedc P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.132534 22480 tablet_replica.cc:333] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.133095 22480 raft_consensus.cc:2243] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.133839 22480 raft_consensus.cc:2272] T 8beaed1e7006424e9876c81ac4b79958 P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.136464 22480 tablet_replica.cc:333] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.137038 22480 raft_consensus.cc:2243] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.138137 22480 raft_consensus.cc:2272] T bce427dc947841f08cb1639fd9be063d P 40fbbe9948ea487489997bbeed3f30b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:06.138697  1894 consensus_peers.cc:597] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 -> Peer f0ba87a2379743149a9508b8ad634cae (127.21.244.2:46399): Couldn't send request to peer f0ba87a2379743149a9508b8ad634cae. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:46399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.140726 22480 tablet_replica.cc:333] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.141358 22480 raft_consensus.cc:2243] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.142146 22480 raft_consensus.cc:2272] T 91bdb66bf92b44ea944b0baa79e108b6 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.144448 22480 tablet_replica.cc:333] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.145095 22480 raft_consensus.cc:2243] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.145587 22480 raft_consensus.cc:2272] T e64592f23f4b4f14a625714595608a7c P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.147869 22480 tablet_replica.cc:333] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.148512 22480 raft_consensus.cc:2243] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.149264 22480 raft_consensus.cc:2272] T cd46f30d2b024cf4b6d7ad97e2e82c7f P 40fbbe9948ea487489997bbeed3f30b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.151293 22480 tablet_replica.cc:333] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.151948 22480 raft_consensus.cc:2243] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.152407 22480 raft_consensus.cc:2272] T 1bb22b538cb14452b67cf0442352ea21 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.154443 22480 tablet_replica.cc:333] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.154973 22480 raft_consensus.cc:2243] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.155423 22480 raft_consensus.cc:2272] T f023cfc6395d4aed82163043c9ed9ec1 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.158179 22480 tablet_replica.cc:333] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.158968 22480 raft_consensus.cc:2243] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.159533 22480 raft_consensus.cc:2272] T 8a160b0f55ec47d18cffc7e2ec0b0023 P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.161808 22480 tablet_replica.cc:333] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0: stopping tablet replica
I20260709 13:13:06.162318 22480 raft_consensus.cc:2243] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.162801 22480 raft_consensus.cc:2272] T a8d30b7afca64b948b52677694480b2e P 40fbbe9948ea487489997bbeed3f30b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.204037 22480 tablet_server.cc:196] TabletServer@127.21.244.3:0 shutdown complete.
I20260709 13:13:06.238828 22480 master.cc:562] Master@127.21.244.62:40225 shutting down...
I20260709 13:13:06.264742 22480 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.265379 22480 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.265762 22480 tablet_replica.cc:333] T 00000000000000000000000000000000 P 13d01bf08bd947c4960cd7188858dcad: stopping tablet replica
I20260709 13:13:06.289116 22480 master.cc:584] Master@127.21.244.62:40225 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12946 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:13:06.351588 22480 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.244.62:44567
I20260709 13:13:06.353096 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:06.359858  2240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:06.360860  2242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:06.363504  2239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:06.365021 22480 server_base.cc:1061] running on GCE node
I20260709 13:13:06.366078 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:06.366263 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:06.366469 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602786366435 us; error 0 us; skew 500 ppm
I20260709 13:13:06.367002 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:06.369803 22480 webserver.cc:533] Webserver started at http://127.21.244.62:36207/ using document root <none> and password file <none>
I20260709 13:13:06.370337 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:06.370548 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:06.370836 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:06.372094 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/master-0-root/instance:
uuid: "749463795b004f4b8e571bcc3caab9fe"
format_stamp: "Formatted at 2026-07-09 13:13:06 on dist-test-slave-j314"
I20260709 13:13:06.376968 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:13:06.380838  2247 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:06.381697 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:13:06.382002 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/master-0-root
uuid: "749463795b004f4b8e571bcc3caab9fe"
format_stamp: "Formatted at 2026-07-09 13:13:06 on dist-test-slave-j314"
I20260709 13:13:06.382277 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:06.392648 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:06.393946 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:06.435321 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.62:44567
I20260709 13:13:06.435442  2298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.62:44567 every 8 connection(s)
I20260709 13:13:06.440018  2299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:06.452451  2299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe: Bootstrap starting.
I20260709 13:13:06.458740  2299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:06.464713  2299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe: No bootstrap required, opened a new log
I20260709 13:13:06.467090  2299 raft_consensus.cc:359] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749463795b004f4b8e571bcc3caab9fe" member_type: VOTER }
I20260709 13:13:06.467492  2299 raft_consensus.cc:385] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:06.467671  2299 raft_consensus.cc:740] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 749463795b004f4b8e571bcc3caab9fe, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.468278  2299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749463795b004f4b8e571bcc3caab9fe" member_type: VOTER }
I20260709 13:13:06.468701  2299 raft_consensus.cc:399] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:06.468890  2299 raft_consensus.cc:493] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:06.469118  2299 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:06.474380  2299 raft_consensus.cc:515] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749463795b004f4b8e571bcc3caab9fe" member_type: VOTER }
I20260709 13:13:06.474893  2299 leader_election.cc:304] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 749463795b004f4b8e571bcc3caab9fe; no voters: 
I20260709 13:13:06.476204  2299 leader_election.cc:290] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:06.476811  2302 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:06.478431  2302 raft_consensus.cc:697] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [term 1 LEADER]: Becoming Leader. State: Replica: 749463795b004f4b8e571bcc3caab9fe, State: Running, Role: LEADER
I20260709 13:13:06.479245  2299 sys_catalog.cc:565] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:06.479184  2302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749463795b004f4b8e571bcc3caab9fe" member_type: VOTER }
I20260709 13:13:06.484573  2303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "749463795b004f4b8e571bcc3caab9fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749463795b004f4b8e571bcc3caab9fe" member_type: VOTER } }
I20260709 13:13:06.484680  2304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 749463795b004f4b8e571bcc3caab9fe. Latest consensus state: current_term: 1 leader_uuid: "749463795b004f4b8e571bcc3caab9fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749463795b004f4b8e571bcc3caab9fe" member_type: VOTER } }
I20260709 13:13:06.485599  2303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:06.485648  2304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:06.490057  2310 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:06.495363  2310 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:06.497001 22480 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:06.504812  2310 catalog_manager.cc:1383] Generated new cluster ID: e3c82988d23e40e3920daadfea6f6ef9
I20260709 13:13:06.505141  2310 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:06.521288  2310 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:06.522697  2310 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:06.538214  2310 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe: Generated new TSK 0
I20260709 13:13:06.538856  2310 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:06.564178 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:06.571157  2321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:06.571448  2320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:06.573055  2323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:06.573470 22480 server_base.cc:1061] running on GCE node
I20260709 13:13:06.574576 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:06.574803 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:06.574980 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602786574961 us; error 0 us; skew 500 ppm
I20260709 13:13:06.575531 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:06.577931 22480 webserver.cc:533] Webserver started at http://127.21.244.1:42313/ using document root <none> and password file <none>
I20260709 13:13:06.578434 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:06.578629 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:06.578905 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:06.580093 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-0-root/instance:
uuid: "1993d204f0334787961668bbfe4c7617"
format_stamp: "Formatted at 2026-07-09 13:13:06 on dist-test-slave-j314"
I20260709 13:13:06.585036 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:13:06.588467  2328 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:06.589224 22480 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:06.589535 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-0-root
uuid: "1993d204f0334787961668bbfe4c7617"
format_stamp: "Formatted at 2026-07-09 13:13:06 on dist-test-slave-j314"
I20260709 13:13:06.589833 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:06.607633 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:06.608973 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:06.610495 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:06.612874 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:06.613095 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:06.613353 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:06.613551 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:06.656936 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.1:44041
I20260709 13:13:06.657052  2390 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.1:44041 every 8 connection(s)
I20260709 13:13:06.662298 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:06.669763  2395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:06.671831  2396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:06.674441 22480 server_base.cc:1061] running on GCE node
W20260709 13:13:06.674664  2398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:06.675781 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:06.676023 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:06.676224 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602786676209 us; error 0 us; skew 500 ppm
I20260709 13:13:06.676784 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:06.679509 22480 webserver.cc:533] Webserver started at http://127.21.244.2:40849/ using document root <none> and password file <none>
I20260709 13:13:06.680051 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:06.680280 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:06.680574 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:06.682129 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-1-root/instance:
uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
format_stamp: "Formatted at 2026-07-09 13:13:06 on dist-test-slave-j314"
I20260709 13:13:06.683307  2391 heartbeater.cc:344] Connected to a master server at 127.21.244.62:44567
I20260709 13:13:06.683887  2391 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:06.684689  2391 heartbeater.cc:507] Master 127.21.244.62:44567 requested a full tablet report, sending...
I20260709 13:13:06.686937  2264 ts_manager.cc:194] Registered new tserver with Master: 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041)
I20260709 13:13:06.687971 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:13:06.688874  2264 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43052
I20260709 13:13:06.692309  2403 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:06.693198 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:13:06.693513 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-1-root
uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
format_stamp: "Formatted at 2026-07-09 13:13:06 on dist-test-slave-j314"
I20260709 13:13:06.693769 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:06.711500 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:06.712828 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:06.714433 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:06.716888 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:06.717137 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:06.717393 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:06.717572 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:06.761888 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.2:39209
I20260709 13:13:06.761994  2465 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.2:39209 every 8 connection(s)
I20260709 13:13:06.766841 22480 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:06.774680  2469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:06.777501  2470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:06.778669 22480 server_base.cc:1061] running on GCE node
W20260709 13:13:06.778545  2472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:06.780140 22480 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:06.780524 22480 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:06.780779 22480 hybrid_clock.cc:648] HybridClock initialized: now 1783602786780757 us; error 0 us; skew 500 ppm
I20260709 13:13:06.781563 22480 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:06.781679  2466 heartbeater.cc:344] Connected to a master server at 127.21.244.62:44567
I20260709 13:13:06.782462  2466 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:06.783625  2466 heartbeater.cc:507] Master 127.21.244.62:44567 requested a full tablet report, sending...
I20260709 13:13:06.784945 22480 webserver.cc:533] Webserver started at http://127.21.244.3:36403/ using document root <none> and password file <none>
I20260709 13:13:06.785727 22480 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:06.785988 22480 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:06.786350 22480 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:06.786448  2264 ts_manager.cc:194] Registered new tserver with Master: 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:06.788151 22480 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-2-root/instance:
uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
format_stamp: "Formatted at 2026-07-09 13:13:06 on dist-test-slave-j314"
I20260709 13:13:06.788718  2264 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43064
I20260709 13:13:06.794087 22480 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:06.798067  2477 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:06.798983 22480 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:13:06.799266 22480 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-2-root
uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
format_stamp: "Formatted at 2026-07-09 13:13:06 on dist-test-slave-j314"
I20260709 13:13:06.799527 22480 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0AG4kF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602440417847-22480-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:06.810300 22480 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:06.811482 22480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:06.813007 22480 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:06.815405 22480 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:06.815601 22480 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:06.816004 22480 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:06.816152 22480 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:06.859696 22480 rpc_server.cc:307] RPC server started. Bound to: 127.21.244.3:45657
I20260709 13:13:06.859941  2539 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.244.3:45657 every 8 connection(s)
I20260709 13:13:06.874493  2540 heartbeater.cc:344] Connected to a master server at 127.21.244.62:44567
I20260709 13:13:06.875011  2540 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:06.875880  2540 heartbeater.cc:507] Master 127.21.244.62:44567 requested a full tablet report, sending...
I20260709 13:13:06.878021  2264 ts_manager.cc:194] Registered new tserver with Master: ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:06.878156 22480 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015085244s
I20260709 13:13:06.880071  2264 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43080
I20260709 13:13:06.905725  2264 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43086:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:06.908445  2264 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:07.005546  2356 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6704d00dbc4b0e91e33a41047deed0 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:07.006378  2355 tablet_service.cc:1511] Processing CreateTablet for tablet 65ee672f4a1e4657b608c22e4ee6a37a (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:07.007187  2356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6704d00dbc4b0e91e33a41047deed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.008008  2355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ee672f4a1e4657b608c22e4ee6a37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.008307  2350 tablet_service.cc:1511] Processing CreateTablet for tablet 8546a5d963d54c9eb7b74a8787ee0c16 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:07.009711  2351 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc9731236294c21ab73f680823788d0 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:07.011448  2349 tablet_service.cc:1511] Processing CreateTablet for tablet 93b67cb5f0ab48fab32cb4ad378278a4 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:07.012396  2352 tablet_service.cc:1511] Processing CreateTablet for tablet 79c28ee28e36491daf04910e43d6e7b3 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:07.009786  2350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8546a5d963d54c9eb7b74a8787ee0c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.012909  2354 tablet_service.cc:1511] Processing CreateTablet for tablet 68201d45db954701af8efa3fd17c86dd (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:07.016450  2498 tablet_service.cc:1511] Processing CreateTablet for tablet 93b67cb5f0ab48fab32cb4ad378278a4 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:07.017058  2504 tablet_service.cc:1511] Processing CreateTablet for tablet 65ee672f4a1e4657b608c22e4ee6a37a (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:07.018057  2498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b67cb5f0ab48fab32cb4ad378278a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.019799  2503 tablet_service.cc:1511] Processing CreateTablet for tablet 68201d45db954701af8efa3fd17c86dd (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:07.021433  2503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68201d45db954701af8efa3fd17c86dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.021106  2348 tablet_service.cc:1511] Processing CreateTablet for tablet c96f816653034ea2b929469c56c4bc44 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:07.023685  2497 tablet_service.cc:1511] Processing CreateTablet for tablet c96f816653034ea2b929469c56c4bc44 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:07.015265  2353 tablet_service.cc:1511] Processing CreateTablet for tablet 65d50a118f7946b881880ed5b1959fc2 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:07.025238  2497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96f816653034ea2b929469c56c4bc44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.025046  2502 tablet_service.cc:1511] Processing CreateTablet for tablet 65d50a118f7946b881880ed5b1959fc2 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:07.026604  2502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d50a118f7946b881880ed5b1959fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.026971  2499 tablet_service.cc:1511] Processing CreateTablet for tablet 8546a5d963d54c9eb7b74a8787ee0c16 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:07.028379  2499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8546a5d963d54c9eb7b74a8787ee0c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.028924  2501 tablet_service.cc:1511] Processing CreateTablet for tablet 79c28ee28e36491daf04910e43d6e7b3 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:07.030280  2501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c28ee28e36491daf04910e43d6e7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.032862  2500 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc9731236294c21ab73f680823788d0 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:07.034217  2500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc9731236294c21ab73f680823788d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.015347  2505 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6704d00dbc4b0e91e33a41047deed0 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:07.036945  2505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6704d00dbc4b0e91e33a41047deed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.044395  2504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ee672f4a1e4657b608c22e4ee6a37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.013923  2352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c28ee28e36491daf04910e43d6e7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.048465  2353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d50a118f7946b881880ed5b1959fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.051086  2351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc9731236294c21ab73f680823788d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.053505  2354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68201d45db954701af8efa3fd17c86dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.064157  2348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96f816653034ea2b929469c56c4bc44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.068162  2349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b67cb5f0ab48fab32cb4ad378278a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.072271  2429 tablet_service.cc:1511] Processing CreateTablet for tablet 68201d45db954701af8efa3fd17c86dd (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:07.073036  2431 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6704d00dbc4b0e91e33a41047deed0 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:07.074011  2429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68201d45db954701af8efa3fd17c86dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.075623  2430 tablet_service.cc:1511] Processing CreateTablet for tablet 65ee672f4a1e4657b608c22e4ee6a37a (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:07.076541  2428 tablet_service.cc:1511] Processing CreateTablet for tablet 65d50a118f7946b881880ed5b1959fc2 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:07.077349  2430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ee672f4a1e4657b608c22e4ee6a37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.078118  2428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d50a118f7946b881880ed5b1959fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.080564  2431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6704d00dbc4b0e91e33a41047deed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.081038  2426 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc9731236294c21ab73f680823788d0 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:07.082389  2426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc9731236294c21ab73f680823788d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.084964  2425 tablet_service.cc:1511] Processing CreateTablet for tablet 8546a5d963d54c9eb7b74a8787ee0c16 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:07.086416  2425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8546a5d963d54c9eb7b74a8787ee0c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.089303  2423 tablet_service.cc:1511] Processing CreateTablet for tablet c96f816653034ea2b929469c56c4bc44 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:07.090685  2423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96f816653034ea2b929469c56c4bc44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.092535  2424 tablet_service.cc:1511] Processing CreateTablet for tablet 93b67cb5f0ab48fab32cb4ad378278a4 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:07.093931  2424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b67cb5f0ab48fab32cb4ad378278a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.095773  2427 tablet_service.cc:1511] Processing CreateTablet for tablet 79c28ee28e36491daf04910e43d6e7b3 (DEFAULT_TABLE table=test-workload [id=b2838d86979e4629a5a362155871cbdd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:07.097193  2427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c28ee28e36491daf04910e43d6e7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.152227  2556 tablet_bootstrap.cc:492] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:07.159193  2556 tablet_bootstrap.cc:654] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.166180  2556 tablet_bootstrap.cc:492] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:07.167856  2556 ts_tablet_manager.cc:1403] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:13:07.171072  2556 raft_consensus.cc:359] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.171921  2556 raft_consensus.cc:385] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.172248  2556 raft_consensus.cc:740] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.173177  2556 consensus_queue.cc:260] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.189487  2556 ts_tablet_manager.cc:1434] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.005s
I20260709 13:13:07.190516  2391 heartbeater.cc:499] Master 127.21.244.62:44567 was elected leader, sending a full tablet report...
I20260709 13:13:07.191401  2556 tablet_bootstrap.cc:492] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:07.212174  2556 tablet_bootstrap.cc:654] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.226361  2555 tablet_bootstrap.cc:492] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:07.230139  2559 tablet_bootstrap.cc:492] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:07.236577  2559 tablet_bootstrap.cc:654] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.237360  2555 tablet_bootstrap.cc:654] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.237572  2556 tablet_bootstrap.cc:492] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:07.238209  2556 ts_tablet_manager.cc:1403] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.004s
I20260709 13:13:07.241374  2556 raft_consensus.cc:359] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.241961  2556 raft_consensus.cc:385] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.242204  2556 raft_consensus.cc:740] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.242237  2559 tablet_bootstrap.cc:492] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:07.242714  2555 tablet_bootstrap.cc:492] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:07.242918  2559 ts_tablet_manager.cc:1403] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:13:07.243245  2555 ts_tablet_manager.cc:1403] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.006s
I20260709 13:13:07.243059  2556 consensus_queue.cc:260] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.245359  2556 ts_tablet_manager.cc:1434] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:07.246399  2556 tablet_bootstrap.cc:492] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:07.246207  2559 raft_consensus.cc:359] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:07.247102  2559 raft_consensus.cc:385] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.246439  2555 raft_consensus.cc:359] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.247435  2559 raft_consensus.cc:740] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.247514  2555 raft_consensus.cc:385] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.247943  2555 raft_consensus.cc:740] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.248476  2559 consensus_queue.cc:260] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:07.248883  2555 consensus_queue.cc:260] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.254007  2556 tablet_bootstrap.cc:654] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.258985  2559 ts_tablet_manager.cc:1434] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:13:07.260859  2540 heartbeater.cc:499] Master 127.21.244.62:44567 was elected leader, sending a full tablet report...
I20260709 13:13:07.261283  2555 ts_tablet_manager.cc:1434] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:13:07.261831  2556 tablet_bootstrap.cc:492] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:07.262311  2556 ts_tablet_manager.cc:1403] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.009s
I20260709 13:13:07.262356  2555 tablet_bootstrap.cc:492] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:07.264067  2466 heartbeater.cc:499] Master 127.21.244.62:44567 was elected leader, sending a full tablet report...
I20260709 13:13:07.265067  2556 raft_consensus.cc:359] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.265827  2556 raft_consensus.cc:385] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.266121  2556 raft_consensus.cc:740] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.266907  2556 consensus_queue.cc:260] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.271610  2556 ts_tablet_manager.cc:1434] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:07.272419  2555 tablet_bootstrap.cc:654] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.272809  2556 tablet_bootstrap.cc:492] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:07.274354  2559 tablet_bootstrap.cc:492] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:07.280344  2556 tablet_bootstrap.cc:654] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.282573  2559 tablet_bootstrap.cc:654] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.299625  2558 raft_consensus.cc:493] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.300531  2558 raft_consensus.cc:515] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.311844  2558 leader_election.cc:290] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.312633  2558 raft_consensus.cc:493] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.313263  2558 raft_consensus.cc:515] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.332602  2558 leader_election.cc:290] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.388665  2555 tablet_bootstrap.cc:492] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:07.389302  2555 ts_tablet_manager.cc:1403] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.127s	user 0.053s	sys 0.066s
I20260709 13:13:07.390301  2556 tablet_bootstrap.cc:492] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:07.390759  2559 tablet_bootstrap.cc:492] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:07.390959  2556 ts_tablet_manager.cc:1403] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.118s	user 0.059s	sys 0.042s
I20260709 13:13:07.391583  2559 ts_tablet_manager.cc:1403] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.117s	user 0.048s	sys 0.053s
I20260709 13:13:07.392428  2514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d50a118f7946b881880ed5b1959fc2" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:07.392526  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8546a5d963d54c9eb7b74a8787ee0c16" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:07.392536  2555 raft_consensus.cc:359] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.393546  2555 raft_consensus.cc:385] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.393527  2515 raft_consensus.cc:2468] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 0.
I20260709 13:13:07.395403  2330 leader_election.cc:304] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:07.395428  2556 raft_consensus.cc:359] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.395563  2559 raft_consensus.cc:359] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.396826  2556 raft_consensus.cc:385] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.396816  2555 raft_consensus.cc:740] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.397329  2558 raft_consensus.cc:2804] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:07.397552  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8546a5d963d54c9eb7b74a8787ee0c16" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:07.399200  2556 raft_consensus.cc:740] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.399459  2558 raft_consensus.cc:493] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.400019  2558 raft_consensus.cc:3060] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.398574  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d50a118f7946b881880ed5b1959fc2" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:07.400206  2556 consensus_queue.cc:260] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.400019  2555 consensus_queue.cc:260] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.401487  2514 raft_consensus.cc:2468] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 0.
I20260709 13:13:07.399158  2559 raft_consensus.cc:385] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.402166  2559 raft_consensus.cc:740] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.403097  2556 ts_tablet_manager.cc:1434] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:13:07.403054  2559 consensus_queue.cc:260] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.404608  2330 leader_election.cc:304] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:07.405606  2569 raft_consensus.cc:2804] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:07.405939  2555 ts_tablet_manager.cc:1434] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:13:07.406160  2569 raft_consensus.cc:493] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.406570  2569 raft_consensus.cc:3060] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.407019  2555 tablet_bootstrap.cc:492] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:07.413264  2555 tablet_bootstrap.cc:654] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:07.406579  2331 leader_election.cc:343] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:07.415810  2331 leader_election.cc:343] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.414500  2569 raft_consensus.cc:515] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.404289  2556 tablet_bootstrap.cc:492] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:07.414427  2558 raft_consensus.cc:515] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.418977  2559 ts_tablet_manager.cc:1434] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:13:07.423323  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d50a118f7946b881880ed5b1959fc2" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:07.423624  2514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d50a118f7946b881880ed5b1959fc2" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:07.424360  2514 raft_consensus.cc:3060] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.424921  2569 leader_election.cc:290] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
W20260709 13:13:07.425117  2331 leader_election.cc:343] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.426697  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8546a5d963d54c9eb7b74a8787ee0c16" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:07.426928  2559 tablet_bootstrap.cc:492] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:07.427042  2558 leader_election.cc:290] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.427219  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8546a5d963d54c9eb7b74a8787ee0c16" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:07.428023  2515 raft_consensus.cc:3060] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:07.428148  2331 leader_election.cc:343] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.423322  2556 tablet_bootstrap.cc:654] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.436007  2514 raft_consensus.cc:2468] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 1.
I20260709 13:13:07.437438  2330 leader_election.cc:304] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:07.438912  2558 raft_consensus.cc:2804] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:07.439402  2558 raft_consensus.cc:697] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:07.422922  2555 tablet_bootstrap.cc:492] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:07.435432  2559 tablet_bootstrap.cc:654] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.440706  2556 tablet_bootstrap.cc:492] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:07.440853  2555 ts_tablet_manager.cc:1403] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.003s
I20260709 13:13:07.441291  2556 ts_tablet_manager.cc:1403] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.009s
I20260709 13:13:07.441181  2558 consensus_queue.cc:237] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.444406  2555 raft_consensus.cc:359] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.444962  2556 raft_consensus.cc:359] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:07.446605  2555 raft_consensus.cc:385] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.446689  2556 raft_consensus.cc:385] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.447062  2555 raft_consensus.cc:740] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.447278  2556 raft_consensus.cc:740] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.448264  2555 consensus_queue.cc:260] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.448454  2556 consensus_queue.cc:260] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:07.451014  2556 ts_tablet_manager.cc:1434] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:07.445844  2515 raft_consensus.cc:2468] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 1.
I20260709 13:13:07.452111  2264 catalog_manager.cc:5697] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.453650  2330 leader_election.cc:304] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:07.455343  2558 raft_consensus.cc:2804] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:07.456387  2558 raft_consensus.cc:697] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:07.457049  2555 ts_tablet_manager.cc:1434] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:13:07.452180  2556 tablet_bootstrap.cc:492] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:07.458201  2555 tablet_bootstrap.cc:492] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:07.457312  2558 consensus_queue.cc:237] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.467252  2555 tablet_bootstrap.cc:654] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.469355  2556 tablet_bootstrap.cc:654] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.474088  2555 tablet_bootstrap.cc:492] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:07.474766  2555 ts_tablet_manager.cc:1403] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:13:07.478400  2559 tablet_bootstrap.cc:492] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:07.479190  2559 ts_tablet_manager.cc:1403] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.007s
I20260709 13:13:07.483397  2559 raft_consensus.cc:359] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.484536  2559 raft_consensus.cc:385] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.484925  2559 raft_consensus.cc:740] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.485935  2559 consensus_queue.cc:260] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
W20260709 13:13:07.491920  2312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:07.494109  2559 ts_tablet_manager.cc:1434] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:13:07.490840  2555 raft_consensus.cc:359] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.496244  2555 raft_consensus.cc:385] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.496649  2555 raft_consensus.cc:740] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.497887  2555 consensus_queue.cc:260] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.500007  2559 tablet_bootstrap.cc:492] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:07.502985  2555 ts_tablet_manager.cc:1434] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:13:07.504580  2555 tablet_bootstrap.cc:492] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:07.508430  2559 tablet_bootstrap.cc:654] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.514631  2556 tablet_bootstrap.cc:492] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:07.515180  2556 ts_tablet_manager.cc:1403] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.063s	user 0.035s	sys 0.017s
I20260709 13:13:07.516821  2555 tablet_bootstrap.cc:654] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.518275  2556 raft_consensus.cc:359] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.519098  2556 raft_consensus.cc:385] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.519402  2556 raft_consensus.cc:740] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.520622  2556 consensus_queue.cc:260] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.521605  2559 tablet_bootstrap.cc:492] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:07.522199  2559 ts_tablet_manager.cc:1403] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 13:13:07.524179  2556 ts_tablet_manager.cc:1434] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:13:07.525203  2559 raft_consensus.cc:359] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.525684  2556 tablet_bootstrap.cc:492] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:07.525967  2559 raft_consensus.cc:385] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.526365  2559 raft_consensus.cc:740] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.527374  2559 consensus_queue.cc:260] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.532099  2559 ts_tablet_manager.cc:1434] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:13:07.533349  2559 tablet_bootstrap.cc:492] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:07.535760  2556 tablet_bootstrap.cc:654] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.538722  2555 tablet_bootstrap.cc:492] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:07.539381  2555 ts_tablet_manager.cc:1403] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.010s
I20260709 13:13:07.543340  2555 raft_consensus.cc:359] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.544262  2559 tablet_bootstrap.cc:654] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.544414  2555 raft_consensus.cc:385] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.545040  2555 raft_consensus.cc:740] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.546029  2555 consensus_queue.cc:260] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.548518  2556 tablet_bootstrap.cc:492] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:07.548740  2555 ts_tablet_manager.cc:1434] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:07.549117  2556 ts_tablet_manager.cc:1403] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 13:13:07.549875  2555 tablet_bootstrap.cc:492] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:07.552551  2558 raft_consensus.cc:493] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.553282  2558 raft_consensus.cc:515] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.556126  2559 tablet_bootstrap.cc:492] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:07.556493  2555 tablet_bootstrap.cc:654] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.556123  2556 raft_consensus.cc:359] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.556847  2559 ts_tablet_manager.cc:1403] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.001s
I20260709 13:13:07.557192  2556 raft_consensus.cc:385] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.557227  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96f816653034ea2b929469c56c4bc44" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:07.557737  2556 raft_consensus.cc:740] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
W20260709 13:13:07.559001  2331 leader_election.cc:343] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.558723  2556 consensus_queue.cc:260] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.560242  2558 leader_election.cc:290] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.560163  2559 raft_consensus.cc:359] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.560578  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96f816653034ea2b929469c56c4bc44" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:07.561076  2559 raft_consensus.cc:385] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.561475  2559 raft_consensus.cc:740] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.562356  2559 consensus_queue.cc:260] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
W20260709 13:13:07.562572  2330 leader_election.cc:343] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.563254  2330 leader_election.cc:304] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1993d204f0334787961668bbfe4c7617; no voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0
I20260709 13:13:07.564442  2558 raft_consensus.cc:2749] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:07.564993  2556 ts_tablet_manager.cc:1434] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:13:07.566512  2556 tablet_bootstrap.cc:492] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:07.567082  2559 ts_tablet_manager.cc:1434] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:07.568241  2559 tablet_bootstrap.cc:492] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:07.574962  2559 tablet_bootstrap.cc:654] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.576119  2556 tablet_bootstrap.cc:654] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.576695  2264 catalog_manager.cc:5697] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.578567  2555 tablet_bootstrap.cc:492] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:07.579135  2555 ts_tablet_manager.cc:1403] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.006s
I20260709 13:13:07.581440  2564 raft_consensus.cc:493] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.582095  2564 raft_consensus.cc:515] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.582250  2555 raft_consensus.cc:359] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.583169  2555 raft_consensus.cc:385] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.583491  2555 raft_consensus.cc:740] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.584426  2555 consensus_queue.cc:260] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.587852  2555 ts_tablet_manager.cc:1434] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:13:07.588848  2555 tablet_bootstrap.cc:492] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:07.592185  2564 leader_election.cc:290] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:07.596843  2555 tablet_bootstrap.cc:654] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.598212  2556 tablet_bootstrap.cc:492] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:07.598760  2556 ts_tablet_manager.cc:1403] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.012s
I20260709 13:13:07.601423  2556 raft_consensus.cc:359] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.602123  2556 raft_consensus.cc:385] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.602388  2556 raft_consensus.cc:740] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.602255  2558 raft_consensus.cc:493] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.603171  2558 raft_consensus.cc:515] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.605765  2558 leader_election.cc:290] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.606554  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ee672f4a1e4657b608c22e4ee6a37a" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:07.607556  2440 raft_consensus.cc:2468] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 0.
I20260709 13:13:07.609416  2331 leader_election.cc:304] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:07.610747  2558 raft_consensus.cc:2804] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:07.611159  2558 raft_consensus.cc:493] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.611505  2558 raft_consensus.cc:3060] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.613654  2556 consensus_queue.cc:260] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.617483  2559 tablet_bootstrap.cc:492] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:07.618283  2559 ts_tablet_manager.cc:1403] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.009s
I20260709 13:13:07.619040  2556 ts_tablet_manager.cc:1434] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:13:07.620157  2556 tablet_bootstrap.cc:492] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:07.622653  2559 raft_consensus.cc:359] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.623692  2559 raft_consensus.cc:385] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.625993  2556 tablet_bootstrap.cc:654] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.631742  2559 raft_consensus.cc:740] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.634552  2558 raft_consensus.cc:515] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.636034  2559 consensus_queue.cc:260] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.638401  2558 leader_election.cc:290] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.643636  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ee672f4a1e4657b608c22e4ee6a37a" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:07.644371  2440 raft_consensus.cc:3060] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.645807  2556 tablet_bootstrap.cc:492] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:07.646867  2556 ts_tablet_manager.cc:1403] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 13:13:07.648070  2564 raft_consensus.cc:493] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.646271  2559 ts_tablet_manager.cc:1434] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.004s
I20260709 13:13:07.648628  2564 raft_consensus.cc:515] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.649626  2559 tablet_bootstrap.cc:492] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:07.650852  2564 leader_election.cc:290] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:07.652791  2440 raft_consensus.cc:2468] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 1.
I20260709 13:13:07.654145  2331 leader_election.cc:304] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:07.655128  2558 raft_consensus.cc:2804] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:07.655604  2558 raft_consensus.cc:697] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:07.656225  2556 raft_consensus.cc:359] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.656492  2558 consensus_queue.cc:237] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.657205  2556 raft_consensus.cc:385] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.657608  2556 raft_consensus.cc:740] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.658507  2556 consensus_queue.cc:260] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.661301  2556 ts_tablet_manager.cc:1434] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:07.665721  2559 tablet_bootstrap.cc:654] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.666668  2264 catalog_manager.cc:5697] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.668949  2555 tablet_bootstrap.cc:492] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:07.669576  2555 ts_tablet_manager.cc:1403] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.032s
I20260709 13:13:07.672967  2555 raft_consensus.cc:359] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:07.673807  2555 raft_consensus.cc:385] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.674185  2555 raft_consensus.cc:740] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.674957  2555 consensus_queue.cc:260] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:07.677615  2555 ts_tablet_manager.cc:1434] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:07.678798  2555 tablet_bootstrap.cc:492] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:07.680219  2563 raft_consensus.cc:493] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.680814  2563 raft_consensus.cc:515] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.685750  2555 tablet_bootstrap.cc:654] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.688913  2559 tablet_bootstrap.cc:492] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:07.689280  2563 leader_election.cc:290] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.689491  2559 ts_tablet_manager.cc:1403] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.016s
I20260709 13:13:07.692937  2559 raft_consensus.cc:359] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.693713  2559 raft_consensus.cc:385] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.694020  2559 raft_consensus.cc:740] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.694425  2563 raft_consensus.cc:493] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.694772  2559 consensus_queue.cc:260] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.695176  2563 raft_consensus.cc:515] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:07.698076  2563 leader_election.cc:290] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657), 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041)
I20260709 13:13:07.701756  2558 raft_consensus.cc:493] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.702385  2558 raft_consensus.cc:515] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.704829  2558 leader_election.cc:290] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.706116  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68201d45db954701af8efa3fd17c86dd" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:07.706712  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6704d00dbc4b0e91e33a41047deed0" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:07.707666  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b67cb5f0ab48fab32cb4ad378278a4" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:07.707751  2366 raft_consensus.cc:2468] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:07.708396  2365 raft_consensus.cc:2468] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:07.709681  2559 ts_tablet_manager.cc:1434] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:13:07.709601  2406 leader_election.cc:304] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:07.708541  2440 raft_consensus.cc:2468] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 0.
I20260709 13:13:07.711201  2331 leader_election.cc:304] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:07.711326  2559 tablet_bootstrap.cc:492] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:07.713593  2558 raft_consensus.cc:2804] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:07.713990  2558 raft_consensus.cc:493] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.714355  2558 raft_consensus.cc:3060] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.718247  2559 tablet_bootstrap.cc:654] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.719785  2564 raft_consensus.cc:493] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.720412  2564 raft_consensus.cc:515] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.721159  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ee672f4a1e4657b608c22e4ee6a37a" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:07.722054  2515 raft_consensus.cc:2468] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 0.
I20260709 13:13:07.722460  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b67cb5f0ab48fab32cb4ad378278a4" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:07.722880  2514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ee672f4a1e4657b608c22e4ee6a37a" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:07.723248  2513 raft_consensus.cc:2468] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 0.
I20260709 13:13:07.723562  2514 raft_consensus.cc:3060] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.724279  2563 raft_consensus.cc:2804] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:07.724699  2563 raft_consensus.cc:493] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.725026  2563 raft_consensus.cc:3060] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.722497  2564 leader_election.cc:290] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:07.721079  2406 leader_election.cc:304] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:07.731989  2558 raft_consensus.cc:515] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.733875  2514 raft_consensus.cc:2468] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 1.
I20260709 13:13:07.736178  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b67cb5f0ab48fab32cb4ad378278a4" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:07.737082  2440 raft_consensus.cc:3060] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.743968  2599 raft_consensus.cc:493] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.745148  2569 raft_consensus.cc:493] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.744807  2599 raft_consensus.cc:515] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.745445  2555 tablet_bootstrap.cc:492] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:07.746071  2555 ts_tablet_manager.cc:1403] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.007s
I20260709 13:13:07.745726  2569 raft_consensus.cc:515] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.747944  2569 leader_election.cc:290] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.749058  2555 raft_consensus.cc:359] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.749795  2555 raft_consensus.cc:385] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.750069  2555 raft_consensus.cc:740] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.750180  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc9731236294c21ab73f680823788d0" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:07.750852  2441 raft_consensus.cc:2468] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 0.
I20260709 13:13:07.733639  2563 raft_consensus.cc:515] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.751688  2440 raft_consensus.cc:2468] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 1.
I20260709 13:13:07.762912  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b67cb5f0ab48fab32cb4ad378278a4" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:07.763540  2513 raft_consensus.cc:3060] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.752883  2331 leader_election.cc:304] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:07.765291  2559 tablet_bootstrap.cc:492] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:07.765408  2569 raft_consensus.cc:2804] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:07.765640  2331 leader_election.cc:304] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:07.756626  2555 consensus_queue.cc:260] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.757455  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc9731236294c21ab73f680823788d0" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:07.754004  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:07.756793  2514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc9731236294c21ab73f680823788d0" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:07.761888  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d50a118f7946b881880ed5b1959fc2" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:07.753235  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc9731236294c21ab73f680823788d0" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:07.771399  2441 raft_consensus.cc:2468] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 0.
I20260709 13:13:07.771750  2563 leader_election.cc:290] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.772486  2513 raft_consensus.cc:2468] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 1.
I20260709 13:13:07.757683  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:07.765890  2569 raft_consensus.cc:493] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.773200  2364 raft_consensus.cc:2468] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 0.
I20260709 13:13:07.752997  2439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b67cb5f0ab48fab32cb4ad378278a4" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:07.757848  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b67cb5f0ab48fab32cb4ad378278a4" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:07.774001  2569 raft_consensus.cc:3060] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.761371  2558 leader_election.cc:290] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.778355  2439 raft_consensus.cc:2393] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad9e746ba8874e58a9f2223e632ea4f0 in current term 1: Already voted for candidate 1993d204f0334787961668bbfe4c7617 in this term.
I20260709 13:13:07.760797  2601 raft_consensus.cc:2804] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:07.779438  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68201d45db954701af8efa3fd17c86dd" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:07.779755  2555 ts_tablet_manager.cc:1434] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.002s
I20260709 13:13:07.761812  2599 leader_election.cc:290] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.769018  2514 raft_consensus.cc:2468] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 0.
I20260709 13:13:07.776350  2366 raft_consensus.cc:2393] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad9e746ba8874e58a9f2223e632ea4f0 in current term 1: Already voted for candidate 1993d204f0334787961668bbfe4c7617 in this term.
I20260709 13:13:07.782334  2601 raft_consensus.cc:493] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.782804  2601 raft_consensus.cc:3060] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.782392  2555 tablet_bootstrap.cc:492] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:07.783766  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6704d00dbc4b0e91e33a41047deed0" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:07.784482  2515 raft_consensus.cc:2468] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:07.785308  2558 raft_consensus.cc:2804] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:07.785499  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68201d45db954701af8efa3fd17c86dd" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:07.786430  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d50a118f7946b881880ed5b1959fc2" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:07.786528  2366 raft_consensus.cc:3060] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.787271  2515 raft_consensus.cc:2393] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in current term 1: Already voted for candidate 1993d204f0334787961668bbfe4c7617 in this term.
I20260709 13:13:07.765882  2559 ts_tablet_manager.cc:1403] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.055s	user 0.027s	sys 0.022s
I20260709 13:13:07.790421  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68201d45db954701af8efa3fd17c86dd" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:07.791512  2558 raft_consensus.cc:697] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:07.793126  2558 consensus_queue.cc:237] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
W20260709 13:13:07.794230  2405 leader_election.cc:343] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.796278  2480 leader_election.cc:304] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:07.797305  2564 raft_consensus.cc:2804] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:07.797606  2480 leader_election.cc:343] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.797873  2564 raft_consensus.cc:493] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.797806  2559 raft_consensus.cc:359] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.798600  2559 raft_consensus.cc:385] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.798561  2564 raft_consensus.cc:3060] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.806546  2564 raft_consensus.cc:515] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.806857  2601 raft_consensus.cc:515] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:07.787290  2569 raft_consensus.cc:515] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.808884  2564 leader_election.cc:290] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:07.809144  2365 raft_consensus.cc:2393] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad9e746ba8874e58a9f2223e632ea4f0 in current term 1: Already voted for candidate 1993d204f0334787961668bbfe4c7617 in this term.
I20260709 13:13:07.807811  2559 raft_consensus.cc:740] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.810027  2569 leader_election.cc:290] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.798714  2480 leader_election.cc:304] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:07.810336  2559 consensus_queue.cc:260] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.811578  2480 leader_election.cc:304] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad9e746ba8874e58a9f2223e632ea4f0; no voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:07.806074  2406 leader_election.cc:304] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0
I20260709 13:13:07.812513  2588 raft_consensus.cc:2804] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:07.812919  2588 raft_consensus.cc:493] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.813287  2588 raft_consensus.cc:3060] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.813645  2563 raft_consensus.cc:3060] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.815646  2559 ts_tablet_manager.cc:1434] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:13:07.819470  2559 tablet_bootstrap.cc:492] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:07.818394  2564 raft_consensus.cc:2749] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:07.821501  2588 raft_consensus.cc:515] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
W20260709 13:13:07.824236  2331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.244.2:39209, user_credentials={real_user=slave}} blocked reactor thread for 58686.9us
W20260709 13:13:07.825284  2405 leader_election.cc:343] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.825973  2439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc9731236294c21ab73f680823788d0" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:07.826650  2439 raft_consensus.cc:3060] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.826828  2588 leader_election.cc:290] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:07.826994  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:07.827689  2365 raft_consensus.cc:3060] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.828449  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:07.828668  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc9731236294c21ab73f680823788d0" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:07.829432  2364 raft_consensus.cc:2393] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ad9e746ba8874e58a9f2223e632ea4f0 in current term 1: Already voted for candidate 1993d204f0334787961668bbfe4c7617 in this term.
I20260709 13:13:07.829967  2559 tablet_bootstrap.cc:654] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.833657  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc9731236294c21ab73f680823788d0" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:07.834590  2513 raft_consensus.cc:2393] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1993d204f0334787961668bbfe4c7617 in current term 1: Already voted for candidate ad9e746ba8874e58a9f2223e632ea4f0 in this term.
I20260709 13:13:07.834582  2439 raft_consensus.cc:2468] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 1.
I20260709 13:13:07.838387  2331 leader_election.cc:304] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:07.839282  2558 raft_consensus.cc:2804] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:07.839818  2558 raft_consensus.cc:697] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:07.840698  2558 consensus_queue.cc:237] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.842684  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc9731236294c21ab73f680823788d0" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:07.842418  2263 catalog_manager.cc:5697] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.843883  2441 raft_consensus.cc:2393] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ad9e746ba8874e58a9f2223e632ea4f0 in current term 1: Already voted for candidate 1993d204f0334787961668bbfe4c7617 in this term.
I20260709 13:13:07.845593  2601 leader_election.cc:290] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Requested vote from peers ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657), 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041)
I20260709 13:13:07.850756  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6704d00dbc4b0e91e33a41047deed0" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:07.851819  2513 raft_consensus.cc:3060] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.855051  2365 raft_consensus.cc:2468] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 1.
I20260709 13:13:07.856985  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6704d00dbc4b0e91e33a41047deed0" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:07.859598  2364 raft_consensus.cc:3060] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.862217  2366 raft_consensus.cc:2468] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:07.864334  2406 leader_election.cc:304] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: ad9e746ba8874e58a9f2223e632ea4f0
I20260709 13:13:07.863150  2555 tablet_bootstrap.cc:654] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.868005  2601 raft_consensus.cc:2804] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:07.868711  2601 raft_consensus.cc:697] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:07.869635  2601 consensus_queue.cc:237] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.870949  2559 tablet_bootstrap.cc:492] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:07.857982  2563 raft_consensus.cc:2749] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:07.871500  2559 ts_tablet_manager.cc:1403] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.013s
W20260709 13:13:07.871903  2480 leader_election.cc:343] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.872148  2262 catalog_manager.cc:5697] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.872784  2480 leader_election.cc:304] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad9e746ba8874e58a9f2223e632ea4f0; no voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:07.874348  2559 raft_consensus.cc:359] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.875099  2559 raft_consensus.cc:385] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.875314  2364 raft_consensus.cc:2468] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:07.876683  2406 leader_election.cc:304] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:07.877571  2555 tablet_bootstrap.cc:492] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:07.879014  2555 ts_tablet_manager.cc:1403] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.000s
I20260709 13:13:07.879395  2588 raft_consensus.cc:2749] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:07.877835  2563 raft_consensus.cc:2804] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:07.880406  2563 raft_consensus.cc:697] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:07.881243  2563 consensus_queue.cc:237] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:07.882175  2555 raft_consensus.cc:359] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.883045  2555 raft_consensus.cc:385] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.883301  2555 raft_consensus.cc:740] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.879562  2558 consensus_queue.cc:1048] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:13:07.883749  2480 leader_election.cc:304] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:07.875373  2559 raft_consensus.cc:740] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.885658  2559 consensus_queue.cc:260] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.886674  2513 raft_consensus.cc:2468] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:07.888329  2559 ts_tablet_manager.cc:1434] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:13:07.884115  2555 consensus_queue.cc:260] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.890089  2564 raft_consensus.cc:2804] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:07.890571  2564 raft_consensus.cc:697] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Becoming Leader. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Running, Role: LEADER
I20260709 13:13:07.891438  2564 consensus_queue.cc:237] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.895124  2555 ts_tablet_manager.cc:1434] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:13:07.904040  2263 catalog_manager.cc:5697] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.920385  2602 consensus_queue.cc:1048] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:07.921502  2264 catalog_manager.cc:5697] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:07.936393  2263 catalog_manager.cc:5697] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:07.951547  2564 raft_consensus.cc:493] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.952029  2563 raft_consensus.cc:493] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.952322  2564 raft_consensus.cc:515] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.952653  2563 raft_consensus.cc:515] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.954859  2563 leader_election.cc:290] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:07.956099  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:07.956112  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:07.956503  2439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96f816653034ea2b929469c56c4bc44" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:07.956126  2564 leader_election.cc:290] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:07.956163  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96f816653034ea2b929469c56c4bc44" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:07.957628  2439 raft_consensus.cc:2468] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 0.
I20260709 13:13:07.957283  2364 raft_consensus.cc:2393] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in current term 1: Already voted for candidate ad9e746ba8874e58a9f2223e632ea4f0 in this term.
I20260709 13:13:07.957854  2366 raft_consensus.cc:2468] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 0.
I20260709 13:13:07.959089  2480 leader_election.cc:304] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:07.959093  2406 leader_election.cc:304] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0
I20260709 13:13:07.960234  2563 raft_consensus.cc:3060] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.960238  2564 raft_consensus.cc:2804] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:07.960822  2564 raft_consensus.cc:493] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.961191  2564 raft_consensus.cc:3060] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.969002  2563 raft_consensus.cc:2749] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:07.969475  2564 raft_consensus.cc:515] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.971515  2564 leader_election.cc:290] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:07.972563  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96f816653034ea2b929469c56c4bc44" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:07.972760  2439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96f816653034ea2b929469c56c4bc44" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:07.973227  2366 raft_consensus.cc:3060] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.973402  2439 raft_consensus.cc:3060] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.979183  2366 raft_consensus.cc:2468] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 1.
I20260709 13:13:07.979183  2439 raft_consensus.cc:2468] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 1.
I20260709 13:13:07.980752  2480 leader_election.cc:304] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:07.981544  2564 raft_consensus.cc:2804] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:07.982002  2564 raft_consensus.cc:697] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Becoming Leader. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Running, Role: LEADER
I20260709 13:13:07.982692  2564 consensus_queue.cc:237] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:07.986941  2439 raft_consensus.cc:3060] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.990803  2264 catalog_manager.cc:5697] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:07.995611  2602 consensus_queue.cc:1048] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:08.009686  2558 consensus_queue.cc:1048] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:08.091863  2439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f6704d00dbc4b0e91e33a41047deed0"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
mode: GRACEFUL
new_leader_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:57530
I20260709 13:13:08.092621  2439 raft_consensus.cc:606] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Received request to transfer leadership to TS 1993d204f0334787961668bbfe4c7617
I20260709 13:13:08.102210  2439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68201d45db954701af8efa3fd17c86dd"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
mode: GRACEFUL
new_leader_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:57530
I20260709 13:13:08.102988  2439 raft_consensus.cc:606] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Received request to transfer leadership to TS 1993d204f0334787961668bbfe4c7617
I20260709 13:13:08.120734  2513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3"
dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
mode: GRACEFUL
new_leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:57614
I20260709 13:13:08.121241  2513 raft_consensus.cc:606] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Received request to transfer leadership to TS 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:08.134800  2366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dc9731236294c21ab73f680823788d0"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
mode: GRACEFUL
new_leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:34286
I20260709 13:13:08.135326  2366 raft_consensus.cc:606] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Received request to transfer leadership to TS 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:08.141207  2366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8546a5d963d54c9eb7b74a8787ee0c16"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
mode: GRACEFUL
new_leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:34286
I20260709 13:13:08.141706  2366 raft_consensus.cc:606] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Received request to transfer leadership to TS 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:08.147323  2366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b67cb5f0ab48fab32cb4ad378278a4"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
mode: GRACEFUL
new_leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:34286
I20260709 13:13:08.147922  2366 raft_consensus.cc:606] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Received request to transfer leadership to TS 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:08.184638  2558 consensus_queue.cc:1048] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.196265  2569 consensus_queue.cc:1048] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.207222  2569 consensus_queue.cc:1048] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.211515  2564 raft_consensus.cc:493] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.212225  2564 raft_consensus.cc:515] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.214352  2564 leader_election.cc:290] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:08.214416  2558 raft_consensus.cc:993] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617: : Instructing follower 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:08.215284  2558 raft_consensus.cc:1081] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Signalling peer 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:08.215958  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68201d45db954701af8efa3fd17c86dd" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:08.216837  2366 raft_consensus.cc:2393] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad9e746ba8874e58a9f2223e632ea4f0 in current term 1: Already voted for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in this term.
I20260709 13:13:08.218575  2439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68201d45db954701af8efa3fd17c86dd" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:08.220492  2480 leader_election.cc:304] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad9e746ba8874e58a9f2223e632ea4f0; no voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:08.221812  2564 raft_consensus.cc:3060] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.221902  2439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93b67cb5f0ab48fab32cb4ad378278a4"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:57512
I20260709 13:13:08.222618  2439 raft_consensus.cc:493] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:08.223085  2439 raft_consensus.cc:3060] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.228665  2617 consensus_queue.cc:1048] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:08.231609  2564 raft_consensus.cc:2749] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:08.235157  2439 raft_consensus.cc:515] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.238056  2439 leader_election.cc:290] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:08.238374  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b67cb5f0ab48fab32cb4ad378278a4" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:08.239073  2366 raft_consensus.cc:3055] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:08.239429  2366 raft_consensus.cc:740] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:08.239365  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b67cb5f0ab48fab32cb4ad378278a4" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:08.240250  2513 raft_consensus.cc:3060] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.240582  2366 consensus_queue.cc:260] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.241997  2366 raft_consensus.cc:3060] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.248118  2513 raft_consensus.cc:2468] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:08.249593  2405 leader_election.cc:304] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:08.249804  2366 raft_consensus.cc:2468] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:08.250593  2563 raft_consensus.cc:2804] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:08.251127  2563 raft_consensus.cc:697] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:08.252028  2563 consensus_queue.cc:237] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.259249  2264 catalog_manager.cc:5697] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 1 to 2, leader changed from 1993d204f0334787961668bbfe4c7617 (127.21.244.1) to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:08.276211  2617 consensus_queue.cc:1048] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.283667  2569 raft_consensus.cc:993] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617: : Instructing follower 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:08.284327  2558 raft_consensus.cc:1081] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Signalling peer 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:08.286826  2441 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7dc9731236294c21ab73f680823788d0"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:57512
I20260709 13:13:08.288944  2558 consensus_queue.cc:1048] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.289680  2441 raft_consensus.cc:493] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:08.290243  2441 raft_consensus.cc:3060] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.293663  2588 consensus_queue.cc:1048] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:08.298935  2441 raft_consensus.cc:515] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.302376  2563 consensus_queue.cc:1048] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:08.308327  2564 raft_consensus.cc:993] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0: : Instructing follower 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:08.309221  2588 raft_consensus.cc:1081] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Signalling peer 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:08.314213  2438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:57522
I20260709 13:13:08.314878  2438 raft_consensus.cc:493] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:08.315330  2438 raft_consensus.cc:3060] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.318375  2441 leader_election.cc:290] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:08.321844  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc9731236294c21ab73f680823788d0" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:08.322746  2364 raft_consensus.cc:3055] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:08.323194  2364 raft_consensus.cc:740] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:08.324286  2364 consensus_queue.cc:260] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.326206  2364 raft_consensus.cc:3060] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.326239  2438 raft_consensus.cc:515] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.321941  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc9731236294c21ab73f680823788d0" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:08.329555  2513 raft_consensus.cc:3060] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.330112  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:08.330300  2438 leader_election.cc:290] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:08.330839  2365 raft_consensus.cc:3060] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.330173  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:08.336467  2515 raft_consensus.cc:3055] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:08.336822  2515 raft_consensus.cc:740] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Running, Role: LEADER
I20260709 13:13:08.337162  2513 raft_consensus.cc:2468] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:08.337711  2515 consensus_queue.cc:260] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.339619  2405 leader_election.cc:304] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:08.343209  2365 raft_consensus.cc:2468] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:08.343832  2599 raft_consensus.cc:2804] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:08.344053  2366 raft_consensus.cc:1240] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Rejecting Update request from peer ad9e746ba8874e58a9f2223e632ea4f0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:08.344341  2599 raft_consensus.cc:697] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:08.345278  2599 consensus_queue.cc:237] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.346057  2364 raft_consensus.cc:2468] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:08.342744  2563 raft_consensus.cc:993] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5: : Instructing follower 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:08.348915  2563 raft_consensus.cc:1081] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Signalling peer 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:08.350449  2406 leader_election.cc:304] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:08.351404  2515 raft_consensus.cc:3060] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.354835  2601 raft_consensus.cc:2804] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:08.355494  2563 consensus_queue.cc:1048] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.359102  2366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68201d45db954701af8efa3fd17c86dd"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:34272
I20260709 13:13:08.359809  2366 raft_consensus.cc:493] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:08.360015  2515 raft_consensus.cc:2468] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:08.360244  2366 raft_consensus.cc:3060] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.362663  2601 raft_consensus.cc:697] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:08.363837  2601 consensus_queue.cc:237] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.365497  2262 catalog_manager.cc:5697] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 1 to 2, leader changed from 1993d204f0334787961668bbfe4c7617 (127.21.244.1) to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:08.370386  2366 raft_consensus.cc:515] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.373544  2366 leader_election.cc:290] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:08.374440  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68201d45db954701af8efa3fd17c86dd" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:08.375144  2438 raft_consensus.cc:3055] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:08.375234  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68201d45db954701af8efa3fd17c86dd" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:08.375531  2438 raft_consensus.cc:740] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:08.375896  2513 raft_consensus.cc:3060] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.376566  2438 consensus_queue.cc:260] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.377975  2438 raft_consensus.cc:3060] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.379137  2599 consensus_queue.cc:1048] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.384068  2513 raft_consensus.cc:2468] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 2.
I20260709 13:13:08.385382  2330 leader_election.cc:304] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:08.386334  2558 raft_consensus.cc:2804] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:08.386838  2558 raft_consensus.cc:697] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:08.387326  2438 raft_consensus.cc:2468] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 2.
I20260709 13:13:08.387579  2558 consensus_queue.cc:237] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.397964  2262 catalog_manager.cc:5697] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 1 to 2, leader changed from ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3) to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:08.403389  2629 consensus_queue.cc:1048] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:08.404304  2264 catalog_manager.cc:5697] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 1 to 2, leader changed from 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2) to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:08.413873  2599 raft_consensus.cc:993] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5: : Instructing follower 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:08.414520  2629 raft_consensus.cc:1081] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Signalling peer 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:08.418569  2366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f6704d00dbc4b0e91e33a41047deed0"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:34272
I20260709 13:13:08.419185  2366 raft_consensus.cc:493] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:08.419593  2366 raft_consensus.cc:3060] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.426638  2366 raft_consensus.cc:515] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:08.428545  2366 leader_election.cc:290] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Requested vote from peers ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:08.429695  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6704d00dbc4b0e91e33a41047deed0" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:08.429728  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6704d00dbc4b0e91e33a41047deed0" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:08.430668  2438 raft_consensus.cc:3055] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:08.430660  2515 raft_consensus.cc:3060] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.431195  2438 raft_consensus.cc:740] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:08.432204  2438 consensus_queue.cc:260] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:08.433576  2438 raft_consensus.cc:3060] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.438768  2515 raft_consensus.cc:2468] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 2.
I20260709 13:13:08.440464  2330 leader_election.cc:304] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:08.441013  2438 raft_consensus.cc:2468] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 2.
I20260709 13:13:08.441331  2558 raft_consensus.cc:2804] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:08.441984  2558 raft_consensus.cc:697] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:08.442816  2558 consensus_queue.cc:237] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } }
I20260709 13:13:08.450920  2262 catalog_manager.cc:5697] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 1 to 2, leader changed from 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2) to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:08.488384  2564 consensus_queue.cc:1048] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.502808  2588 consensus_queue.cc:1048] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.529346  2602 raft_consensus.cc:993] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617: : Instructing follower 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:08.529862  2558 raft_consensus.cc:1081] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Signalling peer 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:08.531483  2438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8546a5d963d54c9eb7b74a8787ee0c16"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:57512
I20260709 13:13:08.532075  2438 raft_consensus.cc:493] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:08.532420  2438 raft_consensus.cc:3060] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.537484  2438 raft_consensus.cc:515] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.539151  2438 leader_election.cc:290] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:08.540125  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8546a5d963d54c9eb7b74a8787ee0c16" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:08.540239  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8546a5d963d54c9eb7b74a8787ee0c16" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:08.540832  2366 raft_consensus.cc:3055] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:08.540954  2515 raft_consensus.cc:3060] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.541146  2366 raft_consensus.cc:740] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:08.541915  2366 consensus_queue.cc:260] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.542882  2366 raft_consensus.cc:3060] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.546476  2515 raft_consensus.cc:2468] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:08.547750  2405 leader_election.cc:304] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:08.548237  2366 raft_consensus.cc:2468] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:08.548636  2629 raft_consensus.cc:2804] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:08.549170  2629 raft_consensus.cc:697] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:08.550045  2629 consensus_queue.cc:237] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:08.556128  2264 catalog_manager.cc:5697] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 1 to 2, leader changed from 1993d204f0334787961668bbfe4c7617 (127.21.244.1) to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:08.755703  2366 raft_consensus.cc:1275] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.757072  2629 consensus_queue.cc:1048] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:08.765884  2515 raft_consensus.cc:1275] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.767256  2563 consensus_queue.cc:1048] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:08.792284  2515 raft_consensus.cc:1275] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.793877  2563 consensus_queue.cc:1048] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:08.802088  2366 raft_consensus.cc:1275] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.802976  2515 raft_consensus.cc:1275] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.804539  2563 consensus_queue.cc:1048] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:08.804983  2601 consensus_queue.cc:1048] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.816749  2365 raft_consensus.cc:1275] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.819149  2599 consensus_queue.cc:1048] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:08.879468  2438 raft_consensus.cc:1275] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.881287  2558 consensus_queue.cc:1048] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:08.890260  2515 raft_consensus.cc:1275] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.892374  2569 consensus_queue.cc:1048] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:08.923241  2438 raft_consensus.cc:1275] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.924731  2569 consensus_queue.cc:1048] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:08.933418  2515 raft_consensus.cc:1275] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:08.935196  2602 consensus_queue.cc:1048] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:09.026500  2515 raft_consensus.cc:1275] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:09.027906  2599 consensus_queue.cc:1048] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:09.037707  2366 raft_consensus.cc:1275] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:09.040066  2563 consensus_queue.cc:1048] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:11.200022  2262 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53688:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:11.203395  2262 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:11.269713  2349 tablet_service.cc:1511] Processing CreateTablet for tablet 6427b8febcbd470babbfdbde4bd6f0e7 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:11.270625  2427 tablet_service.cc:1511] Processing CreateTablet for tablet 6427b8febcbd470babbfdbde4bd6f0e7 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:11.271963  2349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6427b8febcbd470babbfdbde4bd6f0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.272609  2427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6427b8febcbd470babbfdbde4bd6f0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.274993  2354 tablet_service.cc:1511] Processing CreateTablet for tablet 8f4a35f4129e454390d05393cb128e76 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:11.275564  2425 tablet_service.cc:1511] Processing CreateTablet for tablet 8f4a35f4129e454390d05393cb128e76 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:11.276755  2354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f4a35f4129e454390d05393cb128e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.277184  2425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f4a35f4129e454390d05393cb128e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.282399  2352 tablet_service.cc:1511] Processing CreateTablet for tablet e5abf23d1ef54d0f9b724c1b174c2c3b (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:11.282919  2505 tablet_service.cc:1511] Processing CreateTablet for tablet 8f4a35f4129e454390d05393cb128e76 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:11.284265  2352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5abf23d1ef54d0f9b724c1b174c2c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.284629  2505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f4a35f4129e454390d05393cb128e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.282526  2503 tablet_service.cc:1511] Processing CreateTablet for tablet 6427b8febcbd470babbfdbde4bd6f0e7 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:11.288837  2503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6427b8febcbd470babbfdbde4bd6f0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.290217  2499 tablet_service.cc:1511] Processing CreateTablet for tablet e5abf23d1ef54d0f9b724c1b174c2c3b (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:11.292011  2499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5abf23d1ef54d0f9b724c1b174c2c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.295097  2356 tablet_service.cc:1511] Processing CreateTablet for tablet 6a610ea0ec074e7b90dcee79cf9a2709 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:11.296882  2356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a610ea0ec074e7b90dcee79cf9a2709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.298563  2429 tablet_service.cc:1511] Processing CreateTablet for tablet 6a610ea0ec074e7b90dcee79cf9a2709 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:11.300276  2429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a610ea0ec074e7b90dcee79cf9a2709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.302242  2504 tablet_service.cc:1511] Processing CreateTablet for tablet 6a610ea0ec074e7b90dcee79cf9a2709 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:11.306399  2504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a610ea0ec074e7b90dcee79cf9a2709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.295877  2431 tablet_service.cc:1511] Processing CreateTablet for tablet e5abf23d1ef54d0f9b724c1b174c2c3b (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:11.308240  2431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5abf23d1ef54d0f9b724c1b174c2c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.319259  2351 tablet_service.cc:1511] Processing CreateTablet for tablet 8023fc5c4c00493cbd6866f6acd024dc (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:11.321086  2351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8023fc5c4c00493cbd6866f6acd024dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.329746  2428 tablet_service.cc:1511] Processing CreateTablet for tablet 8023fc5c4c00493cbd6866f6acd024dc (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:11.331347  2428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8023fc5c4c00493cbd6866f6acd024dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.341831  2497 tablet_service.cc:1511] Processing CreateTablet for tablet 8023fc5c4c00493cbd6866f6acd024dc (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:11.343446  2497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8023fc5c4c00493cbd6866f6acd024dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.368518  2355 tablet_service.cc:1511] Processing CreateTablet for tablet 0c5f403e3dbc42deb60df25ab7bcde30 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:11.368737  2350 tablet_service.cc:1511] Processing CreateTablet for tablet 0cc5c2ad93974411b386642704ee831d (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:11.370203  2355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5f403e3dbc42deb60df25ab7bcde30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.370921  2348 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd5e4a39d2442158a27b2acae7b501f (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:11.392517  2348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd5e4a39d2442158a27b2acae7b501f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.410187  2431 tablet_service.cc:1511] Processing CreateTablet for tablet 0cc5c2ad93974411b386642704ee831d (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:11.379539  2651 tablet_bootstrap.cc:492] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:11.383842  2423 tablet_service.cc:1511] Processing CreateTablet for tablet e9a46a7557ce4aeba7bda5bccdd00481 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:11.416705  2431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cc5c2ad93974411b386642704ee831d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.388074  2429 tablet_service.cc:1511] Processing CreateTablet for tablet 0c5f403e3dbc42deb60df25ab7bcde30 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:11.432025  2350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cc5c2ad93974411b386642704ee831d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.432406  2501 tablet_service.cc:1511] Processing CreateTablet for tablet e9a46a7557ce4aeba7bda5bccdd00481 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:11.433936  2501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a46a7557ce4aeba7bda5bccdd00481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.383769  2500 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd5e4a39d2442158a27b2acae7b501f (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:11.436902  2500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd5e4a39d2442158a27b2acae7b501f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.385867  2502 tablet_service.cc:1511] Processing CreateTablet for tablet 0c5f403e3dbc42deb60df25ab7bcde30 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:11.443795  2429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5f403e3dbc42deb60df25ab7bcde30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.444201  2502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5f403e3dbc42deb60df25ab7bcde30. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:11.447302  2331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.2:39209, user_credentials={real_user=slave}} blocked reactor thread for 46949.7us
I20260709 13:13:11.388489  2353 tablet_service.cc:1511] Processing CreateTablet for tablet e9a46a7557ce4aeba7bda5bccdd00481 (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:11.449331  2353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a46a7557ce4aeba7bda5bccdd00481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.381893  2426 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd5e4a39d2442158a27b2acae7b501f (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
W20260709 13:13:11.455483  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.244.1:44041, user_credentials={real_user=slave}} blocked reactor thread for 48439.2us
I20260709 13:13:11.384220  2498 tablet_service.cc:1511] Processing CreateTablet for tablet 0cc5c2ad93974411b386642704ee831d (DEFAULT_TABLE table=soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:11.457929  2498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cc5c2ad93974411b386642704ee831d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.459986  2423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a46a7557ce4aeba7bda5bccdd00481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.472177  2652 tablet_bootstrap.cc:492] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:11.472487  2426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd5e4a39d2442158a27b2acae7b501f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.508839  2652 tablet_bootstrap.cc:654] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.526132  2651 tablet_bootstrap.cc:654] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:11.540900  2312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:11.560392  2658 tablet_bootstrap.cc:492] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:11.570363  2652 tablet_bootstrap.cc:492] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:11.572212  2652 ts_tablet_manager.cc:1403] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.010s
I20260709 13:13:11.572468  2651 tablet_bootstrap.cc:492] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:11.573015  2651 ts_tablet_manager.cc:1403] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.194s	user 0.017s	sys 0.004s
I20260709 13:13:11.573251  2658 tablet_bootstrap.cc:654] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.575655  2652 raft_consensus.cc:359] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.576695  2652 raft_consensus.cc:385] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.576365  2651 raft_consensus.cc:359] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.577365  2651 raft_consensus.cc:385] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.577131  2652 raft_consensus.cc:740] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.577766  2651 raft_consensus.cc:740] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.578290  2652 consensus_queue.cc:260] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.578758  2651 consensus_queue.cc:260] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.579667  2658 tablet_bootstrap.cc:492] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:11.580273  2658 ts_tablet_manager.cc:1403] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.006s
I20260709 13:13:11.581672  2651 ts_tablet_manager.cc:1434] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:11.582800  2651 tablet_bootstrap.cc:492] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:11.585296  2652 ts_tablet_manager.cc:1434] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
W20260709 13:13:11.585991  2467 tablet.cc:2406] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:11.586406  2652 tablet_bootstrap.cc:492] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:11.589804  2651 tablet_bootstrap.cc:654] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.595171  2652 tablet_bootstrap.cc:654] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.597486  2658 raft_consensus.cc:359] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.598332  2658 raft_consensus.cc:385] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.598635  2658 raft_consensus.cc:740] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.600461  2658 consensus_queue.cc:260] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.604121  2658 ts_tablet_manager.cc:1434] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.006s
I20260709 13:13:11.605409  2658 tablet_bootstrap.cc:492] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:11.607043  2651 tablet_bootstrap.cc:492] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:11.607656  2651 ts_tablet_manager.cc:1403] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.004s
I20260709 13:13:11.609095  2652 tablet_bootstrap.cc:492] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:11.609654  2652 ts_tablet_manager.cc:1403] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.007s
I20260709 13:13:11.610960  2651 raft_consensus.cc:359] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.611792  2651 raft_consensus.cc:385] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.612079  2651 raft_consensus.cc:740] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.612732  2658 tablet_bootstrap.cc:654] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.612896  2652 raft_consensus.cc:359] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.613718  2652 raft_consensus.cc:385] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.612942  2651 consensus_queue.cc:260] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.614017  2652 raft_consensus.cc:740] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.614846  2652 consensus_queue.cc:260] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.617323  2652 ts_tablet_manager.cc:1434] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:11.618081  2651 ts_tablet_manager.cc:1434] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:13:11.619149  2651 tablet_bootstrap.cc:492] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:11.622215  2658 tablet_bootstrap.cc:492] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:11.622328  2652 tablet_bootstrap.cc:492] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:11.622998  2658 ts_tablet_manager.cc:1403] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:13:11.626052  2651 tablet_bootstrap.cc:654] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.626513  2658 raft_consensus.cc:359] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.627480  2658 raft_consensus.cc:385] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.627877  2658 raft_consensus.cc:740] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.628659  2658 consensus_queue.cc:260] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.632019  2658 ts_tablet_manager.cc:1434] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:13:11.632975  2651 tablet_bootstrap.cc:492] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:11.636088  2652 tablet_bootstrap.cc:654] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.637212  2651 ts_tablet_manager.cc:1403] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 13:13:11.633019  2658 tablet_bootstrap.cc:492] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:11.640506  2651 raft_consensus.cc:359] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.641366  2651 raft_consensus.cc:385] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.641688  2651 raft_consensus.cc:740] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.642485  2651 consensus_queue.cc:260] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.644971  2651 ts_tablet_manager.cc:1434] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:11.646018  2651 tablet_bootstrap.cc:492] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:11.647943  2658 tablet_bootstrap.cc:654] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.652659  2652 tablet_bootstrap.cc:492] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:11.652963  2651 tablet_bootstrap.cc:654] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.653188  2652 ts_tablet_manager.cc:1403] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.008s
I20260709 13:13:11.656853  2652 raft_consensus.cc:359] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.657907  2652 raft_consensus.cc:385] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.658321  2652 raft_consensus.cc:740] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.659152  2652 consensus_queue.cc:260] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.660143  2658 tablet_bootstrap.cc:492] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:11.660691  2658 ts_tablet_manager.cc:1403] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.014s
I20260709 13:13:11.660835  2651 tablet_bootstrap.cc:492] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:11.661350  2651 ts_tablet_manager.cc:1403] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:13:11.663182  2658 raft_consensus.cc:359] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.663834  2658 raft_consensus.cc:385] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.664155  2658 raft_consensus.cc:740] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.664352  2651 raft_consensus.cc:359] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.665202  2651 raft_consensus.cc:385] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.665001  2658 consensus_queue.cc:260] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.665622  2651 raft_consensus.cc:740] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.665700  2652 ts_tablet_manager.cc:1434] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:13:11.667038  2652 tablet_bootstrap.cc:492] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:11.667812  2658 ts_tablet_manager.cc:1434] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:11.668890  2658 tablet_bootstrap.cc:492] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:11.672595  2651 consensus_queue.cc:260] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.675220  2651 ts_tablet_manager.cc:1434] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:11.676329  2651 tablet_bootstrap.cc:492] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:11.677796  2652 tablet_bootstrap.cc:654] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.680984  2658 tablet_bootstrap.cc:654] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.686247  2651 tablet_bootstrap.cc:654] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.698931  2652 tablet_bootstrap.cc:492] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:11.699442  2652 ts_tablet_manager.cc:1403] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.000s
I20260709 13:13:11.702922  2652 raft_consensus.cc:359] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.703922  2652 raft_consensus.cc:385] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.704015  2651 tablet_bootstrap.cc:492] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:11.704268  2652 raft_consensus.cc:740] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.704591  2651 ts_tablet_manager.cc:1403] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.004s
I20260709 13:13:11.705056  2652 consensus_queue.cc:260] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.707576  2652 ts_tablet_manager.cc:1434] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 13:13:11.708401  2658 tablet_bootstrap.cc:492] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:11.708631  2652 tablet_bootstrap.cc:492] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:11.708966  2658 ts_tablet_manager.cc:1403] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.020s
I20260709 13:13:11.708741  2651 raft_consensus.cc:359] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.709900  2651 raft_consensus.cc:385] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.710297  2651 raft_consensus.cc:740] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.711156  2651 consensus_queue.cc:260] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.712797  2658 raft_consensus.cc:359] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.713549  2658 raft_consensus.cc:385] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.713838  2658 raft_consensus.cc:740] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.714597  2658 consensus_queue.cc:260] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.716972  2651 ts_tablet_manager.cc:1434] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:13:11.717159  2658 ts_tablet_manager.cc:1434] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:11.718431  2657 raft_consensus.cc:493] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.719081  2657 raft_consensus.cc:515] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.720141  2652 tablet_bootstrap.cc:654] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.721925  2657 leader_election.cc:290] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:11.722497  2658 tablet_bootstrap.cc:492] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:11.722404  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a610ea0ec074e7b90dcee79cf9a2709" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:11.723294  2365 raft_consensus.cc:2468] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:11.724814  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a610ea0ec074e7b90dcee79cf9a2709" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:11.725425  2406 leader_election.cc:304] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:11.725566  2515 raft_consensus.cc:2468] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:11.726330  2657 raft_consensus.cc:2804] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.726686  2657 raft_consensus.cc:493] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.727023  2657 raft_consensus.cc:3060] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.718487  2651 tablet_bootstrap.cc:492] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:11.736647  2657 raft_consensus.cc:515] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.739889  2652 tablet_bootstrap.cc:492] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:11.740289  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a610ea0ec074e7b90dcee79cf9a2709" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:11.740523  2652 ts_tablet_manager.cc:1403] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.005s
I20260709 13:13:11.741008  2365 raft_consensus.cc:3060] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.741925  2658 tablet_bootstrap.cc:654] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.743003  2651 tablet_bootstrap.cc:654] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.744225  2652 raft_consensus.cc:359] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.745146  2652 raft_consensus.cc:385] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.745612  2652 raft_consensus.cc:740] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.746708  2652 consensus_queue.cc:260] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.750705  2652 ts_tablet_manager.cc:1434] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:11.753037  2652 tablet_bootstrap.cc:492] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:11.753342  2365 raft_consensus.cc:2468] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:11.754009  2658 tablet_bootstrap.cc:492] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:11.754833  2658 ts_tablet_manager.cc:1403] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.011s
I20260709 13:13:11.755488  2406 leader_election.cc:304] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:11.756871  2629 raft_consensus.cc:2804] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.757491  2629 raft_consensus.cc:697] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:11.758471  2629 consensus_queue.cc:237] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.759644  2658 raft_consensus.cc:359] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.760493  2652 tablet_bootstrap.cc:654] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.762374  2651 tablet_bootstrap.cc:492] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:11.763011  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a610ea0ec074e7b90dcee79cf9a2709" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:11.760497  2658 raft_consensus.cc:385] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.763763  2515 raft_consensus.cc:3060] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.763947  2658 raft_consensus.cc:740] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.764875  2658 consensus_queue.cc:260] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.767287  2658 ts_tablet_manager.cc:1434] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 13:13:11.763021  2651 ts_tablet_manager.cc:1403] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.007s
I20260709 13:13:11.768440  2658 tablet_bootstrap.cc:492] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:11.772856  2651 raft_consensus.cc:359] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.773588  2651 raft_consensus.cc:385] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.773939  2651 raft_consensus.cc:740] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.774780  2651 consensus_queue.cc:260] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.775292  2652 tablet_bootstrap.cc:492] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:11.777055  2652 ts_tablet_manager.cc:1403] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.005s
I20260709 13:13:11.777257  2651 ts_tablet_manager.cc:1434] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:13:11.777874  2658 tablet_bootstrap.cc:654] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.778362  2651 tablet_bootstrap.cc:492] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:11.779150  2262 catalog_manager.cc:5697] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.780170  2652 raft_consensus.cc:359] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.780926  2652 raft_consensus.cc:385] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.781219  2652 raft_consensus.cc:740] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.782210  2652 consensus_queue.cc:260] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.784865  2652 ts_tablet_manager.cc:1434] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:13:11.785882  2652 tablet_bootstrap.cc:492] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:11.789520  2651 tablet_bootstrap.cc:654] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.791034  2657 leader_election.cc:290] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:11.793391  2652 tablet_bootstrap.cc:654] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.810904  2656 raft_consensus.cc:493] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.811597  2656 raft_consensus.cc:515] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.814890  2656 leader_election.cc:290] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:11.816944  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a46a7557ce4aeba7bda5bccdd00481" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:11.817521  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a46a7557ce4aeba7bda5bccdd00481" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:11.818168  2513 raft_consensus.cc:2468] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 0.
I20260709 13:13:11.820003  2330 leader_election.cc:304] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
W20260709 13:13:11.821178  2331 leader_election.cc:343] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.823827  2656 raft_consensus.cc:2804] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.824595  2656 raft_consensus.cc:493] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.825215  2656 raft_consensus.cc:3060] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.826912  2564 raft_consensus.cc:493] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.827647  2564 raft_consensus.cc:515] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.830786  2564 leader_election.cc:290] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:11.833807  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023fc5c4c00493cbd6866f6acd024dc" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:11.834810  2366 raft_consensus.cc:2468] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 0.
I20260709 13:13:11.838018  2629 raft_consensus.cc:493] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.838784  2629 raft_consensus.cc:515] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.841785  2629 leader_election.cc:290] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:11.844081  2480 leader_election.cc:304] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:11.846222  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4a35f4129e454390d05393cb128e76" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:11.846976  2366 raft_consensus.cc:2468] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:11.847451  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4a35f4129e454390d05393cb128e76" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:11.846215  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023fc5c4c00493cbd6866f6acd024dc" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:11.848162  2513 raft_consensus.cc:2468] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:11.848320  2441 raft_consensus.cc:2468] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 0.
I20260709 13:13:11.849587  2406 leader_election.cc:304] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:11.850978  2629 raft_consensus.cc:493] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.851012  2654 raft_consensus.cc:2804] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.851717  2654 raft_consensus.cc:493] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.851537  2629 raft_consensus.cc:515] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.852293  2654 raft_consensus.cc:3060] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.852480  2564 raft_consensus.cc:2804] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.853096  2564 raft_consensus.cc:493] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.853502  2564 raft_consensus.cc:3060] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.854576  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5f403e3dbc42deb60df25ab7bcde30" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
W20260709 13:13:11.855996  2406 leader_election.cc:343] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.857756  2629 leader_election.cc:290] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:11.863081  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5f403e3dbc42deb60df25ab7bcde30" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
W20260709 13:13:11.864866  2405 leader_election.cc:343] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.865368  2405 leader_election.cc:304] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0
I20260709 13:13:11.865192  2654 raft_consensus.cc:515] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.867213  2655 raft_consensus.cc:2749] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:11.871001  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4a35f4129e454390d05393cb128e76" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:11.871970  2365 raft_consensus.cc:3060] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.872300  2654 leader_election.cc:290] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:11.875828  2514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4a35f4129e454390d05393cb128e76" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:11.879395  2514 raft_consensus.cc:3060] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.880940  2654 raft_consensus.cc:493] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.877293  2656 raft_consensus.cc:515] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.789773  2515 raft_consensus.cc:2468] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:11.881491  2654 raft_consensus.cc:515] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.884006  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a46a7557ce4aeba7bda5bccdd00481" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:11.884460  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5abf23d1ef54d0f9b724c1b174c2c3b" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:11.885159  2366 raft_consensus.cc:2468] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:11.886256  2406 leader_election.cc:304] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:11.887564  2655 raft_consensus.cc:2804] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.887944  2655 raft_consensus.cc:493] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.888284  2655 raft_consensus.cc:3060] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.889005  2514 raft_consensus.cc:2468] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:11.878824  2564 raft_consensus.cc:515] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
W20260709 13:13:11.890820  2331 leader_election.cc:343] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.894194  2564 leader_election.cc:290] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:11.897634  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023fc5c4c00493cbd6866f6acd024dc" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:11.898339  2366 raft_consensus.cc:3060] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.900357  2654 leader_election.cc:290] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:11.899263  2655 raft_consensus.cc:515] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.901515  2651 tablet_bootstrap.cc:492] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:11.902158  2651 ts_tablet_manager.cc:1403] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.124s	user 0.041s	sys 0.041s
I20260709 13:13:11.902745  2658 tablet_bootstrap.cc:492] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:11.902990  2655 leader_election.cc:290] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:11.903358  2658 ts_tablet_manager.cc:1403] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.135s	user 0.019s	sys 0.060s
I20260709 13:13:11.904029  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5abf23d1ef54d0f9b724c1b174c2c3b" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:11.901990  2405 leader_election.cc:304] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:11.904700  2364 raft_consensus.cc:3060] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.906459  2652 tablet_bootstrap.cc:492] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:11.906844  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023fc5c4c00493cbd6866f6acd024dc" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:11.907051  2652 ts_tablet_manager.cc:1403] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.121s	user 0.025s	sys 0.033s
I20260709 13:13:11.907486  2441 raft_consensus.cc:3060] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.907586  2514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5abf23d1ef54d0f9b724c1b174c2c3b" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:11.910504  2652 raft_consensus.cc:359] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.910528  2654 raft_consensus.cc:2804] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.915666  2652 raft_consensus.cc:385] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.915874  2654 raft_consensus.cc:697] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:11.916009  2366 raft_consensus.cc:2468] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 1.
I20260709 13:13:11.916148  2652 raft_consensus.cc:740] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
W20260709 13:13:11.917315  2405 leader_election.cc:343] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.917225  2652 consensus_queue.cc:260] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.917816  2657 raft_consensus.cc:493] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.918345  2657 raft_consensus.cc:515] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.918685  2656 leader_election.cc:290] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:11.915413  2441 raft_consensus.cc:2468] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 1.
I20260709 13:13:11.920174  2652 ts_tablet_manager.cc:1434] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:13:11.921523  2658 raft_consensus.cc:359] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.921984  2514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a46a7557ce4aeba7bda5bccdd00481" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:11.922381  2658 raft_consensus.cc:385] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.922655  2514 raft_consensus.cc:3060] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.922870  2652 tablet_bootstrap.cc:492] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:11.922794  2658 raft_consensus.cc:740] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.923928  2658 consensus_queue.cc:260] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.921568  2654 consensus_queue.cc:237] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.923419  2480 leader_election.cc:304] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:11.926566  2658 ts_tablet_manager.cc:1434] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:13:11.927592  2658 tablet_bootstrap.cc:492] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:11.915416  2365 raft_consensus.cc:2468] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:11.932082  2652 tablet_bootstrap.cc:654] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.932876  2657 leader_election.cc:290] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:11.912761  2364 raft_consensus.cc:2468] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:11.912982  2651 raft_consensus.cc:359] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.933637  2651 raft_consensus.cc:385] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.933962  2651 raft_consensus.cc:740] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.934623  2658 tablet_bootstrap.cc:654] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.934727  2651 consensus_queue.cc:260] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.913533  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5abf23d1ef54d0f9b724c1b174c2c3b" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:11.936631  2564 raft_consensus.cc:2804] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.936620  2406 leader_election.cc:304] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: ad9e746ba8874e58a9f2223e632ea4f0
I20260709 13:13:11.937655  2651 ts_tablet_manager.cc:1434] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:13:11.937500  2564 raft_consensus.cc:697] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Becoming Leader. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Running, Role: LEADER
I20260709 13:13:11.938092  2657 raft_consensus.cc:2804] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.938639  2657 raft_consensus.cc:697] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:11.938815  2651 tablet_bootstrap.cc:492] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:11.938710  2564 consensus_queue.cc:237] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.939476  2657 consensus_queue.cc:237] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.946862  2651 tablet_bootstrap.cc:654] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.949419  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427b8febcbd470babbfdbde4bd6f0e7" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:11.952986  2514 raft_consensus.cc:2468] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 1.
I20260709 13:13:11.958791  2366 raft_consensus.cc:2468] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:11.960178  2406 leader_election.cc:304] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:11.961189  2629 raft_consensus.cc:2804] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.961583  2629 raft_consensus.cc:493] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.961930  2629 raft_consensus.cc:3060] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:11.964491  2405 leader_election.cc:343] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.965478  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427b8febcbd470babbfdbde4bd6f0e7" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:11.966500  2513 raft_consensus.cc:2468] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:11.967965  2330 leader_election.cc:304] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:11.968809  2656 raft_consensus.cc:2804] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.969311  2656 raft_consensus.cc:697] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:11.970232  2656 consensus_queue.cc:237] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.973030  2262 catalog_manager.cc:5697] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.977414  2629 raft_consensus.cc:515] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:11.989755  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427b8febcbd470babbfdbde4bd6f0e7" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:11.990676  2366 raft_consensus.cc:3060] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.003155  2652 tablet_bootstrap.cc:492] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:12.005262  2652 ts_tablet_manager.cc:1403] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.018s
I20260709 13:13:12.004565  2629 leader_election.cc:290] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.008842  2262 catalog_manager.cc:5697] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.011611  2652 raft_consensus.cc:359] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.018807  2652 raft_consensus.cc:385] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:12.019299  2652 raft_consensus.cc:740] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:12.007158  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427b8febcbd470babbfdbde4bd6f0e7" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:12.021106  2513 raft_consensus.cc:3060] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.021101  2652 consensus_queue.cc:260] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.023175  2652 ts_tablet_manager.cc:1434] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:13:12.024178  2652 tablet_bootstrap.cc:492] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617: Bootstrap starting.
I20260709 13:13:12.015865  2262 catalog_manager.cc:5697] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.018051  2366 raft_consensus.cc:2468] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:12.028898  2406 leader_election.cc:304] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:12.029898  2657 raft_consensus.cc:2804] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:12.030079  2652 tablet_bootstrap.cc:654] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:12.030771  2657 raft_consensus.cc:697] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
W20260709 13:13:12.037979  2688 log.cc:927] Time spent T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:13:12.039149  2658 tablet_bootstrap.cc:492] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:12.039716  2658 ts_tablet_manager.cc:1403] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.019s
I20260709 13:13:12.041707  2657 consensus_queue.cc:237] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.042912  2658 raft_consensus.cc:359] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.043402  2513 raft_consensus.cc:2468] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:12.043803  2658 raft_consensus.cc:385] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:12.044157  2658 raft_consensus.cc:740] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:12.044929  2658 consensus_queue.cc:260] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.047537  2658 ts_tablet_manager.cc:1434] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:12.048642  2658 tablet_bootstrap.cc:492] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:12.051232  2651 tablet_bootstrap.cc:492] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:12.052789  2651 ts_tablet_manager.cc:1403] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.114s	user 0.019s	sys 0.009s
I20260709 13:13:12.055846  2651 raft_consensus.cc:359] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.057838  2264 catalog_manager.cc:5697] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.058791  2651 raft_consensus.cc:385] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:12.059309  2651 raft_consensus.cc:740] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:12.060010  2651 consensus_queue.cc:260] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.065081  2263 catalog_manager.cc:5697] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.066998  2658 tablet_bootstrap.cc:654] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:12.073184  2652 tablet_bootstrap.cc:492] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617: No bootstrap required, opened a new log
I20260709 13:13:12.073727  2652 ts_tablet_manager.cc:1403] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.016s
I20260709 13:13:12.077200  2652 raft_consensus.cc:359] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.077879  2652 raft_consensus.cc:385] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:12.078140  2652 raft_consensus.cc:740] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Initialized, Role: FOLLOWER
I20260709 13:13:12.078804  2652 consensus_queue.cc:260] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.081271  2652 ts_tablet_manager.cc:1434] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:13:12.071833  2651 ts_tablet_manager.cc:1434] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:13:12.086587  2651 tablet_bootstrap.cc:492] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5: Bootstrap starting.
I20260709 13:13:12.092464  2651 tablet_bootstrap.cc:654] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:12.097626  2658 tablet_bootstrap.cc:492] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:12.098067  2658 ts_tablet_manager.cc:1403] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.013s
I20260709 13:13:12.100469  2658 raft_consensus.cc:359] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.101130  2658 raft_consensus.cc:385] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:12.101394  2658 raft_consensus.cc:740] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:12.102033  2658 consensus_queue.cc:260] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.104055  2658 ts_tablet_manager.cc:1434] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:12.105161  2658 tablet_bootstrap.cc:492] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0: Bootstrap starting.
I20260709 13:13:12.108179  2651 tablet_bootstrap.cc:492] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5: No bootstrap required, opened a new log
I20260709 13:13:12.108681  2651 ts_tablet_manager.cc:1403] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:13:12.110508  2658 tablet_bootstrap.cc:654] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:12.110711  2651 raft_consensus.cc:359] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.111716  2651 raft_consensus.cc:385] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:12.112002  2651 raft_consensus.cc:740] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Initialized, Role: FOLLOWER
I20260709 13:13:12.112643  2651 consensus_queue.cc:260] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.114956  2651 ts_tablet_manager.cc:1434] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:12.117092  2658 tablet_bootstrap.cc:492] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0: No bootstrap required, opened a new log
I20260709 13:13:12.117590  2658 ts_tablet_manager.cc:1403] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:13:12.119704  2658 raft_consensus.cc:359] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.120325  2658 raft_consensus.cc:385] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:12.120581  2658 raft_consensus.cc:740] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Initialized, Role: FOLLOWER
I20260709 13:13:12.121191  2658 consensus_queue.cc:260] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.122947  2658 ts_tablet_manager.cc:1434] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:12.158543  2656 raft_consensus.cc:493] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.159235  2656 raft_consensus.cc:515] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.161363  2656 leader_election.cc:290] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.162139  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e4a39d2442158a27b2acae7b501f" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:12.162456  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e4a39d2442158a27b2acae7b501f" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:12.162957  2441 raft_consensus.cc:2468] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 0.
I20260709 13:13:12.163204  2513 raft_consensus.cc:2468] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 0.
I20260709 13:13:12.164310  2331 leader_election.cc:304] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:12.165091  2656 raft_consensus.cc:2804] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:12.165516  2656 raft_consensus.cc:493] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.165829  2656 raft_consensus.cc:3060] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.171142  2656 raft_consensus.cc:515] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.172996  2656 leader_election.cc:290] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.174069  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e4a39d2442158a27b2acae7b501f" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:12.174069  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e4a39d2442158a27b2acae7b501f" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:12.175205  2441 raft_consensus.cc:3060] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.175207  2513 raft_consensus.cc:3060] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.182889  2513 raft_consensus.cc:2468] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 1.
I20260709 13:13:12.182889  2441 raft_consensus.cc:2468] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 1.
I20260709 13:13:12.184504  2331 leader_election.cc:304] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:12.185258  2656 raft_consensus.cc:2804] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:12.185673  2656 raft_consensus.cc:697] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:12.186424  2656 consensus_queue.cc:237] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.193856  2263 catalog_manager.cc:5697] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 1 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.228062  2657 consensus_queue.cc:1048] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.240195  2657 consensus_queue.cc:1048] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:12.244280  2683 raft_consensus.cc:493] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.244886  2683 raft_consensus.cc:515] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.247203  2683 leader_election.cc:290] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:12.248940  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5f403e3dbc42deb60df25ab7bcde30" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:12.249310  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5f403e3dbc42deb60df25ab7bcde30" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" is_pre_election: true
I20260709 13:13:12.249750  2364 raft_consensus.cc:2468] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 0.
I20260709 13:13:12.250007  2441 raft_consensus.cc:2468] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 0.
I20260709 13:13:12.251462  2480 leader_election.cc:304] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:12.252346  2683 raft_consensus.cc:2804] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:12.252825  2683 raft_consensus.cc:493] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.253199  2683 raft_consensus.cc:3060] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.257069  2657 raft_consensus.cc:493] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.257804  2657 raft_consensus.cc:515] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.260214  2657 leader_election.cc:290] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.261647  2683 raft_consensus.cc:515] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.261776  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc5c2ad93974411b386642704ee831d" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:12.261768  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc5c2ad93974411b386642704ee831d" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:12.262876  2513 raft_consensus.cc:2468] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:12.262988  2364 raft_consensus.cc:2468] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 0.
I20260709 13:13:12.264112  2683 leader_election.cc:290] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:12.264233  2405 leader_election.cc:304] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:12.265935  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5f403e3dbc42deb60df25ab7bcde30" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:12.266326  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5f403e3dbc42deb60df25ab7bcde30" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:12.266683  2364 raft_consensus.cc:3060] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.266988  2441 raft_consensus.cc:3060] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.265537  2657 raft_consensus.cc:2804] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:12.268270  2657 raft_consensus.cc:493] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.268697  2657 raft_consensus.cc:3060] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.274454  2657 raft_consensus.cc:515] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.274868  2441 raft_consensus.cc:2468] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 1.
I20260709 13:13:12.274868  2364 raft_consensus.cc:2468] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 1.
I20260709 13:13:12.276494  2480 leader_election.cc:304] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:12.277441  2657 leader_election.cc:290] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.277673  2683 raft_consensus.cc:2804] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:12.277468  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc5c2ad93974411b386642704ee831d" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:12.279088  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cc5c2ad93974411b386642704ee831d" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:12.278285  2683 raft_consensus.cc:697] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Becoming Leader. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Running, Role: LEADER
I20260709 13:13:12.279794  2513 raft_consensus.cc:3060] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.280659  2364 raft_consensus.cc:3060] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.280313  2683 consensus_queue.cc:237] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.288273  2513 raft_consensus.cc:2468] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:12.288833  2364 raft_consensus.cc:2468] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 1.
I20260709 13:13:12.289760  2405 leader_election.cc:304] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:12.291196  2657 raft_consensus.cc:2804] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:12.292152  2657 raft_consensus.cc:697] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:12.290638  2264 catalog_manager.cc:5697] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3). New cstate: current_term: 1 leader_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.293151  2657 consensus_queue.cc:237] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.303411  2263 catalog_manager.cc:5697] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 1 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.329896  2513 raft_consensus.cc:3060] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.336398  2657 consensus_queue.cc:1048] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.339995  2629 consensus_queue.cc:1048] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.369567  2683 consensus_queue.cc:1048] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.382854  2564 consensus_queue.cc:1048] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.410269  2441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6427b8febcbd470babbfdbde4bd6f0e7"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
mode: GRACEFUL
new_leader_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:57530
I20260709 13:13:12.411023  2441 raft_consensus.cc:606] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Received request to transfer leadership to TS 1993d204f0334787961668bbfe4c7617
I20260709 13:13:12.415851  2629 raft_consensus.cc:493] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.416337  2629 raft_consensus.cc:515] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.417145  2441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f4a35f4129e454390d05393cb128e76"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
mode: GRACEFUL
new_leader_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:57530
I20260709 13:13:12.417876  2441 raft_consensus.cc:606] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Received request to transfer leadership to TS 1993d204f0334787961668bbfe4c7617
I20260709 13:13:12.418704  2629 leader_election.cc:290] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.419358  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a46a7557ce4aeba7bda5bccdd00481" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1993d204f0334787961668bbfe4c7617" is_pre_election: true
I20260709 13:13:12.419785  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a46a7557ce4aeba7bda5bccdd00481" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" is_pre_election: true
I20260709 13:13:12.420763  2513 raft_consensus.cc:2393] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in current term 1: Already voted for candidate 1993d204f0334787961668bbfe4c7617 in this term.
I20260709 13:13:12.421839  2405 leader_election.cc:304] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0
I20260709 13:13:12.422675  2629 raft_consensus.cc:3060] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.424299  2441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5abf23d1ef54d0f9b724c1b174c2c3b"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
mode: GRACEFUL
new_leader_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:57530
I20260709 13:13:12.425108  2441 raft_consensus.cc:606] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Received request to transfer leadership to TS 1993d204f0334787961668bbfe4c7617
I20260709 13:13:12.429380  2629 raft_consensus.cc:2749] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:12.431074  2441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a610ea0ec074e7b90dcee79cf9a2709"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
mode: GRACEFUL
new_leader_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:57530
I20260709 13:13:12.431860  2441 raft_consensus.cc:606] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Received request to transfer leadership to TS 1993d204f0334787961668bbfe4c7617
I20260709 13:13:12.437918  2513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8023fc5c4c00493cbd6866f6acd024dc"
dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
mode: GRACEFUL
new_leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:57614
I20260709 13:13:12.438603  2513 raft_consensus.cc:606] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Received request to transfer leadership to TS 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:12.447875  2514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c5f403e3dbc42deb60df25ab7bcde30"
dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
mode: GRACEFUL
new_leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:57614
I20260709 13:13:12.448508  2514 raft_consensus.cc:606] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Received request to transfer leadership to TS 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:12.454070  2364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cd5e4a39d2442158a27b2acae7b501f"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
mode: GRACEFUL
new_leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:34286
I20260709 13:13:12.454600  2364 raft_consensus.cc:606] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Received request to transfer leadership to TS 3fe1d806ed9f4e929b8700e572f9c7b5
I20260709 13:13:12.460429  2364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9a46a7557ce4aeba7bda5bccdd00481"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
mode: GRACEFUL
new_leader_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
 from {username='slave'} at 127.0.0.1:34286
I20260709 13:13:12.460960  2364 raft_consensus.cc:606] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Received request to transfer leadership to TS ad9e746ba8874e58a9f2223e632ea4f0
I20260709 13:13:12.471056  2654 consensus_queue.cc:1048] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.478775  2629 raft_consensus.cc:993] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5: : Instructing follower 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:12.479339  2657 raft_consensus.cc:1081] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Signalling peer 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:12.481673  2366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f4a35f4129e454390d05393cb128e76"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:34272
I20260709 13:13:12.482399  2366 raft_consensus.cc:493] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.482823  2366 raft_consensus.cc:3060] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.484675  2657 consensus_queue.cc:1048] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.491600  2366 raft_consensus.cc:515] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.493209  2364 raft_consensus.cc:1240] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Rejecting Update request from peer 3fe1d806ed9f4e929b8700e572f9c7b5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.494778  2366 leader_election.cc:290] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.495170  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4a35f4129e454390d05393cb128e76" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:12.496358  2441 raft_consensus.cc:3055] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.496744  2441 raft_consensus.cc:740] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:12.497820  2441 consensus_queue.cc:260] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.498886  2441 raft_consensus.cc:3060] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.499899  2514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f4a35f4129e454390d05393cb128e76" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:12.500564  2514 raft_consensus.cc:3060] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.506878  2514 raft_consensus.cc:2468] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 2.
I20260709 13:13:12.508036  2330 leader_election.cc:304] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:12.508291  2441 raft_consensus.cc:2468] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 2.
I20260709 13:13:12.509011  2656 raft_consensus.cc:2804] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.509544  2656 raft_consensus.cc:697] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:12.510378  2656 consensus_queue.cc:237] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.517347  2262 catalog_manager.cc:5697] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 1 to 2, leader changed from 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2) to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.533257  2656 consensus_queue.cc:1048] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.541050  2653 raft_consensus.cc:993] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617: : Instructing follower ad9e746ba8874e58a9f2223e632ea4f0 to start an election
I20260709 13:13:12.541911  2656 raft_consensus.cc:1081] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Signalling peer ad9e746ba8874e58a9f2223e632ea4f0 to start an election
I20260709 13:13:12.548151  2712 consensus_queue.cc:1048] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:12.556330  2514 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9a46a7557ce4aeba7bda5bccdd00481"
dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
 from {username='slave'} at 127.0.0.1:57596
I20260709 13:13:12.557484  2514 raft_consensus.cc:493] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.558027  2514 raft_consensus.cc:3060] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.563153  2629 consensus_queue.cc:1048] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:12.566752  2514 raft_consensus.cc:515] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.577412  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a46a7557ce4aeba7bda5bccdd00481" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:12.578130  2364 raft_consensus.cc:3055] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.578470  2364 raft_consensus.cc:740] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:12.579407  2364 consensus_queue.cc:260] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.580528  2364 raft_consensus.cc:3060] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.582003  2657 raft_consensus.cc:993] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5: : Instructing follower 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:12.582656  2657 raft_consensus.cc:1081] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Signalling peer 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:12.585389  2365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6427b8febcbd470babbfdbde4bd6f0e7"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:34272
I20260709 13:13:12.586054  2365 raft_consensus.cc:493] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.586452  2365 raft_consensus.cc:3060] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.595227  2654 consensus_queue.cc:1048] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:12.596866  2365 raft_consensus.cc:515] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.598003  2514 leader_election.cc:290] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 2 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:12.600194  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a46a7557ce4aeba7bda5bccdd00481" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:12.602375  2441 raft_consensus.cc:3060] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.603581  2366 raft_consensus.cc:1240] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Rejecting Update request from peer 3fe1d806ed9f4e929b8700e572f9c7b5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.606667  2654 consensus_queue.cc:1059] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.607553  2654 raft_consensus.cc:3055] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.607656  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427b8febcbd470babbfdbde4bd6f0e7" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:12.608006  2654 raft_consensus.cc:740] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:12.609105  2654 consensus_queue.cc:260] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.609701  2365 leader_election.cc:290] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.610198  2654 raft_consensus.cc:3060] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.610894  2515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6427b8febcbd470babbfdbde4bd6f0e7" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:12.612062  2364 raft_consensus.cc:2468] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 2.
I20260709 13:13:12.613487  2480 leader_election.cc:304] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:12.614645  2564 raft_consensus.cc:2804] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.615320  2564 raft_consensus.cc:697] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 LEADER]: Becoming Leader. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Running, Role: LEADER
I20260709 13:13:12.616384  2564 consensus_queue.cc:237] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.620784  2441 raft_consensus.cc:2468] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 2.
I20260709 13:13:12.634994  2438 raft_consensus.cc:2468] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 2.
I20260709 13:13:12.635876  2264 catalog_manager.cc:5697] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 reported cstate change: term changed from 1 to 2, leader changed from 1993d204f0334787961668bbfe4c7617 (127.21.244.1) to ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.638134  2331 leader_election.cc:304] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: ad9e746ba8874e58a9f2223e632ea4f0
I20260709 13:13:12.638702  2712 consensus_queue.cc:1048] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.639096  2656 raft_consensus.cc:2804] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.639695  2656 raft_consensus.cc:697] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:12.640590  2656 consensus_queue.cc:237] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.650712  2264 catalog_manager.cc:5697] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 1 to 2, leader changed from 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2) to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.657126  2712 consensus_queue.cc:1048] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.672464  2653 raft_consensus.cc:993] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617: : Instructing follower 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:12.672991  2712 raft_consensus.cc:1081] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Signalling peer 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:12.674837  2438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cd5e4a39d2442158a27b2acae7b501f"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:57512
I20260709 13:13:12.675451  2438 raft_consensus.cc:493] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.675863  2438 raft_consensus.cc:3060] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.681310  2438 raft_consensus.cc:515] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.683529  2438 leader_election.cc:290] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.684087  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e4a39d2442158a27b2acae7b501f" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:12.684877  2366 raft_consensus.cc:3055] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.685202  2366 raft_consensus.cc:740] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:12.685211  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd5e4a39d2442158a27b2acae7b501f" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:12.686013  2513 raft_consensus.cc:3060] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.686117  2366 consensus_queue.cc:260] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.687559  2366 raft_consensus.cc:3060] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.692330  2513 raft_consensus.cc:2468] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:12.692916  2366 raft_consensus.cc:2468] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:12.693502  2405 leader_election.cc:304] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:12.694415  2629 raft_consensus.cc:2804] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.694913  2629 raft_consensus.cc:697] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:12.695845  2629 consensus_queue.cc:237] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.697193  2654 consensus_queue.cc:1048] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.704627  2262 catalog_manager.cc:5697] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 1 to 2, leader changed from 1993d204f0334787961668bbfe4c7617 (127.21.244.1) to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.712141  2655 consensus_queue.cc:1048] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.719580  2657 raft_consensus.cc:993] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5: : Instructing follower 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:12.720173  2654 raft_consensus.cc:1081] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Signalling peer 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:12.722419  2365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a610ea0ec074e7b90dcee79cf9a2709"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:34272
I20260709 13:13:12.723106  2365 raft_consensus.cc:493] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.723547  2365 raft_consensus.cc:3060] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.731998  2365 raft_consensus.cc:515] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.734184  2365 leader_election.cc:290] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.735351  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a610ea0ec074e7b90dcee79cf9a2709" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:12.736443  2438 raft_consensus.cc:3055] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.736971  2438 raft_consensus.cc:740] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:12.737790  2438 consensus_queue.cc:260] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.738796  2438 raft_consensus.cc:3060] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.742221  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a610ea0ec074e7b90dcee79cf9a2709" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:12.742969  2513 raft_consensus.cc:3060] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.747391  2438 raft_consensus.cc:2468] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 2.
I20260709 13:13:12.749015  2331 leader_election.cc:304] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:12.750056  2712 raft_consensus.cc:2804] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.750681  2712 raft_consensus.cc:697] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:12.750962  2513 raft_consensus.cc:2468] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 2.
I20260709 13:13:12.751662  2712 consensus_queue.cc:237] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.759449  2262 catalog_manager.cc:5697] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 1 to 2, leader changed from 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2) to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.761042  2655 raft_consensus.cc:993] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5: : Instructing follower 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:12.761593  2654 raft_consensus.cc:1081] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Signalling peer 1993d204f0334787961668bbfe4c7617 to start an election
I20260709 13:13:12.763295  2365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5abf23d1ef54d0f9b724c1b174c2c3b"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
 from {username='slave'} at 127.0.0.1:34272
I20260709 13:13:12.763931  2365 raft_consensus.cc:493] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.764292  2365 raft_consensus.cc:3060] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.770248  2365 raft_consensus.cc:515] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.772116  2365 leader_election.cc:290] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Requested vote from peers 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.772940  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5abf23d1ef54d0f9b724c1b174c2c3b" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:12.773098  2513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5abf23d1ef54d0f9b724c1b174c2c3b" candidate_uuid: "1993d204f0334787961668bbfe4c7617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:12.773584  2438 raft_consensus.cc:3055] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.773837  2513 raft_consensus.cc:3060] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.773938  2438 raft_consensus.cc:740] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:12.774963  2438 consensus_queue.cc:260] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.776237  2438 raft_consensus.cc:3060] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.779124  2513 raft_consensus.cc:2468] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 2.
I20260709 13:13:12.779834  2514 raft_consensus.cc:1240] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Rejecting Update request from peer 3fe1d806ed9f4e929b8700e572f9c7b5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.780441  2330 leader_election.cc:304] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:12.781363  2712 raft_consensus.cc:2804] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.781858  2712 raft_consensus.cc:697] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Becoming Leader. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:12.782588  2438 raft_consensus.cc:2468] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1993d204f0334787961668bbfe4c7617 in term 2.
I20260709 13:13:12.782719  2712 consensus_queue.cc:237] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.789867  2262 catalog_manager.cc:5697] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 reported cstate change: term changed from 1 to 2, leader changed from 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2) to 1993d204f0334787961668bbfe4c7617 (127.21.244.1). New cstate: current_term: 2 leader_uuid: "1993d204f0334787961668bbfe4c7617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.847488  2707 raft_consensus.cc:993] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0: : Instructing follower 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:12.848088  2564 raft_consensus.cc:1081] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Signalling peer 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:12.849007  2707 consensus_queue.cc:1048] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:12.849992  2438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8023fc5c4c00493cbd6866f6acd024dc"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:57522
I20260709 13:13:12.850730  2438 raft_consensus.cc:493] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.851101  2438 raft_consensus.cc:3060] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.862840  2707 consensus_queue.cc:1048] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:12.864028  2438 raft_consensus.cc:515] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.867955  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023fc5c4c00493cbd6866f6acd024dc" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:12.868606  2365 raft_consensus.cc:3060] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.867158  2438 leader_election.cc:290] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.869292  2514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023fc5c4c00493cbd6866f6acd024dc" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:12.871747  2514 raft_consensus.cc:3055] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.872066  2514 raft_consensus.cc:740] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Running, Role: LEADER
I20260709 13:13:12.872928  2514 consensus_queue.cc:260] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.874091  2514 raft_consensus.cc:3060] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.877619  2365 raft_consensus.cc:2468] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:12.879129  2406 leader_election.cc:304] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:12.880028  2655 raft_consensus.cc:2804] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.880577  2655 raft_consensus.cc:697] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:12.881404  2655 consensus_queue.cc:237] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.885738  2514 raft_consensus.cc:2468] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:12.885984  2707 raft_consensus.cc:993] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0: : Instructing follower 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:12.887837  2683 raft_consensus.cc:1081] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Signalling peer 3fe1d806ed9f4e929b8700e572f9c7b5 to start an election
I20260709 13:13:12.889750  2439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c5f403e3dbc42deb60df25ab7bcde30"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
 from {username='slave'} at 127.0.0.1:57522
I20260709 13:13:12.890350  2439 raft_consensus.cc:493] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.890707  2439 raft_consensus.cc:3060] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.890570  2262 catalog_manager.cc:5697] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 1 to 2, leader changed from ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3) to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.897964  2439 raft_consensus.cc:515] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.900133  2439 leader_election.cc:290] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3:45657)
I20260709 13:13:12.900839  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5f403e3dbc42deb60df25ab7bcde30" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:12.901059  2514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5f403e3dbc42deb60df25ab7bcde30" candidate_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
I20260709 13:13:12.901515  2365 raft_consensus.cc:3060] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.901744  2514 raft_consensus.cc:3055] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.902155  2514 raft_consensus.cc:740] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Running, Role: LEADER
I20260709 13:13:12.902927  2514 consensus_queue.cc:260] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.903985  2514 raft_consensus.cc:3060] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.907035  2365 raft_consensus.cc:2468] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:12.908322  2406 leader_election.cc:304] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, 3fe1d806ed9f4e929b8700e572f9c7b5; no voters: 
I20260709 13:13:12.909041  2655 raft_consensus.cc:2804] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.909157  2514 raft_consensus.cc:2468] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fe1d806ed9f4e929b8700e572f9c7b5 in term 2.
I20260709 13:13:12.909461  2655 raft_consensus.cc:697] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Becoming Leader. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:12.910336  2655 consensus_queue.cc:237] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:12.917214  2262 catalog_manager.cc:5697] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 reported cstate change: term changed from 1 to 2, leader changed from ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3) to 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2). New cstate: current_term: 2 leader_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.944126  2439 raft_consensus.cc:1275] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.945742  2653 consensus_queue.cc:1048] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.955085  2514 raft_consensus.cc:1275] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.956589  2656 consensus_queue.cc:1048] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.076113  2514 raft_consensus.cc:3060] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.081794  2514 raft_consensus.cc:1275] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.083463  2712 consensus_queue.cc:1048] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.089944  2365 raft_consensus.cc:1275] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.092211  2655 consensus_queue.cc:1048] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.097409  2439 raft_consensus.cc:1275] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.099171  2722 consensus_queue.cc:1048] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.104105  2514 raft_consensus.cc:1275] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.106036  2655 consensus_queue.cc:1048] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:13.181056  2365 raft_consensus.cc:1275] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Refusing update from remote peer ad9e746ba8874e58a9f2223e632ea4f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.182579  2707 consensus_queue.cc:1048] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.191644  2439 raft_consensus.cc:1275] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Refusing update from remote peer ad9e746ba8874e58a9f2223e632ea4f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.193252  2683 consensus_queue.cc:1048] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.288337  2514 raft_consensus.cc:1275] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.289760  2722 consensus_queue.cc:1048] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.299448  2439 raft_consensus.cc:1275] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.300906  2656 consensus_queue.cc:1048] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.318697  2514 raft_consensus.cc:1275] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.320042  2654 consensus_queue.cc:1048] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.329599  2365 raft_consensus.cc:1275] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.332010  2654 consensus_queue.cc:1048] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.357621  2439 raft_consensus.cc:1275] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.359006  2656 consensus_queue.cc:1048] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.367871  2514 raft_consensus.cc:1275] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 1993d204f0334787961668bbfe4c7617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.369240  2653 consensus_queue.cc:1048] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.435125  2514 raft_consensus.cc:1275] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.436623  2654 consensus_queue.cc:1048] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.445084  2365 raft_consensus.cc:1275] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Refusing update from remote peer 3fe1d806ed9f4e929b8700e572f9c7b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.447014  2654 consensus_queue.cc:1048] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.464351  2262 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53688:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:15.484567  2262 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53688:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:15.518374 22480 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:15.600695  2745 log.cc:927] Time spent T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:13:15.688520  2744 log.cc:927] Time spent T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:13:15.715178  2776 tablet.cc:1724] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:15.758808  2779 tablet.cc:1724] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:15.762099  2783 tablet.cc:1724] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:15.776207  2786 tablet.cc:1724] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:15.878536  2775 log.cc:927] Time spent T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 13:13:15.844441  2787 tablet.cc:1724] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:15.906983  2790 tablet.cc:1724] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:15.863878  2785 tablet.cc:1724] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:15.826416  2789 tablet.cc:1724] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:15.978808  2801 tablet.cc:1724] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:15.992228  2365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65ee672f4a1e4657b608c22e4ee6a37a"
dest_uuid: "1993d204f0334787961668bbfe4c7617"
mode: GRACEFUL
new_leader_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
 from {username='slave'} at 127.0.0.1:34292
I20260709 13:13:15.992934  2365 raft_consensus.cc:606] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Received request to transfer leadership to TS ad9e746ba8874e58a9f2223e632ea4f0
I20260709 13:13:15.991681  2794 tablet.cc:1724] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.012960  2799 tablet.cc:1724] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.014572  2786 tablet.cc:1724] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:15.989554  2779 tablet.cc:1724] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:16.028337  2798 log.cc:927] Time spent T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:13:16.032485  2787 tablet.cc:1724] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.038719  2776 tablet.cc:1724] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.058449  2790 tablet.cc:1724] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.062008  2786 tablet.cc:1724] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.064599  2789 tablet.cc:1724] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.073326  2797 tablet.cc:1724] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:16.076108  2800 log.cc:927] Time spent T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:13:16.081063  2799 tablet.cc:1724] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.084749  2785 tablet.cc:1724] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.092890  2779 tablet.cc:1724] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.086629  2794 tablet.cc:1724] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.097651  2801 tablet.cc:1724] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.116237  2441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3"
dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
mode: GRACEFUL
new_leader_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
 from {username='slave'} at 127.0.0.1:57540
I20260709 13:13:16.117056  2441 raft_consensus.cc:606] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Received request to transfer leadership to TS ad9e746ba8874e58a9f2223e632ea4f0
I20260709 13:13:16.120393 22480 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:16.121181 22480 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:16.131031  2801 tablet.cc:1724] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.144479  2801 tablet.cc:1724] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.149600  2753 raft_consensus.cc:993] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617: : Instructing follower ad9e746ba8874e58a9f2223e632ea4f0 to start an election
I20260709 13:13:16.150365  2762 raft_consensus.cc:1081] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Signalling peer ad9e746ba8874e58a9f2223e632ea4f0 to start an election
I20260709 13:13:16.152922  2512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65ee672f4a1e4657b608c22e4ee6a37a"
dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
 from {username='slave'} at 127.0.0.1:57596
I20260709 13:13:16.153594  2512 raft_consensus.cc:493] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:16.153962  2512 raft_consensus.cc:3060] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.154292  2786 tablet.cc:1724] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:16.176486  2512 raft_consensus.cc:515] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:16.180171  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ee672f4a1e4657b608c22e4ee6a37a" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:16.180835  2365 raft_consensus.cc:3055] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:16.181143  2365 raft_consensus.cc:740] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1993d204f0334787961668bbfe4c7617, State: Running, Role: LEADER
I20260709 13:13:16.181846  2512 leader_election.cc:290] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 2 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:16.181931  2365 consensus_queue.cc:260] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:16.183890  2365 raft_consensus.cc:3060] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.184410  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ee672f4a1e4657b608c22e4ee6a37a" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:16.185181  2441 raft_consensus.cc:3060] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.194365  2441 raft_consensus.cc:2468] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 2.
I20260709 13:13:16.196127  2480 leader_election.cc:304] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fe1d806ed9f4e929b8700e572f9c7b5, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:16.197463  2804 raft_consensus.cc:2804] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:16.198015  2804 raft_consensus.cc:697] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 LEADER]: Becoming Leader. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Running, Role: LEADER
I20260709 13:13:16.198110  2263 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe: soft_deleted_table [id=d66a212646fb472787e47ef7e5c6be21] alter complete (version 1)
I20260709 13:13:16.198977  2804 consensus_queue.cc:237] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:16.205732  2365 raft_consensus.cc:2468] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 2.
I20260709 13:13:16.212965  2263 catalog_manager.cc:5697] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 reported cstate change: term changed from 1 to 2, leader changed from 1993d204f0334787961668bbfe4c7617 (127.21.244.1) to ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3). New cstate: current_term: 2 leader_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.598878  2365 raft_consensus.cc:1275] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Refusing update from remote peer ad9e746ba8874e58a9f2223e632ea4f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.600275  2804 consensus_queue.cc:1048] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.611207  2441 raft_consensus.cc:1275] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Refusing update from remote peer ad9e746ba8874e58a9f2223e632ea4f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.613260  2723 consensus_queue.cc:1048] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.666538  2816 raft_consensus.cc:993] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5: : Instructing follower ad9e746ba8874e58a9f2223e632ea4f0 to start an election
I20260709 13:13:16.667052  2749 raft_consensus.cc:1081] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Signalling peer ad9e746ba8874e58a9f2223e632ea4f0 to start an election
I20260709 13:13:16.668613  2512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3"
dest_uuid: "ad9e746ba8874e58a9f2223e632ea4f0"
 from {username='slave'} at 127.0.0.1:57608
I20260709 13:13:16.669121  2512 raft_consensus.cc:493] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:16.669435  2512 raft_consensus.cc:3060] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:16.675179  2512 raft_consensus.cc:515] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:16.677090  2512 leader_election.cc:290] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 3 election: Requested vote from peers 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041), 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209)
I20260709 13:13:16.677964  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1993d204f0334787961668bbfe4c7617"
I20260709 13:13:16.678148  2441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c28ee28e36491daf04910e43d6e7b3" candidate_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5"
I20260709 13:13:16.678545  2365 raft_consensus.cc:3060] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:16.678985  2441 raft_consensus.cc:3055] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:16.679299  2441 raft_consensus.cc:740] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3fe1d806ed9f4e929b8700e572f9c7b5, State: Running, Role: LEADER
I20260709 13:13:16.680193  2441 consensus_queue.cc:260] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:16.681484  2441 raft_consensus.cc:3060] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:16.685137  2365 raft_consensus.cc:2468] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 3.
I20260709 13:13:16.686370  2480 leader_election.cc:304] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1993d204f0334787961668bbfe4c7617, ad9e746ba8874e58a9f2223e632ea4f0; no voters: 
I20260709 13:13:16.687083  2804 raft_consensus.cc:2804] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:16.687680  2804 raft_consensus.cc:697] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 3 LEADER]: Becoming Leader. State: Replica: ad9e746ba8874e58a9f2223e632ea4f0, State: Running, Role: LEADER
I20260709 13:13:16.688722  2804 consensus_queue.cc:237] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } }
I20260709 13:13:16.689369  2441 raft_consensus.cc:2468] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad9e746ba8874e58a9f2223e632ea4f0 in term 3.
I20260709 13:13:16.699309  2263 catalog_manager.cc:5697] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 reported cstate change: term changed from 2 to 3, leader changed from 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2) to ad9e746ba8874e58a9f2223e632ea4f0 (127.21.244.3). New cstate: current_term: 3 leader_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad9e746ba8874e58a9f2223e632ea4f0" member_type: VOTER last_known_addr { host: "127.21.244.3" port: 45657 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.108098  2365 raft_consensus.cc:1275] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 3 FOLLOWER]: Refusing update from remote peer ad9e746ba8874e58a9f2223e632ea4f0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:17.109627  2804 consensus_queue.cc:1048] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1993d204f0334787961668bbfe4c7617" member_type: VOTER last_known_addr { host: "127.21.244.1" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:17.127823  2439 raft_consensus.cc:1275] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 3 FOLLOWER]: Refusing update from remote peer ad9e746ba8874e58a9f2223e632ea4f0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:17.130322  2812 consensus_queue.cc:1048] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe1d806ed9f4e929b8700e572f9c7b5" member_type: VOTER last_known_addr { host: "127.21.244.2" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:17.217947 22480 tablet_server.cc:179] TabletServer@127.21.244.1:0 shutting down...
I20260709 13:13:17.252264 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:17.253055 22480 tablet_replica.cc:333] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.253736 22480 raft_consensus.cc:2243] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.254290 22480 raft_consensus.cc:2272] T 0cc5c2ad93974411b386642704ee831d P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.256464 22480 tablet_replica.cc:333] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.257153 22480 raft_consensus.cc:2243] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.258018 22480 raft_consensus.cc:2272] T 6427b8febcbd470babbfdbde4bd6f0e7 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.260243 22480 tablet_replica.cc:333] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.260883 22480 raft_consensus.cc:2243] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.261394 22480 raft_consensus.cc:2272] T 4cd5e4a39d2442158a27b2acae7b501f P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.263415 22480 tablet_replica.cc:333] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.264160 22480 raft_consensus.cc:2243] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.265111 22480 raft_consensus.cc:2272] T 68201d45db954701af8efa3fd17c86dd P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.267511 22480 tablet_replica.cc:333] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.268213 22480 raft_consensus.cc:2243] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.269099 22480 raft_consensus.cc:2272] T 6a610ea0ec074e7b90dcee79cf9a2709 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.271348 22480 tablet_replica.cc:333] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.272089 22480 raft_consensus.cc:2243] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.272619 22480 raft_consensus.cc:2272] T 79c28ee28e36491daf04910e43d6e7b3 P 1993d204f0334787961668bbfe4c7617 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.275476 22480 tablet_replica.cc:333] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.276199 22480 raft_consensus.cc:2243] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.277063 22480 raft_consensus.cc:2272] T 8f4a35f4129e454390d05393cb128e76 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.279083 22480 tablet_replica.cc:333] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.279706 22480 raft_consensus.cc:2243] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.280284 22480 raft_consensus.cc:2272] T 8546a5d963d54c9eb7b74a8787ee0c16 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.282537 22480 tablet_replica.cc:333] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.283134 22480 raft_consensus.cc:2243] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.283628 22480 raft_consensus.cc:2272] T 7dc9731236294c21ab73f680823788d0 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.286098 22480 tablet_replica.cc:333] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.286752 22480 raft_consensus.cc:2243] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.287249 22480 raft_consensus.cc:2272] T 0c5f403e3dbc42deb60df25ab7bcde30 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.289311 22480 tablet_replica.cc:333] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.289897 22480 raft_consensus.cc:2243] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.290902 22480 raft_consensus.cc:2272] T 0f6704d00dbc4b0e91e33a41047deed0 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.293996 22480 tablet_replica.cc:333] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.294859 22480 raft_consensus.cc:2243] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.295378 22480 raft_consensus.cc:2272] T 65ee672f4a1e4657b608c22e4ee6a37a P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.296494  2480 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
I20260709 13:13:17.299101 22480 tablet_replica.cc:333] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.299990 22480 raft_consensus.cc:2243] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.300926 22480 raft_consensus.cc:2272] T 93b67cb5f0ab48fab32cb4ad378278a4 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.301505  2480 consensus_peers.cc:597] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 -> Peer 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041): Couldn't send request to peer 1993d204f0334787961668bbfe4c7617. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.303983 22480 tablet_replica.cc:333] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.304670 22480 raft_consensus.cc:2243] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.305161 22480 raft_consensus.cc:2272] T 8023fc5c4c00493cbd6866f6acd024dc P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.307173 22480 tablet_replica.cc:333] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.307780 22480 raft_consensus.cc:2243] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.308247 22480 raft_consensus.cc:2272] T c96f816653034ea2b929469c56c4bc44 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.310411 22480 tablet_replica.cc:333] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.310983 22480 raft_consensus.cc:2243] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.311836 22480 raft_consensus.cc:2272] T 65d50a118f7946b881880ed5b1959fc2 P 1993d204f0334787961668bbfe4c7617 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.313939 22480 tablet_replica.cc:333] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.314471 22480 raft_consensus.cc:2243] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.314929 22480 raft_consensus.cc:2272] T e9a46a7557ce4aeba7bda5bccdd00481 P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.316977 22480 tablet_replica.cc:333] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617: stopping tablet replica
I20260709 13:13:17.317483 22480 raft_consensus.cc:2243] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.318264 22480 raft_consensus.cc:2272] T e5abf23d1ef54d0f9b724c1b174c2c3b P 1993d204f0334787961668bbfe4c7617 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.331791  2406 consensus_peers.cc:597] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 -> Peer 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041): Couldn't send request to peer 1993d204f0334787961668bbfe4c7617. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.363250  2406 consensus_peers.cc:597] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 -> Peer 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041): Couldn't send request to peer 1993d204f0334787961668bbfe4c7617. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:44041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.363600 22480 tablet_server.cc:196] TabletServer@127.21.244.1:0 shutdown complete.
I20260709 13:13:17.400118 22480 tablet_server.cc:179] TabletServer@127.21.244.2:0 shutting down...
W20260709 13:13:17.425242  2406 consensus_peers.cc:597] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 -> Peer 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041): Couldn't send request to peer 1993d204f0334787961668bbfe4c7617. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:44041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.437563 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:17.438642 22480 tablet_replica.cc:333] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.439570 22480 raft_consensus.cc:2243] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.440781 22480 raft_consensus.cc:2272] T 0cc5c2ad93974411b386642704ee831d P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.443709 22480 tablet_replica.cc:333] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.444433 22480 raft_consensus.cc:2243] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.445257 22480 raft_consensus.cc:2272] T 4cd5e4a39d2442158a27b2acae7b501f P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.447239 22480 tablet_replica.cc:333] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.447927 22480 raft_consensus.cc:2243] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.448401 22480 raft_consensus.cc:2272] T e9a46a7557ce4aeba7bda5bccdd00481 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.450553 22480 tablet_replica.cc:333] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.451188 22480 raft_consensus.cc:2243] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.451712 22480 raft_consensus.cc:2272] T e5abf23d1ef54d0f9b724c1b174c2c3b P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.453703 22480 tablet_replica.cc:333] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.454264 22480 raft_consensus.cc:2243] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.454725 22480 raft_consensus.cc:2272] T 6427b8febcbd470babbfdbde4bd6f0e7 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.456702 22480 tablet_replica.cc:333] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.457324 22480 raft_consensus.cc:2243] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.457794 22480 raft_consensus.cc:2272] T 68201d45db954701af8efa3fd17c86dd P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.459995 22480 tablet_replica.cc:333] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.460580 22480 raft_consensus.cc:2243] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.461031 22480 raft_consensus.cc:2272] T 6a610ea0ec074e7b90dcee79cf9a2709 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.463147 22480 tablet_replica.cc:333] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.463690 22480 raft_consensus.cc:2243] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.464175 22480 raft_consensus.cc:2272] T 79c28ee28e36491daf04910e43d6e7b3 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.467350 22480 tablet_replica.cc:333] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.468091 22480 raft_consensus.cc:2243] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.468648 22480 raft_consensus.cc:2272] T 8f4a35f4129e454390d05393cb128e76 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.468824  2480 consensus_peers.cc:597] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 -> Peer 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209): Couldn't send request to peer 3fe1d806ed9f4e929b8700e572f9c7b5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.470538 22480 tablet_replica.cc:333] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.471239 22480 raft_consensus.cc:2243] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.472096 22480 raft_consensus.cc:2272] T 8546a5d963d54c9eb7b74a8787ee0c16 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.474089 22480 tablet_replica.cc:333] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.474622 22480 raft_consensus.cc:2243] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.475441 22480 raft_consensus.cc:2272] T 7dc9731236294c21ab73f680823788d0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.477669 22480 tablet_replica.cc:333] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.478233 22480 raft_consensus.cc:2243] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.479029 22480 raft_consensus.cc:2272] T 8023fc5c4c00493cbd6866f6acd024dc P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.481474 22480 tablet_replica.cc:333] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
W20260709 13:13:17.481986  2406 consensus_peers.cc:597] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 -> Peer 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041): Couldn't send request to peer 1993d204f0334787961668bbfe4c7617. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:44041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.482126 22480 raft_consensus.cc:2243] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.482755 22480 raft_consensus.cc:2272] T c96f816653034ea2b929469c56c4bc44 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.484963 22480 tablet_replica.cc:333] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.485466 22480 raft_consensus.cc:2243] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.486362 22480 raft_consensus.cc:2272] T 93b67cb5f0ab48fab32cb4ad378278a4 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.488394 22480 tablet_replica.cc:333] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.489049 22480 raft_consensus.cc:2243] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.489441 22480 raft_consensus.cc:2272] T 65d50a118f7946b881880ed5b1959fc2 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.491458 22480 tablet_replica.cc:333] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.492022 22480 raft_consensus.cc:2243] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.492436 22480 raft_consensus.cc:2272] T 65ee672f4a1e4657b608c22e4ee6a37a P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.495229 22480 tablet_replica.cc:333] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.496042 22480 raft_consensus.cc:2243] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.496922 22480 raft_consensus.cc:2272] T 0c5f403e3dbc42deb60df25ab7bcde30 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.499583 22480 tablet_replica.cc:333] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5: stopping tablet replica
I20260709 13:13:17.500155 22480 raft_consensus.cc:2243] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.500811 22480 raft_consensus.cc:2272] T 0f6704d00dbc4b0e91e33a41047deed0 P 3fe1d806ed9f4e929b8700e572f9c7b5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.501617  2480 consensus_peers.cc:597] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 -> Peer 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041): Couldn't send request to peer 1993d204f0334787961668bbfe4c7617. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:44041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.544895 22480 tablet_server.cc:196] TabletServer@127.21.244.2:0 shutdown complete.
W20260709 13:13:17.549448  2480 consensus_peers.cc:597] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 -> Peer 1993d204f0334787961668bbfe4c7617 (127.21.244.1:44041): Couldn't send request to peer 1993d204f0334787961668bbfe4c7617. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.1:44041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.577018 22480 tablet_server.cc:179] TabletServer@127.21.244.3:0 shutting down...
W20260709 13:13:17.610514  2480 consensus_peers.cc:597] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 -> Peer 3fe1d806ed9f4e929b8700e572f9c7b5 (127.21.244.2:39209): Couldn't send request to peer 3fe1d806ed9f4e929b8700e572f9c7b5. Status: Network error: Client connection negotiation failed: client connection to 127.21.244.2:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.613729 22480 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:17.615056 22480 tablet_replica.cc:333] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.616073 22480 raft_consensus.cc:2243] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.616632 22480 raft_consensus.cc:2272] T 0cc5c2ad93974411b386642704ee831d P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.618854 22480 tablet_replica.cc:333] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.619503 22480 raft_consensus.cc:2243] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.620025 22480 raft_consensus.cc:2272] T 4cd5e4a39d2442158a27b2acae7b501f P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.621984 22480 tablet_replica.cc:333] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.622575 22480 raft_consensus.cc:2243] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.623035 22480 raft_consensus.cc:2272] T 6427b8febcbd470babbfdbde4bd6f0e7 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.625464 22480 tablet_replica.cc:333] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.626444 22480 raft_consensus.cc:2243] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.627013 22480 raft_consensus.cc:2272] T e5abf23d1ef54d0f9b724c1b174c2c3b P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.629040 22480 tablet_replica.cc:333] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.629604 22480 raft_consensus.cc:2243] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.630535 22480 raft_consensus.cc:2272] T e9a46a7557ce4aeba7bda5bccdd00481 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.632602 22480 tablet_replica.cc:333] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.633178 22480 raft_consensus.cc:2243] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.633663 22480 raft_consensus.cc:2272] T 0c5f403e3dbc42deb60df25ab7bcde30 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.635530 22480 tablet_replica.cc:333] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.636106 22480 raft_consensus.cc:2243] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.636596 22480 raft_consensus.cc:2272] T 0f6704d00dbc4b0e91e33a41047deed0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.638782 22480 tablet_replica.cc:333] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.639451 22480 raft_consensus.cc:2243] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.640347 22480 raft_consensus.cc:2272] T 65ee672f4a1e4657b608c22e4ee6a37a P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.642484 22480 tablet_replica.cc:333] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.643060 22480 raft_consensus.cc:2243] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.643697 22480 raft_consensus.cc:2272] T 68201d45db954701af8efa3fd17c86dd P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.645910 22480 tablet_replica.cc:333] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.646481 22480 raft_consensus.cc:2243] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.646950 22480 raft_consensus.cc:2272] T 6a610ea0ec074e7b90dcee79cf9a2709 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.648909 22480 tablet_replica.cc:333] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.649516 22480 raft_consensus.cc:2243] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.650413 22480 raft_consensus.cc:2272] T 79c28ee28e36491daf04910e43d6e7b3 P ad9e746ba8874e58a9f2223e632ea4f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.653187 22480 tablet_replica.cc:333] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.653815 22480 raft_consensus.cc:2243] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.654335 22480 raft_consensus.cc:2272] T 8023fc5c4c00493cbd6866f6acd024dc P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.656344 22480 tablet_replica.cc:333] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.656960 22480 raft_consensus.cc:2243] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.657905 22480 raft_consensus.cc:2272] T c96f816653034ea2b929469c56c4bc44 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.660159 22480 tablet_replica.cc:333] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.660722 22480 raft_consensus.cc:2243] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.661192 22480 raft_consensus.cc:2272] T 65d50a118f7946b881880ed5b1959fc2 P ad9e746ba8874e58a9f2223e632ea4f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.663496 22480 tablet_replica.cc:333] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.664120 22480 raft_consensus.cc:2243] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.664613 22480 raft_consensus.cc:2272] T 93b67cb5f0ab48fab32cb4ad378278a4 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.666754 22480 tablet_replica.cc:333] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.667304 22480 raft_consensus.cc:2243] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.667824 22480 raft_consensus.cc:2272] T 8f4a35f4129e454390d05393cb128e76 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.669796 22480 tablet_replica.cc:333] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.670364 22480 raft_consensus.cc:2243] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.670902 22480 raft_consensus.cc:2272] T 7dc9731236294c21ab73f680823788d0 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.673132 22480 tablet_replica.cc:333] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0: stopping tablet replica
I20260709 13:13:17.673645 22480 raft_consensus.cc:2243] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.674108 22480 raft_consensus.cc:2272] T 8546a5d963d54c9eb7b74a8787ee0c16 P ad9e746ba8874e58a9f2223e632ea4f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.719507 22480 tablet_server.cc:196] TabletServer@127.21.244.3:0 shutdown complete.
I20260709 13:13:17.751471 22480 master.cc:562] Master@127.21.244.62:44567 shutting down...
I20260709 13:13:17.775909 22480 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.776646 22480 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.777052 22480 tablet_replica.cc:333] T 00000000000000000000000000000000 P 749463795b004f4b8e571bcc3caab9fe: stopping tablet replica
I20260709 13:13:17.798524 22480 master.cc:584] Master@127.21.244.62:44567 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11501 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24448 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (357265 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:13:17.855823 22480 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:13:17.856046 22480 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 409 messages since previous log ~14 seconds ago
I20260709 13:13:17.856186 22480 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 406 messages since previous log ~14 seconds ago
I20260709 13:13:17.856338 22480 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:13:17.856472 22480 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:13:17.856639 22480 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~131 seconds ago
I20260709 13:13:17.856859 22480 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 13:13:17.857102 22480 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
